Understanding videos with face recognition: a complete pipeline and applications - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Multimedia Systems Année : 2022

Understanding videos with face recognition: a complete pipeline and applications

Pasquale Lisena
Jorma Laaksonen
  • Fonction : Auteur
  • PersonId : 1264199
Raphaël Troncy

Résumé

When browsing or studying a video corpus, particularly relevant information consists in knowing who are the people appearing in the scenes. In this paper, we show how a combination of state of the art techniques can be organised in a pipeline for face recognition of celebrities. In particular, we propose a system which combines MTCNN for detecting faces and FaceNet for extracting face embeddings, which are used to train a set of classifiers. The face recognition results obtained at a frame level are then combined with those in consecutive frames, relying on automatic object tracking. Differently from previous work, we use images automatically retrieved by web search engines. We evaluate the systems one three datasets including historical videos from 1945-1969 and contemporary videos, obtaining a good precision score. In addition, we show how the obtained results can be applied to foster historical studies.
Fichier principal
Vignette du fichier
publi-6931.pdf (4.86 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04138126 , version 1 (22-06-2023)

Identifiants

Citer

Pasquale Lisena, Jorma Laaksonen, Raphaël Troncy. Understanding videos with face recognition: a complete pipeline and applications. Multimedia Systems, 2022, 28 (6), pp.2147-2159. ⟨10.1007/s00530-022-00959-x⟩. ⟨hal-04138126⟩

Collections

CNRS EURECOM ANR
27 Consultations
21 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More