Article Dans Une Revue Multimedia Systems Année : 2022

Understanding videos with face recognition: a complete pipeline and applications

Pasquale Lisena
Jorma Laaksonen
  • Fonction : Auteur
  • PersonId : 1264199
Raphaël Troncy

Résumé

When browsing or studying a video corpus, particularly relevant information consists in knowing who are the people appearing in the scenes. In this paper, we show how a combination of state of the art techniques can be organised in a pipeline for face recognition of celebrities. In particular, we propose a system which combines MTCNN for detecting faces and FaceNet for extracting face embeddings, which are used to train a set of classifiers. The face recognition results obtained at a frame level are then combined with those in consecutive frames, relying on automatic object tracking. Differently from previous work, we use images automatically retrieved by web search engines. We evaluate the systems one three datasets including historical videos from 1945-1969 and contemporary videos, obtaining a good precision score. In addition, we show how the obtained results can be applied to foster historical studies.

Fichier principal
Vignette du fichier
publi-6931.pdf (4.86 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04138126 , version 1 (22-06-2023)

Licence

Identifiants

Citer

Pasquale Lisena, Jorma Laaksonen, Raphaël Troncy. Understanding videos with face recognition: a complete pipeline and applications. Multimedia Systems, 2022, 28 (6), pp.2147-2159. ⟨10.1007/s00530-022-00959-x⟩. ⟨hal-04138126⟩

Collections

167 Consultations
538 Téléchargements

Altmetric

Partager

  • More