Zero-Shot Classification of Events for Character-Centric Video Summarization - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Zero-Shot Classification of Events for Character-Centric Video Summarization

Résumé

This paper describes an event classification and character-centered approach proposed by the D2KLab team at EURECOM for the 2021 TRECVID Video Summarization Task [Awad et al. 2020]. Our approach relies on defining a list of typical important events in a soap opera and using this list of named events as candidate labels for a zero-shot text classification method. This additional data source is used together with the provided videos, scripts and master shot boundaries. We also use BBC EastEnders characters' images crawled from the Google search engine in order to train a face recognition system. All our runs use the same general method, but with varying constraints regarding the number of shots and the maximum duration of the summary. The runs submitted are as follows: • EURECOM1: 5 shots with highest similarity scores and the total duration of the summary is < 150 sec; • EURECOM2: 10 shots with highest similarity scores and the total duration of the summary is < 300 sec; • EURECOM3: 15 shots with highest similarity scores and the total duration of the summary is < 450 sec; • EURECOM4: 20 shots with highest similarity scores and the total duration of the summary is < 600 sec.
Fichier principal
Vignette du fichier
publi-6837.pdf (546.91 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04138136 , version 1 (22-06-2023)

Identifiants

  • HAL Id : hal-04138136 , version 1

Citer

Alison Reboud, Ismail Harrando, Pasquale Lisena, Raphaël Troncy. Zero-Shot Classification of Events for Character-Centric Video Summarization. TRECVID 2021, International Workshop on Video Retrieval Evaluation, NIST, Dec 2021, New York, United States. ⟨hal-04138136⟩

Collections

EURECOM ANR
17 Consultations
10 Téléchargements

Partager

Gmail Facebook X LinkedIn More