Segmentation of TV Shows into Scenes using Speaker Diarization and Speech Recognition - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Segmentation of TV Shows into Scenes using Speaker Diarization and Speech Recognition

Résumé

We investigate the use of speaker diarization (SD) and automatic speech recognition (ASR) for the segmentation of audiovisual documents into scenes. We introduce multiple monomodal and multimodal approaches based on a state-of-the-art algorithm called generalized scene transition graph (GSTG). First, we extend the latter with the use of semantic information derived from both SD and ASR. Then, multimodal fusion of color histograms, SD and ASR is investigated at various point of the GSTG pipeline (early, late or intermediate fusion). Experiments driven on a few episodes of a popular TV show indicate that SD and ASR can be successfully combined with visual information and bring an additional +11% relative increase in terms of F-Measure for scene boundary detection over the state-of-the-art baseline.
Fichier non déposé

Dates et versions

hal-01987818 , version 1 (21-01-2019)

Identifiants

  • HAL Id : hal-01987818 , version 1

Citer

Hervé Bredin. Segmentation of TV Shows into Scenes using Speaker Diarization and Speech Recognition. ICASSP 2012, IEEE International Conference on Acoustics, Speech, and Signal Processing, 2012, Kyoto, Japan. ⟨hal-01987818⟩
13 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More