Video genre categorization and representation using audio-visual information - Archive ouverte HAL
Article Dans Une Revue Journal of Electronic Imaging Année : 2012

Video genre categorization and representation using audio-visual information

Résumé

We propose an audio-visual approach to video genre classification using content descriptors that exploit audio, color, temporal, and contour information. Audio information is extracted at block-level, which has the advantage of capturing local temporal information. At the temporal structure level, we consider action content in relation to human perception. Color perception is quantified using statistics of color distribution, elementary hues, color properties, and relationships between colors. Further, we compute statistics of contour geometry and relationships. The main contribution of our work lies in harnessingn the descriptive power of the combination of these descriptors in genre classification. Validation was carried out on over 91 h of video footage encompassing 7 common video genres, yielding average precision and recall ratios of 87% to 100% and 77% to 100%, respectively, and an overall average correct classification of up to 97%. Also, experimental comparison as part of the MediaEval 2011 benchmarkingn campaign demonstrated the efficiency of the proposed audiovisual descriptors over other existing approaches. Finally, we discuss a 3-D video browsing platform that displays movies using efaturebased coordinates and thus regroups them according to genre.
Fichier principal
Vignette du fichier
JEI2012_draft.pdf (1.2 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00732714 , version 1 (16-09-2012)

Identifiants

Citer

Bogdan Ionescu, Klaus Seyerlehner, Christoph Rasche, Constantin Vertan, Patrick Lambert. Video genre categorization and representation using audio-visual information. Journal of Electronic Imaging, 2012, 21 (2), pp.1-17. ⟨10.1117/1.JEI.21.2.023017⟩. ⟨hal-00732714⟩
139 Consultations
296 Téléchargements

Altmetric

Partager

More