Temporal relation algebra for audiovisual content analysis - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Multimedia Tools and Applications Année : 2018

Temporal relation algebra for audiovisual content analysis

Résumé

The context of this work is to characterize the content and the structure of audiovisual documents by analysing the temporal relationships between basic events resulted from different segmentations of the same document. For this objective, we need to represent and reason about time. We propose a parametric representation of temporal relation between segments (points or intervals) in which the parameters are used to characterize the relationship between two non-convex intervals corresponding to two segmentations in the video analysis domain. The relationship is represented by a co-occurrences matrix noted as Temporal Relation Matrix (TRM). Each document is represented by a set of TRMs computed between each couple of segmentations of the same document using different features. The TRMs are analysed later to detect semantic events, highlight clues about the video content structure or to classify documents based on their types. For higher-level semantic events and documents’ structure, we needed to apply some operations on the basic temporal relations and TRMs such as composition, disjunction, complement, intersection, etc. These operations brought to light more complex patterns; e.g. event 1 occurs at the same time of event 2 followed by event 3. In the work presented in this paper, we define a temporal relation algebra including its set of operations based on the parametric representation and TRM defined above. Several experimentations have been done on different audio and video documents to show the efficiency of the proposed representation and the defined operations for audiovisual content analysing.
Fichier principal
Vignette du fichier
ibrahim_22692.pdf (2.24 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02089343 , version 1 (03-04-2019)

Identifiants

Citer

Zein Al Abidin Ibrahim, Isabelle Ferrané, Philippe Joly. Temporal relation algebra for audiovisual content analysis. Multimedia Tools and Applications, 2018, 78, pp.15275-15316. ⟨10.1007/s11042-018-6771-1⟩. ⟨hal-02089343⟩
49 Consultations
90 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More