Multimedia ontology matching by using visual and textual modalities - Archive ouverte HAL
Article Dans Une Revue Multimedia Tools and Applications Année : 2013

Multimedia ontology matching by using visual and textual modalities

Résumé

Ontologies have been intensively applied for improving multimedia search and retrieval by providing explicit meaning to visual content. Several multimedia ontologies have been recently proposed as knowledge models suitable for narrowing the well known semantic gap and for enabling the semantic interpretation of images. Since these ontologies have been created in different application contexts, establishing links between them, a task known as ontology matching, promises to fully unlock their potential in support of multimedia search and retrieval. This paper proposes and compares empirically two extensional ontology matching techniques applied to an important semantic image retrieval issue: automatically associating common-sense knowledge to multimedia concepts. First, we extend a previously introduced textual concept matching approach to use both textual and visual representation of images. In addition, a novel matching technique based on a multi-modal graph is proposed. We argue that the textual and visual modalities have to be seen as complementary rather than as exclusive sources of extensional information in order to improve the efficiency of the application of an ontology matching approach in the multimedia domain. An experimental evaluation is included in the paper.
Fichier principal
Vignette du fichier
Multimedia_Ontology_Matching_by_Using_Visual_and_T.pdf (497.47 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00824573 , version 1 (18-01-2019)

Identifiants

Citer

Nicolas James, Céline Hudelot, Konstantin Todorov. Multimedia ontology matching by using visual and textual modalities. Multimedia Tools and Applications, 2013, 62 (2), pp.401-425. ⟨10.1007/s11042-011-0912-0⟩. ⟨hal-00824573⟩
180 Consultations
168 Téléchargements

Altmetric

Partager

More