Combining Visual and Textual Modalities for Multimedia Ontology Matching - Archive ouverte HAL
Communication Dans Un Congrès Année : 2011

Combining Visual and Textual Modalities for Multimedia Ontology Matching

Résumé

Multimedia search and retrieval are considerably improved by providing explicit meaning to visual content by the help of ontologies. Several multimedia ontologies have been proposed recently as suitable knowledge models to narrow the well known semantic gap and to enable the semantic interpretation of images. Since these ontologies have been created in different application contexts, establishing links between them, a task known as ontology matching, promises to fully unlock their potential in support of multimedia search and retrieval. This paper proposes and compares empirically two extensional ontology matching techniques applied to an important semantic image retrieval issue: automatically associating common-sense knowledge to multimedia concepts. First, we extend a previously introduced matching approach to use both textual and visual knowledge. In addition, a novel matching technique based on a multimodal graph is proposed. We argue that the textual and visual modalities have to be seen as complementary rather than as exclusive means to improve the efficiency of the application of an ontology matching procedure in the multimedia domain. An experimental evaluation is included.

Dates et versions

hal-00825258 , version 1 (23-05-2013)

Identifiants

Citer

Nicolas James, Konstantin Todorov, Céline Hudelot. Combining Visual and Textual Modalities for Multimedia Ontology Matching. Semantic Multimedia -Lecture Notes in Computer Science proceedings of 5th International Conference on Semantic and Digital Media technologies (SAMT 2010), 2010, Saarbruken, Germany. pp.95-110, ⟨10.1007/978-3-642-23017-2_7⟩. ⟨hal-00825258⟩

Collections

EC-PARIS MAS MICS
42 Consultations
0 Téléchargements

Altmetric

Partager

More