Investigating the document structure as a source of evidence for multimedia fragment retrieval - Archive ouverte HAL Access content directly
Journal Articles Information Processing and Management Year : 2013

Investigating the document structure as a source of evidence for multimedia fragment retrieval

Abstract

Multimedia objects can be retrieved using their context that can be for instance the text surrounding them in documents. This text may be either near or far from the searched objects. Our goal in this paper is to study the impact, in term of effectiveness, of text position relatively to searched objects. The multimedia objects we consider are described in structured documents such as XML ones. The document structure is therefore exploited to provide this text position in documents. Although structural information has been shown to be an effective source of evidence in textual information retrieval, only a few works investigated its interest in multimedia retrieval. More precisely, the task we are interested in this paper is to retrieve multimedia fragments (i.e. XML elements having at least one multimedia object). Our general approach is built on two steps: we first retrieve XML elements containing multimedia objects, and we then explore the surrounding information to retrieve relevant multimedia fragments. In both cases, we study the impact of the surrounding information using the documents structure.Our work is carried out on images, but it can be extended to any other media, since the physical content of multimedia objects is not used. We conducted several experiments in the context of the Multimedia track of the INEX evaluation campaign. Results showed that structural evidences are of high interest to tune the importance of textual context for multimedia retrieval. Moreover, the proposed approach outperforms state of the art approaches.
Fichier principal
Vignette du fichier
Torjmen-Khemakhem_12616.pdf (1.39 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01131253 , version 1 (13-03-2015)

Identifiers

Cite

Mouna Torjmen-Khemakhem, Karen Pinel-Sauvagnat, Mohand Boughanem. Investigating the document structure as a source of evidence for multimedia fragment retrieval. Information Processing and Management, 2013, vol. 49 (n° 6), pp. 1281-1300. ⟨10.1016/j.ipm.2013.06.001⟩. ⟨hal-01131253⟩
96 View
141 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More