Evaluating User Image Tagging Credibility - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Evaluating User Image Tagging Credibility

Résumé

When looking for information on the Web, the credibility of the source plays an important role in the information seeking experience. While data source credibility has been thoroughly studied for Web pages or blogs, the investigation of source credibility in image retrieval tasks is an emerging topic. In this paper, we first propose a novel dataset for evaluating the tagging credibility of Flickr users built with the aim of covering a large variety of topics. We present the motivation behind the need for such a dataset, the methodology used for its creation and detail important statistics on the number of users, images and rater agreement scores. Next, we define both a supervised learning task in which we group the users in 5 credibility classes and a credible user retrieval problem. Besides a couple of credibility features described in previous works, we propose a novel set of credibility estimators, with an emphasis on text based descriptors. Finally, we prove the usefulness of our evaluation dataset and justify the performances of the proposed credibility descriptors by showing promising results for both of the proposed tasks.
Fichier non déposé

Dates et versions

hal-01271183 , version 1 (08-02-2016)

Identifiants

Citer

Alexandru Lucian Ginsca, Adrian Popescu, Mihai Lupu, Adrian Iftene, Ioannis Kanellos. Evaluating User Image Tagging Credibility. CLEF 2015 : Conference and Labs of the Evaluation Forum , Sep 2015, Toulouse, France. pp.41 - 52, ⟨10.1007/978-3-319-24027-5_4⟩. ⟨hal-01271183⟩
299 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More