Multiview Semi-Supervised Ranking for Automatic Image Annotation - Archive ouverte HAL
Communication Dans Un Congrès Année : 2013

Multiview Semi-Supervised Ranking for Automatic Image Annotation

Résumé

Most photo sharing sites give their users the opportunity to manually label images. The labels collected that way are usually very incomplete due to the size of the image collections: most images are not labeled according to all the categories they belong to, and, conversely, many class have relatively few representative examples. Automated image systems that can deal with small amounts of labeled examples and unbalanced classes are thus necessary to better organize and annotate images. In this work, we propose a multiview semi-supervised bipartite ranking model which allows to leverage the information contained in unlabeled sets of images in order to improve the prediction performance, using multiple descriptions, or views of images. For each topic class, our approach first learns as many view-specific rankers as available views using the labeled data only. These rankers are then improved iteratively by adding pseudo-labeled pairs of examples on which all view-specific rankers agree over the ranking of examples within these pairs. We report on experiments carried out on the NUS-WIDE dataset, which show that the multiview ranking process improves predictive performances when a small number of labeled examples is available specially for unbalanced classes. We show also that our approach achieves significant improvements over a state-of the art semi-supervised multiview classification model.
Fichier principal
Vignette du fichier
MultViewRnk_MM2013.pdf (158.68 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00881259 , version 1 (07-11-2013)

Identifiants

Citer

Ali Fakeri-Tabrizi, Massih-Reza Amini, Patrick Gallinari. Multiview Semi-Supervised Ranking for Automatic Image Annotation. ACM International Conference on Multimedia, Oct 2013, Barcelone, Spain. pp.513-516, ⟨10.1145/2502081.2502136⟩. ⟨hal-00881259⟩
299 Consultations
275 Téléchargements

Altmetric

Partager

More