GAZE LATENT SUPPORT VECTOR MACHINE FOR IMAGE CLASSIFICATION - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

GAZE LATENT SUPPORT VECTOR MACHINE FOR IMAGE CLASSIFICATION

Xin Wang
Nicolas Thome
Matthieu Cord

Résumé

This paper deals with image categorization from weak supervision, e.g. global image labels. We propose to improve the region selection performed in latent variable models such as Latent Support Vector Machine (LSVM) by leveraging human eye movement features collected from an eye-tracker device. We introduce a new model, Gaze Latent Support Vector Machine (G-LSVM), whose region selection during training is biased toward regions with a large gaze density ratio. On this purpose, the training objective is enriched with a gaze loss, from which we derive a convex upper bound, leading to a Concave-Convex Procedure (CCCP) optimization scheme. Experiments show that G-LSVM significantly outperforms LSVM in both object detection and action recognition problems on PASCAL VOC 2012. We also show that our G-LSVM is even slightly better than a model trained from bounding box annotations, while gaze labels are much cheaper to collect.
Fichier principal
Vignette du fichier
GAZE_LATENT_SUPPORT_VECTOR_MACHINE_FOR_IMAGE_CLASSIFICATION.pdf (3.11 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01342580 , version 1 (06-07-2016)

Identifiants

Citer

Xin Wang, Nicolas Thome, Matthieu Cord. GAZE LATENT SUPPORT VECTOR MACHINE FOR IMAGE CLASSIFICATION. IEEE International Conference on Image Processing (ICIP), IEEE, Sep 2016, Phoenix, AZ, United States. ⟨10.1109/ICIP.2016.7532354⟩. ⟨hal-01342580⟩
128 Consultations
197 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More