Language modeling for bag-of-visual words image categorization - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

Language modeling for bag-of-visual words image categorization

Pierre Tirilly
Vincent Claveau
Patrick Gros

Résumé

In this paper, we propose two ways of improving image classification based on bag-of-words representation. Two shortcomings of this representation are the loss of the spatial information of visual words and the presence of noisy visual words due to the coarseness of the vocabulary building process. On the one hand, we propose a new representation of images that goes further in the analogy with textual data: visual sentences, that allows us to "read" visual words in a certain order, as in the case of text. We can therefore consider simple spatial relations between words. We also present a new image classification scheme that exploits these relations. It is based on the use of language models, a very popular tool from speech and text analysis communities. On the other hand, we propose new techniques to eliminate useless words, one based on geometric properties of the keypoints, the other on the use of probabilistic Latent Semantic Analysis (pLSA). Experiments show that our techniques can significantly improve image classification, compared to a classical Support Vector Machine-based classification.

Dates et versions

hal-00811922 , version 1 (11-04-2013)

Identifiants

Citer

Pierre Tirilly, Vincent Claveau, Patrick Gros. Language modeling for bag-of-visual words image categorization. International Conference on Image and Video Retrieval, Jul 2008, Niagara Falls, Canada. pp.249-258, ⟨10.1145/1386352.1386388⟩. ⟨hal-00811922⟩
198 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More