Deep Context Networks for Image Annotation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Deep Context Networks for Image Annotation

Mingyuan Jiu
  • Fonction : Auteur
Hichem Sahbi
Lin Qi
  • Fonction : Auteur

Résumé

Context plays an important role in visual pattern recognition as it provides complementary clues for different learning tasks including image classification and annotation. In the particular scenario of kernel learning, the general recipe of context-based kernel design consists in learning positive semi-definite similarity functions that return high values not only when data share similar content but also similar context. However, in spite of having a positive impact on performance, the use of context in these kernel design methods has not been fully explored; indeed, context has been handcrafted instead of being learned. In this paper, we introduce a novel context-aware kernel design framework based on deep learning. Our method discriminatively learns spatial geometric context as the weights of a deep network (DN). The architecture of this network is fully determined by the solution of an objective function that mixes content, context and regularization, while the parameters of this network determine the most relevant (discriminant) parts of the learned context. We apply this context and kernel learning framework to image classification using the challenging ImageCLEF Photo Annotation benchmark; the latter shows that our deep context learning provides highly effective kernels for image classification as corroborated through extensive experiments.
Fichier non déposé

Dates et versions

hal-02325840 , version 1 (22-10-2019)

Identifiants

Citer

Mingyuan Jiu, Hichem Sahbi, Lin Qi. Deep Context Networks for Image Annotation. IEEE International Conference on Pattern Recognition (ICPR), Aug 2018, Beijing, China. pp.2422-2427, ⟨10.1109/ICPR.2018.8545396⟩. ⟨hal-02325840⟩
27 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More