DHCN: Deep Hierarchical Context Networks For Image Annotation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

DHCN: Deep Hierarchical Context Networks For Image Annotation

Résumé

Context modeling is one of the most fertile sub-fields of visual recognition which aims at designing discriminant image representations while incorporating their intrinsic and extrinsic relationships. However, the potential of context modeling is currently under-explored and most of the existing solutions are either context-free or restricted to simple handcrafted geometric relationships. We introduce in this paper DHCN: a novel Deep Hierarchical Context Network that leverages different sources of contexts including geometric and semantic relationships. The proposed method is based on the minimization of an objective function mixing a fidelity term, a context criterion and a regularizer. The solution of this objective function defines the architecture of a bi-level hierarchical context network; the first level of this network captures scene geometry while the second one corresponds to semantic relationships. We solve this representation learning problem by training its underlying deep network whose parameters correspond to the most influencing bi-level contextual relationships and we evaluate its performances on image annotation using the challenging ImageCLEF benchmark.
Fichier principal
Vignette du fichier
camera.pdf (804.78 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03431323 , version 1 (16-11-2021)

Identifiants

Citer

Mingyuan Jiu, Hichem Sahbi. DHCN: Deep Hierarchical Context Networks For Image Annotation. IEEE International Conference on Acoustics, Speech and Signal Processing, Jun 2021, Toronto, ON, Canada. ⟨10.1109/ICASSP39728.2021.9413972⟩. ⟨hal-03431323⟩
24 Consultations
65 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More