QAP Optimisation with Reinforcement Learning for Faster Graph Matching in Sequential Semantic Image Analysis - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

QAP Optimisation with Reinforcement Learning for Faster Graph Matching in Sequential Semantic Image Analysis

Résumé

The paper addresses the fundamental task of semantic image analysis by exploiting structural information (spatial relationships between image regions). We propose to combine a deep neural network (CNN) with graph matching where graphs encode efficiently structural information related to regions segmented by the CNN. Our novel approach solves the quadratic assignment problem (QAP) sequentially for matching graphs. The optimal sequence for graph matching is conveniently defined using reinforcement-learning (RL) based on the region membership probabilities produced by the CNN and their structural relationships. Our RL-based strategy for solving QAP sequentially allows us to significantly reduce the combinatorial complexity for graph matching. Preliminary experiments are performed on both a synthetic dataset and a public dataset dedicated to the semantic segmentation of face images. Results show that the proposed RL-based ordering significantly outperforms random ordering and that our strategy is about 386 times faster than a global QAP-based approach while preserving similar segmentation accuracy.
Fichier principal
Vignette du fichier
2022_ICPRAI_RL_VF.pdf (2.37 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03633036 , version 1 (02-01-2023)

Identifiants

Citer

Jérémy Chopin, Jean-Baptiste Fasquel, Harold Mouchère, Rozenn Dahyot, Isabelle Bloch. QAP Optimisation with Reinforcement Learning for Faster Graph Matching in Sequential Semantic Image Analysis. International Conference on Pattern Recognition and Artificial Intelligence, Jun 2022, Paris, France. pp.47-58, ⟨10.1007/978-3-031-09037-0_5⟩. ⟨hal-03633036⟩
179 Consultations
34 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More