QAP Optimisation with Reinforcement Learning for Faster Graph Matching in Sequential Semantic Image Analysis - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

QAP Optimisation with Reinforcement Learning for Faster Graph Matching in Sequential Semantic Image Analysis

Abstract

The paper addresses the fundamental task of semantic image analysis by exploiting structural information (spatial relationships between image regions). We propose to combine a deep neural network (CNN) with graph matching where graphs encode efficiently structural information related to regions segmented by the CNN. Our novel approach solves the quadratic assignment problem (QAP) sequentially for matching graphs. The optimal sequence for graph matching is conveniently defined using reinforcement-learning (RL) based on the region membership probabilities produced by the CNN and their structural relationships. Our RL-based strategy for solving QAP sequentially allows us to significantly reduce the combinatorial complexity for graph matching. Preliminary experiments are performed on both a synthetic dataset and a public dataset dedicated to the semantic segmentation of face images. Results show that the proposed RL-based ordering significantly outperforms random ordering and that our strategy is about 386 times faster than a global QAP-based approach while preserving similar segmentation accuracy.
Fichier principal
Vignette du fichier
2022_ICPRAI_RL_VF.pdf (2.37 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03633036 , version 1 (02-01-2023)

Identifiers

Cite

Jérémy Chopin, Jean-Baptiste Fasquel, Harold Mouchère, Rozenn Dahyot, Isabelle Bloch. QAP Optimisation with Reinforcement Learning for Faster Graph Matching in Sequential Semantic Image Analysis. International Conference on Pattern Recognition and Artificial Intelligence, Jun 2022, Paris, France. pp.47-58, ⟨10.1007/978-3-031-09037-0_5⟩. ⟨hal-03633036⟩
191 View
44 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More