Attention-Guided Generative Adversarial Network for Explainable Thermal to Visible Face Recognition - Inria EPFL Access content directly
Conference Papers Year : 2022

Attention-Guided Generative Adversarial Network for Explainable Thermal to Visible Face Recognition

Abstract

Thermal to visible face image translation aims at synthesizing high-fidelity visible face images from thermal counterparts, placing emphasis on preserving the identity of the faces. While remarkable progress has been achieved related to the quality of synthetic images, as well as related to associated face matching accuracy, interpreting the generation process from thermal to visible face images remains an open challenge. Towards tackling this challenge, we present a novel generic attention-guided generative adversarial network (AG-GAN) for thermal to visible image translation. The AG-GAN framework is based on an encoder network that directly generates attention feature maps from an input thermal image in either, supervised or unsupervised fashion. A decoder network takes the attention maps and applies adaptive layer-instance normalization, in order to reconstruct the corresponding visible image. We show that solving thermal to visible image translation tasks through AG-GAN significantly improves the cross-spectral face matching accuracy, as well as inherently supports model explanation.
Fichier principal
Vignette du fichier
IJCB2022_AGGAN_HAL.pdf (3.88 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03936358 , version 1 (12-01-2023)

Identifiers

  • HAL Id : hal-03936358 , version 1

Cite

Cunjian Chen, David Anghelone, Philippe Faure, Antitza Dantcheva. Attention-Guided Generative Adversarial Network for Explainable Thermal to Visible Face Recognition. IEEE International joint conference on biometrics, Oct 2022, Abu Dhabi, United Arab Emirates. ⟨hal-03936358⟩
21 View
96 Download

Share

Gmail Facebook X LinkedIn More