Simultaneous Face Hallucination and Translation for Thermal to Visible Face Verification using Axial-GAN
Not on the map. Why?
Abstract (arXiv)
Existing thermal-to-visible face verification approaches expect the thermal and visible face images to be of similar resolution. This is unlikely in real-world long-range surveillance systems, since humans are distant from the cameras. To address this issue, we introduce the task of thermal-to-visible face verification from low-resolution thermal images. Furthermore, we propose Axial-Generative Adversarial Network (Axial-GAN) to synthesize high-resolution visible images for matching. In the proposed approach we augment the GAN framework with axial-attention layers which leverage the recent advances in transformers for modelling long-range dependencies. We demonstrate the effectiveness of the proposed method by evaluating on two different thermal-visible face datasets. When compared to related state-of-the-art works, our results show significant improvements in both image quality and face verification performance, and are also much more efficient.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 33 of its 43 references that are in the map. First posted on arXiv 13 Apr 2021.
Builds on
33 of 43 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2017Non-local Neural Networkscited by 2,293
- 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2018Self-Attention with Relative Position Representationscited by 1,120
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
21 more
- 2019Stand-Alone Self-Attention in Vision Modelscited by 542
- 2019Deep Learning for Image Super-resolution: A Surveycited by 369
- 2019Axial Attention in Multidimensional Transformerscited by 358
- 2020Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentationcited by 326
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 320
- 2017Geometric GANcited by 233
- 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
- 2020HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishmentcited by 70
- 2017Super-FAN: Integrated facial landmark localization and super-resolution of real-world low resolution faces in arbitrary poses with GANscited by 55
- 2018Super-Identity Convolutional Neural Network for Face Hallucinationcited by 39
- 2017Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognitioncited by 37
- 2021Deep Learning-based Face Super-Resolution: A Surveycited by 32
- 2018Synthesis of High-Quality Visible Faces from Polarimetric Thermal Faces using Generative Adversarial Networkscited by 24
- 2021A Large-Scale, Time-Synchronized Visible and Thermal Face Datasetcited by 23
- 2019Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesiscited by 19
- 2020Cross-Domain Identification for Thermal-to-Visible Face Recognitioncited by 14
- 2018Disentangled Variational Representation for Heterogeneous Face Recognitioncited by 13
- 2017Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Facescited by 11
- 2020Multi-Scale Thermal to Visible Face Verification via Attribute Guided Synthesiscited by 11
- 2018Thermal to Visible Synthesis of Face Images using Multiple Regionscited by 9
- 2018Deep Cross Polarimetric Thermal-to-visible Face Recognitioncited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 0; 2024: 0; 2025: 1; 2026: 1.
8 papers.
- 2022T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Modelscited by 17
- 2022Beyond the Visible: A Survey on Cross-spectral Face Recognitioncited by 6
- 2021Heterogeneous Face Frontalization via Domain Agnostic Learningcited by 4
- 2022Learning Domain and Pose Invariance for Thermal-to-Visible Face Recognitioncited by 2
- 2022Thermal to Visible Image Synthesis under Atmospheric Turbulencecited by 1
- 2026MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translationcited by 1
- 2022Escaping Data Scarcity for High-Resolution Heterogeneous Face Hallucinationcited by 0
- 2025LaPIG: Cross-Modal Generation of Paired Thermal and Visible Facial Imagescited by 0
- 2026MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation22 Jul 2026
- 2025LaPIG: Cross-Modal Generation of Paired Thermal and Visible Facial Images20 Mar 2025
- 2022Learning Domain and Pose Invariance for Thermal-to-Visible Face Recognition17 Nov 2022
- 2022T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models19 Sep 2022
- 2022Thermal to Visible Image Synthesis under Atmospheric Turbulence6 Apr 2022
- 2022Escaping Data Scarcity for High-Resolution Heterogeneous Face Hallucination30 Mar 2022
- 2022Beyond the Visible: A Survey on Cross-spectral Face Recognition12 Jan 2022
- 2021Heterogeneous Face Frontalization via Domain Agnostic Learning17 Jul 2021