# Unpaired Thermal to Visible Spectrum Transfer using Adversarial Training

arXiv: https://arxiv.org/abs/1904.02242 · HTML: https://mlsanity.com/paper/1904.02242/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Apr 2019.

## Built on by (most cited first, 9 of 9)

- [Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labels](https://mlsanity.com/paper/2301.12689/) (2023)
- [Thermal Infrared Image Colorization for Nighttime Driving Scenes with Top-Down Guided Attention](https://mlsanity.com/paper/2104.14374/) (2021)
- [DMFourLLIE: Dual-Stage and Multi-Branch Fourier Network for Low-Light Image Enhancement](https://mlsanity.com/paper/2412.00683/) (2024)
- [I2V-GAN: Unpaired Infrared-to-Visible Video Translation](https://mlsanity.com/paper/2108.00913/) (2021)
- [Visibility Constrained Wide-band Illumination Spectrum Design for Seeing-in-the-Dark](https://mlsanity.com/paper/2303.11642/) (2023)
- [Modality-Transition Representation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2511.02685/) (2025)
- [StawGAN: Structural-Aware Generative Adversarial Networks for Infrared Image Translation](https://mlsanity.com/paper/2305.10882/) (2023)
- [Nighttime Thermal Infrared Image Colorization with Feedback-based Object Appearance Learning](https://mlsanity.com/paper/2310.15688/) (2023)
- [Memory-Guided Collaborative Attention for Nighttime Thermal Infrared Image Colorization](https://mlsanity.com/paper/2208.02960/) (2022)

## Abstract (arXiv)

Thermal Infrared (TIR) cameras are gaining popularity in many computer vision applications due to their ability to operate under low-light conditions. Images produced by TIR cameras are usually difficult for humans to perceive visually, which limits their usability. Several methods in the literature were proposed to address this problem by transforming TIR images into realistic visible spectrum (VIS) images. However, existing TIR-VIS datasets suffer from imperfect alignment between TIR-VIS image pairs which degrades the performance of supervised methods. We tackle this problem by learning this transformation using an unsupervised Generative Adversarial Network (GAN) which trains on unpaired TIR and VIS images. When trained and evaluated on KAIST-MS dataset, our proposed methods was shown to produce significantly more realistic and sharp VIS images than the existing state-of-the-art supervised methods. In addition, our proposed method was shown to generalize very well when evaluated on a new dataset of new environments.
