# Unsupervised Image-generation Enhanced Adaptation for Object Detection in Thermal images

arXiv: https://arxiv.org/abs/2002.06770 · HTML: https://mlsanity.com/paper/2002.06770/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 Feb 2020.

## Built on by (most cited first, 6 of 6)

- [Unsupervised Domain Adaptation of Object Detectors: A Survey](https://mlsanity.com/paper/2105.13502/) (2021)
- [A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)](https://mlsanity.com/paper/2402.11413/) (2024)
- [When Visible-to-Thermal Facial GAN Beats Conditional Diffusion](https://mlsanity.com/paper/2302.09395/) (2023)
- [Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels](https://mlsanity.com/paper/2106.08091/) (2021)
- [Assessing thermal imagery integration into object detection methods on ground-based and air-based collection platforms](https://mlsanity.com/paper/2212.12616/) (2022)
- [Data Generation Scheme for Thermal Modality with Edge-Guided Adversarial Conditional Diffusion Model](https://mlsanity.com/paper/2408.03748/) (2024)

## Abstract (arXiv)

Object detection in thermal images is an important computer vision task and has many applications such as unmanned vehicles, robotics, surveillance and night vision. Deep learning based detectors have achieved major progress, which usually need large amount of labelled training data. However, labelled data for object detection in thermal images is scarce and expensive to collect. How to take advantage of the large number labelled visible images and adapt them into thermal image domain, is expected to solve. This paper proposes an unsupervised image-generation enhanced adaptation method for object detection in thermal images. To reduce the gap between visible domain and thermal domain, the proposed method manages to generate simulated fake thermal images that are similar to the target images, and preserves the annotation information of the visible source domain. The image generation includes a CycleGAN based image-to-image translation and an intensity inversion transformation. Generated fake thermal images are used as renewed source domain. And then the off-the-shelf Domain Adaptive Faster RCNN is utilized to reduce the gap between generated intermediate domain and the thermal target domain. Experiments demonstrate the effectiveness and superiority of the proposed method.
