TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translation
Not on the map. Why?
Abstract (arXiv)
Despite the inherent advantages of thermal infrared(TIR) imaging, large-scale data collection and annotation remain a major bottleneck for TIR-based perception. A practical alternative is to synthesize pseudo TIR data via image translation; however, most RGB-to-TIR approaches heavily rely on RGB-centric priors that overlook thermal physics, yielding implausible heat distributions. In this paper, we introduce TherA, a controllable RGB-to-TIR translation framework that produces diverse and thermally plausible images at both scene and object level. TherA couples TherA-VLM with a latent-diffusion-based translator. Given a single RGB image and a user-prompted condition pair, TherA-VLM yields a thermal-aware embedding that encodes scene, object, material, and heat-emission context reflecting the input scene-condition pair. Conditioning the diffusion model on this embedding enables realistic TIR synthesis and fine-grained control across time of day, weather, and object state. Compared to other baselines, TherA achieves state-of-the-art translation performance, demonstrating improved zero-shot translation performance up to 33% increase averaged across all metrics.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 73 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
53 of 73 references.
References · 53
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
38 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
- 2020Detection and Tracking Meet Drones Challengecited by 261
- 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
- 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
- 2024One-Step Image Translation with Text-to-Image Modelscited by 111
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
- 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
- 2020Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blockscited by 85
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
- 2024XoFTR: Cross-modal Feature Matching Transformercited by 45
- 2024MINIMA: Modality Invariant Image Matchingcited by 44
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
- 2022ViViD++: Vision for Visibility Datasetcited by 34
- 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
- 2023Complementary Random Masking for RGB-Thermal Semantic Segmentationcited by 27
- 2025StyleSSP: Sampling StartPoint Enhancement for Training-free Diffusion-based Method for Style Transfercited by 23
- 2019Sparse Depth Enhanced Direct Thermal-infrared SLAM Beyond the Visible Spectrumcited by 22
- 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
- 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
- 2024Bridging Different Language Models and Generative Vision Models for Text-to-Image Generationcited by 17
- 2024PID: Physics-Informed Diffusion Model for Infrared Image Generationcited by 17
- 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
- 2024AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detectioncited by 15
- 2024Dataset and Benchmark: Novel Sensors for Autonomous Vehicle Perceptioncited by 14
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
- 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 13
- 2024When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Datasetcited by 10
- 2020A Multi-spectral Dataset for Evaluating Motion Estimation Systemscited by 8
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
- 2026T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining
- 2026ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
- 2026MonoIR-RS: Infrared Remote Sensing Vision-Language Learning with CLIP and VLM Adaptation
- 2025RGB-Th-Bench: A Dense benchmark for Visual-Thermal Understanding of Vision Language Models
- 2025Inference-Time Scaling of Diffusion Models for Infrared Data Generation
- 2025ThermalDiffusion: Visual-to-Thermal Image-to-Image Translation for Autonomous Navigation
- 2025See the past: Time-Reversed Scene Reconstruction from Thermal Traces Using Visual Language Models