mlsanityData to 7 Oct 2026

TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translation

arXiv 2602.19430 ↗First posted 23 Feb 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Despite the inherent advantages of thermal infrared(TIR) imaging, large-scale data collection and annotation remain a major bottleneck for TIR-based perception. A practical alternative is to synthesize pseudo TIR data via image translation; however, most RGB-to-TIR approaches heavily rely on RGB-centric priors that overlook thermal physics, yielding implausible heat distributions. In this paper, we introduce TherA, a controllable RGB-to-TIR translation framework that produces diverse and thermally plausible images at both scene and object level. TherA couples TherA-VLM with a latent-diffusion-based translator. Given a single RGB image and a user-prompted condition pair, TherA-VLM yields a thermal-aware embedding that encodes scene, object, material, and heat-emission context reflecting the input scene-condition pair. Conditioning the diffusion model on this embedding enables realistic TIR synthesis and fine-grained control across time of day, weather, and object state. Compared to other baselines, TherA achieves state-of-the-art translation performance, demonstrating improved zero-shot translation performance up to 33% increase averaged across all metrics.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 53 of its 73 references that are in the map. First posted on arXiv 23 Feb 2026.

Builds on

53 of 73 references.

References · 53

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Segment Anythingcited by 8,158
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  10. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
38 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  2. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
  3. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  4. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
  5. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  6. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
  7. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  8. 2020Detection and Tracking Meet Drones Challengecited by 261
  9. 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
  10. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
  11. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
  12. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  13. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Modelscited by 174
  14. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
  15. 2024One-Step Image Translation with Text-to-Image Modelscited by 111
  16. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
  17. 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
  18. 2020Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blockscited by 85
  19. 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
  20. 2024XoFTR: Cross-modal Feature Matching Transformercited by 45
  21. 2024MINIMA: Modality Invariant Image Matchingcited by 44
  22. 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
  23. 2022ViViD++: Vision for Visibility Datasetcited by 34
  24. 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
  25. 2023Complementary Random Masking for RGB-Thermal Semantic Segmentationcited by 27
  26. 2025StyleSSP: Sampling StartPoint Enhancement for Training-free Diffusion-based Method for Style Transfercited by 23
  27. 2019Sparse Depth Enhanced Direct Thermal-infrared SLAM Beyond the Visible Spectrumcited by 22
  28. 2024Caltech Aerial RGB-Thermal Dataset in the Wildcited by 19
  29. 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
  30. 2024Bridging Different Language Models and Generative Vision Models for Text-to-Image Generationcited by 17
  31. 2024PID: Physics-Informed Diffusion Model for Infrared Image Generationcited by 17
  32. 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
  33. 2024AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detectioncited by 15
  34. 2024Dataset and Benchmark: Novel Sensors for Autonomous Vehicle Perceptioncited by 14
  35. 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
  36. 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 13
  37. 2024When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Datasetcited by 10
  38. 2020A Multi-spectral Dataset for Evaluating Motion Estimation Systemscited by 8

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
  2. 2026T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining
  3. 2026ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
  4. 2026MonoIR-RS: Infrared Remote Sensing Vision-Language Learning with CLIP and VLM Adaptation
  5. 2025RGB-Th-Bench: A Dense benchmark for Visual-Thermal Understanding of Vision Language Models
  6. 2025Inference-Time Scaling of Diffusion Models for Infrared Data Generation
  7. 2025ThermalDiffusion: Visual-to-Thermal Image-to-Image Translation for Autonomous Navigation
  8. 2025See the past: Time-Reversed Scene Reconstruction from Thermal Traces Using Visual Language Models