mlsanityData to 7 Oct 2026

Text2Thermal: Physics-Aware Thermal Image Synthesis from Textual Priors

arXiv 2609.03585 ↗First posted 3 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Thermal infrared imaging offers reliable perception in darkness and adverse weather, but thermal datasets remain scarce, motivating extensive work on translating abundant RGB images into thermal. Such translation is fundamentally ill-posed as thermal appearance is governed by surface emissivity and object temperature, neither of which is observable in the visible spectrum, so a single RGB image is consistent with many valid thermal outputs. We argue that language offers a natural means of resolving this ambiguity, and propose **Text2Thermal**, a framework for physics-aware thermal image synthesis from textual priors. Rather than inferring the unobservable radiometric factors from RGB, we supply them explicitly through thermally grounded captions encoding material, weather, time-of-day, and heat-emission state, and adapt a pre-trained Stable Diffusion backbone to the thermal domain. Because the radiometric content is determined entirely by the prompt, Text2Thermal synthesizes thermal imagery without requiring a registered RGB image at inference. Where spatial guidance is desired, an optional control signal imparts scene geometry without disturbing the prompt-specified radiometry. On M3FD and FLIR, Text2Thermal achieves state-of-the-art FID among thermal image synthesis methods, and we additionally report results on the FMB dataset, while offering text-level control that translation-based approaches cannot provide.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 56 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

32 of 56 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  12. 2024Depth Anything V2cited by 1,385
20 more
  1. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  2. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  3. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  4. 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 313
  5. 2021LLVIP: A Visible-infrared Paired Dataset for Low-light Visioncited by 229
  6. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
  7. 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
  8. 2023Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfercited by 194
  9. 2023Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentationcited by 128
  10. 2024One-Step Image Translation with Text-to-Image Modelscited by 111
  11. 2023Unpaired Image-to-Image Translation via Neural Schr"odinger Bridgecited by 96
  12. 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 76
  13. 2023Edge-guided Multi-domain RGB-to-TIR image Translation for Training Vision Tasks with Challenging Labelscited by 30
  14. 2025StyleSSP: Sampling StartPoint Enhancement for Training-free Diffusion-based Method for Style Transfercited by 23
  15. 2025DiffV2IR: Visible-to-Infrared Diffusion Model via Vision-Language Understandingcited by 16
  16. 2025ThermalGen: Style-Disentangled Flow-Based Generative Models for RGB-to-Thermal Image Translationcited by 13
  17. 2025F-ViTA: Foundation Model Guided Visible to Thermal Translationcited by 7
  18. 2024Implicit Multi-Spectral Transformer: An Lightweight and Effective Visible to Infrared Image Translation Modelcited by 6
  19. 2026TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translationcited by 3
  20. 2026T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretrainingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025ThermalDiffusion: Visual-to-Thermal Image-to-Image Translation for Autonomous Navigation
  2. 2026Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
  3. 2026ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery
  4. 2025Inference-Time Scaling of Diffusion Models for Infrared Data Generation
  5. 2026TIRMamba: A Thermal-Prior-Modulated State-Space Network for Sub-Million-Parameter Infrared Image Super-Resolution
  6. 2025See the past: Time-Reversed Scene Reconstruction from Thermal Traces Using Visual Language Models
  7. 2026HEARTH: An Object-Centric RGB-Thermal-3D Dataset for Temperature-Aware Robot Manipulation ↗
  8. 2026PolarScale: A Physics-Grounded Benchmark for Radiometrically Consistent RGB-to-Stokes Estimation