mlsanityData to 14 Oct 2026

LucidFlux: Caption-Free Photo-Realistic Image Restoration via a Large-Scale Diffusion Transformer

arXiv 2509.22414 ↗First posted 26 Sep 2025cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Image restoration (IR) aims to recover images degraded by unknown mixtures while preserving semanticsconditions under which discriminative restorers and UNet-based diffusion priors often oversmooth, hallucinate, or drift. We present LucidFlux, a caption-free IR framework that adapts a large diffusion transformer (Flux.1) without image captions. Our LucidFlux introduces a lightweight dual-branch conditioner that injects signals from the degraded input and a lightly restored proxy to respectively anchor geometry and suppress artifacts. Then, a timestep- and layer-adaptive modulation schedule is designed to route these cues across the backbones hierarchy, in order to yield coarse-to-fine and context-aware updates that protect the global structure while recovering texture. After that, to avoid the latency and instability of text prompts or Vision-Language Model (VLM) captions, we enforce caption-free semantic alignment via SigLIP features extracted from the proxy. A scalable curation pipeline further filters large-scale data for structure-rich supervision. Across synthetic and in-the-wild benchmarks, our LucidFlux consistently outperforms strong open-source and commercial baselines, and ablation studies verify the necessity of each component. LucidFlux shows that, for large DiTs, when, where, and what to condition onrather than adding parameters or relying on text promptsis the governing lever for robust and caption-free image restoration in the wild.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 38 of its 59 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

38 of 59 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Harnessing Diffusion-Yielded Score Priors for Image Restoration28 Jul
  2. 2025Dual Prompting Image Restoration with Diffusion Transformers24 Apr
  3. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
  4. 2024AGLLDiff: Guiding Diffusion Models Towards Unsupervised Training-free Real-world Low-light Image Enhancement20 Jul
  5. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
  6. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
  7. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
  8. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul
  9. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May

Other references · 29

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  10. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  11. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  12. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
17 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  2. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  3. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
  4. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  5. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  6. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  7. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  8. 2017NIMA: Neural Image Assessmentcited by 389
  9. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  10. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
  11. 2023Understanding the Latent Space of Diffusion Models through the Lens of Riemannian Geometrycited by 125
  12. 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domaincited by 55
  13. 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
  14. 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 40
  15. 2022MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowingcited by 39
  16. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  17. 2022SnowFormer: Context Interaction Transformer with Scale-awareness for Single Image Desnowingcited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformer
  2. 2026In-Token Learning for High-Fidelity Image Restoration via Diffusion Transformers
  3. 2024SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration
  4. 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration
  5. 2025Unified Diffusion Transformer for High-fidelity Text-Aware Image Restoration
  6. 2025Text-Aware Image Restoration with Diffusion Models
  7. 2025Vision-Language Model Guided Image Restoration
  8. 2026Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution