mlsanityData to 7 Oct 2026

LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Flow-Based Real-World Super-Resolution

arXiv 2603.05947 ↗First posted 6 Mar 2026cs.CVcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Generative real-world image super-resolution (Real-ISR) can synthesize visually convincing details from severely degraded low-resolution (LR) inputs, yet its stochastic sampling makes a critical failure mode hard to avoid: outputs may look sharp but be unfaithful to the LR evidence, exhibiting semantic or structural hallucinations. Preference-based reinforcement learning (RL) is a natural fit because each LR input yields a rollout group of candidate restorations. However, effective alignment in Real-ISR is hindered by three coupled challenges: (i) the lack of an LR-referenced faithfulness signal that is robust to degradation yet sensitive to localized hallucinations, (ii) a rollout-group optimization bottleneck where scalarizing heterogeneous rewards before normalization compresses objective-wise contrasts and weakens DiffusionNFT-style reward-weighted updates, and (iii) limited coverage of real degradations, which restricts rollout diversity and preference signal quality. We propose LucidNFT, a multi-reward RL framework for flow-matching Real-ISR. LucidNFT introduces LucidConsistency, a degradation-invariant and hallucination-sensitive LR-referenced evaluator trained with content-consistent degradation pools and original-inpainted hard negatives; a decoupled reward normalization strategy that preserves objective-wise contrasts within each LR-conditioned rollout group before fusion; and LucidLR, a large-scale collection of real-world degraded images for robust RL fine-tuning. Extensive experiments show that LucidNFT improves perceptual quality on strong flow-based Real-ISR baselines while generally maintaining LR-referenced consistency across diverse real-world scenarios.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 40 of its 55 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

40 of 55 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025FinPercep-RM: A Fine-grained Reward Model and Co-evolutionary Curriculum for RL-based Real-world Super-Resolution27 Dec
  2. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  3. 2025DSPO: Direct Semantic Preference Optimization for Real-World Image Super-Resolution21 Apr
  4. 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov

Other references · 36

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2022Flow Matching for Generative Modelingcited by 5,426
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  10. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  11. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  12. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
24 more
  1. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  2. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  3. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  4. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  5. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  6. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
  7. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  8. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  9. 2017NIMA: Neural Image Assessmentcited by 387
  10. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
  11. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
  12. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  13. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
  14. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
  15. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  16. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
  17. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
  18. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 64
  19. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 50
  20. 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
  21. 2025UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texturecited by 19
  22. 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Modelscited by 12
  23. 2025SAGI: Semantically Aligned and Uncertainty Guided AI Image Inpaintingcited by 10
  24. 2025RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thoughtcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
  2. 2026Bird-SR: Bidirectional Reward-Guided Diffusion for Real-World Image Super-Resolution
  3. 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution
  4. 2026FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution
  5. 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
  6. 2026PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution
  7. 2026PixelIR: Fidelity-Perception Decoupling via Pixel-Space Image-Residual Flow Matching for Efficient One-Step Real-World Super-Resolution
  8. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors