LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Flow-Based Real-World Super-Resolution
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Generative real-world image super-resolution (Real-ISR) can synthesize visually convincing details from severely degraded low-resolution (LR) inputs, yet its stochastic sampling makes a critical failure mode hard to avoid: outputs may look sharp but be unfaithful to the LR evidence, exhibiting semantic or structural hallucinations. Preference-based reinforcement learning (RL) is a natural fit because each LR input yields a rollout group of candidate restorations. However, effective alignment in Real-ISR is hindered by three coupled challenges: (i) the lack of an LR-referenced faithfulness signal that is robust to degradation yet sensitive to localized hallucinations, (ii) a rollout-group optimization bottleneck where scalarizing heterogeneous rewards before normalization compresses objective-wise contrasts and weakens DiffusionNFT-style reward-weighted updates, and (iii) limited coverage of real degradations, which restricts rollout diversity and preference signal quality. We propose LucidNFT, a multi-reward RL framework for flow-matching Real-ISR. LucidNFT introduces LucidConsistency, a degradation-invariant and hallucination-sensitive LR-referenced evaluator trained with content-consistent degradation pools and original-inpainted hard negatives; a decoupled reward normalization strategy that preserves objective-wise contrasts within each LR-conditioned rollout group before fusion; and LucidLR, a large-scale collection of real-world degraded images for robust RL fine-tuning. Extensive experiments show that LucidNFT improves perceptual quality on strong flow-based Real-ISR baselines while generally maintaining LR-referenced consistency across diverse real-world scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 40 of its 55 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
40 of 55 references.
Closest ancestors · 4
Same direction, newest first
- 2025FinPercep-RM: A Fine-grained Reward Model and Co-evolutionary Curriculum for RL-based Real-world Super-Resolution27 Dec
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2025DSPO: Direct Semantic Preference Optimization for Real-World Image Super-Resolution21 Apr
- 2023Diffusion Model Alignment Using Direct Preference Optimization21 Nov
Other references · 36
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
24 more
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2017NIMA: Neural Image Assessmentcited by 387
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 311
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 235
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 64
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 50
- 2024XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolutioncited by 41
- 2025UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texturecited by 19
- 2024Looks Too Good To Be True: An Information-Theoretic Analysis of Hallucinations in Generative Restoration Modelscited by 12
- 2025SAGI: Semantically Aligned and Uncertainty Guided AI Image Inpaintingcited by 10
- 2025RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thoughtcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
- 2026Bird-SR: Bidirectional Reward-Guided Diffusion for Real-World Image Super-Resolution
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution
- 2026FoA-SR: Faithful or Aesthetic? Profile-Aware Preference Optimization for Real-World Image Super-Resolution
- 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
- 2026PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution
- 2026PixelIR: Fidelity-Perception Decoupling via Pixel-Space Image-Residual Flow Matching for Efficient One-Step Real-World Super-Resolution
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors