mlsanityData to 14 Oct 2026

Rarity-Aware Discrete Diffusion with Spatially Consistent Decoding for Photo-Realistic Image Super-Resolution

arXiv 2607.17612 ↗First posted 20 Jul 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

also in 1 more
Abstract (arXiv)

Continuous diffusion models have become the dominant paradigm for photo-realistic image Super-Resolution (SR), but they typically formulate reconstruction as continuous signal-level denoising and incorporate semantic priors through external conditioning modules. This makes it less direct to exploit the unified token-based scaling paradigm of modern multimodal models. Autoregressive models provide a more native semantic representation by modeling images as discrete visual tokens, yet their causal decoding is inefficient for high-resolution reconstruction. Discrete diffusion offers a promising middle ground by enabling non-causal, parallel prediction over visual tokens. However, directly adapting discrete diffusion to SR remains non-trivial due to two task-specific challenges: (1) the long-tailed distribution of visual tokens, which under-represents rare but perceptually critical textures; and (2) spatially inconsistent parallel decoding, which may introduce isolated artifacts. To address these issues, we propose DiMOO-SR, a rarity-aware multimodal discrete diffusion framework for photo-realistic image SR. During training, Inverse Frequency Sampling (IFS) prioritizes under-represented but information-rich tokens. During inference, Spatial Consistency Ranking (SCR) refines token confidence using local neighborhood agreement to improve structural coherence. Extensive experiments on widely used real-world SR benchmarks demonstrate that DiMOO-SR achieves competitive perceptual quality with only a few parallel decoding steps, highlighting the potential of discrete diffusion for generative image super-resolution. The code will be released upon publication.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 18 of its 28 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

18 of 28 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Perceive, Understand and Restore: Real-World Image Super-Resolution with Autoregressive Multimodal Generative Models14 Mar
  2. 2023Iterative Token Evaluation and Refinement for Real-World Super-Resolution9 Dec
  3. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
  4. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug

Other references · 14

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  6. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  7. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  8. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  9. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
  10. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  11. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
  12. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
2 more
  1. 2023HAT: Hybrid Attention Transformer for Image Restorationcited by 66
  2. 2025Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modelingcited by 37

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Improving Consistency in Diffusion Models for Image Super-Resolution
  2. 2026Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution
  3. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  4. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution
  5. 2024Diffusion Models, Image Super-Resolution And Everything: A Survey
  6. 2025Semantic-Guided Diffusion Model for Single-Step Image Super-Resolution
  7. 2024Taming Diffusion Prior for Image Super-Resolution with Domain Shift SDEs
  8. 2025Accelerating Diffusion-based Super-Resolution with Dynamic Time-Spatial Sampling