Scale-Wise VAR is Secretly Discrete Diffusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Autoregressive (AR) transformers have emerged as a powerful paradigm for visual generation, largely due to their scalability, computational efficiency and unified architecture with language and vision. Among them, next scale prediction Visual Autoregressive Generation (VAR) has recently demonstrated remarkable performance, even surpassing diffusion-based models. In this work, we revisit VAR and uncover a theoretical insight: when equipped with a Markovian attention mask, VAR is mathematically equivalent to a discrete diffusion. We term this reinterpretation as Scalable Visual Refinement with Discrete Diffusion (SRDD), establishing a principled bridge between AR transformers and diffusion models. Leveraging this new perspective, we show how one can directly import the advantages of diffusion such as iterative refinement and reduce architectural inefficiencies into VAR, yielding faster convergence, lower inference cost, and improved zero-shot reconstruction. Across multiple datasets, we show that the diffusion based perspective of VAR leads to consistent gains in efficiency and generation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 40 of its 48 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
40 of 48 references.
Closest ancestors · 4
Same direction, newest first
- 2025HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generation4 Jun
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction3 Apr
- 2024CogView3: Finer and Faster Text-to-Image Generation via Relay Diffusion8 Mar
- 2021Palette: Image-to-Image Diffusion Models10 Nov
Other references · 36
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
24 more
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2016Improved Techniques for Training GANscited by 2,970
- 2023Consistency Modelscited by 1,822
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2022MaskGIT: Masked Generative Image Transformercited by 1,099
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2025Large Language Diffusion Modelscited by 912
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2022On Distillation of Guided Diffusion Modelscited by 725
- 2017Masked Autoregressive Flow for Density Estimationcited by 684
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2019A Baseline for Few-Shot Image Classificationcited by 298
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 276
- 2023LCM-LoRA: A Universal Stable-Diffusion Acceleration Modulecited by 211
- 2025Remasking Discrete Diffusion Models with Inference-Time Scalingcited by 189
- 2024Simple Guidance Mechanisms for Discrete Diffusion Modelscited by 155
- 2023Relay Diffusion: Unifying diffusion process across resolutions for image synthesiscited by 79
- 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33
- 2018Scene recognition with CNNs: objects, scales and dataset biascited by 18
- 2024Unlocking the Capabilities of Masked Generative Models for Image Synthesis via Self-Guidancecited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Universal Approximation of Visual Autoregressive Transformers
- 2024M-VAR: Decoupled Scale-wise Autoregressive Modeling for High-Quality Image Generation
- 2025Multi-scale Autoregressive Models are Laplacian, Discrete, and Latent Diffusion Models in Disguise
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restoration
- 2026VISTA: Test-Time Compositional Alignment for Visual Autoregressive Generation
- 2025MVAR: Visual Autoregressive Modeling with Scale and Spatial Markovian Conditioning
- 2026Drift-AR: Single-Step Visual Autoregressive Generation via Anti-Symmetric Drifting
- 2025Diversity Has Always Been There in Your Visual Autoregressive Models