mlsanityData to 7 Oct 2026

Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling

arXiv 2510.16751 ↗First posted 19 Oct 2025cs.CVcited by 1

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

While inference-time scaling through search has revolutionized Large Language Models, translating these gains to image generation has proven difficult. Recent attempts to apply search strategies to continuous diffusion models show limited benefits, with simple random sampling often performing best. We demonstrate that the discrete, sequential nature of visual autoregressive models enables effective search for image generation. We show that beam search substantially improves text-to-image generation, enabling a 2B parameter autoregressive model to outperform a 12B parameter diffusion model across benchmarks. Systematic ablations show that this advantage comes from the discrete token space, which allows early pruning and computational reuse, and our verifier analysis highlights trade-offs between speed and reasoning capability. These findings suggest that model architecture, not just scale, is critical for inference-time optimization in visual generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 26 of its 40 references that are in the map. First posted on arXiv 19 Oct 2025.

Builds on

26 of 40 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing25 Mar
  2. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
  3. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps16 Jan
  4. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan

Other references · 22

  1. 2020Scaling Laws for Neural Language Modelscited by 6,411
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2023Let's Verify Step by Stepcited by 3,598
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  7. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  9. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  10. 2025s1: Simple test-time scalingcited by 1,311
  11. 2024OpenAI o1 System Cardcited by 1,220
  12. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
10 more
  1. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  2. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  3. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  4. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 338
  5. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  6. 2024Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoningcited by 267
  7. 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 238
  8. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
  9. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 53
  10. 2025Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPOcited by 31

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation
  2. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model
  3. 2025From Sequential to Spatial: Reordering Autoregression for Efficient Visual Generation
  4. 2024ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer
  5. 2025ScalingAR: Scaling Confidence for Autoregressive Image Generation
  6. 2026Inference-Time Scaling for Visual AutoRegressive modeling by Searching Representative Samples
  7. 2024Diffusion Beats Autoregressive: An Evaluation of Compositional Generation in Text-to-Image Models
  8. 2025Proxy-Tuning: Tailoring Multimodal Autoregressive Models for Subject-Driven Image Generation