ScalingAR: Scaling Confidence for Autoregressive Image Generation
Not on the map. Why?
Abstract (arXiv)
Test-time strategies have shown remarkable success in improving large language models, but their application to next-token prediction (NTP) autoregressive (AR) image generation remains largely underexplored. Existing test-time scaling (TTS) methods for visual autoregressive models (VAR) rely on frequent partial decoding and external reward models, which are inefficient and often ineffective for NTP-based image generation due to the inherent instability of intermediate decoding results. To address these limitations, we propose ScalingAR, a novel test-time scaling framework tailored for NTP-based AR image generation. ScalingAR introduces token entropy as a confidence signal and operates at two complementary levels: (i) Profile Level, integrates intrinsic uncertainty and conditional utilization into a unified confidence state, and (ii) Policy Level, leverages this state for adaptive trajectory pruning and dynamic guidance scheduling. Without requiring early decoding or auxiliary rewards, ScalingAR achieves significant improvements across diverse benchmarks. Experiments show that ScalingAR (I) improves base models by 12.5% on GenEval and 15.2% on TIIF-Bench, (II) reduces visual token consumption by 62.0% while outperforming baselines, and (III) enhances robustness, mitigating performance degradation by 26.0% in challenging scenarios. These results establish ScalingAR as a robust and efficient test-time scaling solution for autoregressive image generation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 38 of its 45 references that are in the map. First posted on arXiv 30 Sep 2025.
Builds on
38 of 45 references.
References · 38
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023Let's Verify Step by Stepcited by 3,789
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
26 more
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2024Autoregressive Image Generation without Vector Quantizationcited by 651
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
- 2025LIMO: Less is More for Reasoningcited by 498
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 304
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2025Deep Think with Confidencecited by 205
- 2025Scalable Best-of-N Selection for Large Language Models via Self-Certaintycited by 187
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2024Fluid: Scaling Autoregressive Text-to-image Generative Models with Continuous Tokenscited by 147
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 131
- 2025SimpleAR: Pushing the Frontier of Autoregressive Visual Generation through Pretraining, SFT, and RLcited by 86
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 69
- 2025LightGen: Efficient Image Generation through Knowledge Distillation and Direct Preference Optimizationcited by 20
- 2025Impossible Videoscited by 16
- 2025TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generationcited by 15
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation
- 2025Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling
- 2024FlowAR: Scale-wise Autoregressive Image Generation Meets Flow Matching
- 2025Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compression
- 2026Logit Refiner: Improving Visual Autoregressive Models via Intra-Scale Dependency Modeling
- 2025MVAR: Visual Autoregressive Modeling with Scale and Spatial Markovian Conditioning
- 2026Inference-Time Scaling for Visual AutoRegressive modeling by Searching Representative Samples
- 2025AMS-KV: Adaptive KV Caching in Multi-Scale Visual Autoregressive Transformers