TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generation
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
Abstract (arXiv)
Scaling visual generation models is essential for real-world content creation, yet requires substantial training and computational expenses. Alternatively, test-time scaling has garnered growing attention due to resource efficiency and promising performance. In this work, we present TTS-VAR, the first general test-time scaling framework for visual auto-regressive (VAR) models, modeling the generation process as a path searching problem. To dynamically balance computational efficiency with exploration capacity, we first introduce an adaptive descending batch size schedule throughout the causal generation process. Besides, inspired by VAR's hierarchical coarse-to-fine multi-scale generation, our framework integrates two key components: (i) At coarse scales, we observe that generated tokens are hard for evaluation, possibly leading to erroneous acceptance of inferior samples or rejection of superior samples. Noticing that the coarse scales contain sufficient structural information, we propose clustering-based diversity search. It preserves structural variety through semantic feature clustering, enabling later selection on samples with higher potential. (ii) In fine scales, resampling-based potential selection prioritizes promising candidates using potential scores, which are defined as reward functions incorporating multi-scale generation history. Experiments on the powerful VAR model Infinity show a notable 8.7% GenEval score improvement (from 0.69 to 0.75). Key insights reveal that early-stage structural features effectively influence final quality, and resampling efficacy varies across generation scales. Code is available at https://github.com/ali-vilab/TTS-VAR.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 59 of its 67 references that are in the map. First posted on arXiv 24 Jul 2025.
Builds on
59 of 67 references.
Closest ancestors · 3
Same direction, newest first
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps16 Jan
- 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan
Other references · 56
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
38 more
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2023Consistency Modelscited by 1,778
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Servingcited by 199
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
- 2022RL with KL penalties is better viewed as Bayesian inferencecited by 130
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
- 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
- 2024Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumptioncited by 96
- 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 82
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 8; 2026: 7.
15 papers.
Sort:
By area:
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editingcited by 7
- 2025ScalingAR: Scaling Confidence for Autoregressive Image Generationcited by 3
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generationcited by 2
- 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generationcited by 2
- 2025FasterVAR: Plug-and-Play Acceleration for Visual Autoregressive Modelscited by 2
- 2025dMLLM-TTS: Self-Verified and Efficient Test-Time Scaling for Diffusion Multi-Modal Large Language Modelscited by 2
- 2025Rethinking Test Time Scaling for Flow-Matching Generative Modelscited by 1
- 2026Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysiscited by 1
- 2026(1D) Ordered Tokens Enable Efficient Test-Time Searchcited by 1
- 2025FR-TTS: Test-Time Scaling for NTP-based Image Generation with Effective Filling-based Reward Signalcited by 0
- 2026Depth Adaptive Efficient Visual Autoregressive Modelingcited by 0
- 2026VISTA: Test-Time Compositional Alignment for Visual Autoregressive Generation23 Aug 2026
- 2026MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities28 Jul 2026
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning6 Jun 2026
- 2026Depth Adaptive Efficient Visual Autoregressive Modeling19 Apr 2026
- 2026(1D) Ordered Tokens Enable Efficient Test-Time Search16 Apr 2026
- 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editing24 Feb 2026
- 2026Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis1 Feb 2026
- 2025dMLLM-TTS: Self-Verified and Efficient Test-Time Scaling for Diffusion Multi-Modal Large Language Models22 Dec 2025
- 2025FasterVAR: Plug-and-Play Acceleration for Visual Autoregressive Models18 Dec 2025
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance9 Dec 2025
- 2025FR-TTS: Test-Time Scaling for NTP-based Image Generation with Effective Filling-based Reward Signal29 Nov 2025
- 2025Rethinking Test Time Scaling for Flow-Matching Generative Models27 Nov 2025
- 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editingcited by 7
- 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generationcited by 2
- 2025dMLLM-TTS: Self-Verified and Efficient Test-Time Scaling for Diffusion Multi-Modal Large Language Modelscited by 2
- 2025Rethinking Test Time Scaling for Flow-Matching Generative Modelscited by 1
- 2025FR-TTS: Test-Time Scaling for NTP-based Image Generation with Effective Filling-based Reward Signalcited by 0
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoningcited by 0
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning6 Jun 2026
- 2026From Scale to Speed: Adaptive Test-Time Scaling for Image Editing24 Feb 2026
- 2025dMLLM-TTS: Self-Verified and Efficient Test-Time Scaling for Diffusion Multi-Modal Large Language Models22 Dec 2025
- 2025FR-TTS: Test-Time Scaling for NTP-based Image Generation with Effective Filling-based Reward Signal29 Nov 2025
- 2025Rethinking Test Time Scaling for Flow-Matching Generative Models27 Nov 2025
- 2025Progress by Pieces: Test-Time Scaling for Autoregressive Image Generation26 Nov 2025
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2025ScalingAR: Scaling Confidence for Autoregressive Image Generationcited by 3
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generationcited by 2
- 2025FasterVAR: Plug-and-Play Acceleration for Visual Autoregressive Modelscited by 2
- 2026(1D) Ordered Tokens Enable Efficient Test-Time Searchcited by 1
- 2026Depth Adaptive Efficient Visual Autoregressive Modelingcited by 0
- 2026Depth Adaptive Efficient Visual Autoregressive Modeling19 Apr 2026
- 2026(1D) Ordered Tokens Enable Efficient Test-Time Search16 Apr 2026
- 2025FasterVAR: Plug-and-Play Acceleration for Visual Autoregressive Models18 Dec 2025
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidance9 Dec 2025
- 2025ScalingAR: Scaling Confidence for Autoregressive Image Generation30 Sep 2025
- 2025Exploiting Discriminative Codebook Prior for Autoregressive Image Generation14 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026Inference-Time Scaling for Visual AutoRegressive modeling by Searching Representative Samples
- 2025Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Search
- 2025DiverseVAR: Balancing Diversity and Quality of Next-Scale Visual Autoregressive Models
- 2025Scale-Wise VAR is Secretly Discrete Diffusion
- 2025Video-T1: Test-Time Scaling for Video Generation
- 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruning
- 2025Diversity Has Always Been There in Your Visual Autoregressive Models