mlsanityData to 7 Oct 2026

TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generation

arXiv 2507.18537 ↗First posted 24 Jul 2025cs.CVcited by 15

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

Abstract (arXiv)

Scaling visual generation models is essential for real-world content creation, yet requires substantial training and computational expenses. Alternatively, test-time scaling has garnered growing attention due to resource efficiency and promising performance. In this work, we present TTS-VAR, the first general test-time scaling framework for visual auto-regressive (VAR) models, modeling the generation process as a path searching problem. To dynamically balance computational efficiency with exploration capacity, we first introduce an adaptive descending batch size schedule throughout the causal generation process. Besides, inspired by VAR's hierarchical coarse-to-fine multi-scale generation, our framework integrates two key components: (i) At coarse scales, we observe that generated tokens are hard for evaluation, possibly leading to erroneous acceptance of inferior samples or rejection of superior samples. Noticing that the coarse scales contain sufficient structural information, we propose clustering-based diversity search. It preserves structural variety through semantic feature clustering, enabling later selection on samples with higher potential. (ii) In fine scales, resampling-based potential selection prioritizes promising candidates using potential scores, which are defined as reward functions incorporating multi-scale generation history. Experiments on the powerful VAR model Infinity show a notable 8.7% GenEval score improvement (from 0.69 to 0.75). Key insights reveal that early-stage structural features effectively influence final quality, and resampling efficacy varies across generation scales. Code is available at https://github.com/ali-vilab/TTS-VAR.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 59 of its 67 references that are in the map. First posted on arXiv 24 Jul 2025.

Builds on

59 of 67 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
  2. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps16 Jan
  3. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan

Other references · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2024The Llama 3 Herd of Modelscited by 14,192
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  10. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  12. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
38 more
  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  12. 2023Consistency Modelscited by 1,778
  13. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  14. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  15. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  16. 2023Training Diffusion Models with Reinforcement Learningcited by 939
  17. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  18. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
  19. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  20. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  21. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  22. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  23. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 760
  24. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  25. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  26. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  27. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  28. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  29. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  30. 2023CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Servingcited by 199
  31. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  32. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 162
  33. 2022RL with KL penalties is better viewed as Bayesian inferencecited by 130
  34. 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
  35. 2024Image and Video Tokenization with Binary Spherical Quantizationcited by 110
  36. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
  37. 2024Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumptioncited by 96
  38. 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 82

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 7.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Inference-Time Scaling for Visual AutoRegressive modeling by Searching Representative Samples
  2. 2025Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling
  3. 2025Scaling Image and Video Generation via Test-Time Evolutionary Search
  4. 2025DiverseVAR: Balancing Diversity and Quality of Next-Scale Visual Autoregressive Models
  5. 2025Scale-Wise VAR is Secretly Discrete Diffusion
  6. 2025Video-T1: Test-Time Scaling for Video Generation
  7. 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruning
  8. 2025Diversity Has Always Been There in Your Visual Autoregressive Models