Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis
On the map: Efficient LLM inference and serving → Fast autoregressive visual generation
Abstract (arXiv)
Visual AutoRegressive modeling (VAR) suffers from substantial computational cost due to the massive token count involved. Failing to account for the continuous evolution of modeling dynamics, existing VAR token reduction methods face three key limitations: heuristic stage partition, non-adaptive schedules, and limited acceleration scope, thereby leaving significant acceleration potential untapped. Since entropy variation intrinsically reflects the transition of predictive uncertainty, it offers a principled measure to capture modeling dynamics evolution. Therefore, we propose NOVA, a training-free token reduction acceleration framework for VAR models via entropy analysis. NOVA adaptively determines the acceleration activation scale during inference by online identifying the inflection point of scale entropy growth. Through scale-linkage and layer-linkage ratio adjustment, NOVA dynamically computes distinct token reduction ratios for each scale and layer, pruning low-entropy tokens while reusing the cache derived from the residuals at the prior scale to accelerate inference and maintain generation quality. Extensive experiments and analyses validate NOVA as a simple yet effective training-free acceleration framework.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Fast autoregressive visual generation, one of 12 directions in Efficient LLM inference and serving. Builds on 42 of its 53 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
42 of 53 references.
Closest ancestors · 3
Same direction, newest first
- 2025Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compression26 May
- 2025Head-Aware KV Cache Compression for Efficient Visual Autoregressive Modeling12 Apr
- 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruning30 Mar
Other references · 39
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
- 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 249
- 2022A Survey on Generative Diffusion Modelcited by 238
- 2024HART: Efficient Visual Generation with Hybrid Autoregressive Transformercited by 128
- 2025Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmaskingcited by 128
- 2024ControlVAR: Exploring Controllable Visual Autoregressive Modelingcited by 58
27 more
- 2024VAR-CLIP: Text-to-Image Generator with Visual Auto-Regressive Modelingcited by 42
- 2025Visual Autoregressive Modeling for Image Super-Resolutioncited by 36
- 2025Efficient Diffusion Models: A Surveycited by 35
- 2024Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficientcited by 32
- 2025Neighboring Autoregressive Modeling for Efficient Visual Generationcited by 29
- 2024STAR: Scale-wise Text-conditioned AutoRegressive image generationcited by 28
- 2024M-VAR: Decoupled Scale-wise Autoregressive Modeling for High-Quality Image Generationcited by 28
- 2025FlexVAR: Flexible Visual Autoregressive Modeling without Residual Predictioncited by 22
- 2025Training-Free Text-Guided Image Editing with Visual Autoregressive Modelcited by 21
- 2023Exploiting Multi-Label Correlation in Label Distribution Learningcited by 20
- 2025HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generationcited by 19
- 2024SeBot: Structural Entropy Guided Multi-View Contrastive Learning for Social Bot Detectioncited by 16
- 2024LiteVAR: Compressing Visual Autoregressive Modelling with Efficient Attention and Quantizationcited by 16
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
- 2025TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generationcited by 15
- 2025Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesiscited by 15
- 2025DemoSpeedup: Accelerating Visuomotor Policies via Entropy-Guided Demonstration Accelerationcited by 13
- 2025SkipVAR: Accelerating Visual Autoregressive Modeling via Adaptive Frequency-Aware Skippingcited by 11
- 2025SpectralAR: Spectral Autoregressive Visual Generationcited by 11
- 2022Improving the Trainability of Deep Neural Networks through Layerwise Batch-Entropy Regularizationcited by 7
- 2026Positive-Unlabeled Reinforcement Learning Distillation for On-Premise Small Modelscited by 4
- 2023Entropy-based Guidance of Deep Neural Networks for Accelerated Convergence and Improved Performancecited by 3
- 2025Scale-Wise VAR is Secretly Discrete Diffusioncited by 2
- 2025Markovian Scale Prediction: A New Era of Visual Autoregressive Generationcited by 2
- 2025Dynamic Mixture-of-Experts for Visual Autoregressive Modelcited by 1
- 2025ActVAR: Activating Mixtures of Weights and Tokens for Efficient Visual Autoregressive Generationcited by 1
- 2025Efficient Training for Human Video Generation with Entropy-Guided Prioritized Progressive Learningcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Inference-Time Scaling for Visual AutoRegressive modeling by Searching Representative Samples
- 2025ScalingAR: Scaling Confidence for Autoregressive Image Generation
- 2026HACK++: Towards More Effective Head-Aware Key-Value Compression for Efficient Visual Autoregressive Modeling
- 2025Multi-scale Autoregressive Models are Laplacian, Discrete, and Latent Diffusion Models in Disguise
- 2025LSRS: Latent Scale Rejection Sampling for Visual Autoregressive Modeling
- 2025Diversity Has Always Been There in Your Visual Autoregressive Models
- 2026Drift-AR: Single-Step Visual Autoregressive Generation via Anti-Symmetric Drifting
- 2026Visual Implicit Autoregressive Modeling