mlsanityData to 7 Oct 2026

FastSTAR: Spatiotemporal Token Pruning for Efficient Autoregressive Video Synthesis

arXiv 2603.07192 ↗First posted 7 Mar 2026cs.CVcited by 2

On the map: Efficient LLM inference and serving → Fast autoregressive visual generation

Abstract (arXiv)

Visual Autoregressive modeling (VAR) has emerged as a highly efficient alternative to diffusion-based frameworks, achieving comparable synthesis quality. However, as this paradigm extends to Spacetime Autoregressive modeling (STAR) for video generation, scaling resolution and frame counts leads to a "token explosion" that creates a massive computational bottleneck in the final refinement stages. To address this, we propose FastSTAR, a training-free acceleration framework designed for high-quality video generation. Our core method, Spatiotemporal Token Pruning, identifies essential tokens by integrating two specialized terms: (1) Spatial similarity, which evaluates structural convergence across hierarchical scales to skip computations in regions where further refinement becomes redundant, and (2) Temporal similarity, which identifies active motion trajectories by assessing feature-level variations relative to the preceding clip. Combined with a Partial Update mechanism, FastSTAR ensures that only non-converged regions are refined, maintaining fluid motion while bypassing redundant computations. Experimental results on InfinityStar demonstrate that FastSTAR achieves up to a 2.01x speedup with a PSNR of 28.29 and less than 1% performance degradation, proving a superior efficiency-quality trade-off for STAR-based video synthesis.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Fast autoregressive visual generation, one of 12 directions in Efficient LLM inference and serving. Builds on 39 of its 45 references that are in the map. First posted on arXiv 7 Mar 2026.

Builds on

39 of 45 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026PackCache: A Training-Free Acceleration Method for Unified Autoregressive Video Generation via Compact KV-Cache7 Jan
  2. 2025Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compression26 May
  3. 2025FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruning30 Mar
  4. 2025Fast Autoregressive Video Generation with Diagonal Decoding18 Mar

Other references · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  7. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  8. 2022Token Merging: Your ViT But Fastercited by 995
  9. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  10. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  11. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  12. 2022MAGVIT: Masked Generative Video Transformercited by 341
23 more
  1. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
  2. 2024Infinity: Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesiscited by 297
  3. 2023Token Merging for Fast Stable Diffusioncited by 220
  4. 2024Autoregressive Video Generation without Vector Quantizationcited by 180
  5. 2024Accelerating Diffusion Transformers with Token-wise Feature Cachingcited by 143
  6. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
  7. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
  8. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
  9. 2024AnimateDiff-Lightning: Cross-Model Diffusion Distillationcited by 47
  10. 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 43
  11. 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Cachingcited by 39
  12. 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 38
  13. 2024Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficientcited by 32
  14. 2024Token Pruning for Caching Better: 9 Times Acceleration on Stable Diffusion for Freecited by 30
  15. 2025Lumos-1: On Autoregressive Video Generation with Discrete Diffusion from a Unified Model Perspectivecited by 22
  16. 2025ToMA: Token Merge with Attention for Diffusion Modelscited by 17
  17. 2025Attend to Not Attended: Structure-then-Detail Token Merging for Post-training DiT Accelerationcited by 16
  18. 2024AsymRnR: Video Diffusion Transformers Acceleration with Asymmetric Reduction and Restorationcited by 15
  19. 2025Frequency-Aware Autoregressive Modeling for Efficient High-Resolution Image Synthesiscited by 15
  20. 2025SkipVAR: Accelerating Visual Autoregressive Modeling via Adaptive Frequency-Aware Skippingcited by 11
  21. 2023F3-Pruning: A Training-Free and Generalized Pruning Strategy towards Faster and Finer Text-to-Video Synthesiscited by 9
  22. 2025Autoregressive Video Generation beyond Next Frames Predictioncited by 4
  23. 2025FasterVAR: Plug-and-Play Acceleration for Visual Autoregressive Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VideoAR: Autoregressive Video Generation via Next-Frame & Scale Prediction
  2. 2025StarGen: A Spatiotemporal Autoregression Framework with Video Diffusion Model for Scalable and Controllable Scene Generation
  3. 2025VideoSSM: Autoregressive Long Video Generation with Hybrid State-Space Memory
  4. 2025Long-Context Autoregressive Video Modeling with Next-Frame Prediction
  5. 2025VideoMAR: Autoregressive Video Generatio with Continuous Tokens
  6. 2026TokenTrim: Inference-Time Token Pruning for Autoregressive Long Video Generation
  7. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  8. 2024Lumiere: A Space-Time Diffusion Model for Video Generation