mlsanityData to 7 Oct 2026

KV Cache Quantization for Self-Forcing Video Generation: A 33-Method Empirical Study

arXiv 2603.27469 ↗First posted 29 Mar 2026cs.LG cs.AIcited by 2

On the map: Efficient LLM inference and serving → Fast autoregressive visual generation

Abstract (arXiv)

Self-forcing video generation extends a short-horizon video model to longer rollouts by repeatedly feeding generated content back in as context. This scaling path immediately exposes a systems bottleneck: the key-value (KV) cache grows with rollout length, so longer videos require not only better generation quality but also substantially better memory behavior. We present a comprehensive empirical study of KV-cache compression for self-forcing video generation on a Wan2.1-based Self-Forcing stack. Our study covers 33 quantization and cache-policy variants, 610 prompt-level observations, and 63 benchmark-level summaries across two evaluation settings: MovieGen for single-shot 10-second generation and StoryEval for longer narrative-style stability. We jointly evaluate peak VRAM, runtime, realized compression ratio, VBench imaging quality, BF16-referenced fidelity (SSIM, LPIPS, PSNR), and terminal drift. Three findings are robust. First, the strongest practical operating region is a FlowCache-inspired soft-prune INT4 adaptation, which reaches 5.42-5.49x compression while reducing peak VRAM from 19.28 GB to about 11.7 GB with only modest runtime overhead. Second, the highest-fidelity compressed methods, especially PRQ_INT4 and QUAROT_KV_INT4, are not the best deployment choices because they preserve quality at severe runtime or memory cost. Third, nominal compression alone is not sufficient: several methods shrink KV storage but still exceed BF16 peak VRAM because the current integration reconstructs or retains large BF16 buffers during attention and refresh stages. The result is a benchmark harness, analysis workflow, and empirical map of which KV-cache ideas are practical today and which are promising research directions for better memory integration. Code, data products, and the presentation dashboard are available at https://github.com/suraj-ranganath/kv-quant-longhorizon/.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Fast autoregressive visual generation, one of 12 directions in Efficient LLM inference and serving. Builds on 11 of its 11 references that are in the map. First posted on arXiv 29 Mar 2026.

Builds on

11 of 11 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantization3 Feb

Other references · 10

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  4. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  5. 2024KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cachecited by 604
  6. 2024QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMscited by 598
  7. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  8. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  9. 2026Flow caching for autoregressive video generationcited by 19
  10. 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoisingcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Pyramid Forcing: Head-Aware Pyramid KV Cache Policy for High-Quality Long Video Generation
  2. 2026Future Forcing: Future-aware Training-free KV Cache Policy for Autoregressive Video Generation
  3. 2026In-Distribution Forcing for Long Video Generation at Test Time
  4. 2026Past- and Future-Informed KV Cache Policy with Salience Estimation in Autoregressive Video Diffusion
  5. 2026QuantWM: Temporally Consistent 2-Bit KV Cache Quantization for World Models and Video Generation
  6. 2025BIFE: Better Interaction, Fewer Errors for Minute-Long Video Generation
  7. 2026DensityKV: Density-Guided KV Cache Compression for Long Video Generation
  8. 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generation