mlsanityData to 7 Oct 2026

MagCache: Fast Video Generation with Magnitude-Aware Cache

arXiv 2506.09045 ↗First posted 10 Jun 2025cs.CVcited by 36

On the map: Diffusion models → Video generation

Abstract (arXiv)

Existing acceleration techniques for video diffusion models often rely on uniform heuristics or time-embedding variants to skip timesteps and reuse cached features. These approaches typically require extensive calibration with curated prompts and risk inconsistent outputs due to prompt-specific overfitting. In this paper, we introduce a novel and robust discovery: a unified magnitude law observed across different models and prompts. Specifically, the magnitude ratio of successive residual outputs decreases monotonically, steadily in most timesteps while rapidly in the last several steps. Leveraging this insight, we introduce a Magnitude-aware Cache (MagCache) that adaptively skips unimportant timesteps using an error modeling mechanism and adaptive caching strategy. Unlike existing methods requiring dozens of curated samples for calibration, MagCache only requires a single sample for calibration. Experimental results show that MagCache achieves 2.10x-2.68x speedups on Open-Sora, CogVideoX, Wan 2.1, and HunyuanVideo, while preserving superior visual fidelity. It significantly outperforms existing methods in LPIPS, SSIM, and PSNR, under similar computational budgets.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 66 of its 81 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

66 of 81 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025Training-free and Adaptive Sparse Attention for Efficient Long Video Generation28 Feb
  2. 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity3 Feb
  3. 2024VideoMaker: Zero-shot Customized Video Generation with the Inherent Force of Video Diffusion Models27 Dec
  4. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
  5. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformers4 Nov
  6. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality25 Oct
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  8. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  9. 2023VideoLCM: Video Latent Consistency Model14 Dec
  10. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  12. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
2 more
  1. 2023ModelScope Text-to-Video Technical Report12 Aug
  2. 2022Video Diffusion Models7 Apr

Other references · 52

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2022Flow Matching for Generative Modelingcited by 5,426
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
38 more
  1. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  4. 2023Consistency Modelscited by 1,778
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  6. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
  7. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  8. 2023Adversarial Diffusion Distillationcited by 741
  9. 2022On Distillation of Guided Diffusion Modelscited by 721
  10. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  11. 2022Post-training Quantization on Diffusion Modelscited by 262
  12. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  13. 2023Token Merging for Fast Stable Diffusioncited by 220
  14. 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 218
  15. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 169
  16. 2023PTQD: Accurate Post-Training Quantization for Diffusion Modelscited by 167
  17. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Cachingcited by 149
  18. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
  19. 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 138
  20. 2024FORA: Fast-Forward Caching in Diffusion Transformer Accelerationcited by 127
  21. 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 124
  22. 2023Parallel Sampling of Diffusion Modelscited by 112
  23. 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 91
  24. 2023Temporal Dynamic Quantization for Diffusion Modelscited by 81
  25. 2023Language Model Self-improvement by Reinforcement Learning Contemplationcited by 75
  26. 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Accelerationcited by 70
  27. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
  28. 2017DeepCache: Principled Cache for Mobile Deep Visioncited by 57
  29. 2024LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Modelscited by 52
  30. 2023Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMscited by 47
  31. 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 42
  32. 2024Attention-Driven Training-Free Efficiency Enhancement of Diffusion Modelscited by 37
  33. 2024ShortcutsBench: A Large-Scale Real-world Benchmark for API-based Agentscited by 36
  34. 2024Rethinking Token-wise Feature Caching: Accelerating Diffusion Transformers with Dual Feature Cachingcited by 26
  35. 2023Denoising Diffusion Step-aware Modelscited by 24
  36. 2023FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Modelscited by 19
  37. 2024LocLLM: Exploiting Generalizable Human Keypoint Localization via Large Language Modelcited by 17
  38. 2024SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Modelcited by 13

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 9; 2026: 27.

36 papers.

Sort:

By area:

  1. 2026Helios: Real Real-Time Long Video Generation Modelcited by 56
  2. 2025DeCo: Frequency-Decoupled Pixel Diffusion for End-to-End Image Generationcited by 55
  3. 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 14
  4. 2026SeaCache: Spectral-Evolution-Aware Cache for Accelerating Diffusion Modelscited by 10
  5. 2026SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routingcited by 9
  6. 2025TaoCache: Structure-Maintained Video Generation Accelerationcited by 8
  7. 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 8
  8. 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Cachingcited by 6
  9. 2026Efficient Video Diffusion Models: Advancements and Challengescited by 6
  10. 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
  11. 2026DisCa: Accelerating Video Diffusion Transformers with Distillation-Compatible Learnable Feature Cachingcited by 4
  12. 2025Adaptive Hybrid Caching for Efficient Text-to-Video Diffusion Model Accelerationcited by 2
24 more
  1. 2026CHAI: CacHe Attention Inference for text2videocited by 2
  2. 2026Jano: Adaptive Diffusion Generation with Early-stage Convergence Awarenesscited by 2
  3. 2026Accelerating Rectified Flow Models via Trajectory-Aware Cachingcited by 2
  4. 2026Budget-Constrained Step-Level Diffusion Cachingcited by 2
  5. 2026NaviCache: Test-Time Self-Calibration Caching for Video Generationcited by 2
  6. 2025Predictive Feature Caching for Training-free Acceleration of Molecular Geometry Generationcited by 1
  7. 2025Phase-Aligned RoPE for Mixed-Resolution Diffusion Transformercited by 1
  8. 2026FIS-DiT: Breaking the Few-Step Video Inference Barrier via Training-Free Frame Interleaved Sparsitycited by 1
  9. 2026PixelWizard: Towards Efficient High-Fidelity Video Generation at Ultra-Large Spatial Resolutioncited by 1
  10. 2026Chorus II: Cross-Request Sparsity Reuse for Efficient Image-to-Video Generationcited by 1
  11. 2026BAG: Budget-Aware Gating for Diffusion Cachingcited by 1
  12. 2026EpaCache: Error-Propagation-Aware Caching for Accelerating Diffusion-Based Visual Generationcited by 1
  13. 2025ETC: training-free diffusion models acceleration with Error-aware Trend Consistencycited by 0
  14. 2025InvarDiff: Cross-Scale Invariance Caching for Accelerated Diffusion Modelscited by 0
  15. 2026LayerCache: Exploiting Layer-wise Velocity Heterogeneity for Efficient Flow Matching Inferencecited by 0
  16. 2026Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generationcited by 0
  17. 2026AtlasVid: Efficient Ultra-High-Resolution Long Video Generation via Decoupled Global-Local Modelingcited by 0
  18. 2026SyncCache: Exploiting Asymmetric Dynamics for Fast Audio-Driven Portrait Animationcited by 0
  19. 2026FeatFix: Reuse What You Verify through Local Exact-Feature Correction for Faster Cached Diffusion Inferencecited by 0
  20. 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transportcited by 0
  21. 2026Magnitude-Direction Decoupling for Fast Video Generation with Flow Matching Modelscited by 0
  22. 2026GeoShrink: Accelerating Diffusion Transformers with Two Lines of Codecited by 0
  23. 2026CAST: Reconstruction-Coupled Acceleration of Interactive World Modelscited by 0
  24. 2026RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidancecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Caching
  2. 2026ACID: Adaptive Caching for vIDeo generation
  3. 2026From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
  4. 2024FlexCache: Flexible Approximate Cache System for Video Diffusion
  5. 2025BWCache: Accelerating Video Diffusion Transformers through Block-Wise Caching
  6. 2025LightCache: Memory-Efficient, Training-Free Acceleration for Video Generation
  7. 2026Past- and Future-Informed KV Cache Policy with Salience Estimation in Autoregressive Video Diffusion
  8. 2026MORCA: Offline-to-Online Reinforcement Learning for Adaptive Cache Reuse in Video Diffusion Acceleration