mlsanityData to 14 Oct 2026

Model Reveals What to Cache: Profiling-Based Feature Reuse for Video Diffusion Models

arXiv 2504.03140 ↗First posted 4 Apr 2025cs.CVcited by 15

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent advances in diffusion models have demonstrated remarkable capabilities in video generation. However, the computational intensity remains a significant challenge for practical applications. While feature caching has been proposed to reduce the computational burden of diffusion models, existing methods typically overlook the heterogeneous significance of individual blocks, resulting in suboptimal reuse and degraded output quality. To this end, we address this gap by introducing ProfilingDiT, a novel adaptive caching strategy that explicitly disentangles foreground and background-focused blocks. Through a systematic analysis of attention distributions in diffusion models, we reveal a key observation: 1) Most layers exhibit a consistent preference for either foreground or background regions. 2) Predicted noise shows low inter-step similarity initially, which stabilizes as denoising progresses. This finding inspires us to formulate a selective caching strategy that preserves full computation for dynamic foreground elements while efficiently caching static background features. Our approach substantially reduces computational overhead while preserving visual fidelity. Extensive experiments demonstrate that our framework achieves significant acceleration (e.g., 2.01 times speedup for Wan2.1) while maintaining visual fidelity across comprehensive quality metrics, establishing a viable method for efficient video generation.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 37 of its 46 references that are in the map. First posted on arXiv 4 Apr 2025.

Builds on

37 of 46 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Goku: Flow Based Video Generative Foundation Models7 Feb
  2. 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation6 Feb
  3. 2025Diffusion Adversarial Post-Training for One-Step Video Generation14 Jan
  4. 2024DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses30 Nov
  5. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model28 Nov
  6. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformers4 Nov
  7. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality25 Oct
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  9. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence23 Jul
  10. 2024LoopAnimate: Loopable Salient Object Animation14 Apr

Other references · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  11. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  12. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
15 more
  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  2. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  3. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  4. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  5. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 175
  6. 2024Accelerating Diffusion Transformers with Token-wise Feature Cachingcited by 156
  7. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
  8. 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformerscited by 94
  9. 2023Animate-A-Story: Storytelling with Retrieval-Augmented Video Generationcited by 90
  10. 2024Faster Diffusion via Temporal Attention Decompositioncited by 54
  11. 2025LightGen: Efficient Image Generation through Knowledge Distillation and Direct Preference Optimizationcited by 20
  12. 2024FancyVideo: Towards Dynamic and Consistent Video Generation via Cross-frame Textual Guidancecited by 15
  13. 2025Temporal Regularization Makes Your Video Generator Strongercited by 10
  14. 2024Virbo: Multimodal Multilingual Avatar Video Generation in Digital Marketingcited by 4
  15. 2024MYCloth: Towards Intelligent and Interactive Online T-Shirt Customization based on User's Preferencecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 9.

15 papers.

Sort:

By area:

  1. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  2. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
  3. 2025ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichmentcited by 27
  4. 2025A Survey on Cache Methods in Diffusion Models: Toward Efficient Multi-Modal Generationcited by 16
  5. 2025ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusioncited by 12
  6. 2025BWCache: Accelerating Video Diffusion Transformers through Block-Wise Cachingcited by 11
  7. 2026Predict to Skip: Linear Multistep Feature Forecasting for Efficient Diffusion Transformerscited by 2
  8. 2026Not All Tokens Need 40 Steps: Heterogeneous Step Allocation in Diffusion Transformers for Efficient Video Generationcited by 1
  9. 2026FIS-DiT: Breaking the Few-Step Video Inference Barrier via Training-Free Frame Interleaved Sparsitycited by 1
  10. 2026OTCache: Optimal Transport for Geometry-Aware Caching in Diffusion Modelscited by 1
  11. 2026HyperVAttention: Efficient Sparse Attention with Spatio-Temporal Clustering for Video Diffusioncited by 1
  12. 2026RT-Lynx: Putting GEMM Sparsity in the Right Place for Diffusion Modelscited by 0
3 more
  1. 2026LCG: Long-Context Consistent Image Generation with Sparse Relational Attentioncited by 0
  2. 2026From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusioncited by 0
  3. 2026Rethinking What to Cache in Few-Step Diffusion Transformers: Solver-Aware Target Selectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models
  2. 2026Heuristics are Not Enough: Calibrated and Corrected Caching for Video Diffusion Acceleration
  3. 2026LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Caching
  4. 2026ACID: Adaptive Caching for vIDeo generation
  5. 2026WorldCache: Content-Aware Caching for Accelerated Video World Models
  6. 2025AB-Cache: Training-Free Acceleration of Diffusion Models via Adams-Bashforth Cached Feature Reuse
  7. 2026SenCache: Accelerating Diffusion Model Inference via Sensitivity-Aware Caching
  8. 2026ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE