mlsanityData to 7 Oct 2026

ProCache: Constraint-Aware Feature Caching with Selective Computation for Diffusion Transformer Acceleration

arXiv 2512.17298 ↗First posted 19 Dec 2025cs.CVcited by 1

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in generative modeling, yet their high computational cost hinders real-time deployment. While feature caching offers a promising training-free acceleration solution by exploiting temporal redundancy, existing methods suffer from two key limitations: (1) uniform caching intervals fail to align with the non-uniform temporal dynamics of DiT, and (2) naive feature reuse with excessively large caching intervals can lead to severe error accumulation. In this work, we analyze the evolution of DiT features during denoising and reveal that both feature changes and error propagation are highly time- and depth-varying. Motivated by this, we propose ProCache, a training-free dynamic feature caching framework that addresses these issues via two core components: (i) a constraint-aware caching pattern search module that generates non-uniform activation schedules through offline constrained sampling, tailored to the model's temporal characteristics; and (ii) a selective computation module that selectively computes within deep blocks and high-importance tokens for cached segments to mitigate error accumulation with minimal overhead. Extensive experiments on PixArt-alpha and DiT demonstrate that ProCache achieves up to 1.96x and 2.90x acceleration with negligible quality degradation, significantly outperforming prior caching-based methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 18 of its 31 references that are in the map. First posted on arXiv 19 Dec 2025.

Builds on

18 of 31 references.

Closest ancestors · 11

Same direction, newest first

  1. 2024SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformers15 Nov
  2. 2024Accelerating Diffusion Transformers with Token-wise Feature Caching5 Oct
  3. 2024DC-Solver: Improving Predictor-Corrector Diffusion Sampler via Dynamic Compensation5 Sep
  4. 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Caching3 Jun
  5. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
  6. 2024HQ-DiT: Efficient Diffusion Transformer with FP4 Hybrid Quantization30 May
  7. 2023Faster Diffusion: Rethinking the Role of the Encoder for Diffusion Model Inference15 Dec
  8. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching6 Dec
  9. 2023Temporal Dynamic Quantization for Diffusion Models4 Jun
  10. 2022Post-training Quantization on Diffusion Models28 Nov
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun

Other references · 7

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  4. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  5. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
  6. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
  7. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 85

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration
  2. 2025Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformers
  3. 2025Accelerating Diffusion Transformer via Gradient-Optimized Cache
  4. 2026BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration
  5. 2025FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation
  6. 2026Forecast the Principal, Stabilize the Residual: Subspace-Aware Feature Caching for Efficient Diffusion Transformers
  7. 2025Compute Only 16 Tokens in One Timestep: Accelerating Diffusion Transformers with Cluster-Driven Feature Caching
  8. 2024Token Caching for Diffusion Transformer Acceleration