Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion Transformers have established a new state-of-the-art in image synthesis, but the high computational cost of iterative sampling severely hampers their practical deployment. While existing acceleration methods often focus on the temporal domain, they overlook the substantial spatial redundancy inherent in the generative process, where global structures emerge long before fine-grained details are formed. The uniform computational treatment of all spatial regions represents a critical inefficiency. In this paper, we introduce Just-in-Time (JiT), a novel training-free framework that addresses this challenge by acceleration in the spatial domain. JiT formulates a spatially approximated generative ordinary differential equation (ODE) that drives the full latent state evolution based on computations from a dynamically selected, sparse subset of anchor tokens. To ensure seamless transitions as new tokens are incorporated to expand the dimensions of the latent state, we propose a deterministic micro-flow, a simple and effective finite-time ODE that maintains both structural coherence and statistical correctness. Extensive experiments on the state-of-the-art FLUX.1-dev model demonstrate that JiT achieves up to a 7x speedup with nearly lossless performance, significantly outperforming existing acceleration methods and establishing a new and superior trade-off between inference speed and generation fidelity.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 45 of its 51 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
45 of 51 references.
Closest ancestors · 26
Same direction, newest first
- 2025Learnable Sampler Distillation for Discrete Diffusion Models24 Sep
- 2025QVGen: Pushing the Limit of Quantized Video Generative Models16 May
- 2025Autoregressive Distillation of Diffusion Transformers15 Apr
- 2025PCM : Picard Consistency Model for Fast Parallel Sampling of Diffusion Models25 Mar
- 2025Training-free Diffusion Acceleration with Bottleneck Sampling24 Mar
- 2025BlockDance: Reuse Structurally Similar Spatio-Temporal Features to Accelerate Diffusion Transformers20 Mar
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers10 Mar
- 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matching9 Mar
- 2024Schedule On the Fly: Diffusion Time Prediction for Faster and Better Image Generation2 Dec
- 2024SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models7 Nov
- 2024Accelerating Diffusion Transformers with Token-wise Feature Caching5 Oct
- 2024Beta Sampling is All You Need: Efficient Image Generation Strategy for Diffusion Models using Stepwise Spectral Analysis16 Jul
14 more
- 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
- 2024Accelerating Diffusion Sampling with Optimized Time Steps27 Feb
- 2024The Surprising Effectiveness of Skip-Tuning in Diffusion Sampling23 Feb
- 2024QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning6 Feb
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Dimensionality-Varying Diffusion Process29 Nov
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Subspace Diffusion Generative Models3 May
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 19
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
7 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
- 2024Flow Matching Guide and Codecited by 291
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
- 2025Training-Free Efficient Video Generation via Dynamic Token Carvingcited by 33
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Image Restoration via Diffusion Models with Dynamic Resolutioncited by 2
- 2026Tracing the Oracle: Improving Diffusion Timestep Scheduling for 3D CT Reconstructioncited by 0
- 2026Beyond Token-Level Cross-Entropy: Fr'echet Distributional Post-Training for Autoregressive Image Generationcited by 0
- 2026ReAL: Accelerating Flow Matching through Segment Advancement with Shared Lookaheadcited by 0
- 2026ReAL: Accelerating Flow Matching through Segment Advancement with Shared Lookahead27 Sep 2026
- 2026Beyond Token-Level Cross-Entropy: Fr'echet Distributional Post-Training for Autoregressive Image Generation1 Aug 2026
- 2026Tracing the Oracle: Improving Diffusion Timestep Scheduling for 3D CT Reconstruction4 Jun 2026
- 2026Image Restoration via Diffusion Models with Dynamic Resolution14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers
- 2025DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion
- 2024Accelerated Image-Aware Generative Diffusion Modeling
- 2026PDE-SSM: A Spectral State Space Approach to Spatial Mixing in Diffusion Transformers
- 2024Dynamic Diffusion Transformer
- 2025Training-free Mixed-Resolution Latent Upsampling for Spatially Accelerated Diffusion Transformers
- 2026From Sketch to Fresco: Efficient Diffusion Transformer with Progressive Resolution
- 2025DyDiT++: Diffusion Transformers with Timestep and Spatial Dynamics for Efficient Visual Generation