GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code
On the map: Diffusion models → Flow matching, time series and science also fits: Diffusion foundations and sampling
Abstract (arXiv)
Diffusion transformers incur substantial inference cost through repeated model evaluations along a sampling trajectory. We introduce GeoShrink, a training-free acceleration method that retains the original solver grid while evaluating the model only at a prescribed set of anchors. At skipped stages, GeoShrink predicts the solver-facing output by adding a geometrically retained fraction of the latest observed innovation to the most recent exact output. We derive this rule from chordal tangent transport and round-trip line projection, and establish a geometric anchor-spacing principle that minimizes the largest adjacent gap expansion under fixed coverage and first span. The analysis characterizes the geometric closure and propagation of prediction errors without assuming access to future model outputs. Experiments cover image, video, motion, and audio generation, together with adapted 3D backends. At approximately 5× acceleration, GeoShrink improves FLUX PSNR by 3.10 dB over the strongest listed baseline. On HunyuanVideo, it achieves a reported 4.99× speedup and improves ChronoMagic-Bench-150 PSNR by 5.44 dB over the strongest listed fidelity baseline. Comparisons at fixed evaluation budgets further show substantial gains on motion, audio, music, and 3D generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 65 of its 74 references that are in the map. First posted on arXiv 27 Sep 2026.
Builds on
65 of 74 references.
Closest ancestors · 1
Same direction, newest first
Other references · 64
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
38 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
- 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
- 2023MusicLM: Generating Music From Textcited by 448
- 2018SDR - half-baked or well done?cited by 423
- 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 340
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
- 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 175
- 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statisticscited by 161
- 2024Accelerating Diffusion Transformers with Token-wise Feature Cachingcited by 156
- 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 142
- 2024FORA: Fast-Forward Caching in Diffusion Transformer Accelerationcited by 137
- 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 136
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
- 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 96
- 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 75
- 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Modelscited by 72
- 2024TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimizationcited by 68
- 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 57
- 2025ACE-Step: A Step Towards Music Generation Foundation Modelcited by 56
- 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Cachingcited by 45
- 2025MagCache: Fast Video Generation with Magnitude-Aware Cachecited by 41
- 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36
50 most cited of 64 All 64 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DiffSparse: Accelerating Diffusion Transformers with Learned Token Sparsity
- 2026ChebBooster: A Training-Free Approach for Efficient Diffusion Transformer Inference via Chebyshev-Inspired Extrapolation
- 2025Chipmunk: Training-Free Acceleration of Diffusion Transformers with Dynamic Column-Sparse Deltas
- 2025DiffPro: Joint Timestep and Layer-Wise Precision Optimization for Efficient Diffusion Inference
- 2026Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers
- 2025CHORDS: Diffusion Sampling Accelerator with Multi-core Hierarchical ODE Solvers
- 2026BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration
- 2026GeoSPRINT: Geometric Redundancy-Aware Step Pruning for Inference in Diffusion Trajectories