mlsanityData to 14 Oct 2026

GeoShrink: Accelerating Diffusion Transformers with Two Lines of Code

arXiv 2609.33723 ↗First posted 27 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Flow matching, time series and science also fits: Diffusion foundations and sampling

Abstract (arXiv)

Diffusion transformers incur substantial inference cost through repeated model evaluations along a sampling trajectory. We introduce GeoShrink, a training-free acceleration method that retains the original solver grid while evaluating the model only at a prescribed set of anchors. At skipped stages, GeoShrink predicts the solver-facing output by adding a geometrically retained fraction of the latest observed innovation to the most recent exact output. We derive this rule from chordal tangent transport and round-trip line projection, and establish a geometric anchor-spacing principle that minimizes the largest adjacent gap expansion under fixed coverage and first span. The analysis characterizes the geometric closure and propagation of prediction errors without assuming access to future model outputs. Experiments cover image, video, motion, and audio generation, together with adapted 3D backends. At approximately 5× acceleration, GeoShrink improves FLUX PSNR by 3.10 dB over the strongest listed baseline. On HunyuanVideo, it achieves a reported 4.99× speedup and improves ChronoMagic-Bench-150 PSNR by 5.44 dB over the strongest listed fidelity baseline. Comparisons at fixed evaluation budgets further show substantial gains on motion, audio, music, and 3D generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 65 of its 74 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

65 of 74 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 64

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  8. 2022Scalable Diffusion Models with Transformerscited by 6,054
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  11. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  12. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
38 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  5. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  6. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  7. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  9. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  10. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
  11. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  12. 2022Fast Sampling of Diffusion Models with Exponential Integratorcited by 532
  13. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 502
  14. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  15. 2023MusicLM: Generating Music From Textcited by 448
  16. 2018SDR - half-baked or well done?cited by 423
  17. 2023DeepCache: Accelerating Diffusion Models for Freecited by 359
  18. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  19. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 340
  20. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
  21. 2023TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesiscited by 198
  22. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformerscited by 175
  23. 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statisticscited by 161
  24. 2024Accelerating Diffusion Transformers with Token-wise Feature Cachingcited by 156
  25. 2024Learning-to-Cache: Accelerating Diffusion Transformer via Layer Cachingcited by 142
  26. 2024FORA: Fast-Forward Caching in Diffusion Transformer Accelerationcited by 137
  27. 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeerscited by 136
  28. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 122
  29. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 108
  30. 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 96
  31. 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 75
  32. 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Modelscited by 72
  33. 2024TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimizationcited by 68
  34. 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 57
  35. 2025ACE-Step: A Step Towards Music Generation Foundation Modelcited by 56
  36. 2025Less is Enough: Training-Free Video Diffusion Acceleration via Runtime-Adaptive Cachingcited by 45
  37. 2025MagCache: Fast Video Generation with Magnitude-Aware Cachecited by 41
  38. 2025HY-Motion 1.0: Scaling Flow Matching Models for Text-To-Motion Generationcited by 36

50 most cited of 64 All 64 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DiffSparse: Accelerating Diffusion Transformers with Learned Token Sparsity
  2. 2026ChebBooster: A Training-Free Approach for Efficient Diffusion Transformer Inference via Chebyshev-Inspired Extrapolation
  3. 2025Chipmunk: Training-Free Acceleration of Diffusion Transformers with Dynamic Column-Sparse Deltas
  4. 2025DiffPro: Joint Timestep and Layer-Wise Precision Optimization for Efficient Diffusion Inference
  5. 2026Just-in-Time: Training-Free Spatial Acceleration for Diffusion Transformers
  6. 2025CHORDS: Diffusion Sampling Accelerator with Multi-core Hierarchical ODE Solvers
  7. 2026BeCARE: Budgeted Cache Refresh for Diffusion Transformer Acceleration
  8. 2026GeoSPRINT: Geometric Redundancy-Aware Step Pruning for Inference in Diffusion Trajectories