Spatial Transport of Integration Error in Generative ODEs
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
A trained flow or diffusion model is usually run with only a handful of solver steps, and the integration error this leaves behind is unevenly distributed across the image. We ask where that error is injected and how it reaches the endpoint, and answer with a signed source-and-transport accounting of few-step integration error, tested to first order. A perturbation experiment on five models at 256^2 resolution shows the learned dynamics spread local disturbances widely: near the start of sampling, under 10% of the summed endpoint response remains at the source. Signed one-step truncation residuals, propagated through the model's own linearized dynamics, reconstruct much of the endpoint error's direction and regional structure (cosine 0.81-0.87), and a region's error owes more to what arrives from elsewhere than to its own injection. Structure-destroying nulls, with protocols frozen before evaluation, locate what carries the account: randomizing contribution signs halves it, and reassigning which region receives each contribution, with content, norms, and signs intact, destroys it entirely. Where the injections land is readable from the model itself. The variation of its velocity or prediction field along the trajectory, a structure that emerges during training, predicts the final per-region gap (within-image rho of 0.57-0.70 on fine trajectories, weaker from the cheap solve alone). The prediction is partial because endpoint error depends not only on injected magnitude but on its sign, timing, and transport through the learned dynamics. A training penalty on the injected variation lowers few-step error, so the structure is one a model can be trained to change.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 18 of its 21 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
18 of 21 references.
Closest ancestors · 12
Same direction, newest first
- 2026SDiT: Semantic Region-Adaptive for Diffusion Transformers18 Jan
- 2025Training-free Mixed-Resolution Latent Upsampling for Spatially Accelerated Diffusion Transformers11 Jul
- 2025Region-Adaptive Sampling for Diffusion Transformers14 Feb
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
- 2023Consistency Models2 Mar
- 2023Minimizing Trajectory Curvature of ODE-based Generative Models27 Jan
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 6
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2025CurveFlow: Curvature-Guided Flow Matching for Image Generationcited by 10
- 2026Foveated Diffusion: Efficient Spatially Adaptive Image and Video Generationcited by 2
- 2026Isokinetic Flow Matching for Pathwise Straightening of Generative Flowscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Fundamental Limits of Valid Transport Map Estimation
- 2026Learning to Solve Generative ODEs Beyond the Linear Span
- 2024Tracing the Roots: Leveraging Temporal Dynamics in Diffusion Trajectories for Origin Attribution
- 2025Gradient Variance Reveals Failure Modes in Flow-Based Generative Models
- 2025On Exact Editing of Flow-Based Diffusion Models
- 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
- 2026FlowS: One-Step Motion Prediction via Local Transport Conditioning
- 2024Solving Prior Distribution Mismatch in Diffusion Models via Optimal Transport