mlsanityData to 14 Oct 2026

Unfolding Generative Flows with Koopman Operators: Trajectory-Preserving Linearization

arXiv 2506.22304 ↗First posted 27 Jun 2025cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Continuous Normalizing Flows (CNFs) enable elegant generative modeling but remain bottlenecked by their iterative nature requiring costly sampling and lacking interpretability of the intermediate states. Recent approaches accelerate sampling by straightening trajectories or distilling endpoints, yet they treat the original generative process as a black box, discarding the teacher's intermediate dynamics. We propose a fundamentally different perspective: globally linearizing flow dynamics via Koopman theory to achieve trajectory-preserving linearization. By lifting a pre-trained Conditional Flow Matching (CFM) model into a higher-dimensional Koopman space, we represent its evolution with a single linear operator. Crucially, unlike boundary-only distillation, our method enforces infinitesimal consistency with the teacher's vector field along the full generative path. We derive a practical, simulation-free training objective that ensures this global alignment and yields two key benefits. First, sampling becomes one-step and parallelizable. Second, because the linearization is faithful to the dynamics, the Koopman operator provides unique insights on the generation. We demonstrate that this structure enables novel applications unavailable in prior approaches, including discovery of semantically coherent editing directions, inversion with a teacher-aligned linear operator and class-conditional spectral signatures. Empirically, our approach achieves competitive sample quality, while enabling spectral analysis and control of the entire trajectories of generative flows.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 36 of its 56 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

36 of 56 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2018Neural Ordinary Differential Equationscited by 3,779
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  11. 2016Density estimation using Real NVPcited by 2,042
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
24 more
  1. 2023Consistency Modelscited by 1,822
  2. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  3. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  4. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  5. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  6. 2018Disentangling by Factorisingcited by 616
  7. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  8. 2025Mean Flows for One-step Generative Modelingcited by 561
  9. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
  10. 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
  11. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  12. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  13. 2022Diffusion Models already have a Semantic Latent Spacecited by 328
  14. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  15. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  16. 2019On the "steerability" of generative adversarial networkscited by 248
  17. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
  18. 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
  19. 2024Dynamical Regimes of Diffusion Modelscited by 142
  20. 2020Forecasting Sequential Data using Consistent Koopman Autoencoderscited by 115
  21. 2025Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Trainingcited by 81
  22. 2024Distilled Decoding 1: One-step Sampling of Image Auto-regressive Models with Flow Matchingcited by 18
  23. 2025One-Step Offline Distillation of Diffusion-based Models via Koopman Modelingcited by 9
  24. 2023Finite Dimensional Koopman Form of Polynomial Nonlinear Systemscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Hierarchical Koopman Diffusion: Fast Generation with Interpretable Diffusion Trajectory
  2. 2025Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
  3. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency models
  4. 2026Path-independent Flow Matching for Multi-parameter Generative Dynamics
  5. 2026Isokinetic Flow Matching for Pathwise Straightening of Generative Flows
  6. 2026From Euler to Dormand-Prince: ODE Solvers for Flow Matching Generative Models
  7. 2026SplineFlow: Flow Matching for Dynamical Systems with B-Spline Interpolants
  8. 2025Transition Models: Rethinking the Generative Learning Objective