mlsanityData to 14 Oct 2026

Transition Models: Rethinking the Generative Learning Objective

arXiv 2509.04394 ↗First posted 4 Sep 2025cs.LG cs.CVcited by 34

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

A fundamental dilemma in generative modeling persists: iterative diffusion models achieve outstanding fidelity, but at a significant computational cost, while efficient few-step alternatives are constrained by a hard quality ceiling. This conflict between generation steps and output quality arises from restrictive training objectives that focus exclusively on either infinitesimal dynamics (PF-ODEs) or direct endpoint prediction. We address this challenge by introducing an exact, continuous-time dynamics equation that analytically defines state transitions across any finite time interval. This leads to a novel generative paradigm, Transition Models (TiM), which adapt to arbitrary-step transitions, seamlessly traversing the generative trajectory from single leaps to fine-grained refinement with more steps. Despite having only 865M parameters, TiM achieves state-of-the-art performance, surpassing leading models such as SD3.5 (8B parameters) and FLUX.1 (12B parameters) across all evaluated step counts. Importantly, unlike previous few-step generators, TiM demonstrates monotonic quality improvement as the sampling budget increases. Additionally, when employing our native-resolution strategy, TiM delivers exceptional fidelity at resolutions up to 4096x4096.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 81 of its 88 references that are in the map. First posted on arXiv 4 Sep 2025.

Builds on

81 of 88 references.

Closest ancestors · 43

Same direction, newest first

  1. 2025Unified Continuous Generative Models12 May
  2. 2025Inductive Moment Matching10 Mar
  3. 2025Diffusion Models without Classifier-free Guidance17 Feb
  4. 2025Exploring Representation-Aligned Latent Space for Better Generation1 Feb
  5. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
  6. 2024Stable Consistency Tuning: Understanding and Improving Consistency Models24 Oct
  7. 2024One Step Diffusion via Shortcut Models16 Oct
  8. 2024Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models14 Oct
  9. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models14 Oct
  10. 2024Diffusion Models Need Visual Priors for Image Generation11 Oct
  11. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think9 Oct
  12. 2024Phased Consistency Models28 May
31 more
  1. 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
  2. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers9 May
  3. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis21 Apr
  4. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation5 Apr
  5. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation18 Mar
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  7. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillation21 Feb
  8. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers16 Jan
  9. 2023Analyzing and Improving the Training Dynamics of Diffusion Models5 Dec
  10. 2023DiffiT: Diffusion Vision Transformers for Image Generation4 Dec
  11. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  12. 2023Adversarial Diffusion Distillation28 Nov
  13. 2023Improved Techniques for Training Consistency Models22 Oct
  14. 2023DPM-Solver-v3: Improved Diffusion ODE Solver with Empirical Model Statistics20 Oct
  15. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
  16. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion1 Oct
  17. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis4 Jul
  18. 2023Fast Training of Diffusion Models with Masked Transformers15 Jun
  19. 2023MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer25 Mar
  20. 2023Consistency Models2 Mar
  21. 2023Simple diffusion: End-to-end diffusion for high resolution images26 Jan
  22. 2022Scalable Diffusion Models with Transformers19 Dec
  23. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  24. 2022All are Worth Words: A ViT Backbone for Diffusion Models25 Sep
  25. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  26. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  27. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  28. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  29. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  30. 2020Denoising Diffusion Implicit Models6 Oct
  31. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 38

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2016Improved Techniques for Training GANscited by 2,970
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  7. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2025Gemma 3 Technical Reportcited by 1,824
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  11. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  12. 2022MaskGIT: Masked Generative Image Transformercited by 1,099
26 more
  1. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  2. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  3. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  4. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  5. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  6. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  7. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  8. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  9. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
  10. 2025Mean Flows for One-step Generative Modelingcited by 561
  11. 2022StyleGAN-XL: Scaling StyleGAN to Large Diverse Datasetscited by 492
  12. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  13. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  14. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  15. 2021Generating Images with Sparse Representationscited by 266
  16. 2024Playground v2.5: Three Insights towards Enhancing Aesthetic Quality in Text-to-Image Generationcited by 256
  17. 2021RedCaps: web-curated image-text data created by the people, for the peoplecited by 180
  18. 2025Seedream 3.0 Technical Reportcited by 154
  19. 2024Flow map matching with stochastic interpolants: A mathematical framework for consistency modelscited by 109
  20. 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 87
  21. 2025Align Your Flow: Scaling Continuous-Time Flow Map Distillationcited by 87
  22. 2024RandAR: Decoder-only Autoregressive Visual Generation in Random Orderscited by 83
  23. 2025Seedream 2.0: A Native Chinese-English Bilingual Image Generation Foundation Modelcited by 62
  24. 2024From Pixels to Prose: A Large Dataset of Dense Image Captionscited by 54
  25. 2025FACM: Flow-Anchored Consistency Modelscited by 16
  26. 2025Native-Resolution Image Synthesiscited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 23.

34 papers.

Sort:

By area:

  1. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  2. 2025AlphaFlow: Understanding and Improving MeanFlow Modelscited by 41
  3. 2026Transition Matching Distillation for Fast Video Generationcited by 30
  4. 2026AnyFlow: Any-Step Video Diffusion Model with On-Policy Flow Map Distillationcited by 26
  5. 2026One-Step Generative Modeling via Wasserstein Gradient Flowscited by 24
  6. 2025TwinFlow: Realizing One-step Generation on Large Models with Self-adversarial Flowscited by 17
  7. 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
  8. 2025SoFlow: Solution Flow Models for One-Step Generative Modelingcited by 13
  9. 2025Adversarial Flow Modelscited by 12
  10. 2026Parallel Decoding Distillation for Fast Image and Video Generationcited by 10
  11. 2025Understand Before You Generate: Self-Guided Training for Autoregressive Image Generationcited by 7
  12. 2025Bidirectional Normalizing Flow: From Data to Noise and Backcited by 7
22 more
  1. 2026Skywork UniPic 3.0: Unified Multi-Image Composition via Sequence Modelingcited by 7
  2. 2025MeanFlow Transformers with Representation Autoencoderscited by 6
  3. 2025Understanding, Accelerating, and Improving MeanFlow Trainingcited by 4
  4. 2025OMP: One-step Meanflow Policy with Directional Alignmentcited by 4
  5. 2025Self-Evaluation Unlocks Any-Step Text-to-Image Generationcited by 3
  6. 2026Stabilizing Consistency Training: A Flow Map Analysis and Self-Distillationcited by 3
  7. 2026Transition Flow Matchingcited by 2
  8. 2026Self-Adversarial One Step Generation via Condition Shiftingcited by 2
  9. 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representationcited by 2
  10. 2026Trajectory Forcing: Structure-First Generation with Controllable Semantic Trajectoriescited by 2
  11. 2026BiFM: Bidirectional Flow Matching for Few-Step Image Editing and Generationcited by 1
  12. 2026WTF?! Simulation-Free Reinforcement Learning with Wasserstein-Tilted Flow Mapscited by 1
  13. 2026FlowConsist: Make Your Flow Consistent with Real Trajectorycited by 0
  14. 2026Derivative Computation in PINNs: Automatic Differentiation, Finite Differences and Beyondcited by 0
  15. 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlowcited by 0
  16. 2026A Latent Distribution Perspective on Evaluating and Improving Latent Generative Modelscited by 0
  17. 2026Scaling Versatile 3D Assets Editing with a Million-Scale Datasetcited by 0
  18. 2026WorldPlay2: Extending Real-Time Interactive World Models in Control and Horizoncited by 0
  19. 2026Looped Diffusion Transformercited by 0
  20. 2026One-Step Generative Modeling via Training Dynamics Actioncited by 0
  21. 2026Physics is the Best Teacher: Consistency Learning for Time-Invariant Operators of Chaotic Dynamicscited by 0
  22. 2026Are We Overthinking One-Step Generation?cited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Exploring the Design Space of Transition Matching
  2. 2026Formalizing the Sampling Design Space of Diffusion-Based Generative Models via Adaptive Solvers and Wasserstein-Bounded Timesteps
  3. 2026The Geometry of Phase Transitions in Generative Dynamics via Projection Caustics
  4. 2024Generative Diffusion Modeling: A Practical Handbook
  5. 2025Action-Minimization Meets Generative Modeling: Efficient Transition Path Sampling with the Onsager-Machlup Functional
  6. 2024Input-Adaptive Generative Dynamics in Diffusion Models
  7. 2025Warm Starts Accelerate Conditional Diffusion
  8. 2023The statistical thermodynamics of generative diffusion models: Phase transitions, symmetry breaking and critical instability