mlsanityData to 14 Oct 2026

Error Analysis of Discrete Flow with Generator Matching

arXiv 2509.21906 ↗First posted 26 Sep 2025math.ST cs.LG stat.MLcited by 9

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error analysis remain largely unexplored. In this work, we develop a unified framework grounded in stochastic calculus theory to systematically investigate the theoretical properties of discrete flow models. Specifically, by leveraging a Girsanov-type theorem for the path measures of two continuous-time Markov chains (CTMCs), we present a comprehensive error analysis that accounts for both transition rate estimation error and early stopping error. In fact, the estimation error of transition rates has received little attention in existing works. Unlike discrete diffusion models, discrete flow incurs no initialization error caused by truncating the time horizon in the noising process. Building on generator matching and uniformization, we establish non-asymptotic error bounds for distribution estimation without the boundedness condition on oracle transition rates. Furthermore, we derive a faster rate of total variation convergence for the estimated distribution with the boundedness condition, yielding a nearly optimal rate in terms of sample size. Our results provide the first error analysis for discrete flow models. We also investigate model performance under different settings based on simulation results.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 38 of its 52 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

38 of 52 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024Flow Matching Guide and Code9 Dec
  2. 2024Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspective4 Dec
  3. 2024Generator Matching: Generative modeling with arbitrary Markov processes27 Oct
  4. 2024DeFoG: Discrete Flow Matching for Graph Generation5 Oct
  5. 2024Discrete Flow Matching22 Jul
  6. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design7 Feb
  7. 2022Flow Matching for Generative Modeling6 Oct
  8. 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep

Other references · 29

  1. 2018Neural Ordinary Differential Equationscited by 3,779
  2. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
  3. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  4. 2025Large Language Diffusion Modelscited by 912
  5. 2024Simple and Effective Masked Diffusion Language Modelscited by 848
  6. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
  7. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
  8. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
  9. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
  10. 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
  11. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
  12. 2017Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networkscited by 311
17 more
  1. 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
  2. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
  3. 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localizationcited by 235
  4. 2025d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learningcited by 186
  5. 2022Score-based Continuous-time Discrete Diffusion Modelscited by 169
  6. 2023Error Bounds for Flow Matching Methodscited by 91
  7. 2022From Denoising Diffusions to Denoising Markov Modelscited by 58
  8. 2024How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Frameworkcited by 48
  9. 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
  10. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
  11. 2024Convergence Analysis of Discrete Diffusion Model: Exact Implementation through Uniformizationcited by 44
  12. 2024Convergence of Continuous Normalizing Flows for Learning Probability Distributionscited by 26
  13. 2024Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysiscited by 24
  14. 2025Absorb and Converge: Provable Convergence Guarantee for Absorbing Discrete Diffusion Modelscited by 20
  15. 2025Discrete Diffusion Models: Novel Analysis and New Sampler Guaranteescited by 20
  16. 2023Gaussian Interpolation Flowscited by 17
  17. 2025Estimating Unbounded Density Ratios: Applications in Error Control under Covariate Shiftcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Discrete MeanFlow: One-Step Generation via Conditional Transition Kernels
  2. 2024Theoretical guarantees in KL for Diffusion Flow Matching
  3. 2025α-Flow: A Unified Framework for Continuous-State Discrete Flow Matching Models
  4. 2024Minibatch Optimal Transport and Perplexity Bound Estimation in Discrete Flow Matching
  5. 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models
  6. 2024Exploring Diffusion and Flow Matching Under Generator Matching
  7. 2023Formulating Discrete Probability Flow Through Optimal Transport
  8. 2025Time dependent loss reweighting for flow matching and diffusion models is theoretically justified