Error Analysis of Discrete Flow with Generator Matching
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error analysis remain largely unexplored. In this work, we develop a unified framework grounded in stochastic calculus theory to systematically investigate the theoretical properties of discrete flow models. Specifically, by leveraging a Girsanov-type theorem for the path measures of two continuous-time Markov chains (CTMCs), we present a comprehensive error analysis that accounts for both transition rate estimation error and early stopping error. In fact, the estimation error of transition rates has received little attention in existing works. Unlike discrete diffusion models, discrete flow incurs no initialization error caused by truncating the time horizon in the noising process. Building on generator matching and uniformization, we establish non-asymptotic error bounds for distribution estimation without the boundedness condition on oracle transition rates. Furthermore, we derive a faster rate of total variation convergence for the estimated distribution with the boundedness condition, yielding a nearly optimal rate in terms of sample size. Our results provide the first error analysis for discrete flow models. We also investigate model performance under different settings based on simulation results.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 38 of its 52 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
38 of 52 references.
Closest ancestors · 9
Same direction, newest first
- 2024Flow Matching Guide and Code9 Dec
- 2024Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspective4 Dec
- 2024Generator Matching: Generative modeling with arbitrary Markov processes27 Oct
- 2024DeFoG: Discrete Flow Matching for Graph Generation5 Oct
- 2024Discrete Flow Matching22 Jul
- 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design7 Feb
- 2022Flow Matching for Generative Modeling6 Oct
- 2022DiGress: Discrete Denoising diffusion for graph generation29 Sep
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flow7 Sep
Other references · 29
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,719
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2025Large Language Diffusion Modelscited by 912
- 2024Simple and Effective Masked Diffusion Language Modelscited by 848
- 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 745
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 626
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 574
- 2022A Continuous Time Framework for Discrete Denoising Modelscited by 451
- 2022Sampling is as easy as learning the score: theory for diffusion models with minimal data assumptionscited by 445
- 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 381
- 2017Nearly-tight VC-dimension and pseudodimension bounds for piecewise linear neural networkscited by 311
17 more
- 2025LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Modelscited by 285
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 250
- 2023Nearly d-Linear Convergence Bounds for Diffusion Models via Stochastic Localizationcited by 235
- 2025d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learningcited by 186
- 2022Score-based Continuous-time Discrete Diffusion Modelscited by 169
- 2023Error Bounds for Flow Matching Methodscited by 91
- 2022From Denoising Diffusions to Denoising Markov Modelscited by 58
- 2024How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Frameworkcited by 48
- 2025Fast Solvers for Discrete Diffusion Models: Theory and Applications of High-Order Algorithmscited by 47
- 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
- 2024Convergence Analysis of Discrete Diffusion Model: Exact Implementation through Uniformizationcited by 44
- 2024Convergence of Continuous Normalizing Flows for Learning Probability Distributionscited by 26
- 2024Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysiscited by 24
- 2025Absorb and Converge: Provable Convergence Guarantee for Absorbing Discrete Diffusion Modelscited by 20
- 2025Discrete Diffusion Models: Novel Analysis and New Sampler Guaranteescited by 20
- 2023Gaussian Interpolation Flowscited by 17
- 2025Estimating Unbounded Density Ratios: Applications in Error Control under Covariate Shiftcited by 6
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025Non-Asymptotic Convergence of Discrete Diffusion Models: Masked and Random Walk dynamicscited by 11
- 2025Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusioncited by 10
- 2025Dimension-free error estimate for diffusion model and optimal schedulingcited by 3
- 2026Corrected Samplers for Discrete Flow Modelscited by 3
- 2026Minimax Optimality of Score-Entropy Discrete Diffusioncited by 3
- 2026Discrete Flow Matching: Convergence Guarantees Under Minimal Assumptionscited by 1
- 2026A Time-Reparameterized Cumulative Intensity Extrapolation Sampler for Discrete Flow Matchingcited by 0
- 2026Entropy Can Flow, or It Can Guide. Be Entropy. LEDFlow: Introducing Entropy-guided Generation Order into Uniform Discrete Flowcited by 0
- 2026Acceleration of Diffusion Language Model through Discrete Average Generatorcited by 0
- 2026Acceleration of Diffusion Language Model through Discrete Average Generator29 Sep 2026
- 2026Entropy Can Flow, or It Can Guide. Be Entropy. LEDFlow: Introducing Entropy-guided Generation Order into Uniform Discrete Flow20 Sep 2026
- 2026Minimax Optimality of Score-Entropy Discrete Diffusion21 Aug 2026
- 2026A Time-Reparameterized Cumulative Intensity Extrapolation Sampler for Discrete Flow Matching23 Jun 2026
- 2026Discrete Flow Matching: Convergence Guarantees Under Minimal Assumptions9 May 2026
- 2026Corrected Samplers for Discrete Flow Models30 Jan 2026
- 2025Dimension-free error estimate for diffusion model and optimal scheduling1 Dec 2025
- 2025Non-Asymptotic Convergence of Discrete Diffusion Models: Masked and Random Walk dynamics29 Nov 2025
- 2025Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Discrete MeanFlow: One-Step Generation via Conditional Transition Kernels
- 2024Theoretical guarantees in KL for Diffusion Flow Matching
- 2025α-Flow: A Unified Framework for Continuous-State Discrete Flow Matching Models
- 2024Minibatch Optimal Transport and Perplexity Bound Estimation in Discrete Flow Matching
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models
- 2024Exploring Diffusion and Flow Matching Under Generator Matching
- 2023Formulating Discrete Probability Flow Through Optimal Transport
- 2025Time dependent loss reweighting for flow matching and diffusion models is theoretically justified