mlsanityData to 7 Oct 2026

Theoretical Analysis of Engression and Reverse Markov Engression

arXiv 2606.01002 ↗First posted 31 May 2026stat.ME cs.LG math.STcited by 3

Not on the map. Why?

Abstract (arXiv)

Engression is a recently proposed and effective framework for conditional distribution learning. Its multi-step Reverse Markov extension further improves generative flexibility by decomposing complex conditional sampling into sequential reverse transitions. Despite their strong empirical performance, rigorous finite-sample statistical guarantees for these methods remain unavailable. In this paper, under deep neural network parameterizations, we establish nonasymptotic convergence bounds for Engression by directly controlling the Energy Distance between the learned and target conditional distributions. For the Reverse Markov framework, we further develop an Energy-Distance-based chain rule that enables a rigorous analysis of error propagation across reverse steps. Our analysis yields corresponding excess-risk bounds that are near-optimal up to logarithmic factors relative to the classical minimax rate over a general H"older class.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

15 of 23 references.

References · 15

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2017Nonparametric regression using deep neural networks with ReLU activation functioncited by 431
  5. 2022Brain Imaging Generation with Latent Diffusion Modelscited by 267
  6. 2020Learning Energy-Based Models by Diffusion Recovery Likelihoodcited by 122
  7. 2022CARD: Classification and Regression Diffusion Modelscited by 102
  8. 2023Engression: Extrapolation through the Lens of Distributional Regressioncited by 49
  9. 2025Distributional Diffusion Models with Scoring Rulescited by 25
  10. 2023Reliable Generation of Privacy-preserving Synthetic Electronic Health Record Time Series via Diffusion Modelscited by 24
  11. 2020Distribution Approximation and Statistical Estimation Guarantees of Generative Adversarial Networkscited by 23
  12. 2023Wasserstein Generative Regressioncited by 12
3 more
  1. 2017Geometrical Insights for Implicit Generative Modelingcited by 7
  2. 2025Reverse Markov Learning: Multi-Step Generative Models for Complex Distributionscited by 7
  3. 2025Frugal, Flexible, Faithful: Causal Data Simulation via Frengressioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.