Strictly Constrained Generative Modeling via Split Augmented Langevin Sampling
Not on the map. Why?
Abstract (arXiv)
Deep generative models hold great promise for representing complex physical systems, but their deployment is currently limited by the lack of guarantees on the physical plausibility of the generated outputs. Ensuring that known physical constraints are enforced is therefore critical when applying generative models to scientific and engineering problems. We address this limitation by developing a principled framework for sampling from a target distribution while rigorously satisfying mathematical constraints. Leveraging the variational formulation of Langevin dynamics and Lagrangian duality, we propose Constrained Alternated Split Augmented Langevin (CASAL), a novel primal-dual sampling algorithm that enforces constraints progressively through variable splitting. We analyze our algorithm in Wasserstein space and derive explicit mixing time rates. While the method is developed theoretically for Langevin dynamics, we demonstrate its applicability to diffusion models. We apply our method to diffusion-based data assimilation on a complex physical system, where enforcing physical constraints substantially improves both forecast accuracy and the preservation of critical conserved quantities. We also demonstrate the potential of CASAL for challenging non-convex feasibility problems in optimal control.
Key facts. Cited by 6 papers in the map (data through 13 Oct 2026). Builds on 42 of its 82 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
42 of 82 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
- 2022Classifier-Free Diffusion Guidancecited by 5,785
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,077
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 979
- 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 311
- 2023Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Modelscited by 159
- 2023Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Modelscited by 157
- 2018Analysis of Langevin Monte Carlo via convex optimizationcited by 126
- 2024DiffusionPDE: Generative PDE-Solving Under Partial Observationcited by 101
- 2023Score-based Data Assimilationcited by 95
- 2024Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priorscited by 95
30 more
- 2024PnP-Flow: Plug-and-Play Image Restoration with Flow Matchingcited by 94
- 2024Constrained Synthesis with Projected Diffusion Modelscited by 86
- 2016Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreaucited by 83
- 2023Diffusion Models for Constrained Domainscited by 62
- 2018Mirrored Langevin Dynamicscited by 61
- 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilationcited by 60
- 2023Learning Physical Models that Can Respect Conservation Lawscited by 59
- 2020Efficient constrained sampling via the mirror-Langevin algorithmcited by 55
- 2018Split-and-augmented Gibbs sampler - Application to large-scale inference problemscited by 47
- 2017Sampling from a log-concave distribution with compact support with proximal Langevin Monte Carlocited by 43
- 2023Plug-and-Play split Gibbs sampler: embedding deep generative priors in Bayesian inferencecited by 42
- 2023Mirror Diffusion Models for Constrained and Watermarked Generationcited by 38
- 2024Multi-Robot Motion Planning with Diffusion Modelscited by 37
- 2024Gradient-Free Generation for Hard-Constrained Systemscited by 37
- 2025Simultaneous Multi-Robot Motion Planning with Projected Diffusion Modelscited by 37
- 2020Primal Dual Interpretation of the Proximal Stochastic Gradient Langevin Algorithmcited by 34
- 2022Learning differentiable solvers for systems with hard constraintscited by 34
- 2024Deep Generative Data Assimilation in Multimodal Settingcited by 29
- 2023Generative Plug and Play: Posterior Sampling for Inverse Problemscited by 24
- 2025Thermalizer: Stable autoregressive neural emulation of spatiotemporal chaoscited by 21
- 2025Training-Free Constrained Generation With Stable Diffusion Modelscited by 20
- 2019Stochastic Proximal Langevin Algorithm: Potential Splitting and Nonasymptotic Ratescited by 17
- 2022Penalized Overdamped and Underdamped Langevin Monte Carlo Algorithms for Constrained Samplingcited by 13
- 2024Constrained Sampling with Primal-Dual Langevin Monte Carlocited by 10
- 2024Constrained Diffusion with Trust Samplingcited by 10
- 2024Decoupling Training-Free Guided Diffusion by ADMMcited by 10
- 2017Gradient descent with nonconvex constraints: local concavity determines convergencecited by 7
- 2025Generative emulation of chaotic dynamics with coherent priorcited by 7
- 2024Neural Incremental Data Assimilationcited by 3
- 2025Learning to generate physical ocean states: Towards hybrid climate modelingcited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Constrained Diffusion for Protein Design with Hard Structural Constraintscited by 5
- 2026Picasso: Holistic Scene Reconstruction with Physics-Constrained Samplingcited by 4
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Samplingcited by 3
- 2026Constrained Flow Optimization via Sequential Fine Tuning for Molecular Designcited by 2
- 2025PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Modelscited by 0
- 2026Self-Augmented Diffusion Guidance for Physics-Informed Generationcited by 0
- 2026Self-Augmented Diffusion Guidance for Physics-Informed Generation27 Aug 2026
- 2026Constrained Flow Optimization via Sequential Fine Tuning for Molecular Design28 May 2026
- 2026Constraint-Aware Flow Matching: Decision Aligned End-to-End Training for Constrained Sampling12 May 2026
- 2026Picasso: Holistic Scene Reconstruction with Physics-Constrained Sampling8 Feb 2026
- 2025Constrained Diffusion for Protein Design with Hard Structural Constraints1 Oct 2025
- 2025PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models1 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2026Efficient Diffusion Models under Nonconvex Equality and Inequality constraints via Landing
- 2025Score-based constrained generative modeling via Langevin diffusions with boundary conditions
- 2025Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraints
- 2025Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generation
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion
- 2026SNAP-FM: Sparse Nonlinear Accelerated Projection for Physics-Constrained Generative Modeling
- 2025Preconditioned Langevin Dynamics with Score-Based Generative Models for Infinite-Dimensional Linear Bayesian Inverse Problems
- 2026Integration Matters: Rollout-Based Training for Constrained Diffusion Models