mlsanityData to 14 Oct 2026

PID-controlled Langevin Dynamics for Faster Sampling of Generative Models

arXiv 2511.12603 ↗First posted 16 Nov 2025cs.LG cs.AI cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Langevin dynamics sampling suffers from extremely low generation speed, fundamentally limited by numerous fine-grained iterations to converge to the target distribution. We introduce PID-controlled Langevin Dynamics (PIDLD), a novel sampling acceleration algorithm that reinterprets the sampling process using control-theoretic principles. By treating energy gradients as feedback signals, PIDLD combines historical gradients (the integral term) and gradient trends (the derivative term) to efficiently traverse energy landscapes and adaptively stabilize, thereby significantly reducing the number of iterations required to produce high-quality samples. Our approach requires no additional training, datasets, or prior information, making it immediately integrable with any Langevin-based method. Extensive experiments across image generation and reasoning tasks demonstrate that PIDLD achieves higher quality with fewer steps, making Langevin-based generative models more practical for efficiency-critical applications. The implementation can be found at hrefhttps://github.com/tsinghua-fib-lab/PIDLDhttps://github.com/tsinghua-fib-lab/PIDLD.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 44 references that are in the map. First posted on arXiv 16 Nov 2025.

Builds on

22 of 44 references.

References · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  9. 2016RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentationcited by 465
  10. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 233
  11. 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
  12. 2019SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solvercited by 173
10 more
  1. 2019Neural Logic Machinescited by 145
  2. 2019On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Modelscited by 105
  3. 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
  4. 2017Recurrent Relational Networkscited by 72
  5. 2024Learning Iterative Reasoning through Energy Diffusioncited by 36
  6. 2022Learning Iterative Reasoning through Energy Minimizationcited by 32
  7. 2022Accelerating Score-based Generative Models with Preconditioned Diffusion Samplingcited by 19
  8. 2023Preconditioned Score-based Generative Modelscited by 6
  9. 2024Score-based Generative Models with Adaptive Momentumcited by 2
  10. 2025Beyond Equilibrium: Non-Equilibrium Foundations Should Underpin Generative Processes in Complex Dynamical Systemscited by 2

Built on by

Not cited yet.