mlsanityData to 7 Oct 2026

Error-Corrected Inference-Time Scaling for Imperfect Diffusion Models

arXiv 2610.01933 ↗First posted 1 Oct 2026stat.ML cs.LGcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Inference-time scaling adapts pretrained diffusion models to new sampling tasks without additional training. Existing methods rely primarily on Monte Carlo sampling with more particles, yet are premised on the pretrained model being exact. In practice, data and training limitations make the model imperfect, and these methods inherit its error. More particles reduce Monte Carlo error but cannot remove the mismatch between the endpoint and the desired target or the error in tracking the prescribed probability path. We introduce the Energy-based Feynman-Kac Corrector (EBFKC), a framework for energy-based diffusion models that corrects these errors on the fly given a reference energy. We first derive Feynman-Kac dynamics that track a prescribed path exactly in the continuous-time population limit even when the model is imperfect, and approximate these dynamics using sequential Monte Carlo with variance-controlling guidance. To remove the endpoint mismatch, we use the pretrained energy as a surrogate along the diffusion path and progressively incorporate the discrepancy between the learned and target terminal energies. Experiments on Gaussian mixture models, particle systems, alanine dipeptide, and alanine tetrapeptide show that our method closely matches target distributions and molecular free-energy profiles under annealing and reward tilting, whereas standard inference-time scaling baselines retain substantial sampling errors.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 41 of its 53 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

41 of 53 references.

Closest ancestors · 22

Same direction, newest first

  1. 2026FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models28 Sep
  2. 2026Catastrophic Compositional Generation: Why Vanilla Diffusion Models Fail to Extrapolate22 Jun
  3. 2026Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures18 May
  4. 2026Metropolis-Adjusted Diffusion Models10 May
  5. 2026A Diffusive Classification Loss for Learning Energy-based Generative Models28 Jan
  6. 2026Discrete Feynman-Kac Correctors15 Jan
  7. 2025Test-time scaling of diffusions with flow maps27 Nov
  8. 2025DriftLite: Lightweight Drift Control for Inference-Time Scaling of Diffusion Models25 Sep
  9. 2025RNE: plug-and-play diffusion inference-time control and energy-based training6 Jun
  10. 2025Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts4 Mar
  11. 2025Composition and Control with Distilled Energy Diffusion Models and Sequential Monte Carlo18 Feb
  12. 2024Gradient Guidance for Diffusion Models: An Optimization Perspective23 Apr
10 more
  1. 2023Manifold Preserving Guided Diffusion28 Nov
  2. 2023MCMC-Correction of Score-Based Diffusion Models for Model Composition26 Jul
  3. 2023Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC22 Feb
  4. 2022Scalable Diffusion Models with Transformers19 Dec
  5. 2022Classifier-Free Diffusion Guidance26 Jul
  6. 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  8. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  10. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 19

  1. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  3. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  4. 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 511
  5. 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 222
  6. 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Modelscited by 218
  7. 2024Fine-Tuning of Continuous-Time Diffusion Models as Entropy-Regularized Controlcited by 136
  8. 2020Hutch++: Optimal Stochastic Trace Estimationcited by 62
  9. 2023Learning Interpolations between Boltzmann Densitiescited by 42
  10. 2025Scalable Equilibrium Sampling with Sequential Boltzmann Generatorscited by 36
  11. 2020Blindness of score-based methods to isolated components and mixing proportionscited by 33
  12. 2023Accurate transition state generation with an object-aware equivariant elementary reaction diffusion modelcited by 30
7 more
  1. 2024Stochastic Control for Fine-tuning Diffusion Models: Optimality, Regularity, and Convergencecited by 18
  2. 2025Learning normalized image densities via dual score matchingcited by 17
  3. 2025Density Ratio Estimation with Conditional Probability Pathscited by 13
  4. 2026Enhanced Diffusion Sampling: Efficient Rare Event Sampling and Free Energy Calculation with Diffusion Modelscited by 11
  5. 2026Robust Inference-Time Steering of Protein Diffusion Models via Embedding Optimizationcited by 6
  6. 2026Learning Energy-Based Models from Stochastic Interpolants using Spatiotemporal Differencescited by 2
  7. 2026Diffusion-based Annealed Boltzmann Generators : benefits, pitfalls and hopescited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diversify Diffusion with Temperature Sampling and Variance-Corrective Time Shifting
  2. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models
  3. 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Review
  4. 2025Navigating the Exploration-Exploitation Tradeoff in Inference-Time Scaling of Diffusion Models
  5. 2026Inference-Time Scaling in Diffusion Models through Iterative Partial Refinement
  6. 2026Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
  7. 2026Inference-Time Alignment for Diffusion Models via Variationally Stable Doob's Matching
  8. 2025Inference-Time Scaling of Diffusion Language Models via Trajectory Refinement