Simple Approximation and Derivative Free Inference-Time Scaling for Diffusion Models via Sequential Monte Carlo on Path Measures
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
also in 2 more
Abstract (arXiv)
iffusion-based generative models increasingly rely on inference-time guidance, adding a drift term or reweighting mixture of experts, to improve sample quality on task-specific objectives. However, most existing techniques require repeated score or gradient evaluations, introducing bias, high computational overhead, or both. We introduce textttURGE, Unbiased Resampling via Girsanov Estimation, a derivative-free inference-time scaling algorithm that performs path-wise importance reweighting via a Girsanov change of measure. Instead of computing gradient-based particle weights in previous work, textttURGE attaches a simple multiplicative weight to each simulated trajectory and periodically resamples. No score, no Hessian, and no PDE evaluation is required. We establish an equivalence between path-wise and particle-wise SMC: the Girsanov path weight admits a backward conditional expectation that recovers the previous particle-level weights, guaranteeing that both schemes produce the same unbiased terminal law. Empirically, textttURGE outperforms existing inference-time guidance baselines on synthetic tests and diffusion-model benchmarks, achieving better generation quality, while being significantly simpler to implement and fully gradient-free.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 32 of its 77 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
32 of 77 references.
Closest ancestors · 2
Same direction, newest first
- 2025DriftLite: Lightweight Drift Control for Inference-Time Scaling of Diffusion Models25 Sep
- 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan
Other references · 30
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2025Large Language Diffusion Modelscited by 912
- 2024Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal Controlcited by 233
- 2023Practical and Asymptotically Exact Conditional Sampling in Diffusion Modelscited by 232
- 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 136
- 2025Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Expertscited by 96
18 more
- 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 88
- 2025Adjoint Sampling: Highly Scalable Diffusion Samplers via Adjoint Matchingcited by 85
- 2024Guidance with Spherical Gaussian Constraint for Conditional Diffusioncited by 71
- 2024NETS: A Non-Equilibrium Transport Samplercited by 69
- 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Modelscited by 53
- 2024How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Frameworkcited by 48
- 2018Monge-Amp`ere Flow for Generative Modelingcited by 33
- 2023Adaptive Guidance: Training-free Acceleration of Conditional Diffusion Modelscited by 31
- 2025Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlocited by 31
- 2025Adjoint Schr"odinger Bridge Samplercited by 21
- 2025Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approachcited by 18
- 2025RNE: plug-and-play diffusion inference-time control and energy-based trainingcited by 17
- 2025Test-time scaling of diffusions with flow mapscited by 16
- 2025Text-to-Image Diffusion Models Cannot Count, and Prompt Refinement Cannot Helpcited by 12
- 2025A Unified Approach to Analysis and Design of Denoising Markov Modelscited by 12
- 2026Training-Free Adaptation of Diffusion Models via Doob's h-Transformcited by 11
- 2026On the Power of (Approximate) Reward Models for Inference-Time Scalingcited by 7
- 2025Physics-Informed Inference Time Scaling for Solving High-Dimensional PDE via Defect Correctioncited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
- 2025Inference-Time Scaling of Diffusion Language Models via Trajectory Refinement
- 2025Inference-Time Scaling of Discrete Diffusion Models via Importance Weighting and Optimal Proposal Design
- 2025Navigating the Exploration-Exploitation Tradeoff in Inference-Time Scaling of Diffusion Models
- 2026Diversify Diffusion with Temperature Sampling and Variance-Corrective Time Shifting
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps
- 2025Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing
- 2026A Mean-Field Framework for Inference-Time Distributional Control of Diffusion Models