mlsanityData to 14 Oct 2026

Inference-Time Scaling in Diffusion Models through Iterative Partial Refinement

arXiv 2605.19317 ↗First posted 19 May 2026cs.LG cs.AIcited by 2

On the map: LLM reasoning → Diffusion reasoning and test-time scaling

also in 1 more
Abstract (arXiv)

Inference-time scaling has emerged as a major approach for improving reasoning capabilities, and has been increasingly applied to diffusion models. However, existing inference-time scaling methods for diffusion models typically rely on external verifiers or reward models to rank and select samples, limiting their scalability to settings where such evaluators are available and reliable. Moreover, while recent diffusion models perform sequential inference with region-wise, mixed-noise conditioning, inference-time scaling tailored to this setting remains relatively underexplored. We propose Iterative Partial Refinement (IPR), an inference-time scaling method for sequential diffusion that requires no external verifier. Starting from an already-generated sample, IPR re-noises a subset of regions and regenerates them conditioned on the remaining regions, enabling the model to revise earlier decisions under a richer context than was available during the initial generation. This iterative partial refinement produces more globally consistent samples without external verification. On reasoning tasks requiring global constraint satisfaction, IPR consistently improves performance: on MNIST Sudoku, the valid solution rate increases from 55.8% to 75.0%. These results show that iterative partial refinement alone can serve as an effective inference-time scaling strategy for diffusion models in sequential, mixed-noise settings. Code is available at: https://github.com/ahn-ml/IPR

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 19 of its 20 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

19 of 20 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025Inference-time Scaling of Diffusion Models through Classical Search29 May
  2. 2025Scaling Image and Video Generation via Test-Time Evolutionary Search23 May
  3. 2025Adaptive Inference-Time Scaling via Cyclic Diffusion Search20 May
  4. 2025Monte Carlo Tree Diffusion for System 2 Planning11 Feb
  5. 2025VFScale: Intrinsic Reasoning through Verifier-Free Test-time Scalable Diffusion Model4 Feb
  6. 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan

Other references · 13

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  6. 2024Autoregressive Image Generation without Vector Quantizationcited by 651
  7. 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 136
  8. 2023AR-Diffusion: Auto-Regressive Diffusion Model for Text Generationcited by 118
  9. 2025Test-time Alignment of Diffusion Models without Reward Over-optimizationcited by 93
  10. 2023TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesiscited by 49
  11. 2025Training-Free Guidance Beyond Differentiability: Scalable Path Steering with Tree Search in Diffusion and Flow Modelscited by 24
  12. 2025Spatial Reasoning with Denoising Modelscited by 16
1 more
  1. 2025Fast Monte Carlo Tree Diffusion: 100x Speedup via Parallel Sparse Planningcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diffusion as a Training Curriculum for Timestep-Free Iterative Reasoning
  2. 2025Inference-Time Scaling of Diffusion Language Models via Trajectory Refinement
  3. 2025Navigating the Exploration-Exploitation Tradeoff in Inference-Time Scaling of Diffusion Models
  4. 2026Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
  5. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps
  6. 2025Inference-Time Scaling of Discrete Diffusion Models via Importance Weighting and Optimal Proposal Design
  7. 2026S3: Stratified Scaling Search for Test-Time in Diffusion Language Models
  8. 2025Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement