Guided Trajectory Optimization with Sparse Scaling for Test-Time Diffusion
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Test-Time Scaling (TTS) paradigm offers a promising perspective for enhancing the generation performance of diffusion models. However, current solutions largely restrict their search to predefined noise candidates or suffer from inflexible exploration across the denoising trajectory. To bridge this gap, we propose RTS, a novel Reward-guided Trajectory Scaling method to fully unlock the generative potential of diffusion models. Unlike existing methods, RTS facilitates the synthesis of refined, high-fidelity images via two core innovations: 1) a coarse-to-fine noise optimization mechanism that exploits historical search experience to actively steer the exploration toward high-reward regions and 2) a unified sparse test-time scaling framework featuring PCA-driven curvature analysis, which eliminates temporal redundancy by flexiblely allocating compute to a sparse set of key timesteps that represent critical shifts in the denoising direction. Extensive experiments across SD v3, FLUX, and Qwen-Image architectures demonstrate that RTS outperforms baselines, improving the GenEval score by 20.7%, 15.6%, and 12.2%, respectively. Notably, empirical findings indicate that these key points primarily cluster in the mid-stage of the trajectory, distinct from the structure-sensitive early phases and the late attribute refinement phases.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 37 of its 45 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
37 of 45 references.
Closest ancestors · 10
Same direction, newest first
- 2025OmniCache: A Trajectory-Oriented Global Perspective on Training-Free Cache Reuse for Diffusion Transformer Models22 Aug
- 2025Test-Time Scaling of Diffusion Models via Noise Trajectory Search24 May
- 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2023FreeU: Free Lunch in Diffusion U-Net20 Sep
- 2023Restart Sampling for Improving Generative Processes26 Jun
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 27
- 2023GPT-4 Technical Reportcited by 18,396
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Training Compute-Optimal Large Language Modelscited by 3,019
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
15 more
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 366
- 2023Fine-Tuning Language Models with Just Forward Passescited by 345
- 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 269
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 256
- 2020A Primer on Zeroth-Order Optimization in Signal Processing and Machine Learningcited by 162
- 2023DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Trainingcited by 76
- 2023BlackVIP: Black-Box Visual Prompting for Robust Transfer Learningcited by 70
- 2024Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuningcited by 54
- 2022BBTv2: Towards a Gradient-Free Future with Large Language Modelscited by 53
- 2019Multi-marginal Wasserstein GANcited by 32
- 2021On the Convergence of Prior-Guided Zeroth-Order Optimization Algorithmscited by 23
- 2023Implicit Concept Removal of Diffusion Modelscited by 23
- 2024CoMPaSS: Enhancing Spatial Understanding in Text-to-Image Diffusion Modelscited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Rethinking Test Time Scaling for Flow-Matching Generative Models
- 2025Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling
- 2025Ctrl-Z Sampling: Scaling Diffusion Sampling with Controlled Random Zigzag Explorations
- 2026Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models
- 2025Test-time scaling of diffusions with flow maps
- 2026Denoising as Path Planning: Training-Free Acceleration of Diffusion Models with DPCache
- 2025Optimal Stepsize for Diffusion Sampling