Rethinking Test Time Scaling for Flow-Matching Generative Models
On the map: LLM reasoning → Diffusion reasoning and test-time scaling
also in 1 more
Abstract (arXiv)
The performance of text-to-image diffusion models may be improved at test-time by scaling computation to search for a generated image that maximizes a given reward function. While existing trajectory level exploration methods improve the effectiveness of test-time scaling for standard diffusion models, they are largely incompatible with modern flow matching models, which use deterministic sampling. This imposes significant computational overhead on local trajectory search, making the trade-offs less favorable compared to global search. However, global search strategies like trajectory pruning face two critical challenges: the sharp, low-diversity distributions characteristic of scaled flow models that restrict the candidate search space, and the bias of reward models in the early denoising process. To overcome these limitations, we propose Repel, a token-level mechanism that encourages sample diversity, and NARF, a noise-aware reward fine-tuning strategy to obtain more accurate reward ranking at early denoising stages. Together, these promote more effective test-time scaling resource allocation. Overall, we name our pipeline as DOG-Trim: Diversity enhanced Order aligned Global flow Trimming. The experiments demonstrate that, under the same compute cost, our approach achieves around twice the performance improvement relative to the scaling-free baseline compared to the best existing method. Github: https://github.com/TerrysLearning/DOGTrimTTS.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion reasoning and test-time scaling, one of 17 directions in LLM reasoning. Builds on 81 of its 89 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
81 of 89 references.
Closest ancestors · 9
Same direction, newest first
- 2025Noise Hypernetworks: Amortizing Test-Time Compute in Diffusion Models13 Aug
- 2025TTS-VAR: A Test-Time Scaling Framework for Visual Auto-Regressive Generation24 Jul
- 2025Inference-time Scaling of Diffusion Models through Classical Search29 May
- 2025Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing25 Mar
- 2025Video-T1: Test-Time Scaling for Video Generation24 Mar
- 2025Reflect-DiT: Inference-Time Scaling for Text-to-Image Diffusion Transformers via In-Context Reflection15 Mar
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Steps16 Jan
- 2025A General Framework for Inference-time Scaling and Steering of Diffusion Models12 Jan
Other references · 72
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Qwen Technical Reportcited by 3,344
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,407
- 2025s1: Simple test-time scalingcited by 1,341
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewardscited by 448
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problemscited by 260
- 2023Using Human Feedback to Fine-tune Diffusion Models without Any Reward Modelcited by 252
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?cited by 223
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 199
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 156
- 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 136
- 2025Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuningcited by 123
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Test-time scaling of diffusions with flow maps
- 2026Guided Trajectory Optimization with Sparse Scaling for Test-Time Diffusion
- 2026Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
- 2026Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models
- 2026Test-Time Scaling for Video Diffusion Models via Diagnosis-Guided Candidate Recycling
- 2026S3: Stratified Scaling Search for Test-Time in Diffusion Language Models
- 2025Scaling Image and Video Generation via Test-Time Evolutionary Search
- 2025Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement