Agentic Flow Steering and Parallel Rollout Search for Spatially Grounded Text-to-Image Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Precise Text-to-Image (T2I) generation has achieved great success but is hindered by the limited relational reasoning of static text encoders and the error accumulation in open-loop sampling. Without real-time feedback, initial semantic ambiguities during the Ordinary Differential Equation trajectory inevitably escalate into stochastic deviations from spatial constraints. To bridge this gap, we introduce AFS-Search (Agentic Flow Steering and Parallel Rollout Search), a training-free closed-loop framework built upon FLUX.1-dev. AFS-Search incorporates a training-free closed-loop parallel rollout search and flow steering mechanism, which leverages a Vision-Language Model (VLM) as a semantic critic to diagnose intermediate latents and dynamically steer the velocity field via precise spatial grounding. Complementarily, we formulate T2I generation as a sequential decision-making process, exploring multiple trajectories through lookahead simulations and selecting the optimal path based on VLM-guided rewards. Further, we provide AFS-Search-Pro for higher performance and AFS-Search-Fast for quicker generation. Experimental results show that our AFS-Search-Pro greatly boosts the performance of the original FLUX.1-dev, achieving state-of-the-art results across three different benchmarks. Meanwhile, AFS-Search-Fast also significantly enhances performance while maintaining fast generation speed.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 43 of its 47 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
43 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2025AgentComp: From Agentic Reasoning to Compositional Mastery in Text-to-Image Models9 Dec
- 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generation5 May
Other references · 41
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
29 more
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2024OmniGen: Unified Image Generationcited by 394
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2022Optimizing Prompts for Text-to-Image Generationcited by 207
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
- 2025Lumina-Image 2.0: A Unified and Efficient Image Generative Frameworkcited by 96
- 2025Fractal Generative Modelscited by 46
- 2023Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generationcited by 38
- 2024Improving Diffusion-Based Image Synthesis with Context Predictioncited by 32
- 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 32
- 2023Mini-DALLE3: Interactive Text to Image by Prompting Large Language Modelscited by 22
- 2024SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generationcited by 15
- 2024Progressive Compositionality in Text-to-Image Generative Modelscited by 12
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026OctoT2I: A Self-Evolving Agentic Text-to-Image Router
- 2026GenRouter: Unified Workflow Routing for Agentic Image Generation
- 2025Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling
- 2026FullFlow: Upgrading Text-to-Image Flow Matching Models for Bidirectional Vision--Language Generation
- 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
- 2026Getting Space Right: Agentic Rewards for Image Generation
- 2026APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation
- 2026DanceOPD: On-Policy Generative Field Distillation