OctoT2I: A Self-Evolving Agentic Text-to-Image Router
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
The explosive growth of Text-to-Image (T2I) models, from large-scale versions to lightweight, real-time ones, now faces diminishing marginal returns from single-model scaling. Agentic T2I methods emerged to alleviate this bottleneck by using multiple models. However, existing agentic T2I methods suffer from three key challenges: reliance on expensive handcrafted priors or human annotations, rigid single-path decision mechanisms, and a neglect of inference efficiency. To address these challenges, we introduce OctoT2I, a novel agentic framework that reformulates the T2I task as a joint optimization of generation quality and inference efficiency. OctoT2I implements a stateful, multi-round routing strategy that adaptively selects the most suitable tool based on its knowledge and memory. This strategy is enabled by a knowledge base built from scratch by our novel Self-Evolving Mechanism. This mechanism, which requires no human supervision, first autonomously defines foundational Conceptual Dimensions (eg, style, color, count) and then intelligently explores their combinations via an iterative" Propose--Solve--Evaluate--Learn"(PSEL) loop. The PSEL loop efficiently discovers each tool's capability frontier, driving continuous improvement without external guidance. Extensive experiments demonstrate that OctoT2I achieves competitive performance (0.96) on GenEval while delivering a 90.3% inference speedup and a 56.6% energy-efficiency gain over the leading baseline (Flow-GRPO), striking an exceptional balance between performance and efficiency. Code and models will be made available.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 53 of its 63 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
53 of 63 references.
Closest ancestors · 2
Same direction, newest first
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation28 Jul
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul
Other references · 51
- 2024GPT-4o System Cardcited by 4,467
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Qwen Technical Reportcited by 3,273
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2025Qwen-Image Technical Reportcited by 973
38 more
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2023Adversarial Diffusion Distillationcited by 741
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
- 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2023An LLM Compiler for Parallel Function Callingcited by 170
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
- 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
- 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
- 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 85
- 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 79
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
- 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
- 2023Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generationcited by 38
- 2023ChatLLM Network: More brains, More intelligencecited by 37
- 2025Multi-Agent Image Restorationcited by 19
- 2024DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Modelcited by 12
- 2024ChatGen: Automatic Text-to-Image Generation From FreeStyle Chattingcited by 11
- 2025GenCompositor: Generative Video Compositing with Diffusion Transformercited by 9
- 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localizationcited by 9
- 2025CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-stepcited by 8
- 2026DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignmentcited by 7
- 2025AlignedGen: Aligning Style Across Generated Imagescited by 5
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolutioncited by 4
- 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutionscited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnessescited by 0
- 2026EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnesses30 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routing25 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026GenRouter: Unified Workflow Routing for Agentic Image Generation
- 2026MemoGen: Can Past Experience Improve Future Text-to-Image Generation?
- 2025ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generation
- 2026Agentic Flow Steering and Parallel Rollout Search for Spatially Grounded Text-to-Image Generation
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
- 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
- 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation