mlsanityData to 7 Oct 2026

OctoT2I: A Self-Evolving Agentic Text-to-Image Router

arXiv 2606.01803 ↗First posted 1 Jun 2026cs.AIcited by 3

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

The explosive growth of Text-to-Image (T2I) models, from large-scale versions to lightweight, real-time ones, now faces diminishing marginal returns from single-model scaling. Agentic T2I methods emerged to alleviate this bottleneck by using multiple models. However, existing agentic T2I methods suffer from three key challenges: reliance on expensive handcrafted priors or human annotations, rigid single-path decision mechanisms, and a neglect of inference efficiency. To address these challenges, we introduce OctoT2I, a novel agentic framework that reformulates the T2I task as a joint optimization of generation quality and inference efficiency. OctoT2I implements a stateful, multi-round routing strategy that adaptively selects the most suitable tool based on its knowledge and memory. This strategy is enabled by a knowledge base built from scratch by our novel Self-Evolving Mechanism. This mechanism, which requires no human supervision, first autonomously defines foundational Conceptual Dimensions (eg, style, color, count) and then intelligently explores their combinations via an iterative" Propose--Solve--Evaluate--Learn"(PSEL) loop. The PSEL loop efficiently discovers each tool's capability frontier, driving continuous improvement without external guidance. Extensive experiments demonstrate that OctoT2I achieves competitive performance (0.96) on GenEval while delivering a 90.3% inference speedup and a 56.6% energy-efficiency gain over the leading baseline (Flow-GRPO), striking an exceptional balance between performance and efficiency. Code and models will be made available.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 53 of its 63 references that are in the map. First posted on arXiv 1 Jun 2026.

Builds on

53 of 63 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generation28 Jul
  2. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul

Other references · 51

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2023Qwen Technical Reportcited by 3,273
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  8. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  9. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  10. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  11. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  12. 2025Qwen-Image Technical Reportcited by 973
38 more
  1. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  4. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  5. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  6. 2023Adversarial Diffusion Distillationcited by 741
  7. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  8. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  9. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  10. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  11. 2022DiffusionDB: A Large-scale Prompt Gallery Dataset for Text-to-Image Generative Modelscited by 376
  12. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
  13. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
  14. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  15. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  16. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  17. 2023AutoAgents: A Framework for Automatic Agent Generationcited by 211
  18. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  19. 2023An LLM Compiler for Parallel Function Callingcited by 170
  20. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformercited by 165
  21. 2024Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Modelscited by 113
  22. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 105
  23. 2025SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillationcited by 85
  24. 2024Open-Endedness is Essential for Artificial Superhuman Intelligencecited by 79
  25. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 64
  26. 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
  27. 2023Idea2Img: Iterative Self-Refinement with GPT-4V(ision) for Automatic Image Design and Generationcited by 38
  28. 2023ChatLLM Network: More brains, More intelligencecited by 37
  29. 2025Multi-Agent Image Restorationcited by 19
  30. 2024DiffAgent: Fast and Accurate Text-to-Image API Selection with Large Language Modelcited by 12
  31. 2024ChatGen: Automatic Text-to-Image Generation From FreeStyle Chattingcited by 11
  32. 2025GenCompositor: Generative Video Compositing with Diffusion Transformercited by 9
  33. 2025UniShield: An Adaptive Multi-Agent Framework for Unified Forgery Image Detection and Localizationcited by 9
  34. 2025CoT-lized Diffusion: Let's Reinforce T2I Generation Step-by-stepcited by 8
  35. 2026DGPO: Distribution Guided Policy Optimization for Fine Grained Credit Assignmentcited by 7
  36. 2025AlignedGen: Aligning Style Across Generated Imagescited by 5
  37. 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolutioncited by 4
  38. 2024RealOSR: Latent Guidance Boosts Diffusion-based Real-world Omnidirectional Image Super-Resolutionscited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026GenRouter: Unified Workflow Routing for Agentic Image Generation
  2. 2026MemoGen: Can Past Experience Improve Future Text-to-Image Generation?
  3. 2025ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generation
  4. 2026Agentic Flow Steering and Parallel Rollout Search for Spatially Grounded Text-to-Image Generation
  5. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
  6. 2026M3: High-fidelity Text-to-Image Generation via Multi-Modal, Multi-Agent and Multi-Round Visual Reasoning
  7. 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
  8. 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation