mlsanityData to 14 Oct 2026

APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation

arXiv 2610.18097 ↗First posted 13 Oct 2026cs.CV cs.AIcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Post-training is crucial for improving text-to-image models, yet existing pipelines typically rely on manually curated training data and fixed training distributions. We introduce APT (Agentic Post-Training), a fully automated framework that adaptively post-trains a base model according to its evolving capability profile. APT coordinates three agents to construct evaluation sets from user requirements, diagnose model-specific strengths and failure modes, and generate reinforcement learning data with an adaptive prompt distribution that emphasizes underperforming capabilities. By repeatedly evaluating, diagnosing, and updating the generator, APT lets the current model's behavior shape its next training tasks, forming a feedback loop inspired by recursive self-improvement. For general-purpose settings without user-specified evaluation scenarios, we further develop an evaluation harness that enables broad and diverse evaluation set generation. Experiments across multiple base models, benchmarks, and generation architectures demonstrate that APT is model-agnostic, benchmark-agnostic, architecture-agnostic, and fully automated.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 42 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

34 of 42 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026Gen-Searcher: Reinforcing Agentic Search for Image Generation30 Mar
  2. 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation2 Feb
  3. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan

Other references · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  6. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  7. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  8. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  9. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  10. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  11. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  12. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
19 more
  1. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
  2. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 178
  3. 2023Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generationcited by 148
  4. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
  5. 2025LongCat-Image Technical Reportcited by 100
  6. 2025OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generationcited by 87
  7. 2025Self-Adapting Language Modelscited by 84
  8. 2025GenEval 2: Addressing Benchmark Drift in Text-to-Image Evaluationcited by 52
  9. 2025Distribution Matching Distillation Meets Reinforcement Learningcited by 50
  10. 2026Qwen-Image-2.0 Technical Reportcited by 36
  11. 2025ImAgent: A Unified Multimodal Agent Framework for Test-Time Scalable Image Generationcited by 17
  12. 2026Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generationcited by 13
  13. 2025RubricRL: Simple Generalizable Rewards for Text-to-Image Generationcited by 7
  14. 2026Lens: Rethinking Training Efficiency for Foundational Text-to-Image Modelscited by 6
  15. 2026Qwen-Image-2.0-RL Technical Reportcited by 5
  16. 2026Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editingcited by 3
  17. 2026Unified Text-Image Generation with Weakness-Targeted Post-Trainingcited by 2
  18. 2026Curriculum Group Policy Optimization: Adaptive Sampling for Unleashing the Potential of Text-to-Image Generationcited by 1
  19. 2026SeFi-Image: A Text-to-Image Foundation Model with Semantic-First Diffusioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Internalizing Agent Experience into Diffusion Model Weights via On-Policy Context Distillation
  2. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  3. 2024Batch-Instructed Gradient for Prompt Evolution:Systematic Prompt Optimization for Enhanced Text-to-Image Synthesis
  4. 2025GenPilot: A Multi-Agent System for Test-Time Prompt Optimization in Image Generation
  5. 2026MemoGen: Can Past Experience Improve Future Text-to-Image Generation?
  6. 2025AgentComp: From Agentic Reasoning to Compositional Mastery in Text-to-Image Models
  7. 2026Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generation
  8. 2026OctoT2I: A Self-Evolving Agentic Text-to-Image Router