mlsanityData to 14 Oct 2026

AdaPilot: Towards Scene-Adaptive Policy Learning for Cross-Generator Text-to-Image Quality Optimization

arXiv 2609.29517 ↗First posted 25 Aug 2026cs.CV cs.CEcited by 0

On the map: Deep reinforcement learning methods → RL with diffusion and flow models

Abstract (arXiv)

Existing methods for improving text-to-image generation quality have progressed from generator fine-tuning and prompt optimization to reinforcement learning with multi-turn visual feedback. However, existing strategies are deeply coupled with specific generators and tasks, and the learned capabilities are difficult to generalize into a universal quality optimization policy. Therefore, we propose AdaPilot, which learns a scene-adaptive, cross-generator transferable quality optimization policy by formulating multi-turn image generation as a Markov Decision Process (MDP) and optimizing it via end-to-end reinforcement learning. Specifically, AdaPilot decouples the policy from generator internals to enable cross-generator transfer, introduces scene-aware rewards that adaptively align quality assessment dimensions with task semantics, and employs process-level rewards to model the evolution trajectory of image quality. Experimental results show AdaPilot outperforms baselines in generation quality and generalization. Separate cross-generator evaluations further show that a single policy transfers zero-shot to unseen generators while maintaining positive average gains across all evaluated generators. Our project is available at https://github.com/QwenQing/Ada_pilot.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL with diffusion and flow models, one of 15 directions in Deep reinforcement learning methods. Builds on 28 of its 40 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

28 of 40 references.

References · 28

  1. 2025Qwen-Image Technical Reportcited by 1,044
  2. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  3. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  4. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
  5. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  6. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  7. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
  8. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  9. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
  10. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  11. 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
  12. 2025LongCat-Image Technical Reportcited by 100
16 more
  1. 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
  2. 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 83
  3. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 69
  4. 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matchingcited by 61
  5. 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
  6. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
  7. 2024PRDP: Proximal Reward Difference Prediction for Large-Scale Reward Finetuning of Diffusion Modelscited by 42
  8. 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 40
  9. 2025Evaluation of Best-of-N Sampling Strategies for Language Model Alignmentcited by 39
  10. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 33
  11. 2024Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biasescited by 30
  12. 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluationcited by 30
  13. 2025A Survey of Multimodal Hallucination Evaluation and Detectioncited by 27
  14. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
  15. 2024Minority-Focused Text-to-Image Generation via Prompt Optimizationcited by 18
  16. 2026Fine-T2I: An Open, Large-Scale, and Diverse Dataset for High-Quality T2I Fine-Tuningcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AdaGen: Learning Adaptive Policy for Image Synthesis
  2. 2025Policy Optimized Text-to-Image Pipeline Design
  3. 2024AdaNAT: Exploring Adaptive Policy for Token-Based Image Generation
  4. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learning
  5. 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generation
  6. 2025AR-GRPO: Training Autoregressive Image Generation Models via Reinforcement Learning
  7. 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation
  8. 2026Generation Navigator: A State-Aware Agentic Framework for Image Generation