AdaPilot: Towards Scene-Adaptive Policy Learning for Cross-Generator Text-to-Image Quality Optimization
On the map: Deep reinforcement learning methods → RL with diffusion and flow models
Abstract (arXiv)
Existing methods for improving text-to-image generation quality have progressed from generator fine-tuning and prompt optimization to reinforcement learning with multi-turn visual feedback. However, existing strategies are deeply coupled with specific generators and tasks, and the learned capabilities are difficult to generalize into a universal quality optimization policy. Therefore, we propose AdaPilot, which learns a scene-adaptive, cross-generator transferable quality optimization policy by formulating multi-turn image generation as a Markov Decision Process (MDP) and optimizing it via end-to-end reinforcement learning. Specifically, AdaPilot decouples the policy from generator internals to enable cross-generator transfer, introduces scene-aware rewards that adaptively align quality assessment dimensions with task semantics, and employs process-level rewards to model the evolution trajectory of image quality. Experimental results show AdaPilot outperforms baselines in generation quality and generalization. Separate cross-generator evaluations further show that a single policy transfers zero-shot to unseen generators while maintaining positive average gains across all evaluated generators. Our project is available at https://github.com/QwenQing/Ada_pilot.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL with diffusion and flow models, one of 15 directions in Deep reinforcement learning methods. Builds on 28 of its 40 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
28 of 40 references.
References · 28
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
- 2025LongCat-Image Technical Reportcited by 100
16 more
- 2024Improving Text-to-Image Consistency via Automatic Prompt Optimizationcited by 90
- 2024Controllable Generation with Text-to-Image Diffusion Models: A Surveycited by 83
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 69
- 2024CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matchingcited by 61
- 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 56
- 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewritingcited by 43
- 2024PRDP: Proximal Reward Difference Prediction for Large-Scale Reward Finetuning of Diffusion Modelscited by 42
- 2025PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Frameworkcited by 40
- 2025Evaluation of Best-of-N Sampling Strategies for Language Model Alignmentcited by 39
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 33
- 2024Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biasescited by 30
- 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluationcited by 30
- 2025A Survey of Multimodal Hallucination Evaluation and Detectioncited by 27
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 24
- 2024Minority-Focused Text-to-Image Generation via Prompt Optimizationcited by 18
- 2026Fine-T2I: An Open, Large-Scale, and Diverse Dataset for High-Quality T2I Fine-Tuningcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AdaGen: Learning Adaptive Policy for Image Synthesis
- 2025Policy Optimized Text-to-Image Pipeline Design
- 2024AdaNAT: Exploring Adaptive Policy for Token-Based Image Generation
- 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learning
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generation
- 2025AR-GRPO: Training Autoregressive Image Generation Models via Reinforcement Learning
- 2025Learning to Sample Effective and Diverse Prompts for Text-to-Image Generation
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generation