mlsanityData to 14 Oct 2026

Image-POSER: Reflective RL for Multi-Expert Image Generation and Editing

arXiv 2511.11780 ↗First posted 15 Nov 2025cs.CV cs.AIcited by 2

On the map: Deep reinforcement learning methods → RL with diffusion and flow models

Abstract (arXiv)

Recent advances in text-to-image generation have produced strong single-shot models, yet no individual system reliably executes the long, compositional prompts typical of creative workflows. We introduce Image-POSER, a reflective reinforcement learning framework that (i) orchestrates a diverse registry of pretrained text-to-image and image-to-image experts, (ii) handles long-form prompts end-to-end through dynamic task decomposition, and (iii) supervises alignment at each step via structured feedback from a vision-language model critic. By casting image synthesis and editing as a Markov Decision Process, we learn non-trivial expert pipelines that adaptively combine strengths across models. Experiments show that Image-POSER outperforms baselines, including frontier models, across industry-standard and custom benchmarks in alignment, fidelity, and aesthetics, and is consistently preferred in human evaluations. These results highlight that reinforcement learning can endow AI systems with the capacity to autonomously decompose, reorder, and combine visual models, moving towards general-purpose visual assistants.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in RL with diffusion and flow models, one of 15 directions in Deep reinforcement learning methods. Builds on 16 of its 29 references that are in the map. First posted on arXiv 15 Nov 2025.

Builds on

16 of 29 references.

References · 16

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  8. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  9. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  10. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  11. 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
  12. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
4 more
  1. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  2. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  3. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  4. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learningcited by 52

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Self-Rewarding Large Vision-Language Models for Optimizing Prompts in Text-to-Image Generation
  2. 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
  3. 2026ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations
  4. 2025Integrating Reinforcement Learning with Visual Generative Models: Foundations and Advances
  5. 2025InstructEngine: Instruction-driven Text-to-Image Alignment
  6. 2026Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generation
  7. 2025PromptEnhancer: A Simple Approach to Enhance Text-to-Image Models via Chain-of-Thought Prompt Rewriting
  8. 2026Can We Perform Online RL for Image Editing without Editing Rewards?