RSIgen: Reciprocal Self-Improvement for Agentic Visual Generation
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Agentic visual generation produces experience that can improve the native understanding (agent) and generation roles of a unified multimodal backbone, but task success alone does not determine which role should learn. Generator updates can also make the agent's action supervision stale. We introduce RSIgen, a task-centric reciprocal self-improvement framework linking learning allocation, supervision refresh, and recursive curriculum construction. Dynamic Responsibility Routing (DRR) uses matched interventions on evidence, inputs, and supported actions to select learning recipients and construct compatible training targets. After generator learning, RSIgen re-evaluates the relative utility of tested actions with branch inputs held fixed to refresh agent supervision; the retained roles then construct the next curriculum. Across BAGEL, Qwen-Image, and Wan-Image-7B, RSIgen improves AgentGen-Bench Full Overall9 by 3.2--3.3 points over a three-cycle SearchGen adaptation with action costs. Wan controls support allocation gains at matched role-level training exposure, refresh gains at a matched adaptation budget, and benefits from updated curriculum sources while recipients continue learning. In blind evaluation on 200 real-user requests, pooled tie-adjusted preference scores against the same baseline reach 70.0% for task completion and 64.9% for visual quality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 28 of its 33 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
28 of 33 references.
Closest ancestors · 5
Same direction, newest first
- 2026ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation5 Aug
- 2026Search Beyond What Can Be Taught: Evolving the Knowledge Boundary in Agentic Visual Generation6 Jul
- 2026Unify-Agent: A Unified Multimodal Agent for World-Grounded Image Synthesis31 Mar
- 2026Gen-Searcher: Reinforcing Agentic Search for Image Generation30 Mar
- 2026Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation2 Feb
Other references · 23
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 557
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
- 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 210
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2022Text-Guided Synthesis of Artistic Images with Retrieval-Augmented Diffusion Modelscited by 64
- 2026UniCorn: Towards Self-Improving Unified Multimodal Models through Self-Generated Supervisioncited by 26
- 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 22
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 21
11 more
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 19
- 2025HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generationcited by 18
- 2026UniGRPO: Unified Policy Optimization for Reasoning-Driven Visual Generationcited by 13
- 2026Qwen-Image-Agent: Bridging the Context Gap in Real-World Image Generationcited by 13
- 2025Turning Internal Gap into Self-Improvement: Promoting the Generation-Understanding Unification in MLLMscited by 10
- 2025SUDER: Self-Improving Unified Large Multimodal Models for Understanding and Generation with Dual Self-Rewardscited by 8
- 2026Endogenous Reprompting: Self-Evolving Cognitive Alignment for Unified Multimodal Modelscited by 7
- 2026Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewardscited by 7
- 2026Learning to Generate via Understanding: Understanding-Driven Intrinsic Rewarding for Unified Multimodal Modelscited by 6
- 2025UniRL-Zero: Reinforcement Learning on Unified Models with Joint Language Model and Diffusion Model Expertscited by 5
- 2026Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Internalizing Agent Experience into Diffusion Model Weights via On-Policy Context Distillation
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning
- 2026SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learning
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
- 2026V-Gym: Enhancing Agentic Visual Reasoning via Skill-Data Co-Evolution
- 2026VideoGen-Agent: Reinforcing Video Generation Agents
- 2026APT: Feedback-Driven Agentic Post-Training for Text-to-Image Generation
- 2026Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generation