JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimization
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Agent-based editing models have substantially advanced interactive experiences, processing quality, and creative flexibility. However, two critical challenges persist: (1) instruction hallucination, text-only chain-of-thought (CoT) reasoning cannot fully prevent factual errors due to inherent information bottlenecks; (2) reward hacking, dynamic policy optimization against static reward models allows agents to exploit flaws in reward functions. To address these issues, we propose JarvisEvo, a unified image editing agent that emulates an expert human designer by iteratively editing, selecting appropriate tools, evaluating results, and reflecting on its own decisions to refine outcomes. JarvisEvo offers three key advantages: (1) an interleaved multimodal chain-of-thought (iMCoT) reasoning mechanism that enhances instruction following and editing quality; (2) a synergistic editor-evaluator policy optimization (SEPO) framework that enables self-improvement without external rewards, effectively mitigating reward hacking; and (3) support for both global and local fine-grained editing through seamless integration of Adobe Lightroom. On ArtEdit-Bench, JarvisEvo outperforms Nano-Banana by an average of 18.95% on preservative editing metrics, including a substantial 44.96% improvement in pixel-level content fidelity. Project page: https://jarvisevo.vercel.app/
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 91 of its 108 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
91 of 108 references.
Closest ancestors · 7
Same direction, newest first
- 2025Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preference8 Sep
- 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
- 2025Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment25 Jul
- 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
- 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewards29 Sep
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar
- 2023Aligning Text-to-Image Models using Human Feedback23 Feb
Other references · 84
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
38 more
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024Self-Rewarding Language Modelscited by 681
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
- 2024OmniGen: Unified Image Generationcited by 394
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
- 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
- 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
- 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
- 2025Learning to Reason without External Rewardscited by 210
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
- 2020Fast Differentiable Sorting and Rankingcited by 197
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2025Thyme: Think Beyond Imagescited by 167
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2023Benchmarking Cognitive Biases in Large Language Models as Evaluatorscited by 150
- 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 121
50 most cited of 84 All 84 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 30.
31 papers.
Sort:
By area:
- 2026Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challengescited by 33
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
- 2026GenClaw: Code-Driven Agentic Image Generationcited by 11
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 9
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
- 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generationcited by 8
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
19 more
- 2025Active Intelligence in Video Avatars via Closed-loop World Modelingcited by 3
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generationcited by 3
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorizationcited by 2
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learningcited by 2
- 2026VisionCreator-R1: A Reflection-Enhanced Native Visual-Generation Agentic Modelcited by 1
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferencescited by 0
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fogcited by 0
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancementcited by 0
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognitioncited by 0
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matchingcited by 0
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillationcited by 0
- 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editingcited by 0
- 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing9 Oct 2026
- 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillation8 Oct 2026
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching28 Sep 2026
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning13 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition3 Sep 2026
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement1 Sep 2026
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents26 Jul 2026
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fog6 Jul 2026
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences30 May 2026
- 2026GenClaw: Code-Driven Agentic Image Generation28 May 2026
- 2026Aurora: Unified Video Editing with a Tool-Using Agent18 May 2026
19 more
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generation18 May 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges15 Apr 2026
- 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generation13 Apr 2026
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization30 Mar 2026
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generation23 Mar 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026VisionCreator-R1: A Reflection-Enhanced Native Visual-Generation Agentic Model9 Mar 2026
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation6 Mar 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedback12 Feb 2026
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling9 Feb 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
- 2025Active Intelligence in Video Avatars via Closed-loop World Modeling23 Dec 2025
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
- 2026GenClaw: Code-Driven Agentic Image Generationcited by 11
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generationcited by 3
- 2026VisionCreator-R1: A Reflection-Enhanced Native Visual-Generation Agentic Modelcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferencescited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferences30 May 2026
- 2026GenClaw: Code-Driven Agentic Image Generation28 May 2026
- 2026Generation Navigator: A State-Aware Agentic Framework for Image Generation18 May 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026VisionCreator-R1: A Reflection-Enhanced Native Visual-Generation Agentic Model9 Mar 2026
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling9 Feb 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 2
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matchingcited by 0
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching28 Sep 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generation23 Mar 2026
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation6 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
- 2026Aurora: Unified Video Editing with a Tool-Using Agent18 May 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 9
- 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generationcited by 8
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorizationcited by 2
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fogcited by 0
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancementcited by 0
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognitioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing9 Oct 2026
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition3 Sep 2026
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement1 Sep 2026
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents26 Jul 2026
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fog6 Jul 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generation13 Apr 2026
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization30 Mar 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedback12 Feb 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models
- 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
- 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions
- 2026RewardHarness: Self-Evolving Agentic Post-Training
- 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward
- 2026Scalable Minimal-Change Learning for Controllable Image Editing
- 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing