mlsanityData to 14 Oct 2026

JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimization

arXiv 2511.23002 ↗First posted 28 Nov 2025cs.CVcited by 31

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Agent-based editing models have substantially advanced interactive experiences, processing quality, and creative flexibility. However, two critical challenges persist: (1) instruction hallucination, text-only chain-of-thought (CoT) reasoning cannot fully prevent factual errors due to inherent information bottlenecks; (2) reward hacking, dynamic policy optimization against static reward models allows agents to exploit flaws in reward functions. To address these issues, we propose JarvisEvo, a unified image editing agent that emulates an expert human designer by iteratively editing, selecting appropriate tools, evaluating results, and reflecting on its own decisions to refine outcomes. JarvisEvo offers three key advantages: (1) an interleaved multimodal chain-of-thought (iMCoT) reasoning mechanism that enhances instruction following and editing quality; (2) a synergistic editor-evaluator policy optimization (SEPO) framework that enables self-improvement without external rewards, effectively mitigating reward hacking; and (3) support for both global and local fine-grained editing through seamless integration of Adobe Lightroom. On ArtEdit-Bench, JarvisEvo outperforms Nano-Banana by an average of 18.95% on preservative editing metrics, including a substantial 44.96% improvement in pixel-level content fidelity. Project page: https://jarvisevo.vercel.app/

Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 91 of its 108 references that are in the map. First posted on arXiv 28 Nov 2025.

Builds on

91 of 108 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preference8 Sep
  2. 2025HPSv3: Towards Wide-Spectrum Human Preference Score5 Aug
  3. 2025Enhancing Reward Models for High-quality Image Generation: Beyond Text-Image Alignment25 Jul
  4. 2025DanceGRPO: Unleashing GRPO on Visual Generation12 May
  5. 2023Directly Fine-Tuning Diffusion Models on Differentiable Rewards29 Sep
  6. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar
  7. 2023Aligning Text-to-Image Models using Human Feedback23 Feb

Other references · 84

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  10. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  11. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  12. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
38 more
  1. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  2. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  3. 2025Qwen-Image Technical Reportcited by 1,044
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  5. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  6. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  7. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  8. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  9. 2024Self-Rewarding Language Modelscited by 681
  10. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  11. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  12. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  13. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  14. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  15. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 461
  16. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  17. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  18. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  19. 2024OmniGen: Unified Image Generationcited by 394
  20. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  21. 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 344
  22. 2022The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Modelscited by 328
  23. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
  24. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314
  25. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  26. 2024Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judgecited by 269
  27. 2024Self-Preference Bias in LLM-as-a-Judgecited by 258
  28. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  29. 2025Learning to Reason without External Rewardscited by 210
  30. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 199
  31. 2020Fast Differentiable Sorting and Rankingcited by 197
  32. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 182
  33. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  34. 2025Thyme: Think Beyond Imagescited by 167
  35. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoTcited by 166
  36. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  37. 2023Benchmarking Cognitive Biases in Large Language Models as Evaluatorscited by 150
  38. 2025MiMo: Unlocking the Reasoning Potential of Language Model -- From Pretraining to Posttrainingcited by 121

50 most cited of 84 All 84 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 30.

31 papers.

Sort:

By area:

  1. 2026Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challengescited by 33
  2. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  3. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
  4. 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
  5. 2026GenClaw: Code-Driven Agentic Image Generationcited by 11
  6. 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 9
  7. 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
  8. 2026OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generationcited by 8
  9. 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
  10. 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
  11. 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
  12. 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
19 more
  1. 2025Active Intelligence in Video Avatars via Closed-loop World Modelingcited by 3
  2. 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
  3. 2026Generation Navigator: A State-Aware Agentic Framework for Image Generationcited by 3
  4. 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
  5. 2026Advances in GRPO for Generation Models: A Surveycited by 2
  6. 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorizationcited by 2
  7. 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learningcited by 2
  8. 2026VisionCreator-R1: A Reflection-Enhanced Native Visual-Generation Agentic Modelcited by 1
  9. 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
  10. 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
  11. 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
  12. 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
  13. 2026CV-Arena: An Open Benchmark for Instructional Computer Vision Problem Solving with Human-AI Collaborative Preferencescited by 0
  14. 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fogcited by 0
  15. 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancementcited by 0
  16. 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognitioncited by 0
  17. 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matchingcited by 0
  18. 2026Rubric-CEPR: Self-Evolving Image Editing via Reward-Verified Self-Distillationcited by 0
  19. 2026MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models
  2. 2026ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
  3. 2026Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions
  4. 2026RewardHarness: Self-Evolving Agentic Post-Training
  5. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor
  6. 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward
  7. 2026Scalable Minimal-Change Learning for Controllable Image Editing
  8. 2026Leveraging Verifier-Based Reinforcement Learning in Image Editing