mlsanityData to 14 Oct 2026

JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent

arXiv 2506.17612 ↗First posted 21 Jun 2025cs.CVcited by 39

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Photo retouching has become integral to contemporary visual storytelling, enabling users to capture aesthetics and express creativity. While professional tools such as Adobe Lightroom offer powerful capabilities, they demand substantial expertise and manual effort. In contrast, existing AI-based solutions provide automation but often suffer from limited adjustability and poor generalization, failing to meet diverse and personalized editing needs. To bridge this gap, we introduce JarvisArt, a multi-modal large language model (MLLM)-driven agent that understands user intent, mimics the reasoning process of professional artists, and intelligently coordinates over 200 retouching tools within Lightroom. JarvisArt undergoes a two-stage training process: an initial Chain-of-Thought supervised fine-tuning to establish basic reasoning and tool-use skills, followed by Group Relative Policy Optimization for Retouching (GRPO-R) to further enhance its decision-making and tool proficiency. We also propose the Agent-to-Lightroom Protocol to facilitate seamless integration with Lightroom. To evaluate performance, we develop MMArt-Bench, a novel benchmark constructed from real-world user edits. JarvisArt demonstrates user-friendly interaction, superior generalization, and fine-grained control over both global and local adjustments, paving a new avenue for intelligent photo retouching. Notably, it outperforms GPT-4o with a 60% improvement in average pixel-level metrics on MMArt-Bench for content fidelity, while maintaining comparable instruction-following capabilities. Project Page: https://jarvisart.vercel.app/.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 78 references that are in the map. First posted on arXiv 21 Jun 2025.

Builds on

57 of 78 references.

References · 57

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  9. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  10. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  11. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  12. 2024Qwen2.5-Coder Technical Reportcited by 1,203
38 more
  1. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  3. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  4. 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
  5. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  6. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
  7. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  8. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  9. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  10. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  11. 2024InternLM2 Technical Reportcited by 397
  12. 2024OmniGen: Unified Image Generationcited by 394
  13. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  14. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  15. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  16. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  17. 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
  18. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
  19. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  20. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  21. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  22. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
  23. 2020Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-timecited by 163
  24. 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
  25. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 137
  26. 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 119
  27. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
  28. 2024o1-Coder: an o1 Replication for Codingcited by 78
  29. 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
  30. 2021PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistencycited by 59
  31. 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
  32. 2025QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generationcited by 45
  33. 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
  34. 2024Preference Optimization for Reasoning with Pseudo Feedbackcited by 39
  35. 2019Unpaired Image Enhancement Featuring Reinforcement-Learning-Controlled Image Editing Softwarecited by 34
  36. 2024CodeDPO: Aligning Code Models with Self Generated and Verified Source Codecited by 34
  37. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
  38. 2021ReconfigISP: Reconfigurable Camera Image Processing Pipelinecited by 30

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 31.

39 papers.

Sort:

By area:

  1. 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 31
  2. 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
  3. 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
  4. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
  5. 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
  6. 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 9
  7. 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistencycited by 7
  8. 2026Agentic Retoucher for Text-To-Image Generationcited by 7
  9. 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesiscited by 6
  10. 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouchingcited by 6
  11. 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
  12. 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
27 more
  1. 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
  2. 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
  3. 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
  4. 2025Enhancing Zero-Shot Brain Tumor Subtype Classification via Fine-Grained Patch-Text Alignmentcited by 4
  5. 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Rewardcited by 4
  6. 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 4
  7. 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
  8. 2025Active Intelligence in Video Avatars via Closed-loop World Modelingcited by 3
  9. 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
  10. 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
  11. 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorizationcited by 2
  12. 2026AceTone: Bridging Words and Colors for Conditional Image Gradingcited by 2
  13. 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignmentcited by 2
  14. 2025MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Modelscited by 1
  15. 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
  16. 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Datasetcited by 1
  17. 2026AesFormer: Transform Everyday Photos into Beautiful Memoriescited by 1
  18. 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
  19. 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learningcited by 0
  20. 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
  21. 2026VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouchingcited by 0
  22. 2026InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Spacecited by 0
  23. 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fogcited by 0
  24. 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancementcited by 0
  25. 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarioscited by 0
  26. 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matchingcited by 0
  27. 2026FigAct: Turning Scientific Figures into Active Canvases for Explanationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025PhotoArtAgent: Intelligent Photo Retouching with Language Model-Based Artist Agents
  2. 2026CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
  3. 2025RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models
  4. 2025MonetGPT: Solving Puzzles Enhances MLLMs' Image Retouching Skills
  5. 2026PrismGPT: Proxy-Guided Learning for Region-Aware Photo Editing with Self-Synthesized Reasoning
  6. 2026CutVerse: A Compositional GUI Agents Benchmark for Media Post-Production Editing
  7. 2025Image-POSER: Reflective RL for Multi-Expert Image Generation and Editing
  8. 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement