JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Photo retouching has become integral to contemporary visual storytelling, enabling users to capture aesthetics and express creativity. While professional tools such as Adobe Lightroom offer powerful capabilities, they demand substantial expertise and manual effort. In contrast, existing AI-based solutions provide automation but often suffer from limited adjustability and poor generalization, failing to meet diverse and personalized editing needs. To bridge this gap, we introduce JarvisArt, a multi-modal large language model (MLLM)-driven agent that understands user intent, mimics the reasoning process of professional artists, and intelligently coordinates over 200 retouching tools within Lightroom. JarvisArt undergoes a two-stage training process: an initial Chain-of-Thought supervised fine-tuning to establish basic reasoning and tool-use skills, followed by Group Relative Policy Optimization for Retouching (GRPO-R) to further enhance its decision-making and tool proficiency. We also propose the Agent-to-Lightroom Protocol to facilitate seamless integration with Lightroom. To evaluate performance, we develop MMArt-Bench, a novel benchmark constructed from real-world user edits. JarvisArt demonstrates user-friendly interaction, superior generalization, and fine-grained control over both global and local adjustments, paving a new avenue for intelligent photo retouching. Notably, it outperforms GPT-4o with a 60% improvement in average pixel-level metrics on MMArt-Bench for content fidelity, while maintaining comparable instruction-following capabilities. Project Page: https://jarvisart.vercel.app/.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 78 references that are in the map. First posted on arXiv 21 Jun 2025.
Builds on
57 of 78 references.
References · 57
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2024GPT-4o System Cardcited by 4,588
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
38 more
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 666
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 634
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024InternLM2 Technical Reportcited by 397
- 2024OmniGen: Unified Image Generationcited by 394
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2025ToolRL: Reward is All Tool Learning Needscited by 362
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
- 2023AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Headcited by 265
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 185
- 2020Learning Image-adaptive 3D Lookup Tables for High Performance Photo Enhancement in Real-timecited by 163
- 2025UniTok: A Unified Tokenizer for Visual Generation and Understandingcited by 153
- 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 137
- 2024InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoningcited by 119
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2024o1-Coder: an o1 Replication for Codingcited by 78
- 2022Harmonizer: Learning to Perform White-Box Image and Video Harmonizationcited by 61
- 2021PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistencycited by 59
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
- 2025QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generationcited by 45
- 2025EEdit: Rethinking the Spatial and Temporal Redundancy for Efficient Image Editingcited by 45
- 2024Preference Optimization for Reasoning with Pseudo Feedbackcited by 39
- 2019Unpaired Image Enhancement Featuring Reinforcement-Learning-Controlled Image Editing Softwarecited by 34
- 2024CodeDPO: Aligning Code Models with Self Generated and Verified Source Codecited by 34
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
- 2021ReconfigISP: Reconfigurable Camera Image Processing Pipelinecited by 30
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 8; 2026: 31.
39 papers.
Sort:
By area:
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 31
- 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 9
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistencycited by 7
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesiscited by 6
- 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouchingcited by 6
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
27 more
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
- 2025Enhancing Zero-Shot Brain Tumor Subtype Classification via Fine-Grained Patch-Text Alignmentcited by 4
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Rewardcited by 4
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 4
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2025Active Intelligence in Video Avatars via Closed-loop World Modelingcited by 3
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorizationcited by 2
- 2026AceTone: Bridging Words and Colors for Conditional Image Gradingcited by 2
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignmentcited by 2
- 2025MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Modelscited by 1
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
- 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Datasetcited by 1
- 2026AesFormer: Transform Everyday Photos into Beautiful Memoriescited by 1
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agentscited by 1
- 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learningcited by 0
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editingcited by 0
- 2026VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouchingcited by 0
- 2026InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Spacecited by 0
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fogcited by 0
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancementcited by 0
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarioscited by 0
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matchingcited by 0
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanationcited by 0
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanation28 Sep 2026
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching28 Sep 2026
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios3 Sep 2026
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement1 Sep 2026
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents26 Jul 2026
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fog6 Jul 2026
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment6 Jun 2026
- 2026InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Space3 Jun 2026
- 2026AesFormer: Transform Everyday Photos into Beautiful Memories21 May 2026
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling30 Apr 2026
- 2026VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouching30 Apr 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
27 more
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Dataset17 Apr 2026
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026AceTone: Bridging Words and Colors for Conditional Image Grading1 Apr 2026
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization30 Mar 2026
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generation23 Mar 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents9 Mar 2026
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation6 Mar 2026
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Images2 Mar 2026
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Models26 Feb 2026
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward19 Feb 2026
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedback12 Feb 2026
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling9 Feb 2026
- 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learning9 Feb 2026
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfer5 Feb 2026
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025Active Intelligence in Video Avatars via Closed-loop World Modeling23 Dec 2025
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimization28 Nov 2025
- 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouching17 Nov 2025
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistency27 Oct 2025
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis2 Oct 2025
- 2025MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Models26 Sep 2025
- 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Control11 Aug 2025
- 2025Enhancing Zero-Shot Brain Tumor Subtype Classification via Fine-Grained Patch-Text Alignment3 Aug 2025
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 19
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesiscited by 6
- 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouchingcited by 6
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflowscited by 4
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignmentcited by 2
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Procited by 1
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment6 Jun 2026
- 2026Banana100: Breaking NR-IQA Metrics by 100 Iterative Image Replications with Nano Banana Pro3 Apr 2026
- 2026GlyphBanana: Advancing Precise Text Rendering Through Agentic Workflows12 Mar 2026
- 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Tooling9 Feb 2026
- 2025PerTouch: VLM-Driven Agent for Personalized and Semantic Image Retouching17 Nov 2025
- 2025DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis2 Oct 2025
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generationcited by 15
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
- 2026VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouchingcited by 0
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matchingcited by 0
- 2026FlowTool: Controlling Tool Parameter in Image Retouching via Flow Matching28 Sep 2026
- 2026VeraRetouch: A Lightweight Fully Differentiable Framework for Multi-Task Reasoning Photo Retouching30 Apr 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026Manifold-Aware Exploration for Reinforcement Learning in Video Generation23 Mar 2026
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation6 Mar 2026
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Modelscited by 6
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Rewardcited by 4
- 2025MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Modelscited by 1
- 2026Photon: Speedup Volume Understanding with Efficient Multimodal Large Language Models26 Mar 2026
- 2026RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward19 Feb 2026
- 2025MultiMat: Multimodal Program Synthesis for Procedural Materials using Large Multimodal Models26 Sep 2025
- 2026Agentic Retoucher for Text-To-Image Generationcited by 7
- 2026Agentic Retoucher for Text-To-Image Generation5 Jan 2026
- 2025Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Controlcited by 28
- 2026FastVMT: Eliminating Redundancy in Video Motion Transfercited by 23
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 9
- 2025SceneDecorator: Towards Scene-Oriented Story Generation with Scene Planning and Scene Consistencycited by 7
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2026HiFi-Inpaint: Towards High-Fidelity Reference-Based Inpainting for Generating Detail-Preserving Human-Product Imagescited by 5
- 2026SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agentscited by 5
- 2025Enhancing Zero-Shot Brain Tumor Subtype Classification via Fine-Grained Patch-Text Alignmentcited by 4
- 2026PhotoAgent: Exploratory Visual Aesthetic Planning with Large Vision Modelscited by 4
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorizationcited by 2
- 2026AceTone: Bridging Words and Colors for Conditional Image Gradingcited by 2
- 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Datasetcited by 1
12 most cited of 20 All 20 (JSON)
- 2026FigAct: Turning Scientific Figures into Active Canvases for Explanation28 Sep 2026
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios3 Sep 2026
- 2026Dotting the Eye: An Intent-Driven Image Retouching Agent for Visual Focus Enhancement1 Sep 2026
- 2026JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents26 Jul 2026
- 2026A Task-Driven Evaluation of UAV Detection and Tracking under Synthetic Fog6 Jul 2026
- 2026InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Space3 Jun 2026
- 2026AesFormer: Transform Everyday Photos into Beautiful Memories21 May 2026
- 2026SmartPhotoCrafter: Unified Reasoning, Generation and Optimization for Automatic Photographic Image Editing21 Apr 2026
- 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Dataset17 Apr 2026
- 2026AceTone: Bridging Words and Colors for Conditional Image Grading1 Apr 2026
- 2026ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization30 Mar 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
12 newest of 20 All 20 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025PhotoArtAgent: Intelligent Photo Retouching with Language Model-Based Artist Agents
- 2026CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration
- 2025RetouchLLM: Training-free Code-based Image Retouching with Vision Language Models
- 2025MonetGPT: Solving Puzzles Enhances MLLMs' Image Retouching Skills
- 2026PrismGPT: Proxy-Guided Learning for Region-Aware Photo Editing with Self-Synthesized Reasoning
- 2026CutVerse: A Compositional GUI Agents Benchmark for Media Post-Production Editing
- 2025Image-POSER: Reflective RL for Multi-Expert Image Generation and Editing
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement