A Benchmark and Baseline for Language-Driven Image Editing
Not on the map. Why?
Abstract (arXiv)
Language-driven image editing can significantly save the laborious image editing work and be friendly to the photography novice. However, most similar work can only deal with a specific image domain or can only do global retouching. To solve this new task, we first present a new language-driven image editing dataset that supports both local and global editing with editing operation and mask annotations. Besides, we also propose a baseline method that fully utilizes the annotation to solve this problem. Our new method treats each editing operation as a sub-module and can automatically predict operation parameters. Not only performing well on challenging user data, but such an approach is also highly interpretable. We believe our work, including both the benchmark and the baseline, will advance the image editing area towards a more general and free-form level.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 3; 2024: 5; 2025: 7; 2026: 2.
25 papers.
Sort:
By area:
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2021Improving Generation and Evaluation of Visual Stories via Semantic Consistencycited by 43
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
- 2021Learning by Planning: Language-Guided Global Image Editingcited by 25
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2021Embedding Arithmetic of Multimodal Queries for Image Retrievalcited by 21
- 2025REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformationscited by 15
13 more
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
- 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editingcited by 10
- 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Groundingcited by 7
- 2025Towards Scalable Human-aligned Benchmark for Text-guided Image Editingcited by 7
- 2024Text-to-Image Cross-Modal Generation: A Systematic Reviewcited by 5
- 2025What's Producible May Not Be Reachable: Measuring the Steerability of Generative Modelscited by 5
- 2025Understanding Generative AI Capabilities in Everyday Image Editing Taskscited by 5
- 2022CAISE: Conversational Agent for Image Search and Editingcited by 3
- 2021SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editingcited by 2
- 2025What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Modelscited by 2
- 2026VIBE: Visual Instruction Based Editorcited by 2
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignmentcited by 2
- 2024UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraintcited by 1
- 2026IEA: Amateur-Friendly Conversational Image Editing Agent via Three Stages of Multitask Alignment6 Jun 2026
- 2026VIBE: Visual Instruction Based Editor5 Jan 2026
- 2025What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Models26 May 2025
- 2025Understanding Generative AI Capabilities in Everyday Image Editing Tasks22 May 2025
- 2025Towards Scalable Human-aligned Benchmark for Text-guided Image Editing1 May 2025
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Vision7 Apr 2025
- 2025What's Producible May Not Be Reachable: Measuring the Steerability of Generative Models21 Mar 2025
- 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing28 Feb 2025
- 2025REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformations5 Feb 2025
- 2024UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraint19 Dec 2024
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing5 Dec 2024
- 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Grounding21 Oct 2024
13 more
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions23 Sep 2024
- 2024Text-to-Image Cross-Modal Generation: A Systematic Review21 Jan 2024
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Models29 Sep 2023
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Tasks7 Sep 2023
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning3 Sep 2023
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct 2022
- 2022FlexIT: Towards Flexible Semantic Image Translation9 Mar 2022
- 2022CAISE: Conversational Agent for Image Search and Editing24 Feb 2022
- 2021Embedding Arithmetic of Multimodal Queries for Image Retrieval6 Dec 2021
- 2021SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing30 Nov 2021
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialog9 Sep 2021
- 2021Learning by Planning: Language-Guided Global Image Editing24 Jun 2021
- 2021Improving Generation and Evaluation of Visual Stories via Semantic Consistency20 May 2021
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2021Improving Generation and Evaluation of Visual Stories via Semantic Consistencycited by 43
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
- 2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
- 2021Learning by Planning: Language-Guided Global Image Editingcited by 25
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2021Embedding Arithmetic of Multimodal Queries for Image Retrievalcited by 21
- 2025REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformationscited by 15
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
- 2025Towards Scalable Human-aligned Benchmark for Text-guided Image Editingcited by 7
12 most cited of 19 All 19 (JSON)
- 2026VIBE: Visual Instruction Based Editor5 Jan 2026
- 2025Understanding Generative AI Capabilities in Everyday Image Editing Tasks22 May 2025
- 2025Towards Scalable Human-aligned Benchmark for Text-guided Image Editing1 May 2025
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Vision7 Apr 2025
- 2025What's Producible May Not Be Reachable: Measuring the Steerability of Generative Models21 Mar 2025
- 2025REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformations5 Feb 2025
- 2024UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraint19 Dec 2024
- 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing5 Dec 2024
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions23 Sep 2024
- 2024Text-to-Image Cross-Modal Generation: A Systematic Review21 Jan 2024
- 2023InstructDiffusion: A Generalist Modeling Interface for Vision Tasks7 Sep 2023
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning3 Sep 2023
12 newest of 19 All 19 (JSON)