mlsanityData to 7 Oct 2026

Open-Edit: Open-Domain Image Manipulation with Open-Vocabulary Instructions

arXiv 2008.01576 ↗First posted 4 Aug 2020cs.CVcited by 25

Not on the map. Why?

Abstract (arXiv)

We propose a novel algorithm, named Open-Edit, which is the first attempt on open-domain image manipulation with open-vocabulary instructions. It is a challenging task considering the large variation of image domains and the lack of training supervision. Our approach takes advantage of the unified visual-semantic embedding space pretrained on a general image-caption dataset, and manipulates the embedded visual features by applying text-guided vector arithmetic on the image feature maps. A structure-preserving image decoder then generates the manipulated images from the manipulated feature maps. We further propose an on-the-fly sample-specific optimization approach with cycle-consistency constraints to regularize the manipulated images and force them to preserve details of the source images. Our approach shows promising results in manipulating open-vocabulary color, texture, and high-level attributes for various scenarios of open-domain images.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 3; 2023: 7; 2024: 6; 2025: 3; 2026: 2.

25 papers.

Sort:

By area:

  1. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  2. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  3. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  4. 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
  5. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
  6. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  7. 2023Alchemist: Parametric Control of Material Properties with Diffusion Modelscited by 38
  8. 2021Language-Driven Image Style Transfercited by 36
  9. 2023LIME: Localized Image Editing via Attention Regularization in Diffusion Modelscited by 27
  10. 2023Region-Aware Diffusion for Zero-shot Text-driven Image Editingcited by 25
  11. 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
  12. 2022DE-Net: Dynamic Text-guided Image Editing Adversarial Networkscited by 12
13 more
  1. 2023MVP-SEG: Multi-View Prompt Learning for Open-Vocabulary Semantic Segmentationcited by 10
  2. 2025InstructVEdit: A Holistic Approach for Instructional Video Editingcited by 7
  3. 2023Language-based Photo Color Adjustment for Graphic Designscited by 6
  4. 2024A Survey of Multimodal Composite Editing and Retrievalcited by 5
  5. 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
  6. 2021SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editingcited by 2
  7. 2024Content-aware Tile Generation using Exterior Boundary Inpaintingcited by 2
  8. 2026HorizonWeaver: Generalizable Multi-Level Semantic Editing for Driving Scenescited by 2
  9. 2021Each Attribute Matters: Contrastive Attention for Sentence-based Image Editingcited by 1
  10. 2022Target-Free Text-guided Image Manipulationcited by 1
  11. 2024UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraintcited by 1
  12. 2024PixLens: A Novel Framework for Disentangled Evaluation in Diffusion-Based Image Editing with Object Detection + SAMcited by 0
  13. 2025Understanding the Implicit User Intention via Reasoning with Large Language Model for Image Editingcited by 0