mlsanityData to 14 Oct 2026

HQ-Edit: A High-Quality Dataset for Instruction-based Image Editing

arXiv 2404.09990 ↗First posted 15 Apr 2024cs.CV cs.AIcited by 193

Not on the map. Why?

Cited by 40 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This study introduces HQ-Edit, a high-quality instruction-based image editing dataset with around 200,000 edits. Unlike prior approaches relying on attribute guidance or human feedback on building datasets, we devise a scalable data collection pipeline leveraging advanced foundation models, namely GPT-4V and DALL-E 3. To ensure its high quality, diverse examples are first collected online, expanded, and then used to create high-quality diptychs featuring input and output images with detailed text prompts, followed by precise alignment ensured through post-processing. In addition, we propose two evaluation metrics, Alignment and Coherence, to quantitatively assess the quality of image edit pairs using GPT-4V. HQ-Edits high-resolution images, rich in detail and accompanied by comprehensive editing prompts, substantially enhance the capabilities of existing image editing models. For example, an HQ-Edit finetuned InstructPix2Pix can attain state-of-the-art image editing performance, even surpassing those models fine-tuned with human-annotated data. The project page is https://thefllood.github.io/HQEdit_web.

Key facts. Cited by 193 papers in the map (data through 14 Oct 2026). Builds on 28 of its 31 references that are in the map. First posted on arXiv 15 Apr 2024.

Builds on

28 of 31 references.

References · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  11. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  12. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
16 more
  1. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  2. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  3. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  4. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
  5. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  6. 2023Emergent Correspondence from Image Diffusioncited by 446
  7. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 324
  8. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  9. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  10. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  11. 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 178
  12. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 173
  13. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  14. 2023Real-Time Flying Object Detection with YOLOv8cited by 94
  15. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  16. 2023Learning to Follow Object-Centric Image Editing Instructions Faithfullycited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 30; 2025: 93; 2026: 70.

193 papers.

Sort:

By area:

  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  3. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  4. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 268
  5. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 241
  6. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  7. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  8. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 127
  9. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  10. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  11. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 97
  12. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
38 more
  1. 2024What If We Recaption Billions of Web Images with LLaMA-3?cited by 87
  2. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 85
  3. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 71
  4. 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 70
  5. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 63
  6. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 62
  7. 2024SeedEdit: Align Image Re-Generation to Image Editingcited by 61
  8. 2025Se~norita-2M: A High-Quality Instruction-based Dataset for General Video Editing by Video Specialistscited by 61
  9. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 61
  10. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 54
  11. 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 53
  12. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 53
  13. 2025Unified Autoregressive Visual Generation and Understanding with Continuous Tokenscited by 51
  14. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  15. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  16. 2025EditAR: Unified Conditional Generation with Autoregressive Modelscited by 40
  17. 2025UniEdit-Flow: Unleashing Inversion and Editing in the Era of Flow Modelscited by 39
  18. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
  19. 2024Generative Image Layer Decomposition with Visual Effectscited by 34
  20. 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
  21. 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
  22. 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 32
  23. 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
  24. 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
  25. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  26. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 28
  27. 2024Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveycited by 27
  28. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 27
  29. 2024TurboEdit: Instant text-based image editingcited by 26
  30. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  31. 2024VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editingcited by 25
  32. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 25
  33. 2025PhotoDoodle: Learning Artistic Image Editing from Few-Shot Pairwise Datacited by 24
  34. 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 22
  35. 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Datacited by 21
  36. 2024Multi-Reward as Condition for Instruction-based Image Editingcited by 20
  37. 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
  38. 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Imagecited by 20

50 most cited of 193 All 193 (JSON)