mlsanityData to 7 Oct 2026

AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea

arXiv 2411.15738 ↗First posted 24 Nov 2024cs.CVcited by 235

Not on the map. Why?

Cited by 53 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on low-quality data with limited editing types. We present AnyEdit, a comprehensive multi-modal instruction editing dataset, comprising 2.5 million high-quality editing pairs spanning over 20 editing types and five domains. We ensure the diversity and quality of the AnyEdit collection through three aspects: initial data diversity, adaptive editing process, and automated selection of editing results. Using the dataset, we further train a novel AnyEdit Stable Diffusion with task-aware routing and learnable task embedding for unified image editing. Comprehensive experiments on three benchmark datasets show that AnyEdit consistently boosts the performance of diffusion-based editing models. This presents prospects for developing instruction-driven image editing models that support human creativity.

Key facts. Cited by 235 papers in the map (data through 7 Oct 2026). Builds on 72 of its 90 references that are in the map. First posted on arXiv 24 Nov 2024.

Builds on

72 of 90 references.

References · 72

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2024The Llama 3 Herd of Modelscited by 14,192
  7. 2020Denoising Diffusion Implicit Modelscited by 9,655
  8. 2023Segment Anythingcited by 8,158
  9. 2023Visual Instruction Tuningcited by 7,792
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  11. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  12. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
38 more
  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2022Classifier-Free Diffusion Guidancecited by 5,717
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  9. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  10. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  11. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  12. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  13. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  14. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  15. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  16. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  17. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  18. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  19. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  20. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
  21. 2022Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionalitycited by 523
  22. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  23. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  24. 2024OmniGen: Unified Image Generationcited by 388
  25. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
  26. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  27. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  28. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  29. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  30. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  31. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  32. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  33. 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
  34. 2022Versatile Diffusion: Text, Images and Variations All in One Diffusion Modelcited by 199
  35. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  36. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  37. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  38. 2023HIVE: Harnessing Human Feedback for Instructional Visual Editingcited by 172

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 108; 2026: 125.

235 papers.

Sort:

By area:

  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  4. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  5. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  6. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  7. 2025Emu3.5: Native Multimodal Models are World Learnerscited by 119
  8. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
  9. 2025LongCat-Image Technical Reportcited by 92
  10. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
  11. 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
  12. 2025Uniworld-V2: Reinforce Image Editing with Diffusion Negative-aware Finetuning and MLLM Implicit Feedbackcited by 78
38 more
  1. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  2. 2025Ovis-U1 Technical Reportcited by 65
  3. 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generationcited by 64
  4. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  5. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 59
  6. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scalecited by 55
  7. 2025ILLUME+: Illuminating Unified MLLM with Dual Visual Tokenization and Diffusion Refinementcited by 53
  8. 2025EditVerse: Unifying Image and Video Editing and Generation with In-Context Learningcited by 53
  9. 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 52
  10. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Visioncited by 52
  11. 2025OneCAT: Decoder-Only Auto-Regressive Model for Unified Understanding and Generationcited by 50
  12. 2025BLIP3o-NEXT: Next Frontier of Native Image Generationcited by 50
  13. 2025OpenVE-3M: A Large-Scale High-Quality Dataset for Instruction-Guided Video Editingcited by 50
  14. 2025UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editingcited by 43
  15. 2025Omni-Video: Democratizing Unified Video Understanding and Generationcited by 39
  16. 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
  17. 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
  18. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
  19. 2025FireEdit: Fine-grained Instruction-based Image Editing via Region-aware Vision Language Modelcited by 31
  20. 2026FireRed-Image-Edit-1.0 Technical Reportcited by 31
  21. 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
  22. 2024HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editingcited by 29
  23. 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
  24. 2025ChronoEdit: Towards Temporal Reasoning for Image Editing and World Simulationcited by 28
  25. 2025Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokenscited by 27
  26. 2025Ming-UniVision: Joint Image Understanding and Generation with a Unified Continuous Tokenizercited by 27
  27. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 25
  28. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 24
  29. 2025UniREditBench: A Unified Reasoning-based Image Editing Benchmarkcited by 23
  30. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
  31. 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 21
  32. 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
  33. 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependenciescited by 20
  34. 2025ByteMorph: Benchmarking Instruction-Guided Image Editing with Non-Rigid Motionscited by 19
  35. 2025SRUM: Fine-Grained Self-Rewarding for Unified Multimodal Modelscited by 19
  36. 2026Agent Banana: High-Fidelity Image Editing with Agentic Thinking and Toolingcited by 17
  37. 2025RealGeneral: Unifying Visual Generation via Temporal In-Context Learning with Video Modelscited by 16
  38. 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editingcited by 15

50 most cited of 235 All 235 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024InsightEdit: Towards Better Instruction Following for Image Editing
  2. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
  3. 2025Disentangling Instruction Influence in Diffusion Transformers for Parallel Multi-Instruction-Guided Image Editing
  4. 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
  5. 2025SuperEdit: Rectifying and Facilitating Supervision for Instruction-Based Image Editing
  6. 2026Instruction-based Image Editing with Planning, Reasoning, and Generation
  7. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editing
  8. 2025EditThinker: Unlocking Iterative Reasoning for Any Image Editor