mlsanityData to 7 Oct 2026

MCIE: Multimodal LLM-Driven Complex Instruction Image Editing with Spatial Guidance

arXiv 2602.07993 ↗First posted 8 Feb 2026cs.CV cs.AIcited by 1

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

Abstract (arXiv)

Recent advances in instruction-based image editing have shown remarkable progress. However, existing methods remain limited to relatively simple editing operations, hindering real-world applications that require complex and compositional instructions. In this work, we address these limitations from the perspectives of architectural design, data, and evaluation protocols. Specifically, we identify two key challenges in current models: insufficient instruction compliance and background inconsistency. To this end, we propose MCIE-E1, a Multimodal Large Language Model-Driven Complex Instruction Image Editing method that integrates two key modules: a spatial-aware cross-attention module and a background-consistent cross-attention module. The former enhances instruction-following capability by explicitly aligning semantic instructions with spatial regions through spatial guidance during the denoising process, while the latter preserves features in unedited regions to maintain background consistency. To enable effective training, we construct a dedicated data pipeline to mitigate the scarcity of complex instruction-based image editing datasets, combining fine-grained automatic filtering via a powerful MLLM with rigorous human validation. Finally, to comprehensively evaluate complex instruction-based image editing, we introduce CIE-Bench, a new benchmark with two new evaluation metrics. Experimental results on CIE-Bench demonstrate that MCIE-E1 consistently outperforms previous state-of-the-art methods in both quantitative and qualitative assessments, achieving a 23.96% improvement in instruction compliance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 32 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

27 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan

Other references · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  7. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  8. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  9. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  10. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
  11. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  12. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
14 more
  1. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  2. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  3. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 229
  4. 2023InstructDiffusion: A Generalist Modeling Interface for Vision Taskscited by 162
  5. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  6. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
  7. 2024SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editingcited by 97
  8. 2025Q-Insight: Understanding Image Quality via Visual Reinforcement Learningcited by 93
  9. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  10. 2023ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Modelscited by 75
  11. 2023Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulationcited by 61
  12. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 61
  13. 2025OpenGPT-4o-Image: A Comprehensive Dataset for Advanced Image Generation and Editingcited by 27
  14. 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editingcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Models
  2. 2023SmartEdit: Exploring Complex Instruction-based Image Editing with Multimodal Large Language Models
  3. 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
  4. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmark
  5. 2024InsightEdit: Towards Better Instruction Following for Image Editing
  6. 2025Beyond Simple Edits: X-Planner for Complex Instruction-Based Image Editing
  7. 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications
  8. 2025CompBench: Benchmarking Complex Instruction-guided Image Editing