mlsanityData to 13 Oct 2026

MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing

arXiv 2608.02059 ↗First posted 3 Aug 2026cs.CV cs.MMcited by 1

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Recent advances in unified multimodal models have significantly improved text-guided image editing abilities. In particular, models such as Nano-Banana-Pro and GPT-Image-2 demonstrate emerging capabilities in multi-source image editing (MIE), including tasks such as object synthesis, person-background composition, and cross-image style fusion. However, existing benchmarks and image editing assessment (IEQA) methods remain primarily focused on single-image editing tasks and largely overlook the more challenging setting of MIE. This highlights the urgent need for a comprehensive and human-aligned benchmark for MIE. To this end, we introduce MIE-Bench, the first large-scale multiple image editing benchmark with fine-grained human preference annotations. Specifically, MIE-Bench includes 3,000 editing instances across 16 tasks, each involving more than two source images and an editing prompt, together with 36K edited images produced by 12 state-of-the-art editing models and over 108K mean opinion scores (MOSs) covering visual quality, instruction following, and attribute preservation. Based on MIE-Bench, we propose MIEScore, a multimodal large language model (MLLM)-based evaluation model enhanced with skill optimization and multi-dimensional supervised fine-tuning, to provide human-aligned feedback for MIE. Extensive experiments show that MIEScore achieves state-of-the-art performance in aligning with human preferences and generalizes well across other IEQA datasets. Both the dataset and the model are available at https://github.com/IntMeGroup/MIEScore.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 35 of its 59 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

35 of 59 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing16 Mar
  2. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editing30 Sep
  3. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep
  4. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar

Other references · 31

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  2. 2025Qwen2.5-VL Technical Reportcited by 5,499
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,407
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,798
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,586
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,452
  9. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,115
  10. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,070
  11. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 725
  12. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 619
19 more
  1. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 495
  2. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 240
  3. 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 215
  4. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  5. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 134
  6. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  7. 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 82
  8. 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 77
  9. 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 62
  10. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
  11. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 54
  12. 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
  13. 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
  14. 2025LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMscited by 23
  15. 2026Wan-Image: Pushing the Boundaries of Generative Visual Intelligencecited by 15
  16. 2025IE-Bench: Advancing the Measurement of Text-Driven Image Editing for Human Perception Alignmentcited by 10
  17. 2024Removing Distributional Discrepancies in Captions Improves Image-Text Alignmentcited by 8
  18. 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Modelscited by 7
  19. 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Modelscited by 5

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
  2. 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editing
  3. 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach
  4. 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
  5. 2025ADIEE: Automatic Dataset Creation and Scorer for Instruction-Guided Image Editing Evaluation
  6. 2025MultiEdit: Advancing Instruction-based Image Editing on Diverse and Challenging Tasks
  7. 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment
  8. 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis