MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Recent advances in unified multimodal models have significantly improved text-guided image editing abilities. In particular, models such as Nano-Banana-Pro and GPT-Image-2 demonstrate emerging capabilities in multi-source image editing (MIE), including tasks such as object synthesis, person-background composition, and cross-image style fusion. However, existing benchmarks and image editing assessment (IEQA) methods remain primarily focused on single-image editing tasks and largely overlook the more challenging setting of MIE. This highlights the urgent need for a comprehensive and human-aligned benchmark for MIE. To this end, we introduce MIE-Bench, the first large-scale multiple image editing benchmark with fine-grained human preference annotations. Specifically, MIE-Bench includes 3,000 editing instances across 16 tasks, each involving more than two source images and an editing prompt, together with 36K edited images produced by 12 state-of-the-art editing models and over 108K mean opinion scores (MOSs) covering visual quality, instruction following, and attribute preservation. Based on MIE-Bench, we propose MIEScore, a multimodal large language model (MLLM)-based evaluation model enhanced with skill optimization and multi-dimensional supervised fine-tuning, to provide human-aligned feedback for MIE. Extensive experiments show that MIEScore achieves state-of-the-art performance in aligning with human preferences and generalizes well across other IEQA datasets. Both the dataset and the model are available at https://github.com/IntMeGroup/MIEScore.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 35 of its 59 references that are in the map. First posted on arXiv 3 Aug 2026.
Builds on
35 of 59 references.
Closest ancestors · 4
Same direction, newest first
- 2026EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editing16 Mar
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editing30 Sep
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preference25 Mar
Other references · 31
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,714
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,407
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,798
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,586
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,452
- 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,115
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,070
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 725
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 619
19 more
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 495
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 240
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 215
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 134
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 82
- 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 77
- 2024I2EBench: A Comprehensive Benchmark for Instruction-based Image Editingcited by 62
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 54
- 2023Contrastive Denoising Score for Text-guided Latent Diffusion Image Editingcited by 49
- 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
- 2025LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMscited by 23
- 2026Wan-Image: Pushing the Boundaries of Generative Visual Intelligencecited by 15
- 2025IE-Bench: Advancing the Measurement of Text-Driven Image Editing for Human Perception Alignmentcited by 10
- 2024Removing Distributional Discrepancies in Captions Improves Image-Text Alignmentcited by 8
- 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Modelscited by 7
- 2026MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Modelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
- 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editing
- 2026Evaluating Image Editing with LLMs: A Comprehensive Benchmark and Intermediate-Layer Probing Approach
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
- 2025ADIEE: Automatic Dataset Creation and Scorer for Instruction-Guided Image Editing Evaluation
- 2025MultiEdit: Advancing Instruction-based Image Editing on Diverse and Challenging Tasks
- 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment
- 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis