GEditBench v2: A Human-Aligned Benchmark for General Image Editing
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Recent advances in image editing have enabled models to handle complex instructions with impressive realism. However, existing evaluation frameworks lag behind: current benchmarks suffer from narrow task coverage, while standard metrics fail to adequately capture visual consistency, i.e., the preservation of identity, structure and semantic coherence between edited and original images. To address these limitations, we introduce GEditBench v2, a comprehensive benchmark with 1,200 real-world user queries spanning 23 tasks, including a dedicated open-set category for unconstrained, out-of-distribution editing instructions beyond predefined tasks. Furthermore, we propose PVC-Judge, an open-source pairwise assessment model for visual consistency, trained via two novel region-decoupled preference data synthesis pipelines. Besides, we construct VCReward-Bench using expert-annotated preference pairs to assess the alignment of PVC-Judge with human judgments on visual consistency evaluation. Experiments show that our PVC-Judge achieves state-of-the-art evaluation performance among open-source models and even surpasses GPT-5.1 on average. Finally, by benchmarking 16 frontier editing models, we show that GEditBench v2 enables more human-aligned evaluation, revealing critical limitations of current models, and providing a reliable foundation for advancing precise image editing.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 34 of its 56 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
34 of 56 references.
Closest ancestors · 4
Same direction, newest first
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editing30 Sep
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learning28 Aug
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May
Other references · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2024Depth Anything V2cited by 1,385
- 2025DINOv3cited by 1,297
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
18 more
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
- 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 139
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025LongCat-Image Technical Reportcited by 92
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
- 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
- 2025VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cuescited by 33
- 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
- 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 24
- 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 23
- 2025UnicEdit-10M: A Dataset and Benchmark Breaking the Scale-Quality Barrier via Unified Verification for Reasoning-Enriched Editscited by 9
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 5
- 2026ChatGPT Images 2.5 on Forgery Tasks: Testing Advertised Improvements Against Known Answerscited by 2
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editingcited by 0
- 2026ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancementcited by 0
- 2026Qwen-Image-Flash: Rethinking the Training Recipe for Few-Step Distillationcited by 0
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metriccited by 0
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editingcited by 0
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generationcited by 0
- 2026Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoningcited by 0
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEvalcited by 0
- 2026Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservationcited by 0
- 2026Do MLLM Judges Judge the Edit? Auditing Bias in Image Editing Evaluation with Verified Quality Preservation1 Oct 2026
- 2026ChatGPT Images 2.5 on Forgery Tasks: Testing Advertised Improvements Against Known Answers12 Sep 2026
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval10 Sep 2026
- 2026Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning27 Aug 2026
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation17 Aug 2026
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing30 Jul 2026
- 2026The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric20 Jul 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026Qwen-Image-Flash: Rethinking the Training Recipe for Few-Step Distillation2 Jun 2026
- 2026ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement25 May 2026
- 2026Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing26 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
- 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
- 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
- 2026MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing
- 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Models
- 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement