mlsanityData to 7 Oct 2026

GEditBench v2: A Human-Aligned Benchmark for General Image Editing

arXiv 2603.28547 ↗First posted 30 Mar 2026cs.CVcited by 11

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Recent advances in image editing have enabled models to handle complex instructions with impressive realism. However, existing evaluation frameworks lag behind: current benchmarks suffer from narrow task coverage, while standard metrics fail to adequately capture visual consistency, i.e., the preservation of identity, structure and semantic coherence between edited and original images. To address these limitations, we introduce GEditBench v2, a comprehensive benchmark with 1,200 real-world user queries spanning 23 tasks, including a dedicated open-set category for unconstrained, out-of-distribution editing instructions beyond predefined tasks. Furthermore, we propose PVC-Judge, an open-source pairwise assessment model for visual consistency, trained via two novel region-decoupled preference data synthesis pipelines. Besides, we construct VCReward-Bench using expert-annotated preference pairs to assess the alignment of PVC-Judge with human judgments on visual consistency evaluation. Experiments show that our PVC-Judge achieves state-of-the-art evaluation performance among open-source models and even surpasses GPT-5.1 on average. Finally, by benchmarking 16 frontier editing models, we show that GEditBench v2 enables more human-aligned evaluation, revealing critical limitations of current models, and providing a reliable foundation for advancing precise image editing.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 34 of its 56 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

34 of 56 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editing30 Sep
  2. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modeling28 Sep
  3. 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learning28 Aug
  4. 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning6 May

Other references · 30

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2024Depth Anything V2cited by 1,385
  7. 2025DINOv3cited by 1,297
  8. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  9. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  10. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  11. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  12. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 362
18 more
  1. 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
  2. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  3. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  4. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  5. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  6. 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 211
  7. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
  8. 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 139
  9. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
  10. 2025LongCat-Image Technical Reportcited by 92
  11. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
  12. 2023InstructEdit: Improving Automatic Masks for Diffusion-based Image Editing With User Instructionscited by 64
  13. 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
  14. 2025VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cuescited by 33
  15. 2024BrushEdit: All-In-One Image Inpainting and Editingcited by 31
  16. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 24
  17. 2025ICE-Bench: A Unified and Comprehensive Benchmark for Image Creating and Editingcited by 23
  18. 2025UnicEdit-10M: A Dataset and Benchmark Breaking the Scale-Quality Barrier via Unified Verification for Reasoning-Enriched Editscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
  2. 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editing
  3. 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
  4. 2026UniEditBench: A Unified and Cost-Effective Benchmark for Image and Video Editing via Distilled MLLMs
  5. 2026MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing
  6. 2025I2I-Bench: A Comprehensive Benchmark Suite for Image-to-Image Editing Models
  7. 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependencies
  8. 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement