mlsanityData to 7 Oct 2026

Redefining Quality Criteria and Distance-Aware Score Modeling for Image Editing Assessment

arXiv 2604.12175 ↗First posted 14 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in image editing have heightened the need for reliable Image Editing Quality Assessment (IEQA). Unlike traditional methods, IEQA requires complex reasoning over multimodal inputs and multi-dimensional assessments. Existing MLLM-based approaches often rely on human heuristic prompting, leading to two key limitations: rigid metric prompting and distance-agnostic score modeling. These issues hinder alignment with implicit human criteria and fail to capture the continuous structure of score spaces. To address this, we propose Define-and-Score Image Editing Quality Assessment (DS-IEQA), a unified framework that jointly learns evaluation criteria and score representations. Specifically, we introduce Feedback-Driven Metric Prompt Optimization (FDMPO) to automatically refine metric definitions via probabilistic feedback. Furthermore, we propose Token-Decoupled Distance Regression Loss (TDRL), which decouples numerical tokens from language modeling to explicitly model score continuity through expected distance minimization. Extensive experiments show our method's superior performance; it ranks 4th in the 2026 NTIRE X-AIGC Quality Assessment Track 2 without any additional training data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 35 references that are in the map. First posted on arXiv 14 Apr 2026.

Builds on

32 of 35 references.

References · 32

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  4. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  5. 2023Large Language Modelscited by 774
  6. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  7. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  8. 2023State of What Art? A Call for Multi-Prompt LLM Evaluationcited by 299
  9. 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 247
  10. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 196
  11. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 139
  12. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
20 more
  1. 2023Re-IQA: Unsupervised Learning for Image Quality Assessment in the Wildcited by 97
  2. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rankcited by 77
  3. 2024AesBench: An Expert Benchmark for Multimodal Large Language Models on Image Aesthetics Perceptioncited by 63
  4. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 61
  5. 2024ACE: All-round Creator and Editor Following Instructions via Diffusion Transformercited by 56
  6. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methodscited by 52
  7. 2024Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructionscited by 34
  8. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  9. 2024Large Multi-modality Model Assisted AI-Generated Image Quality Assessmentcited by 24
  10. 2025LMM4Edit: Benchmarking and Evaluating Multimodal Image Editing with LMMscited by 22
  11. 2025Reasoning as Representation: Rethinking Visual Reinforcement Learning in Image Quality Assessmentcited by 18
  12. 2024PrExMe! Large Scale Prompt Exploration of Open Source LLMs for Machine Translation and Summarization Evaluationcited by 15
  13. 2025Q-Ponder: A Unified Training Pipeline for Reasoning-based Visual Quality Assessmentcited by 14
  14. 2025Balancing Preservation and Modification: A Region and Semantic Aware Metric for Instruction-Based Image Editingcited by 9
  15. 2025Towards Scalable Human-aligned Benchmark for Text-guided Image Editingcited by 7
  16. 2025Revisiting MLLM Based Image Quality Assessment: Errors and Remedycited by 7
  17. 2025Text-Visual Semantic Constrained AI-Generated Image Quality Assessmentcited by 6
  18. 2026EditHF-1M: A Million-Scale Rich Human Preference Feedback for Image Editingcited by 4
  19. 2024Surprisingly Fragile: Assessing and Addressing Prompt Instability in Multimodal Foundation Modelscited by 3
  20. 2025M3-AGIQA: Multimodal, Multi-Round, Multi-Aspect AI-Generated Image Quality Assessmentcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
  2. 2024Ground-A-Score: Scaling Up the Score Distillation for Multi-Attribute Editing
  3. 2025ADIEE: Automatic Dataset Creation and Scorer for Instruction-Guided Image Editing Evaluation
  4. 2024Multi-Reward as Condition for Instruction-based Image Editing
  5. 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessment
  6. 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
  7. 2025EdiVal-Agent: An Object-Centric Framework for Automated, Fine-Grained Evaluation of Multi-Turn Editing
  8. 2026MIEScore: Human-Aligned Evaluation for Multi-Source Image Editing