mlsanityData to 7 Oct 2026

VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation

arXiv 2312.14867 ↗First posted 22 Dec 2023cs.CV cs.AI cs.CLcited by 196

Not on the map. Why?

Cited by 35 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

In the rapidly advancing field of conditional image generation research, challenges such as limited explainability lie in effectively evaluating the performance and capabilities of various models. This paper introduces VIEScore, a Visual Instruction-guided Explainable metric for evaluating any conditional image generation tasks. VIEScore leverages general knowledge from Multimodal Large Language Models (MLLMs) as the backbone and does not require training or fine-tuning. We evaluate VIEScore on seven prominent tasks in conditional image tasks and found: (1) VIEScore (GPT4-o) achieves a high Spearman correlation of 0.4 with human evaluations, while the human-to-human correlation is 0.45. (2) VIEScore (with open-source MLLM) is significantly weaker than GPT-4o and GPT-4v in evaluating synthetic images. (3) VIEScore achieves a correlation on par with human ratings in the generation tasks but struggles in editing tasks. With these results, we believe VIEScore shows its great potential to replace human judges in evaluating image synthesis tasks.

Key facts. Cited by 196 papers in the map (data through 7 Oct 2026). Builds on 50 of its 73 references that are in the map. First posted on arXiv 22 Dec 2023.

Builds on

50 of 73 references.

References · 50

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  10. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  11. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  12. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
38 more
  1. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  3. 2016Improved Techniques for Training GANscited by 2,938
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  8. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  9. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  10. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  11. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  12. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  13. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  14. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
  15. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  16. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 738
  17. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  18. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
  19. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
  20. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  21. 2023TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answeringcited by 416
  22. 2018Assessing Generative Models via Precision and Recallcited by 401
  23. 2023Emu Edit: Precise Image Editing via Recognition and Generation Taskscited by 321
  24. 2022Text2LIVE: Text-Driven Layered Image and Video Editingcited by 312
  25. 2015Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networkscited by 214
  26. 2023Subject-driven Text-to-Image Generation via Apprenticeship Learningcited by 210
  27. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 197
  28. 2023Holistic Evaluation of Text-To-Image Modelscited by 160
  29. 2013Stabilitycited by 119
  30. 2023GPT-4V(ision) as a Generalist Evaluator for Vision-Language Taskscited by 118
  31. 2023LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluationcited by 85
  32. 2023ImagenHub: Standardizing the evaluation of conditional image generation modelscited by 75
  33. 2023TIGERScore: Towards Building Explainable Metric for All Text Generation Taskscited by 69
  34. 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
  35. 2023Photoswap: Personalized Subject Swapping in Imagescited by 47
  36. 2022Mutual Information Divergence: A Unified Metric for Multimodal Generative Modelscited by 35
  37. 2023DreamCom: Finetuning Text-guided Inpainting Model for Image Compositioncited by 17
  38. 2021COSMic: A Coherence-Aware Generation Metric for Image Descriptionscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 28; 2025: 74; 2026: 94.

196 papers.

Sort:

By area:

  1. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  2. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  3. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  4. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  5. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  6. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
  7. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
  8. 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
  9. 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
  10. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  11. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 103
  12. 2024GenAI Arena: An Open Evaluation Platform for Generative Modelscited by 81
38 more
  1. 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
  2. 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 61
  3. 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
  4. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 59
  5. 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 53
  6. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
  7. 2024A-Bench: Are LMMs Masters at Evaluating AI-generated Images?cited by 39
  8. 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
  9. 2024Reward Guided Latent Consistency Distillationcited by 35
  10. 2024Learning Action and Reasoning-Centric Image Editing from Videos and Simulationscited by 32
  11. 2025R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generationcited by 31
  12. 2026HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformercited by 29
  13. 2024Holistic Evaluation for Interleaved Text-and-Image Generationcited by 26
  14. 2025textttComplex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmarkcited by 25
  15. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 24
  16. 2025ReasonEdit: Towards Reasoning-Enhanced Image Editing Modelscited by 24
  17. 2024CrossViewDiff: A Cross-View Diffusion Model for Satellite-to-Street View Synthesiscited by 23
  18. 2025TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understandingcited by 20
  19. 2025Multimodal DeepResearcher: Generating Text-Chart Interleaved Reports From Scratch with Agentic Frameworkcited by 20
  20. 2024A Survey on Quality Metrics for Text-to-Image Generationcited by 17
  21. 2024VersaT2I: Improving Text-to-Image Models with Versatile Rewardcited by 17
  22. 2024Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2)cited by 17
  23. 2024InsightEdit: Towards Better Instruction Following for Image Editingcited by 17
  24. 2025WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generationcited by 16
  25. 2025REALEDIT: Reddit Edits As a Large-scale Empirical Dataset for Image Transformationscited by 15
  26. 2025A Unified Agentic Framework for Evaluating Conditional Image Generationcited by 15
  27. 2025Science-T2I: Addressing Scientific Illusions in Image Synthesiscited by 15
  28. 2025MIRA: Multimodal Iterative Reasoning Agent for Image Editingcited by 15
  29. 2024Automatic Evaluation for Text-to-image Generation: Task-decomposed Framework, Distilled Training, and Meta-evaluation Benchmarkcited by 13
  30. 2025Learning an Image Editing Model without Image Editing Pairscited by 13
  31. 2026Diagnosing the Reliability of LLM-as-a-Judge via Item Response Theorycited by 13
  32. 2024T2I-FactualBench: Benchmarking the Factuality of Text-to-Image Models with Knowledge-Intensive Conceptscited by 12
  33. 2025Dual-Process Image Generationcited by 12
  34. 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editingcited by 12
  35. 2026How Well Do Models Follow Visual Instructions? VIBE: A Systematic Benchmark for Visual Instruction-Driven Image Editingcited by 12
  36. 2026DanceOPD: On-Policy Generative Field Distillationcited by 12
  37. 2024Eta Inversion: Designing an Optimal Eta Function for Diffusion-based Real Image Editingcited by 11
  38. 2026GEditBench v2: A Human-Aligned Benchmark for General Image Editingcited by 11

50 most cited of 196 All 196 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Instruct-Imagen: Image Generation with Multi-modal Instruction
  2. 2026GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models
  3. 2026Large Language Models are Universal Reasoners for Visual Generation
  4. 2025GIR-Bench: Versatile Benchmark for Generating Images with Reasoning
  5. 2026Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
  6. 2025MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation
  7. 2026EditCaption: Human-Refined SFT and HAE-DPO for Image Editing Instruction Synthesis
  8. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation