mlsanityData to 14 Oct 2026

Physics-Based Benchmarking Metrics for Multimodal Synthetic Images

arXiv 2511.15204 ↗First posted 19 Nov 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Current state of the art measures like BLEU, CIDEr, VQA score, SigLIP-2 and CLIPScore are often unable to capture semantic or structural accuracy, especially for domain-specific or context-dependent scenarios. For this, this paper proposes a Physics-Constrained Multimodal Data Evaluation (PCMDE) metric combining large language models with reasoning, knowledge based mapping and vision-language models to overcome these limitations. The architecture is comprised of three main stages: (1) feature extraction of spatial and semantic information with multimodal features through object detection and VLMs; (2) Confidence-Weighted Component Fusion for adaptive component-level validation; and (3) physics-guided reasoning using large language models for structural and relational constraints (e.g., alignment, position, consistency) enforcement.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 19 Nov 2025.

Builds on

23 of 39 references.

References · 23

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  6. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  7. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  8. 2016SPICE: Semantic Propositional Image Caption Evaluationcited by 824
  9. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  10. 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 305
  11. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  12. 2019Does BLEU Score Work for Code Migration?cited by 49
11 more
  1. 2024FLEUR: An Explainable Reference-Free Evaluation Metric for Image Captioning Using a Large Multimodal Modelcited by 45
  2. 2025Synthetic Data Generation & Multi-Step RL for Reasoning & Tool Usecited by 45
  3. 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 40
  4. 2024PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Modelscited by 36
  5. 2021Coarse-to-Fine Reasoning for Visual Question Answeringcited by 25
  6. 2021CIDEr-R: Robust Consensus-based Image Description Evaluationcited by 22
  7. 2025Synthetic Data is an Elegant GIFT for Continual Vision-Language Modelscited by 21
  8. 2024Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Supportcited by 11
  9. 2024SynthVLM: Towards High-Quality and Efficient Synthesis of Image-Caption Datasets for Vision-Language Modelscited by 6
  10. 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokenscited by 4
  11. 2024Text-to-Image Generation Via Energy-Based CLIPcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence
  2. 2025RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks
  3. 2023MMBench: Is Your Multi-modal Model an All-around Player?
  4. 2024MEGA-Bench: Scaling Multimodal Evaluation to over 500 Real-World Tasks
  5. 2026FORGE: Fine-grained Multimodal Evaluation for Manufacturing Scenarios
  6. 2025Revisiting Reliability in the Reasoning-based Pose Estimation Benchmark
  7. 2025The Art of Saying "Maybe": A Conformal Lens for Uncertainty Benchmarking in VLMs
  8. 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMs