mlsanityData to 14 Oct 2026

MedLayBench-V: A Large-Scale Benchmark for Expert-Lay Semantic Alignment in Medical Vision Language Models

arXiv 2604.05738 ↗First posted 7 Apr 2026cs.CLcited by 1

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Medical Vision-Language Models (Med-VLMs) have achieved expert-level proficiency in interpreting diagnostic imaging. However, current models are predominantly trained on professional literature, limiting their ability to communicate findings in the lay register required for patient-centered care. While text-centric research has actively developed resources for simplifying medical jargon, there is a critical absence of large-scale multimodal benchmarks designed to facilitate lay-accessible medical image understanding. To bridge this resource gap, we introduce MedLayBench-V, the first large-scale multimodal benchmark dedicated to expert-lay semantic alignment. Unlike naive simplification approaches that risk hallucination, our dataset is constructed via a Structured Concept-Grounded Refinement (SCGR) pipeline. This method enforces strict semantic equivalence by integrating Unified Medical Language System (UMLS) Concept Unique Identifiers (CUIs) with micro-level entity constraints. MedLayBench-V provides a verified foundation for training and evaluating next-generation Med-VLMs capable of bridging the communication divide between clinical experts and patients.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 19 of its 40 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

19 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day1 Jun

Other references · 18

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  6. 2022Reproducible scaling laws for contrastive language-image learningcited by 1,173
  7. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  8. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  9. 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
  10. 2020Multi-domain Clinical Natural Language Processing with MedCAT: the Medical Concept Annotation Toolkitcited by 66
  11. 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 55
  12. 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
6 more
  1. 2025MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Taskscited by 29
  2. 2024Overview of the BioLaySumm 2024 Shared Task on the Lay Summarization of Biomedical Research Articlescited by 18
  3. 2023README: Bridging Medical Jargon and Lay Understanding for Patient Education through Data-Centric NLPcited by 17
  4. 2024X-ray Made Simple: Lay Radiology Report Generation and Robust Evaluationcited by 10
  5. 2023Visual Question Answering in the Medical Domaincited by 8
  6. 2025Magical: Medical Lay Language Generation via Semantic Invariance and Layperson-tailored Adaptationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025How Far Have Medical Vision-Language Models Come? A Comprehensive Benchmarking Study
  2. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Review
  3. 2025Bridged Semantic Alignment for Zero-shot 3D Medical Image Diagnosis
  4. 2025Visual Alignment of Medical Vision-Language Models for Grounded Radiology Report Generation
  5. 2026MedPlex: Deep Vision-Language Co-Adaptation for Clinically Grounded Medical Segmentation
  6. 2026Towards Clinically Faithful Medical Image Captioning via Enhanced Vision-Language Alignment
  7. 2026SCALPEL: Semantic Cross-modal Alignment via LLM-Powered Encoder Learning for Medical Vision-Language Representation
  8. 2024Med-MoE: Mixture of Domain-Specific Experts for Lightweight Medical Vision-Language Models