mlsanityData to 14 Oct 2026

OpenMedQ: Broad Open Pretraining for Medical Vision-Language Models

arXiv 2606.12953 ↗First posted 11 Jun 2026cs.AI cs.CV cs.LGcited by 1

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

We present OpenMedQ, a medical vision-language model pretrained on the broadest fully-open medical mix to date: 14 datasets totaling ~3.35M pretraining samples spanning pathology, radiology, microscopy, and text-only clinical QA. OpenMedQ reaches state-of-the-art BLEU-1 on PathVQA (75.9), beating Med-PaLM M variants up to 562B parameters (~80x larger), and matches the best reported VQA-MED BLEU-1 (64.5). Its vision encoder, transferred to 8 unseen medical classification benchmarks under an identical downstream recipe, obtains the highest average macro-F1 (0.757) among BiomedCLIP (0.745), PMC-CLIP (0.745), PubMedCLIP (0.746), and a from-scratch baseline (0.616). We release our code and an interactive demo is publicly available as a reproducible baseline for the community.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 15 of its 26 references that are in the map. First posted on arXiv 11 Jun 2026.

Builds on

15 of 26 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024OmniMedVQA: A New Large-Scale Comprehensive Evaluation Benchmark for Medical LVLM14 Feb
  2. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day1 Jun

Other references · 13

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 972
  5. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
  6. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  7. 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
  8. 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 338
  9. 2023Towards Generalist Biomedical AIcited by 289
  10. 2023PMC-CLIP: Contrastive Language-Image Pre-training using Biomedical Documentscited by 212
  11. 2023Open-Ended Medical Visual Question Answering Through Prefix Tuning of Language Modelscited by 58
  12. 2021Hard Sample Aware Noise Robust Learning for Histopathology Image Classificationcited by 48
1 more
  1. 2024μ-Bench: A Vision-Language Benchmark for Microscopy Understandingcited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Discrete Diffusion Language Models for Interactive Radiology Report Draftingcited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2026OpenMedReason: Scientific Reasoning Supervision for Medical Vision-Language Models
  2. 2025How Far Have Medical Vision-Language Models Come? A Comprehensive Benchmarking Study
  3. 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Models
  4. 2024WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation
  5. 2026MedLLM: An Open Medical Language Model at the Sub-Billion Scale
  6. 2025A Lightweight Large Vision-language Model for Multimodal Medical Images
  7. 2026A Controlled Audit of Pretraining Contamination in Public Medical Vision-Language Benchmarks
  8. 2025OmniV-Med: Scaling Medical Vision-Language Model for Universal Visual Understanding