mlsanityData to 7 Oct 2026

A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation

arXiv 2401.12208 ↗First posted 22 Jan 2024cs.CV cs.CLcited by 79

Not on the map. Why?

Cited by 28 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Over 1.4 billion chest X-rays (CXRs) are performed annually due to their cost-effectiveness as an initial diagnostic test. This scale of radiological studies provides a significant opportunity to streamline CXR interpretation and documentation. While foundation models are a promising solution, the lack of publicly available large-scale datasets and benchmarks inhibits their iterative development and real-world evaluation. To overcome these challenges, we constructed a large-scale dataset (CheXinstruct), which we utilized to train a vision-language foundation model (CheXagent). We systematically demonstrated competitive performance across eight distinct task types on our novel evaluation benchmark (CheXbench). Beyond technical validation, we assessed the real-world utility of CheXagent in directly drafting radiology reports. Our clinical assessment with eight radiologists revealed a 36% time saving for residents using CheXagent-drafted reports, while attending radiologists showed no significant time difference editing resident-drafted or CheXagent-drafted reports. The CheXagent-drafted reports improved the writing efficiency of both radiology residents and attending radiologists in 81% and 61% of cases, respectively, without loss of quality. Overall, we demonstrate that CheXagent can effectively perform a variety of CXR interpretation tasks and holds potential to assist radiologists in routine clinical workflows.

Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Jan 2024.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 25; 2025: 30; 2026: 24.

79 papers.

Sort:

By area:

  1. 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
  2. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 124
  3. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 100
  4. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
  5. 2025MedRAX: Medical Reasoning Agent for Chest X-raycited by 68
  6. 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
  7. 2024MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosiscited by 28
  8. 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiologycited by 24
  9. 2024Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generationcited by 23
  10. 2024An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generationcited by 23
  11. 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Surveycited by 20
  12. 2024MedVH: Towards Systematic Evaluation of Hallucination for Large Vision Language Models in the Medical Contextcited by 19
38 more
  1. 2024Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlookscited by 18
  2. 2024A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Modelscited by 16
  3. 2024A Survey on Trustworthiness in Foundation Models for Medical Image Analysiscited by 16
  4. 2024M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretationcited by 16
  5. 2024EchoFM: Foundation Model for Generalizable Echocardiogram Analysiscited by 14
  6. 2024CXR-Agent: Vision-language models for chest X-ray interpretation with uncertainty aware radiology reportingcited by 11
  7. 2024LLM-RG4: Flexible and Factual Radiology Report Generation across Diverse Input Contextscited by 11
  8. 2024Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Modelscited by 8
  9. 2025Lunguage: A Benchmark for Structured and Sequential Chest X-ray Interpretationcited by 8
  10. 2025ReEvalMed: Rethinking Medical Report Evaluation by Aligning Metrics with Real-World Clinical Judgmentcited by 8
  11. 2025Ophiuchus: Incentivizing Tool-augmented "Think with Images" for Joint Medical Segmentation, Understanding and Reasoningcited by 8
  12. 2024Uncovering Knowledge Gaps in Radiology Report Generation Models through Knowledge Graphscited by 7
  13. 2025Improving Performance, Robustness, and Fairness of Radiographic AI Models with Finely-Controllable Synthetic Datacited by 7
  14. 2025MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Modelscited by 6
  15. 2024Specialized curricula for training vision-language models in retinal image analysiscited by 5
  16. 2024Fool Me Once? Contrasting Textual and Visual Explanations in a Clinical Decision-Support Settingcited by 5
  17. 2025Chest X-ray Foundation Model with Global and Local Representations Integrationcited by 5
  18. 2025CXReasonBench: A Benchmark for Evaluating Structured Diagnostic Reasoning in Chest X-rayscited by 5
  19. 2025AURA: A Multi-Modal Medical Agent for Understanding, Reasoning & Annotationcited by 5
  20. 2025Agentic Systems in Radiology: Design, Applications, Evaluation, and Challengescited by 5
  21. 2025DeepSparse: A Foundation Model for Sparse-View CBCT Reconstructioncited by 4
  22. 2025Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learningcited by 4
  23. 2026MEDVISTAGYM: A Scalable Training Environment for Thinking with Medical Images via Tool-Integrated Reinforcement Learningcited by 4
  24. 2026A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretationcited by 4
  25. 2024CheXalign: Preference fine-tuning in chest X-ray interpretation models without human feedbackcited by 3
  26. 2025Automated Real-time Assessment of Intracranial Hemorrhage Detection AI Using an Ensembled Monitoring Model (EMM)cited by 3
  27. 2025Benchmarking Foundation Models and Parameter-Efficient Fine-Tuning for Prognosis Prediction in Medical Imagingcited by 3
  28. 2026ECHO: Efficient Chest X-ray Report Generation with One-step Block Diffusioncited by 3
  29. 2024Inquire, Interact, and Integrate: A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoningcited by 2
  30. 2024LaB-RAG: Label Boosted Retrieval Augmented Generation for Radiology Report Generationcited by 2
  31. 2025Rethinking Whole-Body CT Image Interpretation: An Abnormality-Centric Approachcited by 2
  32. 2025CX-Mind: A Pioneering Multimodal Large Language Model for Interleaved Reasoning in Chest X-ray via Curriculum-Guided Reinforcement Learningcited by 2
  33. 2025Resolution scaling governs DINOv3 transfer performance in chest radiograph classificationcited by 2
  34. 2025A DeepSeek-Powered AI System for Automated Chest Radiograph Interpretation in Clinical Practicecited by 2
  35. 2026Picking the Right Specialist: Attentive Neural Process-based Selection of Task-Specialized Models as Tools for Agentic Healthcare Systemscited by 2
  36. 2026ClinFusion: A Vision-Centric Multimodal LLM System for Holistic Medical Understandingcited by 2
  37. 2024Intelligent Control of Robotic X-ray Devices using a Language-promptable Digital Twincited by 1
  38. 2025Meta-Entity Driven Triplet Mining for Aligning Medical Vision-Language Modelscited by 1

50 most cited of 79 All 79 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023CXR-LLAVA: a multimodal large language model for interpreting chest X-ray images
  2. 2026CheXthought: A global multimodal dataset of clinical chain-of-thought reasoning and visual attention for chest X-ray interpretation
  3. 2025Benchmarking Chest X-ray Diagnosis Models Across Multinational Datasets
  4. 2025A Review of Longitudinal Radiology Report Generation: Dataset Composition, Methods, and Performance Evaluation
  5. 2026CheXGround: Anatomical Region Tokens for Grounded Longitudinal Chest X-ray Interpretation
  6. 2026A data- and compute-efficient chest X-ray foundation model beyond aggressive scaling
  7. 2023Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generation
  8. 2025CoCa-CXR: Contrastive Captioners Learn Strong Temporal Structures for Chest X-Ray Vision-Language Understanding