mlsanityData to 7 Oct 2026

RadGraph: Extracting Clinical Entities and Relations from Radiology Reports

arXiv 2106.14463 ↗First posted 28 Jun 2021cs.CL cs.AI cs.IRcited by 310

Not on the map. Why?

Cited by 69 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Extracting structured clinical information from free-text radiology reports can enable the use of radiology report information for a variety of critical healthcare applications. In our work, we present RadGraph, a dataset of entities and relations in full-text chest X-ray radiology reports based on a novel information extraction schema we designed to structure radiology reports. We release a development dataset, which contains board-certified radiologist annotations for 500 radiology reports from the MIMIC-CXR dataset (14,579 entities and 10,889 relations), and a test dataset, which contains two independent sets of board-certified radiologist annotations for 100 radiology reports split equally across the MIMIC-CXR and CheXpert datasets. Using these datasets, we train and test a deep learning model, RadGraph Benchmark, that achieves a micro F1 of 0.82 and 0.73 on relation extraction on the MIMIC-CXR and CheXpert test sets respectively. Additionally, we release an inference dataset, which contains annotations automatically generated by RadGraph Benchmark across 220,763 MIMIC-CXR reports (around 6 million entities and 4 million relations) and 500 CheXpert reports (13,783 entities and 9,908 relations) with mappings to associated chest radiographs. Our freely available dataset can facilitate a wide range of research in medical natural language processing, as well as computer vision and multi-modal learning when linked to chest radiographs.

Key facts. Cited by 310 papers in the map (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 28 Jun 2021.

Builds on

19 of 39 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  3. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  4. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  5. 2019Publicly Available Clinical BERT Embeddingscited by 995
  6. 2020CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTcited by 329
  7. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  8. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 308
  9. 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
  10. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  11. 2020CheXclusion: Fairness gaps in deep chest X-ray classifierscited by 153
  12. 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 101
7 more
  1. 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
  2. 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
  3. 2017NegBio: a high-performance tool for negation and uncertainty detection in radiology reportscited by 79
  4. 2020A Frustratingly Easy Approach for Entity and Relation Extractioncited by 37
  5. 2021VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labelscited by 27
  6. 2020CheXpert++: Approximating the CheXpert labeler for Speed,Differentiability, and Probabilistic Outputcited by 23
  7. 2019Understanding Spatial Language in Radiology: Representation Framework, Annotation, and Spatial Relation Extraction from Chest X-ray Reports using Deep Learningcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 9; 2023: 48; 2024: 70; 2025: 68; 2026: 114.

310 papers.

Sort:

By area:

  1. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
  2. 2023Towards Generalist Biomedical AIcited by 286
  3. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
  4. 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
  5. 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
  6. 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
  7. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 124
  8. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  9. 2023Dynamic Graph Enhanced Contrastive Learning for Chest X-ray Report Generationcited by 114
  10. 2023R2GenGPT: Radiology Report Generation with Frozen LLMscited by 111
  11. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
  12. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 100
38 more
  1. 2024Advancing Multimodal Medical Capabilities of Geminicited by 88
  2. 2022Improving the Factual Correctness of Radiology Report Generation with Semantic Rewardscited by 82
  3. 2023A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text Supervisioncited by 78
  4. 2023MAIRA-1: A specialised large multimodal model for radiology report generationcited by 72
  5. 2021Knowledge Matters: Radiology Report Generation with General and Specific Knowledgecited by 68
  6. 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
  7. 2024Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluationcited by 51
  8. 2022Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priorscited by 48
  9. 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
  10. 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
  11. 2026MedGemma 1.5 Technical Reportcited by 43
  12. 2022A Medical Semantic-Assisted Transformer for Radiographic Report Generationcited by 42
  13. 2023CLIP in Medical Imaging: A Surveycited by 40
  14. 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 39
  15. 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 39
  16. 2023ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMscited by 35
  17. 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 33
  18. 2023Exploring the Boundaries of GPT-4 in Radiologycited by 31
  19. 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
  20. 2023Style-Aware Radiology Report Generation with RadGraph and Few-Shot Promptingcited by 28
  21. 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Modelscited by 28
  22. 2024VividMed: Vision Language Model with Versatile Visual Grounding for Medicinecited by 28
  23. 2023Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT modelscited by 27
  24. 2024Decomposing Disease Descriptions for Enhanced Pathology Detection: A Multi-Aspect Vision-Language Pre-training Frameworkcited by 27
  25. 2022Cross-modal Clinical Graph Transformer for Ophthalmic Report Generationcited by 24
  26. 2023RadAdapt: Radiology Report Summarization via Lightweight Domain Adaptation of Large Language Modelscited by 24
  27. 2023Longitudinal Data and a Semantic Similarity Reward for Chest X-Ray Report Generationcited by 24
  28. 2023Medical Vision Language Pretraining: A surveycited by 24
  29. 2024ReXrank: A Public Leaderboard for AI-Powered Radiology Report Generationcited by 24
  30. 2025RadVLM: A Multitask Conversational Vision-Language Model for Radiologycited by 24
  31. 2024Fact-Aware Multimodal Retrieval Augmentation for Accurate Medical Radiology Report Generationcited by 23
  32. 2024An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generationcited by 23
  33. 2023RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoningcited by 22
  34. 2022Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rayscited by 21
  35. 2023UniChest: Conquer-and-Divide Pre-training for Multi-Source Chest X-Ray Classificationcited by 21
  36. 2025RadEval: A framework for radiology text evaluationcited by 21
  37. 2024Has Multimodal Learning Delivered Universal Intelligence in Healthcare? A Comprehensive Surveycited by 20
  38. 2024Anatomical Structure-Guided Medical Vision-Language Pre-trainingcited by 18

50 most cited of 310 All 310 (JSON)