mlsanityData to 7 Oct 2026

CheXbert: Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERT

arXiv 2004.09167 ↗First posted 20 Apr 2020cs.CL cs.IR cs.LGcited by 329

Not on the map. Why?

Cited by 55 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The extraction of labels from radiology text reports enables large-scale training of medical imaging models. Existing approaches to report labeling typically rely either on sophisticated feature engineering based on medical domain knowledge or manual annotations by experts. In this work, we introduce a BERT-based approach to medical image report labeling that exploits both the scale of available rule-based systems and the quality of expert annotations. We demonstrate superior performance of a biomedically pretrained BERT model first trained on annotations of a rule-based labeler and then finetuned on a small set of expert annotations augmented with automated backtranslation. We find that our final model, CheXbert, is able to outperform the previous best rules-based labeler with statistical significance, setting a new SOTA for report labeling on one of the largest datasets of chest x-rays.

Key facts. Cited by 329 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 17; 2022: 25; 2023: 51; 2024: 84; 2025: 74; 2026: 78.

329 papers.

Sort:

By area:

  1. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  2. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  3. 2023Towards Generalist Biomedical AIcited by 286
  4. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 217
  5. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
  6. 2023Conformal Language Modelingcited by 163
  7. 2022Domino: Discovering Systematic Errors with Cross-Modal Embeddingscited by 155
  8. 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
  9. 2024MAIRA-2: Grounded Radiology Report Generationcited by 140
  10. 2023Interactive and Explainable Region-guided Radiology Report Generationcited by 139
  11. 2024Exploring scalable medical image encoders beyond text supervisioncited by 129
  12. 2023Knowledge-enhanced Visual-Language Pre-training on Chest Radiology Imagescited by 128
38 more
  1. 2024GREEN: Generative Radiology Report Evaluation and Error Notationcited by 124
  2. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  3. 2024Vision-Language Models for Medical Report Generation and Visual Question Answering: A Reviewcited by 121
  4. 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
  5. 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116
  6. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 100
  7. 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
  8. 2022Improving Chest X-Ray Report Generation by Leveraging Warm Startingcited by 93
  9. 2023PromptMRG: Diagnosis-Driven Prompts for Medical Report Generationcited by 92
  10. 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
  11. 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
  12. 2022Improving the Factual Correctness of Radiology Report Generation with Semantic Rewardscited by 82
  13. 2023MAIRA-1: A specialised large multimodal model for radiology report generationcited by 72
  14. 2022Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequencescited by 67
  15. 2024RaTEScore: A Metric for Radiology Report Generationcited by 65
  16. 2022Cross-modal Prototype Driven Network for Radiology Report Generationcited by 58
  17. 2024Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluationcited by 51
  18. 2024Conformal Alignment: Knowing When to Trust Foundation Models with Guaranteescited by 50
  19. 2022Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priorscited by 48
  20. 2024MedImageInsight: An Open-Source Embedding Model for General Domain Medical Imagingcited by 45
  21. 2024Automated Radiology Report Generation: A Review of Recent Advancescited by 43
  22. 2021Weakly Supervised Contrastive Learning for Chest X-Ray Report Generationcited by 39
  23. 2023ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoningcited by 39
  24. 2025Enhanced Contrastive Learning with Multi-view Longitudinal Data for Chest X-ray Report Generationcited by 39
  25. 2023Multimodal Image-Text Matching Improves Retrieval-based Chest X-Ray Report Generationcited by 37
  26. 2021Neural Natural Language Processing for Unstructured Data in Electronic Health Records: a Reviewcited by 35
  27. 2023A Comparative Study of Pretrained Language Models for Long Clinical Textcited by 35
  28. 2023ChatCAD+: Towards a Universal and Reliable Interactive CAD using LLMscited by 35
  29. 2024CXPMRG-Bench: Pre-training and Benchmarking for X-ray Medical Report Generation on CheXpert Plus Datasetcited by 33
  30. 2024Dia-LLaMA: Towards Large Language Model-driven CT Report Generationcited by 32
  31. 2024HERGen: Elevating Radiology Report Generation with Longitudinal Datacited by 32
  32. 2023Exploring the Boundaries of GPT-4 in Radiologycited by 31
  33. 2024Libra: Leveraging Temporal Images for Biomedical Radiology Analysiscited by 29
  34. 2024MultiMedEval: A Benchmark and a Toolkit for Evaluating Medical Vision-Language Modelscited by 28
  35. 2024VividMed: Vision Language Model with Versatile Visual Grounding for Medicinecited by 28
  36. 2021VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labelscited by 27
  37. 2022Explaining Chest X-ray Pathologies in Natural Languagecited by 27
  38. 2023Retrieval Augmented Chest X-Ray Report Generation using OpenAI GPT modelscited by 27

50 most cited of 329 All 329 (JSON)