mlsanityData to 7 Oct 2026

ChatGPT Makes Medicine Easy to Swallow: An Exploratory Case Study on Simplified Radiology Reports

arXiv 2212.14882 ↗First posted 30 Dec 2022cs.CL cs.LGcited by 100

Not on the map. Why?

Abstract (arXiv)

The release of ChatGPT, a language model capable of generating text that appears human-like and authentic, has gained significant attention beyond the research community. We expect that the convincing performance of ChatGPT incentivizes users to apply it to a variety of downstream tasks, including prompting the model to simplify their own medical reports. To investigate this phenomenon, we conducted an exploratory case study. In a questionnaire, we asked 15 radiologists to assess the quality of radiology reports simplified by ChatGPT. Most radiologists agreed that the simplified reports were factually correct, complete, and not potentially harmful to the patient. Nevertheless, instances of incorrect statements, missed key medical findings, and potentially harmful passages were reported. While further studies are needed, the initial insights of this study indicate a great potential in using large language models like ChatGPT to improve patient-centered care in radiology and other medical domains.

Key facts. Cited by 100 papers in the map (data through 7 Oct 2026). Builds on 25 of its 56 references that are in the map. First posted on arXiv 30 Dec 2022.

Builds on

25 of 56 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2017Proximal Policy Optimization Algorithmscited by 14,441
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  8. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  9. 2017Deep reinforcement learning from human preferencescited by 3,846
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  11. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  12. 2020Extracting Training Data from Large Language Modelscited by 2,144
13 more
  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  2. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  3. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  6. 2022Galactica: A Large Language Model for Sciencecited by 736
  7. 2020Detecting Hallucinated Content in Conditional Neural Sequence Generationcited by 151
  8. 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
  9. 2020On Exposure Bias, Hallucination and Domain Shift in Neural Machine Translationcited by 127
  10. 2022Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translationcited by 60
  11. 2018Learning to Summarize Radiology Findingscited by 54
  12. 2019Ontology-Aware Clinical Abstractive Summarizationcited by 33
  13. 2022Explain to me like I am five -- Sentence Simplification Using Transformerscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 50; 2024: 41; 2025: 7; 2026: 2.

100 papers.

Sort:

By area:

  1. 2023A Survey of Large Language Modelscited by 2,537
  2. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  3. 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 472
  4. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  5. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  6. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  7. 2023ChatGPT: Jack of all trades, master of nonecited by 204
  8. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
  9. 2023Gender bias and stereotypes in Large Language Modelscited by 185
  10. 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 165
  11. 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 152
  12. 2023Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Surveycited by 134
38 more
  1. 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
  2. 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 128
  3. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  4. 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
  5. 2023LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunitiescited by 97
  6. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  7. 2023MindAgent: Emergent Gaming Interactioncited by 87
  8. 2023Large AI Models in Health Informatics: Applications, Challenges, and the Futurecited by 61
  9. 2023An Empirical Study on Information Extraction using Large Language Modelscited by 46
  10. 2023Translating Radiology Reports into Plain Language using ChatGPT and GPT-4 with Prompt Learning: Promising Results, Limitations, and Potentialcited by 39
  11. 2024Large Language Models for Medicine: A Surveycited by 38
  12. 2024Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenizationcited by 32
  13. 2023Evaluation of GPT-3.5 and GPT-4 for supporting real-world information needs in healthcare deliverycited by 30
  14. 2023The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRscited by 29
  15. 2023Advancing Medical Imaging with Language Models: A Journey from N-grams to ChatGPTcited by 28
  16. 2023Integration of Large Language Models and Federated Learningcited by 28
  17. 2023Enhancing Psychological Counseling with Large Language Model: A Multifaceted Decision-Support System for Non-Professionalscited by 24
  18. 2024Large Language Models in Drug Discovery and Development: From Disease Mechanisms to Clinical Trialscited by 24
  19. 2024An X-Ray Is Worth 15 Features: Sparse Autoencoders for Interpretable Radiology Report Generationcited by 23
  20. 2023Large language models in medicine: the potentials and pitfallscited by 21
  21. 2025Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imagingcited by 20
  22. 2024Guiding Clinical Reasoning with Large Language Models via Knowledge Seedscited by 19
  23. 2023Can ChatGPT Enable ITS? The Case of Mixed Traffic Control via Reinforcement Learningcited by 18
  24. 2023Classification of Human- and AI-Generated Texts: Investigating Features for ChatGPTcited by 18
  25. 2023Transformers in Healthcare: A Surveycited by 17
  26. 2023Can LLMs facilitate interpretation of pre-trained language models?cited by 15
  27. 2024Synergizing Foundation Models and Federated Learning: A Surveycited by 14
  28. 2024TelecomRAG: Taming Telecom Standards with Retrieval Augmented Generation and LLMscited by 13
  29. 2023Is attention all you need in medical image analysis? A reviewcited by 12
  30. 2024Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcarecited by 12
  31. 2025BRIDGE: Benchmarking Large Language Models for Understanding Real-world Clinical Practice Textcited by 11
  32. 2023Exploring ChatGPT's Empathic Abilitiescited by 10
  33. 2023Prompting a Large Language Model to Generate Diverse Motivational Messages: A Comparison with Human-Written Messagescited by 10
  34. 2023ChatGPT for Suicide Risk Assessment on Social Media: Quantitative Evaluation of Model Performance, Potentials and Limitationscited by 9
  35. 2023Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Mediacited by 9
  36. 2024MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devicescited by 9
  37. 2023Scamming the Scammers: Using ChatGPT to Reply Mails for Wasting Time and Resourcescited by 8
  38. 2023Investigating Large Language Models and Control Mechanisms to Improve Text Readability of Biomedical Abstractscited by 8

50 most cited of 100 All 100 (JSON)