RadOnc-GPT: A Large Language Model for Radiation Oncology
Not on the map. Why?
Abstract (arXiv)
This paper presents RadOnc-GPT, a large language model specialized for radiation oncology through advanced tuning methods. RadOnc-GPT was finetuned on a large dataset of radiation oncology patient records from the Mayo Clinic in Arizona. The model employs instruction tuning on three key tasks - generating radiotherapy treatment regimens, determining optimal radiation modalities, and providing diagnostic descriptions/ICD codes based on patient diagnostic details. Evaluations conducted by comparing RadOnc-GPT outputs to general large language model outputs showed higher ROUGE scores in these three tasks. The study demonstrated the potential of using large language models fine-tuned using domain-specific knowledge like RadOnc-GPT to achieve transformational capabilities in highly specialized healthcare fields such as radiation oncology. However, our model's clinical relevance requires confirmation, and it specializes in only the aforementioned three specific tasks and lacks broader applicability. Furthermore, its evaluation through ROUGE scores might not reflect the true semantic and clinical accuracy - challenges we intend to address in future research.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 24 of its 59 references that are in the map. First posted on arXiv 18 Sep 2023.
Builds on
24 of 59 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023GPT-4 Technical Reportcited by 18,396
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 368
- 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 130
- 2023Review of Large Vision Models and Visual Prompt Engineeringcited by 77
- 2023An Iterative Optimizing Framework for Radiology Report Summarization with ChatGPTcited by 57
- 2023When Brain-inspired AI Meets AGIcited by 54
- 2023Evaluating Large Language Models on a Highly-specialized Topic, Radiation Oncology Physicscited by 49
- 2023Radiology-GPT: A Large Language Model for Radiologycited by 44
- 2023SAMAug: Point Prompt Augmentation for Segment Anything Modelcited by 38
12 more
- 2023AD-AutoGPT: An Autonomous GPT for Alzheimer's Disease Infodemiologycited by 34
- 2023Context Matters: A Strategy to Pre-train Language Model for Science Educationcited by 32
- 2023Exploring the Trade-Offs: Unified Large Language Models vs Local Fine-Tuned Models for Highly-Specific Radiology NLI Taskcited by 32
- 2023Artificial General Intelligence for Medical Imaging Analysiscited by 32
- 2023Differentiate ChatGPT-generated and Human-written Medical Textscited by 26
- 2023Mask-guided BERT for Few Shot Text Classificationcited by 25
- 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
- 2023Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applicationscited by 21
- 2023CohortGPT: An Enhanced GPT for Participant Recruitment in Clinical Studycited by 19
- 2023Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Datacited by 13
- 2023Evaluating Large Language Models for Radiology Natural Language Processingcited by 12
- 2023Hierarchical Semantic Tree Concept Whitening for Interpretable Image Classificationcited by 5
Built on by
Citing papers per year: 2023: 5; 2024: 9; 2025: 4.
18 papers.
Sort:
By area:
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
- 2024Reasoning before Comparison: LLM-Enhanced Semantic Similarity Metrics for Domain Specialized Text Analysiscited by 21
- 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
- 2023On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applicationscited by 15
- 2024Automated radiotherapy treatment planning guided by GPT-4Visioncited by 12
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translationcited by 12
- 2024GP-GPT: Large Language Model for Gene-Phenotype Mappingcited by 11
- 2023Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 reportcited by 5
- 2023Evaluating multiple large language models in pediatric ophthalmologycited by 4
- 2025Large Language Models for Bioinformaticscited by 3
6 more
- 2025Evaluating The Performance of Using Large Language Models to Automate Summarization of CT Simulation Orders in Radiation Oncologycited by 3
- 2024Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses from Closed-Domain LLM vs. Clinical Teamscited by 2
- 2024EXACT-Net:EHR-guided lung tumor auto-segmentation for non-small cell lung cancer radiotherapycited by 1
- 2024A Survey for Large Language Models in Biomedicinecited by 1
- 2025A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncologycited by 1
- 2025An Automated Retrieval-Augmented Generation LLaMA-4 109B-based System for Evaluating Radiotherapy Treatment Planscited by 0
- 2025An Automated Retrieval-Augmented Generation LLaMA-4 109B-based System for Evaluating Radiotherapy Treatment Plans25 Sep 2025
- 2025A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncology19 Mar 2025
- 2025Evaluating The Performance of Using Large Language Models to Automate Summarization of CT Simulation Orders in Radiation Oncology27 Jan 2025
- 2025Large Language Models for Bioinformatics10 Jan 2025
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research30 Nov 2024
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation18 Nov 2024
- 2024Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses from Closed-Domain LLM vs. Clinical Teams26 Sep 2024
- 2024GP-GPT: Large Language Model for Gene-Phenotype Mapping15 Sep 2024
- 2024A Survey for Large Language Models in Biomedicine29 Aug 2024
- 2024Automated radiotherapy treatment planning guided by GPT-4Vision21 Jun 2024
- 2024EXACT-Net:EHR-guided lung tumor auto-segmentation for non-small cell lung cancer radiotherapy21 Feb 2024
- 2024Reasoning before Comparison: LLM-Enhanced Semantic Similarity Metrics for Domain Specialized Text Analysis17 Feb 2024
6 more
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insights22 Jan 2024
- 2023On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applications23 Dec 2023
- 2023Multimodality of AI for Education: Towards Artificial General Intelligence10 Dec 2023
- 2023Holistic Evaluation of GPT-4V for Biomedical Imaging10 Nov 2023
- 2023Evaluating multiple large language models in pediatric ophthalmology7 Nov 2023
- 2023Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 report5 Oct 2023
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 90
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Researchcited by 27
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
- 2023Holistic Evaluation of GPT-4V for Biomedical Imagingcited by 19
- 2023On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applicationscited by 15
- 2024Automated radiotherapy treatment planning guided by GPT-4Visioncited by 12
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translationcited by 12
- 2024GP-GPT: Large Language Model for Gene-Phenotype Mappingcited by 11
- 2023Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 reportcited by 5
- 2023Evaluating multiple large language models in pediatric ophthalmologycited by 4
- 2025Large Language Models for Bioinformaticscited by 3
- 2025Evaluating The Performance of Using Large Language Models to Automate Summarization of CT Simulation Orders in Radiation Oncologycited by 3
12 most cited of 16 All 16 (JSON)
- 2025A Language Vision Model Approach for Automated Tumor Contouring in Radiation Oncology19 Mar 2025
- 2025Evaluating The Performance of Using Large Language Models to Automate Summarization of CT Simulation Orders in Radiation Oncology27 Jan 2025
- 2025Large Language Models for Bioinformatics10 Jan 2025
- 2024Opportunities and Challenges of Large Language Models for Low-Resource Languages in Humanities Research30 Nov 2024
- 2024Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation18 Nov 2024
- 2024Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses from Closed-Domain LLM vs. Clinical Teams26 Sep 2024
- 2024GP-GPT: Large Language Model for Gene-Phenotype Mapping15 Sep 2024
- 2024A Survey for Large Language Models in Biomedicine29 Aug 2024
- 2024Automated radiotherapy treatment planning guided by GPT-4Vision21 Jun 2024
- 2024EXACT-Net:EHR-guided lung tumor auto-segmentation for non-small cell lung cancer radiotherapy21 Feb 2024
- 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insights22 Jan 2024
- 2023On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applications23 Dec 2023
12 newest of 16 All 16 (JSON)