Breast Ultrasound Report Generation using LangChain
Not on the map. Why?
Abstract (arXiv)
Breast ultrasound (BUS) is a critical diagnostic tool in the field of breast imaging, aiding in the early detection and characterization of breast abnormalities. Interpreting breast ultrasound images commonly involves creating comprehensive medical reports, containing vital information to promptly assess the patient's condition. However, the ultrasound imaging system necessitates capturing multiple images of various parts to compile a single report, presenting a time-consuming challenge. To address this problem, we propose the integration of multiple image analysis tools through a LangChain using Large Language Models (LLM), into the breast reporting process. Through a combination of designated tools and text generation through LangChain, our method can accurately extract relevant features from ultrasound images, interpret them in a clinical context, and produce comprehensive and standardized reports. This approach not only reduces the burden on radiologists and healthcare professionals but also enhances the consistency and quality of reports. The extensive experiments shows that each tools involved in the proposed method can offer qualitatively and quantitatively significant results. Furthermore, clinical evaluation on the generated reports demonstrates that the proposed method can make report in clinically meaningful way.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 5 Dec 2023.
Builds on
27 of 36 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
- 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
15 more
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 2017On the Automatic Generation of Medical Imaging Reportscited by 215
- 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
- 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 160
- 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
- 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 101
- 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
- 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
- 2019Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichmentcited by 60
- 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
- 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
- 2023ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoderscited by 49
- 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Datacited by 14
- 2020Reinforced Medical Report Generation with X-Linear Attention and Repetition Penaltycited by 1
Built on by
Citing papers per year: 2024: 3; 2025: 2.
5 papers.
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
- 2024Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!"cited by 19
- 2024MMSummary: Multimodal Summary Generation for Fetal Ultrasound Videocited by 9
- 2024Opportunities and challenges in the application of large artificial intelligence models in radiologycited by 1
- 2025Ultrasound Report Generation with Multimodal Large Language Models for Standardized Textscited by 1
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions29 Oct 2025
- 2025Ultrasound Report Generation with Multimodal Large Language Models for Standardized Texts13 May 2025
- 2024Overview of the First Shared Task on Clinical Text Generation: RRG24 and "Discharge Me!"25 Sep 2024
- 2024MMSummary: Multimodal Summary Generation for Fetal Ultrasound Video7 Aug 2024
- 2024Opportunities and challenges in the application of large artificial intelligence models in radiology24 Mar 2024