mlsanityData to 7 Oct 2026

Breast Ultrasound Report Generation using LangChain

arXiv 2312.03013 ↗First posted 5 Dec 2023eess.IV cs.AI cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Breast ultrasound (BUS) is a critical diagnostic tool in the field of breast imaging, aiding in the early detection and characterization of breast abnormalities. Interpreting breast ultrasound images commonly involves creating comprehensive medical reports, containing vital information to promptly assess the patient's condition. However, the ultrasound imaging system necessitates capturing multiple images of various parts to compile a single report, presenting a time-consuming challenge. To address this problem, we propose the integration of multiple image analysis tools through a LangChain using Large Language Models (LLM), into the breast reporting process. Through a combination of designated tools and text generation through LangChain, our method can accurately extract relevant features from ultrasound images, interpret them in a clinical context, and produce comprehensive and standardized reports. This approach not only reduces the burden on radiologists and healthcare professionals but also enhances the consistency and quality of reports. The extensive experiments shows that each tools involved in the proposed method can offer qualitatively and quantitatively significant results. Furthermore, clinical evaluation on the generated reports demonstrates that the proposed method can make report in clinically meaningful way.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 5 Dec 2023.

Builds on

27 of 36 references.

References · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  7. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  8. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  9. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  10. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  11. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  12. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 387
15 more
  1. 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
  2. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
  3. 2017On the Automatic Generation of Medical Imaging Reportscited by 215
  4. 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
  5. 2021Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generationcited by 160
  6. 2018Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generationcited by 141
  7. 2019Knowledge-driven Encode, Retrieve, Paraphrase for Medical Image Report Generationcited by 101
  8. 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
  9. 2023XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Modelscited by 61
  10. 2019Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichmentcited by 60
  11. 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
  12. 2017MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Networkcited by 56
  13. 2023ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoderscited by 49
  14. 2023ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Datacited by 14
  15. 2020Reinforced Medical Report Generation with X-Linear Attention and Repetition Penaltycited by 1

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 2.

5 papers.