mlsanityData to 14 Oct 2026

Continually Self-Improving Language Models for Bariatric Surgery Question--Answering

arXiv 2505.16102 ↗First posted 22 May 2025cs.CLcited by 1

On the map: Synthetic data and self-improvement for LLMs → Medical synthetic data and agents

Abstract (arXiv)

While bariatric and metabolic surgery (MBS) is considered the gold standard treatment for severe and morbid obesity, its therapeutic efficacy hinges upon active and longitudinal engagement with multidisciplinary providers, including surgeons, dietitians/nutritionists, psychologists, and endocrinologists. This engagement spans the entire patient journey, from preoperative preparation to long-term postoperative management. However, this process is often hindered by numerous healthcare disparities, such as logistical and access barriers, which impair easy patient access to timely, evidence-based, clinician-endorsed information. To address these gaps, we introduce bRAGgen, a novel adaptive retrieval-augmented generation (RAG)-based model that autonomously integrates real-time medical evidence when response confidence dips below dynamic thresholds. This self-updating architecture ensures that responses remain current and accurate, reducing the risk of misinformation. Additionally, we present bRAGq, a curated dataset of 1,302 bariatric surgery--related questions, validated by an expert bariatric surgeon. bRAGq constitutes the first large-scale, domain-specific benchmark for comprehensive MBS care. In a two-phase evaluation, bRAGgen is benchmarked against state-of-the-art models using both large language model (LLM)--based metrics and expert surgeon review. Across all evaluation dimensions, bRAGgen demonstrates substantially superior performance in generating clinically accurate and relevant responses.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical synthetic data and agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 22 of its 49 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

22 of 49 references.

References · 22

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  4. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  5. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  6. 2021Understanding the Capabilities, Limitations, and Societal Impact of Large Language Modelscited by 160
  7. 2024Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generationcited by 90
  8. 2024Enhancing LLM Factual Accuracy with RAG to Counter Hallucinations: A Case Study on Domain-Specific Queries in Private Knowledge-Basescited by 77
  9. 2024MedExQA: Medical Question Answering Benchmark with Multiple Explanationscited by 60
  10. 2024Dated Data: Tracing Knowledge Cutoffs in Large Language Modelscited by 51
  11. 2024Rationale-Guided Retrieval Augmented Generation for Medical Question Answeringcited by 41
  12. 2024Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approachcited by 40
10 more
  1. 2021See, Hear, Read: Leveraging Multimodality with Guided Attention for Abstractive Text Summarizationcited by 18
  2. 2024FoRAG: Factuality-optimized Retrieval Augmented Generation for Web-enhanced Long-form Question Answeringcited by 18
  3. 2024Pandora's Box or Aladdin's Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Modelscited by 13
  4. 2024Improving Health Question Answering with Reliable and Time-Aware Evidence Retrievalcited by 12
  5. 2024CasiMedicos-Arg: A Medical Question Answering Dataset Annotated with Explanatory Argumentative Structurescited by 11
  6. 2020Corpora Evaluation and System Bias Detection in Multi-document Summarizationcited by 8
  7. 2023Fusing Multimodal Signals on Hyper-complex Space for Extreme Abstractive Text Summarization (TL;DR) of Scientific Contentscited by 7
  8. 2024Safety challenges of AI in medicine in the era of large language modelscited by 5
  9. 2024MediFact at MEDIQA-M3G 2024: Medical Question Answering in Dermatology with Multimodal Learningcited by 2
  10. 2024Efficient Medical Question Answering with Knowledge-Augmented Question Generationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025ASTRID -- An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems
  2. 2024oRetrieval Augmented Generation for 10 Large Language Models and its Generalizability in Assessing Medical Fitness
  3. 2026When Retrieval Doesn't Help: A Large-Scale Study of Biomedical RAG
  4. 2026Evaluating Biomedical Reranking for LLM-Based Question Answering over Longitudinal Clinical Notes
  5. 2025Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
  6. 2024Enhancing Large Language Models with Domain-specific Retrieval Augment Generation: A Case Study on Long-form Consumer Health Question Answering in Ophthalmology
  7. 2026Benchmarking Retrieval Strategies for Biomedical Retrieval-Augmented Generation: A Controlled Empirical Study
  8. 2025Beyond Retrieval: Ensembling Cross-Encoders and GPT Rerankers with LLMs for Biomedical QA