mlsanityData to 7 Oct 2026

SAGE: Semantic Anchor-Guided Evolution for Grounded Medical QA Data Synthesis

arXiv 2610.08093 ↗First posted 6 Oct 2026cs.CL cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → Medical synthetic data and agents

Abstract (arXiv)

Developing reliable models for clinical tasks, such as Medical Question Answering (QA), is severely constrained by the limited availability of high-quality, expert-annotated training data. This challenge is exacerbated by stringent privacy requirements and the impracticality of utilizing large open-source corpora or proprietary cloud APIs within resource-limited clinical settings. To address these obstacles, we introduce SAGE (textitSemantic Anchor-Guided Evolution), a novel data synthesis framework that enables small, locally deployed models to generate high-quality medical training data. SAGE leverages lightweight, publicly available taxonomies such as MeSH as semantic anchors, imposing a structured prior to effectively guide and ground the data generation process. At its core, SAGE iteratively interleaves atomic (individual concept-based) and associative (relation-based) synthesis, bootstrapping training data from minimal seeds. This approach eliminates the need for large collections of medical documents or reliance on external APIs, providing a practical solution for on-premises data creation. Extensive experiments across multiple medical question-answering benchmarks demonstrate that models fine-tuned with SAGE-synthesized data consistently outperform those trained using self-derived or conventional document-based paradigms, highlighting tangible improvements in data efficiency and resource utilization for medical LLM development. Code is available at https://github.com/DIaacKr/SAGE.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical synthetic data and agents, one of 13 directions in Synthetic data and self-improvement for LLMs. First posted on arXiv 6 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Give me Some Hard Questions: Synthetic Data Generation for Clinical QA
  2. 2026SentryLine: Evidence-Grounded Question Answering over Evolving Documents in Oncology Care
  3. 2026LakeQuest: A Three-Domain Benchmark for Grounded Question Answering across Data Lakes
  4. 2026Domain Fine-Tuning vs. Retrieval-Augmented Generation for Medical Multiple-Choice Question Answering: A Controlled Comparison at the 4B-Parameter Scale
  5. 2025From Retrieval to Generation: Unifying External and Parametric Knowledge for Medical Question Answering
  6. 2025Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
  7. 2026MedLLM: An Open Medical Language Model at the Sub-Billion Scale
  8. 2025MedBioLM: Optimizing Medical and Biological QA with Fine-Tuned Large Language Models and Retrieval-Augmented Generation