mlsanityData to 7 Oct 2026

MAPLE: Medical Aspect-Based Summarization with Phrase-Level Evidence

arXiv 2601.03418 ↗First posted 6 Jan 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Trustworthy clinical summarization requires every claim to be traceable to its evidence, yet existing attribution often resolves only to the sentence or document, leaving clinicians to scan surrounding text for the few words that matter. We argue that the unit of attribution should match the unit of verification: the precise phrase the reader's eye must land on. We present MAPLE (Medical Aspect-Based Summarization with Phrase-Level Evidence), a human-annotated benchmark that grounds each summarized claim in both cited sentences and contributory phrases within them. Spanning 152 randomized controlled trial (RCT) abstracts and 16 clinically motivated aspects, MAPLE comprises 1,799 aspect-based summaries with two-level evidence. We further introduce a decoupled evaluation framework that separately scores content, traceability, and locatability, together with a proxy for the amount of source text a clinician must inspect to verify a claim. Benchmarking eleven LLMs shows that sentence-level citation is consistently strong (C-F1 up to 90.9%), while phrase-level grounding remains less stable and the most discriminative axis across models (P-F1 66.1-84.5%). These results suggest that the key challenge is not only producing accurate summaries, but localizing their supporting evidence precisely enough for efficient clinical verification. Data and code are available at https://github.com/chubohao/maple.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

17 of 34 references.

References · 17

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  4. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  5. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  6. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 376
  7. 2022Teaching language models to support answers with verified quotescited by 290
  8. 2016Understanding Neural Networks through Representation Erasurecited by 223
  9. 2020Re-evaluating Evaluation in Text Summarizationcited by 144
  10. 2020WikiAsp: A Dataset for Multi-domain Aspect-based Summarizationcited by 56
  11. 2024Attribute First, then Generate: Locally-attributable Grounded Text Generationcited by 54
  12. 2022OASum: Large-Scale Open Domain Aspect-based Summarizationcited by 24
5 more
  1. 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publicationscited by 20
  2. 2024FactPICO: Factuality Evaluation for Plain Language Summarization of Medical Evidencecited by 18
  3. 2023DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generationcited by 16
  4. 2022MACSum: Controllable Summarization with Mixed Attributescited by 13
  5. 2025TracSum: A New Benchmark for Aspect-Based Summarization with Sentence-Level Traceability in Medical Domaincited by 4

Built on by

Not cited yet.