Optimizing Automatic Summarization of Long Clinical Records Using Dynamic Context Extension:Testing and Evaluation of the NBCE Method
Not on the map. Why?
Abstract (arXiv)
Summarizing patient clinical notes is vital for reducing documentation burdens. Current manual summarization makes medical staff struggle. We propose an automatic method using LLMs, but long inputs cause LLMs to lose context, reducing output quality especially in small size model. We used a 7B model, open-calm-7b, enhanced with Native Bayes Context Extend and a redesigned decoding mechanism to reference one sentence at a time, keeping inputs within context windows, 2048 tokens. Our improved model achieved near parity with Google's over 175B Gemini on ROUGE-L metrics with 200 samples, indicating strong performance using less resources, enhancing automated EMR summarization feasibility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 7 references that are in the map. First posted on arXiv 13 Nov 2024.
Builds on
6 of 7 references.
References · 6
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
- 2022Parallel Context Windows for Large Language Modelscited by 81
Built on by
Not cited yet.