mlsanityData to 14 Oct 2026

Beyond Long Context: When Semantics Matter More than Tokens

arXiv 2510.25816 ↗First posted 29 Oct 2025cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Electronic Health Records (EHR) store clinical documentation as base64 encoded attachments in FHIR DocumentReference resources, which makes semantic question answering difficult. Traditional vector database methods often miss nuanced clinical relationships. The Clinical Entity Augmented Retrieval (CLEAR) method, introduced by Lopez et al. 2025, uses entity aware retrieval and achieved improved performance with an F1 score of 0.90 versus 0.86 for embedding based retrieval, while using over 70 percent fewer tokens. We developed a Clinical Notes QA Evaluation Platform to validate CLEAR against zero shot large context inference and traditional chunk based retrieval augmented generation. The platform was tested on 12 clinical notes ranging from 10,000 to 65,000 tokens representing realistic EHR content. CLEAR achieved a 58.3 percent win rate, an average semantic similarity of 0.878, and used 78 percent fewer tokens than wide context processing. The largest performance gains occurred on long notes, with a 75 percent win rate for documents exceeding 65,000 tokens. These findings confirm that entity aware retrieval improves both efficiency and accuracy in clinical natural language processing. The evaluation framework provides a reusable and transparent benchmark for assessing clinical question answering systems where semantic precision and computational efficiency are critical.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 7 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

5 of 7 references.

References · 5

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Evaluating Retrieval-Augmented Generation vs. Long-Context Input for Clinical Reasoning over EHRs
  2. 2026Automating Clinical Information Retrieval from Finnish Electronic Health Records Using Large Language Models
  3. 2025CLI-RAG: A Retrieval-Augmented Framework for Clinically Structured and Context Aware Text Generation with LLMs
  4. 2026Harnessing Large Language Models for Precision Querying and Retrieval-Augmented Knowledge Extraction in Clinical Data Science
  5. 2026ClinicalBench: Stress-Testing Assertion-Aware Retrieval for Cross-Admission Clinical QA on MIMIC-IV
  6. 2026Evaluating Biomedical Reranking for LLM-Based Question Answering over Longitudinal Clinical Notes
  7. 2025DR.EHR: Dense Retrieval for Electronic Health Record with Knowledge Injection and Synthetic Data
  8. 2024Large Language Models Struggle in Token-Level Clinical Named Entity Recognition