mlsanityData to 14 Oct 2026

HistoRAG: Embedding Historical Methodology in Retrieval-Augmented Generation Through Critical Technical Practice

arXiv 2606.18103 ↗First posted 16 Jun 2026cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → RAG pipeline design and evaluation

Abstract (arXiv)

Retrieval-Augmented Generation (RAG) is the prevailing architecture for grounding language model outputs in external evidence, yet its dominant evaluation paradigms and default configurations remain oriented toward factual question-answering. For interpretive disciplines such as historical studies, RAG embeds assumptions that conflict with scholarly practice. We introduce HistoRAG, a framework that translates historiographical principles into concrete architectural interventions. Separated retrieval and generation decouples source discovery from interpretation, temporal windowing enforces balanced source representation across the research period as a methodological requirement of historical inquiry, and LLM-as-judge evaluation makes relevance judgments transparent and contestable. We evaluate these interventions using SPIEGELragged, applied to 102,189 articles from Der Spiegel (1950-1979). Each intervention addresses a measurable deficiency in standard RAG: era-specific vocabulary retrieves zero chunks from the 1950s when using 1970s terminology, evidence of the temporal skew that motivates windowing; vector similarity and LLM-assessed relevance correlate only weakly (Spearman rho = 0.275), motivating post-retrieval evaluation; and keyword-based and semantic retrieval surface largely disjoint source pools, motivating an architecture in which both operate as complementary retrieval layers under a shared LLM evaluation filter. We also introduce the concept of Zwischentexte (intermediate texts that function as interpretive proposals rather than findings) as a framework for responsible integration of LLM-generated text into scholarly practice. The architecture offers a model for how domain-specific epistemological commitments can be translated into RAG design decisions, and may transfer to other interpretive disciplines working with large corpora.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RAG pipeline design and evaluation, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 38 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

12 of 38 references.

References · 12

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  3. 2024A Survey on LLM-as-a-Judgecited by 1,423
  4. 2019Passage Re-ranking with BERTcited by 645
  5. 2024Nomic Embed: Training a Reproducible Long Context Text Embeddercited by 265
  6. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
  7. 2024Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Toolscited by 176
  8. 2018Diachronic word embeddings and semantic shifts: a surveycited by 92
  9. 2024Evaluating the Evaluator: Measuring LLMs' Adherence to Task Evaluation Instructionscited by 34
  10. 2025Training Sparse Mixture Of Experts Text Embedding Modelscited by 32
  11. 2025Semantics at an Angle: When Cosine Similarity Works Until It Doesn'tcited by 13
  12. 2025Beyond Tools: Generative AI as Epistemic Infrastructure in Educationcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in History
  2. 2026Forgotten History or Test-of-Time? Retrospect and Prospect on RAG from an IR Perspective
  3. 2025On Path to Multimodal Historical Reasoning: HistBench and HistAgent
  4. 2025Controlled Retrieval-augmented Context Evaluation for Long-form RAG
  5. 2025A Preliminary Study of RAG for Taiwanese Historical Archives
  6. 2026Conversational Retrieval and On-the-Fly Knowledge Modeling of Historical Penitentiary Repression Records
  7. 2025Reading Between the Timelines: RAG for Answering Diachronic Questions
  8. 2025HoH: A Dynamic Benchmark for Evaluating the Impact of Outdated Information on Retrieval-Augmented Generation