mlsanityData to 14 Oct 2026

KARLA: Knowledge-base Augmented Retrieval for Language Models

arXiv 2606.26807 ↗First posted 25 Jun 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose a new method that allows an LLM to automatically pull in factual knowledge from a knowledge base during token generation. This means that (1)~factual knowledge in the LLM output can be updated without retraining the LLM, (2)~facts in the LLM output can be traced to the knowledge base for transparency and explainability, and (3)~smaller models can achieve the same factual accuracy as larger models. Our core idea is to train the model to produce special tokens that trigger a query to the knowledge base. Our experiments show that our method improves factual grounding in both short and long-form generation, and allows factual revisions to take effect through KB edits rather than parameter updates.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

21 of 41 references.

References · 21

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  5. 2019Language Models as Knowledge Bases?cited by 1,936
  6. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  7. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  8. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  9. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  10. 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
  11. 2021Entity-Based Knowledge Conflicts in Question Answeringcited by 356
  12. 2023Physics of Language Models: Part 3.1, Knowledge Storage and Extractioncited by 270
9 more
  1. 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 240
  2. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
  3. 2021Time Waits for No One! Analysis and Challenges of Temporal Misalignmentcited by 91
  4. 2023Exploiting Asymmetry for Synthetic Training Data Generation: SynthIE and the Case of Information Extractioncited by 89
  5. 2024Lynx: An Open Source Hallucination Evaluation Modelcited by 57
  6. 2023YAGO 4.5: A Large and Clean Knowledge Base with a Rich Taxonomycited by 37
  7. 2024KBLaM: Knowledge Base augmented Language Modelcited by 16
  8. 2026LELA: an LLM-based Entity Linking Approach with Zero-Shot Domain Adaptationcited by 6
  9. 2025Large Language Models as Search Engines: Societal Challengescited by 3

Built on by

Not cited yet.