mlsanityData to 14 Oct 2026

Predict the Retrieval! Test time adaptation for Retrieval Augmented Generation

arXiv 2601.11443 ↗First posted 16 Jan 2026cs.CLcited by 2

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for enhancing large language models' question-answering capabilities through the integration of external knowledge. However, when adapting RAG systems to specialized domains, challenges arise from distribution shifts, resulting in suboptimal generalization performance. In this work, we propose TTARAG, a test-time adaptation method that dynamically updates the language model's parameters during inference to improve RAG system performance in specialized domains. Our method introduces a simple yet effective approach where the model learns to predict retrieved content, enabling automatic parameter adjustment to the target domain. Through extensive experiments across six specialized domains, we demonstrate that TTARAG achieves substantial performance improvements over baseline RAG systems. Code available at https://github.com/sunxin000/TTARAG.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 29 of its 38 references that are in the map. First posted on arXiv 16 Jan 2026.

Builds on

29 of 38 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025Divide-Then-Align: Honest Alignment based on the Knowledge Boundary of RAG27 May
  2. 2024SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains23 Oct
  3. 2024UncertaintyRAG: Span-Level Uncertainty Enhanced Long-Context Modeling for Retrieval-Augmented Generation3 Oct
  4. 2024Enhancing Noise Robustness of Retrieval-Augmented Language Models with Adaptive Adversarial Training31 May
  5. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexity21 Mar
  6. 2024ChatQA: Surpassing GPT-4 on Conversational QA and RAG18 Jan
  7. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct

Other references · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  5. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  6. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,288
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  8. 2020Do We Really Need to Access the Source Data? Source Hypothesis Transfer for Unsupervised Domain Adaptationcited by 848
  9. 2023Active Retrieval Augmented Generationcited by 516
  10. 2020Improving robustness against common corruptions by covariate shift adaptationcited by 431
  11. 2023Making Retrieval-Augmented Language Models Robust to Irrelevant Contextcited by 369
  12. 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
10 more
  1. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 202
  2. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 195
  3. 2022Parameter-free Online Test-time Adaptationcited by 189
  4. 2024Efficient Test-Time Adaptation of Vision-Language Modelscited by 141
  5. 2020The Effect of Natural Distribution Shift on Question Answering Modelscited by 104
  6. 2024CRAG -- Comprehensive RAG Benchmarkcited by 97
  7. 2024MedAdapter: Efficient Test-Time Adaptation of Large Language Models towards Medical Reasoningcited by 36
  8. 2021Challenges in Generalization in Open Domain Question Answeringcited by 30
  9. 2024DIVE: Subgraph Disagreement for Graph Out-of-Distribution Generalizationcited by 7
  10. 2025KBQA-R1: Reinforcing Large Language Models for Knowledge Base Question Answeringcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026Why AI systems don't learn and what to do about it: Lessons on autonomous learning from cognitive sciencecited by 11
  2. 2026HopRefusalBench: Diagnosing Refusal Failures in Search-Augmented Agents for Multi-Hop Reasoningcited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
  2. 2025Investigating the Robustness of Retrieval-Augmented Generation at the Query Level
  3. 2025Domain-Specific Data Generation Framework for RAG Adaptation
  4. 2025Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generation
  5. 2025Context-Guided Dynamic Retrieval for Improving Generation Quality in RAG Models
  6. 2024RQ-RAG: Learning to Refine Queries for Retrieval Augmented Generation
  7. 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models
  8. 2024A Comprehensive Survey of Retrieval-Augmented Generation (RAG): Evolution, Current Landscape and Future Directions