ARK: Answer-Centric Retriever Tuning via KG-augmented Curriculum Learning
On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has emerged as a powerful framework for knowledge-intensive tasks, yet its effectiveness in long-context scenarios is often bottlenecked by the retriever's inability to distinguish sparse yet crucial evidence. Standard retrievers, optimized for query-document similarity, frequently fail to align with the downstream goal of generating a precise answer. To bridge this gap, we propose a novel fine-tuning framework that optimizes the retriever for Answer Alignment. Specifically, we first identify high-quality positive chunks by evaluating their sufficiency to generate the correct answer. We then employ a curriculum-based contrastive learning scheme to fine-tune the retriever. This curriculum leverages LLM-constructed Knowledge Graphs (KGs) to generate augmented queries, which in turn mine progressively challenging hard negatives. This process trains the retriever to distinguish the answer-sufficient positive chunks from these nuanced distractors, enhancing its generalization. Extensive experiments on 10 datasets from the Ultradomain and LongBench benchmarks demonstrate that our fine-tuned retriever achieves state-of-the-art performance, improving 14.5% over the base model without substantial architectural modifications and maintaining strong efficiency for long-context RAG. Our work presents a robust and effective methodology for building truly answer-centric retrievers. Source Code is available on https://github.com/valleysprings/ARK/.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 23 of its 37 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
23 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 22
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
- 2021Improving language models by retrieving from trillions of tokenscited by 1,293
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,282
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 792
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2017The NarrativeQA Reading Comprehension Challengecited by 597
10 more
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 517
- 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 486
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2024Long-context LLMs Struggle with Long In-context Learningcited by 286
- 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 230
- 2020Distilling Knowledge from Reader to Retriever for Question Answeringcited by 226
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
- 2025GRAIL:Learning to Interact with Large Knowledge Graphs for Retrieval Augmented Reasoningcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026DynaWeb: Model-Based Reinforcement Learning of Web Agentscited by 14
- 2026Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systemscited by 2
- 2026Disco-RAG: Discourse-Aware Retrieval-Augmented Generationcited by 1
- 2026Semantically Similar, Logically Distinct: Diagnosing the Semantic-Answerability Gap in Table RAGcited by 0
- 2026Semantically Similar, Logically Distinct: Diagnosing the Semantic-Answerability Gap in Table RAG20 Jul 2026
- 2026Rethinking Reasoning-Intensive Retrieval: Evaluating and Advancing Retrievers in Agentic Search Systems5 May 2026
- 2026DynaWeb: Model-Based Reinforcement Learning of Web Agents29 Jan 2026
- 2026Disco-RAG: Discourse-Aware Retrieval-Augmented Generation7 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025RAG-RL: Advancing Retrieval-Augmented Generation via RL and Curriculum Learning
- 2026R3AG: Retriever Routing for Retrieval-Augmented Generation
- 2025Retrieval-Augmented Generation: A Comprehensive Survey of Architectures, Enhancements, and Robustness Frontiers
- 2024RuleRAG: Rule-Guided Retrieval-Augmented Generation with Language Models for Question Answering
- 2025Aligning LLMs for the Classroom with Knowledge-Based Retrieval -- A Comparative RAG Study
- 2024RichRAG: Crafting Rich Responses for Multi-faceted Queries in Retrieval-Augmented Generation
- 2025Machine Assistant with Reliable Knowledge: Enhancing Student Learning via RAG-based Retrieval
- 2025Investigating the Robustness of Retrieval-Augmented Generation at the Query Level