mlsanityData to 14 Oct 2026

Beyond Top-K: Replacing Black-Box Retrieval with Interpretable Agentic Operations

arXiv 2608.06305 ↗First posted 6 Aug 2026cs.AI cs.CL cs.IRcited by 0

On the map: Retrieval-augmented generation → Multimodal RAG

also in 1 more
Abstract (arXiv)

Retrieval-augmented generation over long documents is dominated by one design: chunk the text, embed the chunks, and surface the top-k nearest neighbours of the query. We argue that for an important class of documents -- financial statements, audit reports, regulatory returns -- this design is structurally unsound, and we make the argument measurable. On a 780-page government financial report, 86.8% of content lines are table rows, thousands of near-identical figures compete in one embedding space, and a figure inherits its unit from a header a median of 13 lines above it -- so a chunk boundary routinely separates a number from whether it is in lakh or crore, an error of two orders of magnitude. A table-aware chunker built as a steelman fixes the unit problem but leaves 27-30% of numeric chunks with no fiscal-year header at every chunk size we tried. We propose READ (Reliable Embedding-free Agentic Document-search), in which an agent reads the raw document through three deterministic operations -- normalized lexical search, structural navigation, and bounded span reads -- exposed over the Model Context Protocol, so a trajectory is a replayable audit trail, not an opaque similarity score. On 51 verified questions READ answers 58.8% against dense retrieval's 15.7% (p_Holm = 2 x 10^-5) -- or 35.3% tuned, which READ still leads by 23.5 points (p_Holm = 0.017). An agent given the same loop but a top-k tool reaches only 27.5%, locating the gain in the interface rather than in iteration. We also report what the evidence does not support: BM25 is statistically indistinguishable from READ, so our result separates embedding-based from embedding-free retrieval, not agentic from lexical search.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 17 of its 25 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

17 of 25 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026From Rows to Reasoning: A Retrieval-Augmented Multimodal Framework for Spreadsheet Understanding13 Jan
  2. 2024Searching for Best Practices in Retrieval-Augmented Generation1 Jul

Other references · 15

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  6. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  7. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  8. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  9. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 923
  10. 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 286
  11. 2023How is ChatGPT's behavior changing over time?cited by 270
  12. 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
3 more
  1. 2026Beyond Semantic Similarity: Rethinking Retrieval for Agentic Search via Direct Corpus Interactioncited by 38
  2. 2026Is Grep All You Need? How Agent Harnesses Reshape Agentic Searchcited by 21
  3. 2026Chronos: Temporal-Aware Conversational Agents with Structured Event Retrieval for Long-Term Memorycited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TopoChunker: Topology-Aware Agentic Document Chunking Framework
  2. 2026RIT-RAG: Navigating Document Corpora with Retrieval-Induced Trees
  3. 2025Rethinking Retrieval: From Traditional Retrieval Augmented Generation to Agentic and Non-Vector Reasoning Systems in the Financial Domain for Large Language Models
  4. 2026VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval
  5. 2026Evaluating Chunking Strategies For Retrieval-Augmented Generation in Oil and Gas Enterprise Documents
  6. 2026Query-Adaptive Semantic Chunking for Retrieval-Augmented Generation: A Dynamic Strategy with Contextual Window Expansion
  7. 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering
  8. 2026Structured Linked Data as a Memory Layer for Agent-Orchestrated Retrieval