mlsanityData to 7 Oct 2026

vstash: Local-First Hybrid Retrieval with Adaptive Fusion for LLM Agents

arXiv 2604.15484 ↗First posted 16 Apr 2026cs.IRcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

We present **vstash**, a local-first document memory system that combines vector similarity search with full-text keyword matching via Reciprocal Rank Fusion (RRF) and adaptive per-query IDF weighting. All data resides in a single SQLite file using sqlite-vec for approximate nearest neighbor search and FTS5 for keyword matching. We make four primary contributions. **(1)** Self-supervised embedding refinement via hybrid retrieval disagreement: across 753 BEIR queries on SciFact, NFCorpus, and FiQA, 74.5% produce top-10 disagreement between vector-heavy (vec=0.95, fts=0.05) and FTS-heavy (vec=0.05, fts=0.95) search (per-dataset rates 63.4% / 73.4% / 86.7%, Section 5.2), providing a free training signal without human labels. Fine-tuning BGE-small (33M params) with MultipleNegativesRankingLoss on 76K disagreement triples improves NDCG@10 on all 5 BEIR datasets (up to +19.5% on NFCorpus vs. BGE-small base RRF, Table 6). On 3 of 5 datasets, under different preprocessing, the tuned 33M-parameter pipeline matches or exceeds published ColBERTv2 results (110M params) and an untrained BGE-base (110M); on FiQA and ArguAna it underperforms ColBERTv2 (Section 5.5). **(2)** Adaptive RRF with per-query IDF weighting improves NDCG@10 on all 5 BEIR datasets versus fixed weights (up to +21.4% on ArguAna), achieving 0.7263 on SciFact with BGE-small. **(3)** A negative result on post-RRF scoring: frequency+decay, history-augmented recall, and cross-encoder reranking all failed to improve NDCG. **(4)** A production-grade substrate with integrity checking, schema versioning, ranking diagnostics, and a distance-based relevance signal validated on 50,425 relevance-judged queries across the 5 BEIR datasets. Search latency remains 20.9 ms median at 50K chunks with stable NDCG. The fine-tuned model is published as `Stffens/bge-small-rrf-v2` on HuggingFace. All code, data, and experiments are open-source.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 16 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

13 of 16 references.

References · 13

  1. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  2. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  3. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  4. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
  5. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  6. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 722
  7. 2022MTEB: Massive Text Embedding Benchmarkcited by 623
  8. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 464
  9. 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 372
  10. 2021Optimizing Dense Retrieval Model Training with Hard Negativescited by 154
  11. 2025Forgetful but Faithful: A Cognitive Memory Architecture and Benchmark for Privacy-Aware Generative Agentscited by 12
  12. 2025Memoria: A Scalable Agentic Memory Framework for Personalized Conversational AIcited by 11
1 more
  1. 2026Predictive Associative Memory: Retrieval Beyond Similarity Through Temporal Co-occurrencecited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Rethinking Hybrid Retrieval: When Small Embeddings and LLM Re-ranking Beat Bigger Models
  2. 2026A Comprehensive Empirical Evaluation of Vector Database Systems for Approximate Nearest Neighbor Search: Performance, Quality, and Resource Trade-offs
  3. 2026Difficulty-Gated Fusion of Reasoning Views for Temporal Retrieval
  4. 2025Balancing the Blend: An Experimental Analysis of Trade-offs in Hybrid Search
  5. 2026A Reference Architecture for Agentic Hybrid Retrieval in Dataset Search
  6. 2026Aligning Dense Retrievers with LLM Utility via Distillation
  7. 2025LLM-guided Hierarchical Search for End-to-end Reasoning Intensive Retrieval
  8. 2022Zero-Shot Retrieval with Search Agents and Hybrid Environments