mlsanityData to 14 Oct 2026

RAGdb: A Zero-Dependency, Embeddable Architecture for Multimodal Retrieval-Augmented Generation on the Edge

arXiv 2602.22217 ↗First posted 9 Dec 2025cs.IR cs.AIcited by 1

On the map: Retrieval-augmented generation → Multimodal RAG

Abstract (arXiv)

Retrieval-Augmented Generation (RAG) has established itself as the standard paradigm for grounding Large Language Models (LLMs) in domain-specific, up-to-date data. However, the prevailing architecture for RAG has evolved into a complex, distributed stack requiring cloud-hosted vector databases, heavy deep learning frameworks (e.g., PyTorch, CUDA), and high-latency embedding inference servers. This ``infrastructure bloat'' creates a significant barrier to entry for edge computing, air-gapped environments, and privacy-constrained applications where data sovereignty is paramount. This paper introduces RAGdb, a novel monolithic architecture that consolidates automated multimodal ingestion, ONNX-based extraction, and hybrid vector retrieval into a single, portable SQLite container. We propose a deterministic Hybrid Scoring Function (HSF) that combines sublinear TF-IDF vectorization with exact substring boosting, eliminating the need for GPU inference at query time. Experimental evaluation on an Intel i7-1165G7 consumer laptop demonstrates that RAGdb achieves 100% Recall@1 for entity retrieval and an ingestion efficiency gain of 31.6x during incremental updates compared to cold starts. Furthermore, the system reduces disk footprint by approximately 99.5% compared to standard Docker-based RAG stacks, establishing the ``Single-File Knowledge Container'' as a viable primitive for decentralized, local-first AI. Keywords: Edge AI, Retrieval-Augmented Generation, Vector Search, Green AI, Serverless Architecture, Knowledge Graphs, Efficient Computing.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 11 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

6 of 11 references.

References · 6

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2017Billion-scale similarity search with GPUscited by 2,497
  5. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  6. 2019Green AIcited by 627

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025HetaRAG: Hybrid Deep Retrieval-Augmented Generation across Heterogeneous Data Stores
  2. 2026RAGe: A Retrieval-Augmented Generation Evaluation Framework
  3. 2026Evaluating Modern RAG: Textual, Multimodal, Dense, and Late Interaction Pipelines
  4. 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models
  5. 2024Robust Implementation of Retrieval-Augmented Generation on Edge-based Computing-in-Memory Architectures
  6. 2024Beyond Text: Optimizing RAG with Multimodal Inputs for Industrial Applications
  7. 2025RAG-Anything: All-in-One RAG Framework
  8. 2025Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device