RAGdb: A Zero-Dependency, Embeddable Architecture for Multimodal Retrieval-Augmented Generation on the Edge
On the map: Retrieval-augmented generation → Multimodal RAG
Abstract (arXiv)
Retrieval-Augmented Generation (RAG) has established itself as the standard paradigm for grounding Large Language Models (LLMs) in domain-specific, up-to-date data. However, the prevailing architecture for RAG has evolved into a complex, distributed stack requiring cloud-hosted vector databases, heavy deep learning frameworks (e.g., PyTorch, CUDA), and high-latency embedding inference servers. This ``infrastructure bloat'' creates a significant barrier to entry for edge computing, air-gapped environments, and privacy-constrained applications where data sovereignty is paramount. This paper introduces RAGdb, a novel monolithic architecture that consolidates automated multimodal ingestion, ONNX-based extraction, and hybrid vector retrieval into a single, portable SQLite container. We propose a deterministic Hybrid Scoring Function (HSF) that combines sublinear TF-IDF vectorization with exact substring boosting, eliminating the need for GPU inference at query time. Experimental evaluation on an Intel i7-1165G7 consumer laptop demonstrates that RAGdb achieves 100% Recall@1 for entity retrieval and an ingestion efficiency gain of 31.6x during incremental updates compared to cold starts. Furthermore, the system reduces disk footprint by approximately 99.5% compared to standard Docker-based RAG stacks, establishing the ``Single-File Knowledge Container'' as a viable primitive for decentralized, local-first AI. Keywords: Edge AI, Retrieval-Augmented Generation, Vector Search, Green AI, Serverless Architecture, Knowledge Graphs, Efficient Computing.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 11 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
6 of 11 references.
References · 6
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2019Green AIcited by 627
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025HetaRAG: Hybrid Deep Retrieval-Augmented Generation across Heterogeneous Data Stores
- 2026RAGe: A Retrieval-Augmented Generation Evaluation Framework
- 2026Evaluating Modern RAG: Textual, Multimodal, Dense, and Late Interaction Pipelines
- 2024A Survey on Retrieval-Augmented Text Generation for Large Language Models
- 2024Robust Implementation of Retrieval-Augmented Generation on Edge-based Computing-in-Memory Architectures
- 2024Beyond Text: Optimizing RAG with Multimodal Inputs for Industrial Applications
- 2025RAG-Anything: All-in-One RAG Framework
- 2025Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device