All-in-one Graph-based Indexing for Hybrid Search on GPUs
On the map: Retrieval-augmented generation → Knowledge-graph and structured-knowledge RAG
Abstract (arXiv)
Hybrid search has emerged as a promising paradigm that combines lexical and semantic retrieval, enhancing accuracy for applications such as recommendations, information retrieval, and Retrieval-Augmented Generation. However, existing methods are constrained by a trilemma: they sacrifice flexibility for efficiency, suffer from accuracy degradation, or incur prohibitive storage overhead for flexible combinations of retrieval paths. This paper introduces Allan-Poe, a novel all-in-one graph index accelerated by GPUs for efficient hybrid search. We first analyze the limitations of existing retrieval paradigms and extract key design principles for an effective hybrid index. Guided by the principles, we architect a unified graph-based index that flexibly integrates three retrieval paths (dense vector, sparse vector, and full-text) within a single, cohesive structure. To enable efficient construction, we design a GPU-accelerated pipeline featuring a warp-level hybrid distance kernel, RNG-IP joint pruning, and keyword-aware neighbor recycling. For query processing, we introduce a dynamic fusion framework that supports any combination of retrieval paths and weights without index reconstruction, flexibly leveraging logical structures from the knowledge graph to resolve complex multi-hop queries. Extensive experiments on 6 real-world datasets demonstrate that Allan-Poe achieves superior end-to-end query accuracy and outperforms state-of-the-art methods by 1.5x-186.4x in throughput, while significantly reducing storage overhead.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge-graph and structured-knowledge RAG, one of 15 directions in Retrieval-augmented generation. Builds on 36 of its 85 references that are in the map. First posted on arXiv 2 Nov 2025.
Builds on
36 of 85 references.
Closest ancestors · 3
Same direction, newest first
- 2025In-depth Analysis of Graph-based RAG in a Unified Framework6 Mar
- 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspective23 Oct
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarization24 Apr
Other references · 33
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2021SPLADE: Sparse Lexical and Expansion Model for First Stage Rankingcited by 283
- 2020Sparse GPU Kernels for Deep Learningcited by 138
- 2013A Theoretical Analysis of NDCG Type Ranking Measurescited by 119
- 2017Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graphcited by 103
- 2025On the Theoretical Limitations of Embedding-Based Retrievalcited by 98
- 2024Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrieverscited by 83
21 more
- 2021A Comprehensive Survey and Experimental Comparison of Graph-Based Approximate Nearest Neighbor Searchcited by 82
- 2020DGL-KE: Training Knowledge Graph Embeddings at Scalecited by 67
- 2022An Analysis of Fusion Functions for Hybrid Retrievalcited by 49
- 2024ACORN: Performant and Predicate-Agnostic Search Over Vector Embeddings and Structured Datacited by 31
- 2023Chameleon: a Heterogeneous and Disaggregated Accelerator System for Retrieval-Augmented Language Modelscited by 23
- 2024Efficient Inverted Indexes for Approximate Retrieval over Learned Sparse Representationscited by 23
- 2023CAGRA: Highly Parallel Graph Construction and Approximate Nearest Neighbor Search for GPUscited by 22
- 2018Optimization of Indexing Based on k-Nearest Neighbor Graph for Proximity Search in High-dimensional Datacited by 20
- 2019The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platformcited by 16
- 2024Starling: An I/O-Efficient Disk-Resident Graph Index Framework for High-Dimensional Vector Similarity Search on Data Segmentcited by 16
- 2024Automatic Database Configuration Debugging using Retrieval-Augmented Language Modelscited by 12
- 2024Faster Learned Sparse Retrieval with Block-Max Pruningcited by 10
- 2024UNIFY: Unified Index for Range Filtered Approximate Nearest Neighbors Searchcited by 10
- 2023MUST: An Effective and Scalable Framework for Multimodal Search of Target Modalitycited by 9
- 2023Bridging Dense and Sparse Maximum Inner Product Searchcited by 8
- 2022Hercules Against Data Series Similarity Searchcited by 6
- 2024Revisiting Reciprocal Recommender Systems: Metrics, Formulation, and Methodcited by 5
- 2025Hybrid Retrieval for Hallucination Mitigation in Large Language Models: A Comparative Analysiscited by 5
- 2022An In-Depth Study of Continuous Subgraph Matching (Complete Version)cited by 3
- 2025Maximum Inner Product is Query-Scaled Nearest Neighborcited by 2
- 2025Stitching Inner Product and Euclidean Metrics for Topology-aware Maximum Inner Product Searchcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Balancing the Blend: An Experimental Analysis of Trade-offs in Hybrid Search
- 2025Beyond Nearest Neighbors: Semantic Compression and Graph-Augmented Retrieval for Enhanced Vector Search
- 2026CubeGraph: Efficient Retrieval-Augmented Generation for Spatial and Temporal Data
- 2024A Real-Time Adaptive Multi-Stream GPU System for Online Approximate Nearest Neighborhood Search
- 2026InSituANN: Revisiting IVF for PCIe-Efficient Billion-Scale Vector Search ↗
- 2026FGIM: a Fast Graph-based Indexes Merging Framework for Approximate Nearest Neighbor Search
- 2025Breaking the Storage-Compute Bottleneck in Billion-Scale ANNS: A GPU-Driven Asynchronous I/O Framework
- 2025Trinity: Disaggregating Vector Search from Prefill-Decode Disaggregation in LLM Serving