mlsanityData to 7 Oct 2026

Scalable Disk-Based Approximate Nearest Neighbor Search with Page-Aligned Graph

arXiv 2509.25487 ↗First posted 29 Sep 2025cs.LG cs.DB cs.IRcited by 2

Not on the map. Why?

Abstract (arXiv)

Approximate Nearest Neighbor Search (ANNS), as the core of vector databases (VectorDBs), has become widely used in modern AI and ML systems, powering applications from information retrieval to bio-informatics. While graph-based ANNS methods achieve high query efficiency, their scalability is constrained by the available host memory. Recent disk-based ANNS approaches mitigate memory usage by offloading data to Solid-State Drives (SSDs). However, they still suffer from issues such as long I/O traversal path, misalignment with storage I/O granularity, and high in-memory indexing overhead, leading to significant I/O latency and ultimately limiting scalability for large-scale vector search. In this paper, we propose PageANN, a disk-based approximate nearest neighbor search (ANNS) framework designed for high performance and scalability. PageANN introduces a page-node graph structure that aligns logical graph nodes with physical SSD pages, thereby shortening I/O traversal paths and reducing I/O operations. Specifically, similar vectors are clustered into page nodes, and a co-designed disk data layout leverages this structure with a merging technique to store only representative vectors and topology information, avoiding unnecessary reads. To further improve efficiency, we design a memory management strategy that combines lightweight indexing with coordinated memory-disk data allocation, maximizing host memory utilization while minimizing query latency and storage overhead. Experimental results show that PageANN significantly outperforms state-of-the-art (SOTA) disk-based ANNS methods, achieving 1.85x-10.83x higher throughput and 51.7%-91.9% lower latency across different datasets and memory budgets, while maintaining comparable high recall accuracy.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 22 of its 51 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

22 of 51 references.

References · 22

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  3. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  4. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  5. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  6. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  7. 2020Embedding-based Retrieval in Facebook Searchcited by 155
  8. 2017Fast Approximate Nearest Neighbor Search With The Navigating Spreading-out Graphcited by 103
  9. 2023Learning Customized Visual Models with Retrieval-Augmented Knowledgecited by 58
  10. 2021SPANN: Highly-efficient Billion-scale Approximate Nearest Neighbor Searchcited by 35
  11. 2024SPFresh: Incremental In-Place Update for Billion-Scale Vector Searchcited by 28
  12. 2021Visual Search at Alibabacited by 27
10 more
  1. 2022Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Searchcited by 17
  2. 2019The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platformcited by 16
  3. 2024Starling: An I/O-Efficient Disk-Resident Graph Index Framework for High-Dimensional Vector Similarity Search on Data Segmentcited by 16
  4. 2023DiskANN++: Efficient Page-based Search over Isomorphic Mapped Graph Index using Query-sensitivity Entry Vertexcited by 7
  5. 2014Machine learning approach for text and document miningcited by 6
  6. 2025MicroNN: An On-device Disk-resident Updatable Vector Databasecited by 6
  7. 2019Starling: A Scalable Query Engine on Cloud Function Servicescited by 4
  8. 2025LSM-VEC: A Large-Scale Disk-Based System for Dynamic Vector Searchcited by 4
  9. 2019Pyramid: A General Framework for Distributed Similarity Searchcited by 3
  10. 2025Towards Efficient and Scalable Distributed Vector Search with RDMAcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.