# GraphAr: An Efficient Storage Scheme for Graph Data in Data Lakes

arXiv: https://arxiv.org/abs/2312.09577 · HTML: https://mlsanity.com/paper/2312.09577/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Dec 2023.

## Built on by (most cited first, 1 of 1)

- [CMDBench: A Benchmark for Coarse-to-fine Multimodal Data Discovery in Compound AI Systems](https://mlsanity.com/paper/2406.00583/) (2024)

## Abstract (arXiv)

Data lakes, increasingly adopted for their ability to store and analyze diverse types of data, commonly use columnar storage formats like Parquet and ORC for handling relational tables. However, these traditional setups fall short when it comes to efficiently managing graph data, particularly those conforming to the Labeled Property Graph (LPG) model. To address this gap, this paper introduces GraphAr, a specialized storage scheme designed to enhance existing data lakes for efficient graph data management. Leveraging the strengths of Parquet, GraphAr captures LPG semantics precisely and facilitates graph-specific operations such as neighbor retrieval and label filtering. Through innovative data organization, encoding, and decoding techniques, GraphAr dramatically improves performance. Our evaluations reveal that GraphAr outperforms conventional Parquet and Acero-based methods, achieving an average speedup of 4452x for neighbor retrieval, 14.8x for label filtering, and 29.5x for end-to-end workloads. These findings highlight GraphAr's potential to extend the utility of data lakes by enabling efficient graph data management.