Graph Memory for LLM Agents: At What Cost? A Comparative Evaluation of Query, Ingest, and Update Performance Across Graph Database Engines
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Graph databases are frequently positioned as categorically necessary for connected-data workloads, yet the systems dimension along which they actually differ - query planning, indexing, and data-readiness cost - is rarely isolated from vendor framing. We construct a synthetic, biomedical-shaped property graph (1.02 million nodes, 5.34 million total node and edge rows) and a twenty-query workload spanning neighborhood lookups, bounded paths, set intersections, anti-joins, grouped aggregation, top-k ranking, temporal filters, full scans, and relational joins. We benchmark Corvic AI - a purpose-built columnar query engine underlying Corvic's ontology management layer ("memories")- against seven purpose-built or graph-extension database systems (LoraDB, Ladybug, DuckPGQ, Memgraph, Neo4j, HugeGraph, and FalkorDB) at three graph scales spanning three orders of magnitude. We report query latency geomeans, bulk-ingest throughput, point-update latency, and answer correctness for each system, and we derive a simple total-cost-of-ownership model that expresses the ingest/query trade-off as a function of query volume. Our central finding is that no system in this sample is categorically fastest: a native graph engine (Ladybug) outperforms Corvic AI on narrow, bounded-neighborhood shapes, while Corvic AI is faster on shapes that scan or join a large fraction of the graph, and a system implementing graph query syntax via SQL/PGQ (DuckPGQ) is measurably slower purely due to query-plan choice. The dominant cost differential in our data is not query latency but the cost of making data queryable at all: bulk-ingest throughput varies by three orders of magnitude across engines (5.0k-4.3M rows/s), a gap that a simple crossover-point calculation shows dominates total cost for any workload with fewer than roughly 105 queries per data refresh.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 27 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
7 of 27 references.
References · 7
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2024STaRK: Benchmarking LLM Retrieval on Textual and Relational Knowledge Basescited by 55
- 2019Demystifying Graph Databases: Analysis and Taxonomy of Data Organization, System Designs, and Graph Queriescited by 22
- 2015The Gremlin Graph Traversal Machine and Languagecited by 10
- 2020The LDBC Social Network Benchmarkcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026WorldDB: A Vector Graph-of-Worlds Memory Engine with Ontology-Aware Write-Time Reconciliation
- 2026GraphSeek: Next-Generation Graph Analytics with LLMs
- 2024Towards Evaluating Large Language Models for Graph Query Generation
- 2025Multi-Agent GraphRAG: A Text-to-Cypher Framework for Labeled Property Graphs
- 2026TGMS: An Agent-Native Bi-Temporal Graph Management System ↗
- 2026MemForest: An Efficient Agent Memory System with Hierarchical Temporal Indexing
- 2026GraphMemix: Query-Aware Evidence Forests for Long-Term Multimodal Agent Memory
- 2025Rethinking Query Optimization for Multi-Agent Systems [Vision]