Structure-Grounded Knowledge Retrieval via Code Dependencies for Multi-Step Data Reasoning
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Selecting the right knowledge is critical when using large language models (LLMs) to solve domain-specific data analysis tasks. However, most retrieval-augmented approaches rely primarily on lexical or embedding similarity, which is often a weak proxy for the task-critical knowledge needed for multi-step reasoning. In many such tasks, the relevant knowledge is not merely textually related to the query, but is instead grounded in executable code and the dependency structure through which computations are carried out. To address this mismatch, we propose SGKR (Structure-Grounded Knowledge Retrieval), a retrieval framework that organizes domain knowledge with a graph induced by function-call dependencies. Given a question, SGKR extracts semantic input and output tags, identifies dependency paths connecting them, and constructs a task-relevant subgraph. The associated knowledge and corresponding function implementations are then assembled as a structured context for LLM-based code generation. Experiments on multi-step data analysis benchmarks show that SGKR consistently improves solution correctness over no-retrieval and similarity-based retrieval baselines for both vanilla LLMs and coding agents.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 32 references that are in the map. First posted on arXiv 12 Apr 2026.
Builds on
12 of 32 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 140
- 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?cited by 125
- 2025DABstep: Data Agent Benchmark for Multi-step Reasoningcited by 46
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 16
- 2026Arming Data Agents with Tribal Knowledgecited by 7
- 2026SentGraph: Hierarchical Sentence Graph for Multi-hop Retrieval-Augmented Question Answeringcited by 6
- 2025SQLGovernor: An LLM-powered SQL Toolkit for Real World Applicationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation
- 2026Context-Augmented Code Generation Using Programming Knowledge Graphs
- 2025The Structure-Content Trade-off in Knowledge Graph Retrieval
- 2025Graph-Augmented Reasoning: Evolving Step-by-Step Knowledge Graph Retrieval for LLM Reasoning
- 2025PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language Models
- 2025FRAG: A Flexible Modular Framework for Retrieval-Augmented Generation based on Knowledge Graphs
- 2026Multi-hop Reasoning and Retrieval in Embedding Space: Leveraging Large Language Models with Knowledge
- 2025Grounding LLM Reasoning with Knowledge Graphs