Neurosymbolic Repo-level Code Localization
Not on the map. Why?
Abstract (arXiv)
Code localization is a cornerstone of autonomous software engineering. Recent advancements have achieved impressive performance on real-world issue benchmarks. However, we identify a critical yet overlooked bias: these benchmarks are saturated with keyword references (e.g. file paths, function names), encouraging models to rely on superficial lexical matching rather than genuine structural reasoning. We term this phenomenon the Keyword Shortcut. To address this, we formalize the challenge of Keyword-Agnostic Logical Code Localization (KA-LCL) and introduce KA-LogicQuery, a diagnostic benchmark requiring structural reasoning without any naming hints. Our evaluation reveals a catastrophic performance drop of state-of-the-art approaches on KA-LogicQuery, exposing their lack of deterministic reasoning capabilities. We propose LogicLoc, a novel agentic framework that combines large language models with the rigorous logical reasoning of Datalog for precise localization. LogicLoc extracts program facts from the codebase and leverages an LLM to synthesize Datalog programs, with parser-gated validation and mutation-based intermediate-rule diagnostic feedback to ensure correctness and efficiency. The validated programs are executed by a high-performance inference engine, enabling accurate and verifiable localization in a fully automated, closed-loop workflow. Experimental results demonstrate that LogicLoc significantly outperforms SOTA methods on KA-LogicQuery while maintaining competitive performance on popular issue-driven benchmarks. Notably, LogicLoc attains superior performance with significantly lower token consumption and faster execution by offloading structural traversal to a deterministic engine, reducing the overhead of iterative LLM inference.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
25 of 38 references.
References · 25
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 527
- 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 400
- 2025SWE-smith: Scaling Data for Software Engineering Agentscited by 255
- 2024MAGIS: LLM-Based Multi-Agent Framework for GitHub Issue Resolutioncited by 132
- 2024SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agentscited by 129
- 2025SWE-Fixer: Training Open-Source LLMs for Effective and Efficient GitHub Issue Resolutioncited by 87
- 2025LocAgent: Graph-Guided LLM Agents for Code Localizationcited by 82
13 more
- 2025OrcaLoca: An LLM Agent Framework for Software Issue Localizationcited by 43
- 2025SWE-QA: Can Language Models Answer Repository-level Code Questions?cited by 37
- 2021CodeQA: A Question Answering Dataset for Source Code Comprehensioncited by 30
- 2025SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-Tuningcited by 27
- 2025SweRank: Software Issue Localization with Code Rankingcited by 20
- 2022Code Search: A Survey of Techniques for Finding Codecited by 18
- 2025CoReQA: Uncovering Potentials of Language Models in Code Repository Question Answeringcited by 17
- 2023CrossCodeBench: Benchmarking Cross-Task Generalization of Source Code Modelscited by 16
- 2025Doc2Feat-Bench: Evaluating Documentation-Driven Feature Additioncited by 15
- 2024Collu-Bench: A Benchmark for Predicting Language Model Hallucinations in Codecited by 13
- 2024ProCQA: A Large-scale Community-based Programming Question Answering Dataset for Code Searchcited by 12
- 2024CodeRepoQA: A Large-scale Benchmark for Software Engineering Question Answeringcited by 11
- 2025GraphLocator: Graph-guided Causal Reasoning for Issue Localizationcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026SHERLOC: Structured Diagnostic Localization for Code Repair Agents
- 2026Agentic Code Reasoning
- 2025Assessing the Impact of Code Changes on the Fault Localizability of Large Language Models
- 2025Breakpoint: Scalable evaluation of system-level reasoning in LLM code agents
- 2026From Laboratory to Real-World Applications: Benchmarking Agentic Code Reasoning at the Repository Level
- 2026SemLoc: Structured Grounding of Free-Form LLM Reasoning for Fault Localization
- 2026RGFL: Reasoning Guided Fault Localization for Automated Program Repair Using Large Language Models
- 2026Improved Bug Localization with AI Agents Leveraging Hypothesis and Dynamic Cognition