mlsanityData to 14 Oct 2026

On the Role of Fault Localization Context for LLM-Based Program Repair

arXiv 2604.05481 ↗First posted 7 Apr 2026cs.SE cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Fault Localization (FL) is a key component of Large Language Model (LLM)-based Automated Program Repair (APR), yet its impact remains underexplored. In particular, it is unclear how much localization is needed, whether additional context beyond the predicted buggy location is beneficial, and how such context should be retrieved. We conduct a large-scale empirical study on 500 SWE-bench Verified instances using GPT-5-mini, evaluating 61 configurations that vary file-level, element-level, and line-level context. Our results show that more context does not consistently improve repair performance. File-level localization is the dominant factor, yielding a 15-17x improvement over a no-file baseline. Expanding file context is often associated with improved performance, with successful repairs most commonly observed in configurations with approximately 6-10 relevant files. Element-level context expansion provides conditional gains that depend strongly on the file context quality, while line-level context expansion frequently degrades performance due to noise amplification. LLM-based retrieval generally outperforms structural heuristics while using fewer files and tokens. Overall, the most effective FL context strategy typically combines a broad semantic understanding at higher abstraction levels with precise line-level localization. These findings challenge our assumption that increasing the localization context uniformly improves APR, and provide practical guidance for designing LLM-based FL strategies.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

17 of 42 references.

References · 17

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
  3. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 1,002
  4. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
  5. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
  6. 2024Agentless: Demystifying LLM-based Software Engineering Agentscited by 421
  7. 2024SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinementcited by 132
  8. 2018An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translationcited by 108
  9. 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scalingcited by 94
  10. 2025LocAgent: Graph-Guided LLM Agents for Code Localizationcited by 86
  11. 2025OrcaLoca: An LLM Agent Framework for Software Issue Localizationcited by 45
  12. 2018You Cannot Fix What You Cannot Find! An Investigation of Fault Localization Bias in Benchmarking Automated Program Repair Systemscited by 13
5 more
  1. 2019iFixR: Bug Report driven Program Repaircited by 11
  2. 2021Locating Faults with Program Slicing: An Empirical Analysiscited by 7
  3. 2014Locating Crashing Faults based on Crash Stack Tracescited by 3
  4. 2021Beep: Fine-grained Fix Localization by Learning to Predict Buggy Code Elementscited by 2
  5. 2025Simple Fault Localization using Execution Tracescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.