Improved IR-based Bug Localization with Intelligent Relevance Feedback
Not on the map. Why?
Abstract (arXiv)
Software bugs pose a significant challenge during development and maintenance, and practitioners spend nearly 50% of their time dealing with bugs. Many existing techniques adopt Information Retrieval (IR) to localize a reported bug using textual and semantic relevance between bug reports and source code. However, they often struggle to bridge a critical gap between bug reports and code that requires in-depth contextual understanding, which goes beyond textual or semantic relevance. In this paper, we present a novel technique for bug localization - BRaIn - that addresses the contextual gaps by assessing the relevance between bug reports and code with Large Language Models (LLM). It then leverages the LLM's feedback (a.k.a., Intelligent Relevance Feedback) to reformulate queries and re-rank source documents, improving bug localization. We evaluate BRaIn using a benchmark dataset, Bench4BL, and three performance metrics and compare it against six baseline techniques from the literature. Our experimental results show that BRaIn outperforms baselines by 87.6%, 89.5%, and 48.8% margins in MAP, MRR, and HIT@K, respectively. Additionally, it can localize approximately 52% of bugs that cannot be localized by the baseline techniques due to the poor quality of corresponding bug reports. By addressing the contextual gaps and introducing Intelligent Relevance Feedback, BRaIn advances not only theory but also improves IR-based bug localization.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 26 of its 87 references that are in the map. First posted on arXiv 17 Jan 2025.
Builds on
26 of 87 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,218
- 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
- 2021Do Prompt-Based Models Really Understand the Meaning of their Prompts?cited by 326
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2017A Survey of Machine Learning for Big Code and Naturalnesscited by 221
14 more
- 2023Prompting Large Language Models with Speech Recognition Abilitiescited by 140
- 2023Unleashing the potential of prompt engineering for large language modelscited by 72
- 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
- 2023Prompting Is All You Need: Automated Android Bug Replay with Large Language Modelscited by 40
- 2018NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrievalcited by 17
- 2021Fast Changeset-based Bug Localization with BERTcited by 13
- 2018RACK: Automatic API Recommendation using Crowdsourced Knowledgecited by 12
- 2018Improving IR-Based Bug Localization with Context-Aware Query Reformulationcited by 11
- 2020Deep Reinforced Query Reformulation for Information Retrievalcited by 10
- 2023RLocator: Reinforcement Learning for Bug Localizationcited by 7
- 2019Improving Neural Language Models by Segmenting, Attending, and Predicting the Futurecited by 5
- 2021The Forgotten Role of Search Queries in IR-based Bug Localization: An Empirical Studycited by 5
- 2018Improved Query Reformulation for Concept Location using CodeRank and Document Structurescited by 4
- 2023A Brief History of Prompt: Leveraging Language Models. (Through Advanced Prompting)cited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requestscited by 8
- 2025Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Studycited by 1
- 2025Imitation Game: Reproducing Deep Learning Bugs Leveraging an Intelligent Agentcited by 1
- 2026Improved Bug Localization with AI Agents Leveraging Hypothesis and Dynamic Cognitioncited by 0
- 2026BLAgent: Agentic RAG for File-Level Bug Localizationcited by 0
- 2026BLAgent: Agentic RAG for File-Level Bug Localization18 May 2026
- 2026How AI Coding Agents Modify Code: A Large-Scale Study of GitHub Pull Requests24 Jan 2026
- 2026Improved Bug Localization with AI Agents Leveraging Hypothesis and Dynamic Cognition18 Jan 2026
- 2025Imitation Game: Reproducing Deep Learning Bugs Leveraging an Intelligent Agent17 Dec 2025
- 2025Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Study29 Nov 2025