Time Travel: LLM-Assisted Semantic Behavior Localization with Git Bisect
Not on the map. Why?
Abstract (arXiv)
We present a novel framework that integrates Large Language Models (LLMs) into the Git bisect process for semantic fault localization. Traditional bisect assumes deterministic predicates and binary failure states assumptions often violated in modern software development due to flaky tests, nonmonotonic regressions, and semantic divergence from upstream repositories. Our system augments bisect traversal with structured chain of thought reasoning, enabling commit by commit analysis under noisy conditions. We evaluate multiple open source and proprietary LLMs for their suitability and fine tune DeepSeekCoderV2 using QLoRA on a curated dataset of semantically labeled diffs. We adopt a weak supervision workflow to reduce annotation overhead, incorporating human in the loop corrections and self consistency filtering. Experiments across multiple open source projects show a 6.4 point absolute gain in success rate from 74.2 to 80.6 percent, leading to significantly fewer failed traversals and by experiment up to 2x reduction in average bisect time. We conclude with discussions on temporal reasoning, prompt design, and finetuning strategies tailored for commit level behavior analysis.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 11 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
6 of 11 references.
References · 6
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
- 2022Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matterscited by 222
- 2023Large Language Models for Test-Free Fault Localizationcited by 67
- 2023A Quantitative and Qualitative Evaluation of LLM-Based Explainable Fault Localizationcited by 50
- 2023The Parrot Dilemma: Human-Labeled vs. LLM-augmented Data in Classification Taskscited by 35
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Exploring the Potential and Limitations of Large Language Models for Novice Program Fault Localization ↗
- 2025Assessing the Impact of Code Changes on the Fault Localizability of Large Language Models
- 2025Large Language Models for Fault Localization: An Empirical Study ↗
- 2025LocAgent: Graph-Guided LLM Agents for Code Localization
- 2026LIDL: LLM Integration Defect Localization via Knowledge Graph-Enhanced Multi-Agent Analysis
- 2026ConFL: Explainable Concurrent Fault Localization via Hierarchy-Guided LLM Reasoning
- 2026Semantic Navigation for Issue Localization in Code Repository
- 2026CommitDistill: A Lightweight Knowledge-Centric Memory Layer for Software Repositories