mlsanityData to 14 Oct 2026

The Hitchhiker's Guide to Program Analysis, Part II: Deep Thoughts by LLMs

arXiv 2504.11711 ↗First posted 16 Apr 2025cs.SE cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Static analysis plays a crucial role in software vulnerability detection, yet faces a persistent precision-scalability tradeoff. In large codebases like the Linux kernel, traditional static analysis tools often generate excessive false positives due to simplified vulnerability modeling and overapproximation of path and data constraints. While large language models (LLMs) demonstrate promising code understanding capabilities, their direct application to program analysis remains unreliable due to inherent reasoning limitations. We introduce BugLens, a post-refinement framework that significantly enhances static analysis precision for bug detection. BugLens guides LLMs through structured reasoning steps to assess security impact and validate constraints from the source code. When evaluated on Linux kernel taint-style bugs detected by static analysis tools, BugLens improves precision approximately 7-fold (from 0.10 to 0.72), substantially reducing false positives while uncovering four previously unreported vulnerabilities. Our results demonstrate that a well-structured, fully automated LLM-based workflow can effectively complement and enhance traditional static analysis techniques.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 31 of its 56 references that are in the map. First posted on arXiv 16 Apr 2025.

Builds on

31 of 56 references.

References · 31

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  3. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
  4. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  5. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  6. 2023Structured Chain-of-Thought Prompting for Code Generationcited by 138
  7. 2023Chain of Code: Reasoning with a Language Model-Augmented Code Emulatorcited by 123
  8. 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 103
  9. 2025A Sober Look at Progress in Language Model Reasoning: Pitfalls and Paths to Reproducibilitycited by 93
  10. 2024Can Large Language Models Reason and Plan?cited by 82
  11. 2022Natural Attack for Pre-trained Models of Codecited by 75
  12. 2019Adversarial Examples for Models of Codecited by 63
19 more
  1. 2024NExT: Teaching Large Language Models to Reason about Code Executioncited by 63
  2. 2023Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilitiescited by 59
  3. 2024Towards AI-Assisted Synthesis of Verified Dafny Methodscited by 58
  4. 2025CodeI/O: Condensing Reasoning Patterns via Code Input-Output Predictioncited by 55
  5. 2025RepoAudit: An Autonomous LLM-Agent for Repository-Level Code Auditingcited by 49
  6. 2023Large Language Models for Code Analysis: Do LLMs Really Do Their Job?cited by 45
  7. 2024Reasoning Runtime Behavior of a Program with LLM: How Far Are We?cited by 45
  8. 2020Adversarial Robustness for Codecited by 38
  9. 2024SemCoder: Training Code Language Models with Comprehensive Semantics Reasoningcited by 27
  10. 2024Deciphering the Factors Influencing the Efficacy of Chain-of-Thought: Probability, Memorization, and Noisy Reasoningcited by 27
  11. 2024Steering Large Language Models between Code Execution and Textual Reasoningcited by 24
  12. 2024LLMDFA: Analyzing Dataflow in Code with Large Language Modelscited by 22
  13. 2025LAMD: Context-driven Android Malware Detection and Classification with LLMscited by 18
  14. 2025Can LLMs Reason About Program Semantics? A Comprehensive Evaluation of LLMs on Formal Specification Inferencecited by 16
  15. 2024Verified Code Transpilation with LLMscited by 15
  16. 2024PyTy: Repairing Static Type Errors in Pythoncited by 10
  17. 2024Generating API Parameter Security Rules with LLM for API Misuse Detectioncited by 7
  18. 2024Scaling Symbolic Execution to Large Software Systemscited by 1
  19. 2024Semantic-Enhanced Indirect Call Analysis with Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Trust Me, I Know This Function: Hijacking LLM Static Analysis using Bias
  2. 2025ZeroFalse: Improving Precision in Static Analysis with LLMs
  3. 2026Guiding Symbolic Execution with Static Analysis and LLMs for Vulnerability Discovery
  4. 2024Can LLM Prompting Serve as a Proxy for Static Analysis in Vulnerability Detection
  5. 2026VulWeaver: Weaving Broken Semantics for Grounded Vulnerability Detection
  6. 2026Bridging Code Property Graphs and Language Models for Program Analysis ↗
  7. 2026OpenAnt: LLM-Powered Vulnerability Discovery Through Code Decomposition, Adversarial Verification, and Dynamic Testing
  8. 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAG