Combining Large Language Models with Static Analyzers for Code Review Generation
Not on the map. Why?
Abstract (arXiv)
Code review is a crucial but often complex, subjective, and time-consuming activity in software development. Over the past decades, significant efforts have been made to automate this process. Early approaches focused on knowledge-based systems (KBS) that apply rule-based mechanisms to detect code issues, providing precise feedback but struggling with complex, context-dependent cases. More recent work has shifted toward fine-tuning pre-trained language models for code review, enabling broader issue coverage but often at the expense of precision. In this paper, we propose a hybrid approach that combines the strengths of KBS and learning-based systems (LBS) to generate high-quality, comprehensive code reviews. Our method integrates knowledge at three distinct stages of the language model pipeline: during data preparation (Data-Augmented Training, DAT), at inference (Retrieval-Augmented Generation, RAG), and after inference (Naive Concatenation of Outputs, NCO). We empirically evaluate our combination strategies against standalone KBS and LBS fine-tuned on a real-world dataset. Our results show that these hybrid strategies enhance the relevance, completeness, and overall quality of review comments, effectively bridging the gap between rule-based tools and deep learning models.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
30 of 61 references.
References · 30
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2023StarCoder: may the source be with you!cited by 799
- 2023Active Retrieval Augmented Generationcited by 516
- 2023JudgeLM: Fine-tuned Large Language Models are Scalable Judgescited by 367
- 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 232
- 2024Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judgescited by 205
- 2022Automating Code Review Activities by Large-Scale Pre-trainingcited by 98
- 2023No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generationcited by 82
18 more
- 2023GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysiscited by 65
- 2022Using Pre-Trained Models to Boost Code Review Automationcited by 63
- 2024CodeUltraFeedback: An LLM-as-a-Judge Dataset for Aligning Large Language Models to Coding Preferencescited by 57
- 2021Towards Automating Code Review Activitiescited by 54
- 2021D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysiscited by 49
- 2023LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuningcited by 47
- 2024ReposVul: A Repository-Level High-Quality Vulnerability Datasetcited by 36
- 2023Learning Deep Semantics for Test Completioncited by 31
- 2022AUGER: Automatically Generating Review Comments with Pre-training Modelscited by 23
- 2024STALL+: Boosting LLM-based Repository-level Code Completion with Static Analysiscited by 21
- 2024Code Review Automation: Strengths and Weaknesses of the State of the Artcited by 20
- 2019CORE: Automating Review Recommendation for Code Changescited by 14
- 2024PyTy: Repairing Static Type Errors in Pythoncited by 10
- 2020The Effectiveness of Supervised Machine Learning Algorithms in Predicting Software Refactoringcited by 9
- 2021A Critical Comparison on Six Static Analysis Tools: Detection, Agreement, and Precisioncited by 9
- 2024Improving the Learning of Code Review Successive Tasks with Cross-Task Knowledge Distillationcited by 7
- 2023SkipAnalyzer: A Tool for Static Code Analysis with Large Language Modelscited by 4
- 2024A Roadmap on Modern Code Review: Challenges and Opportunitiescited by 3
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Repairing vulnerabilities without invisible hands. A differentiated replication study on LLMscited by 1
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Reviewcited by 1
- 2025MetaLint: Easy-to-Hard Generalization for Code Lintingcited by 0
- 2026Enhancing Debugging Skills with AI-Powered Assistance: A Real-Time Tool for Debugging Supportcited by 0
- 2026FlowArk: Boosting Agentic Data-flow Analysis for Android Apps via Context-Aware Knowledge Reusecited by 0
- 2026Enhancing SLMs for Sustainable Code Optimization in Radio-Astronomycited by 0
- 2026Enhancing SLMs for Sustainable Code Optimization in Radio-Astronomy23 Jul 2026
- 2026FlowArk: Boosting Agentic Data-flow Analysis for Android Apps via Context-Aware Knowledge Reuse13 Jul 2026
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review17 May 2026
- 2026Enhancing Debugging Skills with AI-Powered Assistance: A Real-Time Tool for Debugging Support5 Jan 2026
- 2025Repairing vulnerabilities without invisible hands. A differentiated replication study on LLMs28 Jul 2025
- 2025MetaLint: Easy-to-Hard Generalization for Code Linting15 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025LAURA: Enhancing Code Review Generation with Context-Enriched Retrieval-Augmented LLM
- 2025Fine-Tuning Multilingual Language Models for Code Review: An Empirical Study on Industrial C# Projects
- 2024Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generation
- 2025CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models
- 2025Fine-Tuning LLMs to Analyze Multiple Dimensions of Code Review: A Maximum Entropy Regulated Long Chain-of-Thought Approach
- 2025Automated Code Review Using Large Language Models with Symbolic Reasoning
- 2024Distilling Desired Comments for Enhanced Code Review with Large Language Models
- 2025Retrieval-Augmented Code Review Comment Generation