Towards Automating Code Review Activities
Not on the map. Why?
Abstract (arXiv)
Code reviews are popular in both industrial and open source projects. The benefits of code reviews are widely recognized and include better code quality and lower likelihood of introducing bugs. However, since code review is a manual activity it comes at the cost of spending developers' time on reviewing their teammates' code. Our goal is to make the first step towards partially automating the code review process, thus, possibly reducing the manual costs associated with it. We focus on both the contributor and the reviewer sides of the process, by training two different Deep Learning architectures. The first one learns code changes performed by developers during real code review activities, thus providing the contributor with a revised version of her code implementing code transformations usually recommended during code review before the code is even submitted for review. The second one automatically provides the reviewer commenting on a submitted code with the revised code implementing her comments expressed in natural language. The empirical evaluation of the two models shows that, on the contributor side, the trained model succeeds in replicating the code transformations applied during code reviews in up to 16% of cases. On the reviewer side, the model can correctly implement a comment provided in natural language in up to 31% of cases. While these results are encouraging, more research is needed to make these models usable by developers.
Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jan 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 8; 2024: 6; 2025: 19; 2026: 14.
54 papers.
Sort:
By area:
- 2022Automating Code Review Activities by Large-Scale Pre-trainingcited by 98
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHubcited by 53
- 2023LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuningcited by 47
- 2022CoditT5: Pretraining for Source Code and Natural Language Editingcited by 45
- 2024Automatic Programming: Large Language Models and Beyondcited by 35
- 2024CodeAgent: Autonomous Communicative Agents for Code Reviewcited by 33
- 2021On Multi-Modal Learning of Editing Source Codecited by 25
- 2023Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptionscited by 14
- 2023Benchmarking Causal Study to Interpret Large Language Models for Source Codecited by 14
- 2025Migrating Code At Scale With LLMs At Googlecited by 14
- 2022Learning to Reduce False Positives in Analytic Bug Detectorscited by 12
- 2022CodeEditor: Learning to Edit Source Code with Pre-trained Modelscited by 12
38 more
- 2023Toward a Theory of Causation for Interpreting Neural Code Modelscited by 12
- 2023Enhancing Automated Program Repair through Fine-tuning and Prompt Engineeringcited by 10
- 2025Traceability and Accountability in Role-Specialized Multi-Agent LLM Pipelinescited by 10
- 2023Coeditor: Leveraging Contextual Changes for Multi-round Code Auto-editingcited by 9
- 2024CRScore: Grounding Automated Evaluation of Code Review Comments in Code Claims and Smellscited by 8
- 2025LAURA: Enhancing Code Review Generation with Context-Enriched Retrieval-Augmented LLMcited by 8
- 2024Automated User Story Generation with Test Case Specification Using Large Language Modelcited by 7
- 2024Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generationcited by 7
- 2025Evaluating Large Language Models for Code Reviewcited by 7
- 2022CommitBART: A Large Pre-trained Model for GitHub Commitscited by 6
- 2025Combining Large Language Models with Static Analyzers for Code Review Generationcited by 6
- 2025Retrieval-Augmented Code Review Comment Generationcited by 6
- 2026RovoDev Code Reviewer: A Large-Scale Online Evaluation of LLM-based Code Review Automation at Atlassiancited by 6
- 2021JavaBERT: Training a transformer-based model for the Java programming languagecited by 5
- 2025SecureReviewer: Enhancing Large Language Models for Secure Code Review through Secure-aware Fine-tuningcited by 5
- 2026HalluJudge: A Reference-Free Hallucination Detection for Context Misalignment in Code Review Automationcited by 5
- 2023Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generationcited by 4
- 2024Leveraging Reviewer Experience in Code Review Comment Generationcited by 4
- 2025Hallucinations in Code Change to Natural Language Generation: Prevalence and Evaluation of Detection Metricscited by 4
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generationcited by 4
- 2026Code Review Agent Benchmarkcited by 4
- 2026SWE-Review: Closing the Loop on Issue Resolution with Agentic Code Reviewcited by 4
- 2025CodeReviewQA: The Code Review Comprehension Assessment for Large Language Modelscited by 3
- 2025Towards Practical Defect-Focused Automated Code Reviewcited by 3
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agentscited by 3
- 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agentscited by 3
- 2026Measuring and Exploiting Contextual Bias in LLM-Assisted Security Code Reviewcited by 3
- 2026AgenticSCR: An Autonomous Agentic Secure Code Review for Immature Vulnerabilities Detectioncited by 2
- 2026Cross-Model LLM Code Review: Should you use Claude to review Codex or vice versa?cited by 2
- 2023Towards Automatically Addressing Self-Admitted Technical Debt: How Far Are We?cited by 1
- 2025SnipGen: A Mining Repository Framework for Evaluating LLMs for Codecited by 1
- 2025Leveraging Reward Models for Guiding Code Review Comment Generationcited by 1
- 2025Previously on... Automating Code Reviewcited by 1
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Reviewcited by 1
- 2025Improving Automated Secure Code Reviews: A Synthetic Dataset for Code Vulnerability Flawscited by 0
- 2025On The Impact of Merge Request Deviations on Code Review Practicescited by 0
- 2025Fine-Tuning Multilingual Language Models for Code Review: An Empirical Study on Industrial C# Projectscited by 0
- 2025A Dataset and Preliminary Study of Using GPT-5 for Code-change Impact Analysiscited by 0
50 most cited of 54 All 54 (JSON)
- 2026From Static to Dynamic: Benchmarking Real-World Code Review with MCR-Bench27 Aug 2026
- 2026BulkPR-Bench: Benchmarking Queue-Level Governance of Interacting Pull Requests3 Aug 2026
- 2026Cross-Model LLM Code Review: Should you use Claude to review Codex or vice versa?22 Jul 2026
- 2026SWE-Review: Closing the Loop on Issue Resolution with Agentic Code Review7 Jul 2026
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review17 May 2026
- 2026From Helpful to Trustworthy: LLM Agents for Pair Programming11 Apr 2026
- 2026Code Review Agent Benchmark24 Mar 2026
- 2026Measuring and Exploiting Contextual Bias in LLM-Assisted Security Code Review19 Mar 2026
- 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agents10 Mar 2026
- 2026Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering28 Jan 2026
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents27 Jan 2026
- 2026AgenticSCR: An Autonomous Agentic Secure Code Review for Immature Vulnerabilities Detection27 Jan 2026
38 more
- 2026HalluJudge: A Reference-Free Hallucination Detection for Context Misalignment in Code Review Automation27 Jan 2026
- 2026RovoDev Code Reviewer: A Large-Scale Online Evaluation of LLM-based Code Review Automation at Atlassian3 Jan 2026
- 2025A Dataset and Preliminary Study of Using GPT-5 for Code-change Impact Analysis22 Dec 2025
- 2025LAURA: Enhancing Code Review Generation with Context-Enriched Retrieval-Augmented LLM1 Dec 2025
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generation1 Nov 2025
- 2025SecureReviewer: Enhancing Large Language Models for Secure Code Review through Secure-aware Fine-tuning30 Oct 2025
- 2025Traceability and Accountability in Role-Specialized Multi-Agent LLM Pipelines8 Oct 2025
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep 2025
- 2025Previously on... Automating Code Review25 Aug 2025
- 2025Hallucinations in Code Change to Natural Language Generation: Prevalence and Evaluation of Detection Metrics12 Aug 2025
- 2025Fine-Tuning Multilingual Language Models for Code Review: An Empirical Study on Industrial C# Projects25 Jul 2025
- 2025Retrieval-Augmented Code Review Comment Generation13 Jun 2025
- 2025On The Impact of Merge Request Deviations on Code Review Practices10 Jun 2025
- 2025Leveraging Reward Models for Guiding Code Review Comment Generation4 Jun 2025
- 2025Evaluating Large Language Models for Code Review26 May 2025
- 2025Towards Practical Defect-Focused Automated Code Review23 May 2025
- 2025Improving Automated Secure Code Reviews: A Synthetic Dataset for Code Vulnerability Flaws22 Apr 2025
- 2025Migrating Code At Scale With LLMs At Google13 Apr 2025
- 2025CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models20 Mar 2025
- 2025SnipGen: A Mining Repository Framework for Evaluating LLMs for Code10 Feb 2025
- 2025Combining Large Language Models with Static Analyzers for Code Review Generation10 Feb 2025
- 2024Prompting and Fine-tuning Large Language Models for Automated Code Review Comment Generation15 Nov 2024
- 2024CRScore: Grounding Automated Evaluation of Code Review Comments in Code Claims and Smells29 Sep 2024
- 2024Leveraging Reviewer Experience in Code Review Comment Generation17 Sep 2024
- 2024Automatic Programming: Large Language Models and Beyond3 May 2024
- 2024Automated User Story Generation with Test Case Specification Using Large Language Model2 Apr 2024
- 2024CodeAgent: Autonomous Communicative Agents for Code Review3 Feb 2024
- 2023Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generation8 Dec 2023
- 2023Benchmarking Causal Study to Interpret Large Language Models for Source Code23 Aug 2023
- 2023LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuning22 Aug 2023
- 2023Towards Automatically Addressing Self-Admitted Technical Debt: How Far Are We?17 Aug 2023
- 2023Coeditor: Leveraging Contextual Changes for Multi-round Code Auto-editing29 May 2023
- 2023Enhancing Automated Program Repair through Fine-tuning and Prompt Engineering16 Apr 2023
- 2023Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptions7 Apr 2023
- 2023Toward a Theory of Causation for Interpreting Neural Code Models7 Feb 2023
- 2022CodeEditor: Learning to Edit Source Code with Pre-trained Models31 Oct 2022
- 2022CommitBART: A Large Pre-trained Model for GitHub Commits17 Aug 2022
- 2022CoditT5: Pretraining for Source Code and Natural Language Editing10 Aug 2022
50 newest of 54 All 54 (JSON)
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHubcited by 53
- 2024CodeAgent: Autonomous Communicative Agents for Code Reviewcited by 33
- 2025Traceability and Accountability in Role-Specialized Multi-Agent LLM Pipelinescited by 10
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generationcited by 4
- 2026Code Review Agent Benchmarkcited by 4
- 2026SWE-Review: Closing the Loop on Issue Resolution with Agentic Code Reviewcited by 4
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agentscited by 3
- 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agentscited by 3
- 2026AgenticSCR: An Autonomous Agentic Secure Code Review for Immature Vulnerabilities Detectioncited by 2
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Reviewcited by 1
- 2026From Helpful to Trustworthy: LLM Agents for Pair Programmingcited by 0
- 2026SWE-Review: Closing the Loop on Issue Resolution with Agentic Code Review7 Jul 2026
- 2026Rethinking Code Review in the Age of AI: A Vision for Agentic Code Review17 May 2026
- 2026From Helpful to Trustworthy: LLM Agents for Pair Programming11 Apr 2026
- 2026Code Review Agent Benchmark24 Mar 2026
- 2026CR-Bench: Evaluating the Real-World Utility of AI Code Review Agents10 Mar 2026
- 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents27 Jan 2026
- 2026AgenticSCR: An Autonomous Agentic Secure Code Review for Immature Vulnerabilities Detection27 Jan 2026
- 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generation1 Nov 2025
- 2025Traceability and Accountability in Role-Specialized Multi-Agent LLM Pipelines8 Oct 2025
- 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHub18 Sep 2025
- 2024CodeAgent: Autonomous Communicative Agents for Code Review3 Feb 2024
- 2022Automating Code Review Activities by Large-Scale Pre-trainingcited by 98
- 2023LLaMA-Reviewer: Advancing Code Review Automation with Large Language Models through Parameter-Efficient Fine-Tuningcited by 47
- 2022CoditT5: Pretraining for Source Code and Natural Language Editingcited by 45
- 2024Automatic Programming: Large Language Models and Beyondcited by 35
- 2021On Multi-Modal Learning of Editing Source Codecited by 25
- 2023Towards Generating Functionally Correct Code Edits from Natural Language Issue Descriptionscited by 14
- 2023Benchmarking Causal Study to Interpret Large Language Models for Source Codecited by 14
- 2025Migrating Code At Scale With LLMs At Googlecited by 14
- 2022Learning to Reduce False Positives in Analytic Bug Detectorscited by 12
- 2022CodeEditor: Learning to Edit Source Code with Pre-trained Modelscited by 12
- 2023Toward a Theory of Causation for Interpreting Neural Code Modelscited by 12
- 2023Enhancing Automated Program Repair through Fine-tuning and Prompt Engineeringcited by 10
12 most cited of 39 All 39 (JSON)
- 2026From Static to Dynamic: Benchmarking Real-World Code Review with MCR-Bench27 Aug 2026
- 2026BulkPR-Bench: Benchmarking Queue-Level Governance of Interacting Pull Requests3 Aug 2026
- 2026Cross-Model LLM Code Review: Should you use Claude to review Codex or vice versa?22 Jul 2026
- 2026Measuring and Exploiting Contextual Bias in LLM-Assisted Security Code Review19 Mar 2026
- 2026Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering28 Jan 2026
- 2026HalluJudge: A Reference-Free Hallucination Detection for Context Misalignment in Code Review Automation27 Jan 2026
- 2026RovoDev Code Reviewer: A Large-Scale Online Evaluation of LLM-based Code Review Automation at Atlassian3 Jan 2026
- 2025A Dataset and Preliminary Study of Using GPT-5 for Code-change Impact Analysis22 Dec 2025
- 2025SecureReviewer: Enhancing Large Language Models for Secure Code Review through Secure-aware Fine-tuning30 Oct 2025
- 2025Previously on... Automating Code Review25 Aug 2025
- 2025Hallucinations in Code Change to Natural Language Generation: Prevalence and Evaluation of Detection Metrics12 Aug 2025
- 2025Fine-Tuning Multilingual Language Models for Code Review: An Empirical Study on Industrial C# Projects25 Jul 2025
12 newest of 39 All 39 (JSON)