Fine-Tuning Multilingual Language Models for Code Review: An Empirical Study on Industrial C# Projects
Not on the map. Why?
Abstract (arXiv)
Code review is essential for maintaining software quality but often time-consuming and cognitively demanding, especially in industrial environments. Recent advancements in language models (LMs) have opened new avenues for automating core review tasks. This study presents the empirical evaluation of monolingual fine-tuning on the performance of open-source LMs across three key automated code review tasks: Code Change Quality Estimation, Review Comment Generation, and Code Refinement. We fine-tuned three distinct models, CodeReviewer, CodeLlama-7B, and DeepSeek-R1-Distill, on a C# specific dataset combining public benchmarks with industrial repositories. Our study investigates how different configurations of programming languages and natural languages in the training data affect LM performance, particularly in comment generation. Additionally, we benchmark the fine-tuned models against an automated software analysis tool (ASAT) and human reviewers to evaluate their practical utility in real-world settings. Our results show that monolingual fine-tuning improves model accuracy and relevance compared to multilingual baselines. While LMs can effectively support code review workflows, especially for routine or repetitive tasks, human reviewers remain superior in handling semantically complex or context-sensitive changes. Our findings highlight the importance of language alignment and task-specific adaptation in optimizing LMs for automated code review.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 60 references that are in the map. First posted on arXiv 25 Jul 2025.
Builds on
17 of 60 references.
References · 17
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2022Automating Code Review Activities by Large-Scale Pre-trainingcited by 98
- 2021CURE: Code-Aware Neural Machine Translation for Automatic Program Repaircited by 85
- 2021Towards Automating Code Review Activitiescited by 54
- 2019On Learning Meaningful Code Changes via Neural Machine Translationcited by 50
- 2023Exploring the Potential of ChatGPT in Automated Code Refinement: An Empirical Studycited by 44
- 2022On the Transferability of Pre-trained Language Models for Low-Resource Programming Languagescited by 30
- 2022AUGER: Automatically Generating Review Comments with Pre-training Modelscited by 23
5 more
- 2024An Empirical Study of Static Analysis Tools for Secure Code Reviewcited by 17
- 2024AI-Assisted Assessment of Coding Practices in Modern Code Reviewcited by 16
- 2024Improving Automated Code Reviews: Learning from Experiencecited by 13
- 2024Leveraging Reviewer Experience in Code Review Comment Generationcited by 4
- 2018CORRECT: Code Reviewer Recommendation at GitHub for Vendasta Technologiescited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CodeReviewQA: The Code Review Comprehension Assessment for Large Language Models
- 2025Combining Large Language Models with Static Analyzers for Code Review Generation
- 2025Fine-Tuning LLMs to Analyze Multiple Dimensions of Code Review: A Maximum Entropy Regulated Long Chain-of-Thought Approach
- 2024Distilling Desired Comments for Enhanced Code Review with Large Language Models
- 2025LAURA: Enhancing Code Review Generation with Context-Enriched Retrieval-Augmented LLM
- 2025Evaluating Large Language Models for Functional and Maintainable Code in Industrial Settings: A Case Study at ASML
- 2026Rethinking Training Data for Generating Code Review Comments
- 2026Automated Classification of Human Code Review Comments with Large Language Models