mlsanityData to 14 Oct 2026

On The Impact of Merge Request Deviations on Code Review Practices

arXiv 2506.08860 ↗First posted 10 Jun 2025cs.SE cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Code review is a key practice in software engineering, ensuring quality and collaboration. However, industrial Merge Request (MR) workflows often deviate from standardized review processes, with many MRs serving non-review purposes (e.g., drafts, rebases, or dependency updates). We term these cases deviations and hypothesize that ignoring them biases analytics and undermines ML models for review analysis. We identify seven deviation categories, occurring in 37.02% of MRs, and propose a few-shot learning detection method (91% accuracy). By excluding deviations, ML models predicting review completion time improve performance in 53.33% of cases (up to 2.25x) and exhibit significant shifts in feature importance (47% overall, 60% top-*k*). Our contributions include: (1) a taxonomy of MR deviations, (2) an AI-driven detection approach, and (3) empirical evidence of their impact on ML-based review analytics. This work aids practitioners in optimizing review efforts and ensuring reliable insights.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 46 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

16 of 46 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Efficient Few-Shot Learning Without Promptscited by 137
  3. 2021Towards Automating Code Review Activitiescited by 54
  4. 2022The impact of feature importance methods on the interpretation of defect classifierscited by 12
  5. 2022An Exploratory Study on Code Attention in BERTcited by 12
  6. 2025Too Noisy To Learn: Enhancing Data Quality for Code Review Comment Generationcited by 12
  7. 2020Nudge: Accelerating Overdue Pull Requests Towards Completioncited by 6
  8. 2022Impact of Discretization Noise of the Dependent variable on Machine Learning Classifiers in Software Engineeringcited by 6
  9. 2022The Impact of Using Regression Models to Build Defect Classifierscited by 5
  10. 2023Understanding the Time to First Response In GitHub Pull Requestscited by 3
  11. 2021Using Machine Intelligence to Prioritise Code Review Requestscited by 2
  12. 2021An Empirical Study of the Characteristics of Popular Minecraft Modscited by 2
4 more
  1. 2023Which Features are Learned by CodeBert: An Empirical Study of the BERT-based Source Code Representation Learningcited by 2
  2. 2019Early Prediction for Merged vs Abandoned Code Changes in Modern Code Reviewscited by 1
  3. 2020Do Code Review Measures Explain the Incidence of Post-Release Defects?cited by 1
  4. 2024Automatic Categorization of GitHub Actions with Transformers and Few-shot Learningcited by 1

Built on by

Not cited yet.