# Nudge: Accelerating Overdue Pull Requests Towards Completion

arXiv: https://arxiv.org/abs/2011.12468 · HTML: https://mlsanity.com/paper/2011.12468/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Nov 2020.

## Built on by (most cited first, 6 of 6)

- [CatAlyst: Domain-Extensible Intervention for Preventing Task Procrastination Using Large Generative Models](https://mlsanity.com/paper/2302.05678/) (2023)
- [Predicting the First Response Latency of Maintainers and Contributors in Pull Requests](https://mlsanity.com/paper/2311.07786/) (2023)
- [Previously on... Automating Code Review](https://mlsanity.com/paper/2508.18003/) (2025)
- [On The Impact of Merge Request Deviations on Code Review Practices](https://mlsanity.com/paper/2506.08860/) (2025)
- [AI-Assisted Fixes to Code Review Comments at Scale](https://mlsanity.com/paper/2507.13499/) (2025)
- [From Code Review to Code Critique: Intent, Drift, and Spotlight for AI-Generated Diffs at Scale](https://mlsanity.com/paper/2607.29516/) (2026)

## Abstract (arXiv)

Pull requests are a key part of the collaborative software development and code review process today. However, pull requests can also slow down the software development process when the reviewer(s) or the author do not actively engage with the pull request. In this work, we design an end-to-end service, Nudge, for accelerating overdue pull requests towards completion by reminding the author or the reviewer(s) to engage with their overdue pull requests. First, we use models based on effort estimation and machine learning to predict the completion time for a given pull request. Second, we use activity detection to filter out pull requests that may be overdue, but for which sufficient action is taking place nonetheless. Lastly, we use actor identification to understand who the blocker of the pull request is and nudge the appropriate actor (author or reviewer(s)). The key novelty of Nudge is that it succeeds in reducing pull request resolution time, while ensuring that developers perceive the notifications sent as useful, at the scale of thousands of repositories. In a randomized trial on 147 repositories in use at Microsoft, Nudge was able to reduce pull request resolution time by 60% for 8,500 pull requests, when compared to overdue pull requests for which Nudge did not send a notification. Furthermore, developers receiving Nudge notifications resolved 73% of these notifications as positive. We observed similar results when scaling up the deployment of Nudge to 8,000 repositories at Microsoft, for which Nudge sent 210,000 notifications during a full year. This demonstrates Nudge's ability to scale to thousands of repositories. Lastly, our qualitative analysis of a selection of Nudge notifications indicates areas for future research, such as taking dependencies among pull requests and developer availability into account.
