mlsanityData to 7 Oct 2026

Pre-Filtering Code Suggestions using Developer Behavioral Telemetry to Optimize LLM-Assisted Programming

arXiv 2511.18849 ↗First posted 24 Nov 2025cs.SE cs.AI cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) are increasingly integrated into code editors to provide AI-powered code suggestions. Yet many of these suggestions are ignored, resulting in wasted computation, increased latency, and unnecessary interruptions. We introduce a lightweight pre-filtering model that predicts the likelihood of suggestion acceptance before invoking the LLM, using only real-time developer telemetry such as typing speed, file navigation, and editing activity. Deployed in a production-grade Visual Studio Code plugin over four months of naturalistic use, our approach nearly doubled acceptance rates (18.4% -> 34.2%) while suppressing 35% of low-value LLM calls. These findings demonstrate that behavioral signals alone can meaningfully improve both user experience and system efficiency in LLM-assisted programming, highlighting the value of timing-aware, privacy-preserving adaptation mechanisms. The filter operates solely on pre-invocation editor telemetry and never inspects code or prompts.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

14 of 22 references.

References · 14

  1. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 216
  2. 2023Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPTcited by 71
  3. 2024The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmerscited by 28
  4. 2023When to Show a Suggestion? Integrating Human Feedback in AI-Assisted Programmingcited by 25
  5. 2024Examining the Use and Impact of an AI Code Assistant on Developer Productivity and Experience in the Enterprisecited by 17
  6. 2024Prompt-based Code Completion via Multi-Retrieval Augmented Generationcited by 16
  7. 2024The Impact of Generative AI on Collaborative Open-Source Software Development: Evidence from GitHub Copilotcited by 11
  8. 2022Overwatch: Learning Patterns in Code Edit Sequencescited by 8
  9. 2025Experience with GitHub Copilot for Developer Productivity at Zoominfocited by 8
  10. 2024A Transformer-Based Approach for Smart Invocation of Automatic Code Completioncited by 5
  11. 2025Understanding User Mental Models in AI-Driven Code Completion Tools: Insights from an Elicitation Studycited by 5
  12. 2025Mind the Metrics: Patterns for Telemetry-Aware In-IDE AI Application Development using the Model Context Protocol (MCP)cited by 4
2 more
  1. 2025NES: An Instruction-Free, Low-Latency Next Edit Suggestion Framework Powered by Learned Historical Editing Trajectoriescited by 2
  2. 2020Predicting Developers' IDE Commands with Machine Learningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.