mlsanityData to 14 Oct 2026

Characterizing the Quality Profile of AI-Generated C++ in Production

arXiv 2608.06640 ↗First posted 6 Aug 2026cs.SE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The widespread integration of AI coding assistants offers undeniable boosts to engineering velocity. Yet, recent studies point to a growing trade-off, revealing persistent challenges with code quality and maintainability. Industry leaders, including frontier AI labs, echo these concerns. As large language models are increasingly relied upon to author production code, understanding their impact on shipped software quality has become a critical priority. However, assessing these effects in industrial workflows remains difficult due to observability barriers. We study the impact of AI-generated code on production quality within a large enterprise operating global products relied upon by billions of users daily. Driven by this scale and user trust, the organization values code quality and has built thorough observability for every line of code deployed into production, enabling us to overcome measurement barriers to assess these effects. This study presents a large-scale empirical analysis of AI-generated C++ code from April 2025 to April 2026, tracking 3.52 million code changes across this enterprise's brownfield codebase. The core purpose is to understand the quality, performance, and maintenance characteristics of AI-generated code compared to human-written code in a production environment at scale. We find that AI-generated C++ code has a distinct quality profile, showing higher rates of interface and coupling burdens, copy and allocation overheads, and a reliance on explicit loops over optimized standard APIs. These issues translate into tangible downstream costs, including increased review effort and a 5-8% increase in compute resource consumption. However, we demonstrate that providing models with targeted, taxonomy-informed feedback can mitigate these effects, leading to an 11.1% reduction in targeted static analysis warnings and improved computational efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

24 of 47 references.

References · 24

  1. 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 653
  2. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 431
  3. 2023The Impact of AI on Developer Productivity: Evidence from GitHub Copilotcited by 274
  4. 2022Grounded Copilot: How Programmers Interact with Code-Generating Modelscited by 218
  5. 2022Lost at C: A User Study on the Security Implications of Large Language Model Code Assistantscited by 91
  6. 2022Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programmingcited by 91
  7. 2023Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issuescited by 79
  8. 2024Human-In-the-Loop Software Development Agentscited by 42
  9. 2024Language Models for Code Completion: A Practical Evaluationcited by 39
  10. 2024LLMs Meet Library Evolution: Evaluating Deprecated API Usage in LLM-based Code Completioncited by 32
  11. 2024Towards Understanding the Characteristics of Code Generation Errors Made by Large Language Modelscited by 30
  12. 2023Traces of Memorisation in Large Language Models for Codecited by 29
12 more
  1. 2025Large Language Models for Code Generation: A Comprehensive Survey of Challenges, Techniques, Evaluation, and Applicationscited by 26
  2. 2025Speed at the Cost of Quality: How Cursor AI Increases Short-Term Velocity and Long-Term Complexity in Open-Source Projectscited by 24
  3. 2024How much does AI impact development speed? An enterprise-based randomized controlled trialcited by 20
  4. 2024AI-Assisted Assessment of Coding Practices in Modern Code Reviewcited by 16
  5. 2024The Role of Generative AI in Software Development Productivity: A Pilot Case Studycited by 14
  6. 2025Static Analysis as a Feedback Loop: Enhancing LLM-Generated Code Beyond Correctnesscited by 8
  7. 2024Dear Diary: A randomized controlled trial of Generative AI coding tools in the workplacecited by 7
  8. 2025Generating Energy-Efficient Code via Large-Language Models -- Where are we now?cited by 6
  9. 2023Measuring the Runtime Performance of C++ Code Written by Humans using GitHub Copilotcited by 5
  10. 2026Correctness isnt Efficiency: Runtime Memory Divergence in LLM-Generated Codecited by 4
  11. 2024Chain of Targeted Verification Questions to Improve the Reliability of Code Generated by LLMscited by 3
  12. 2025How Much Do Code Language Models Remember? An Investigation on Data Extraction Attacks before and after Fine-tuningcited by 3

Built on by

Not cited yet.