mlsanityData to 7 Oct 2026

How Do Agents Perform Code Optimization? An Empirical Study

arXiv 2512.21757 ↗First posted 25 Dec 2025cs.SE cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Performance optimization is a critical yet challenging aspect of software development, often requiring a deep understanding of system behavior, algorithmic tradeoffs, and careful code modifications. Although recent advances in AI coding agents have accelerated code generation and bug fixing, little is known about how these agents perform on real-world performance optimization tasks. We present the first empirical study comparing agent- and human-authored performance optimization commits, analyzing 324 agent-generated and 83 human-authored PRs from the AIDev dataset across adoption, maintainability, optimization patterns, and validation practices. We find that AI-authored performance PRs are less likely to include explicit performance validation than human-authored PRs (45.7% vs. 63.6%, p=0.007). In addition, AI-authored PRs largely use the same optimization patterns as humans. We further discuss limitations and opportunities for advancing agentic code optimization.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 7 of its 46 references that are in the map. First posted on arXiv 25 Dec 2025.

Builds on

7 of 46 references.

References · 7

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  2. 2025On the Use of Agentic Coding: An Empirical Study of Pull Requests on GitHubcited by 53
  3. 2024Can LLMs Replace Manual Annotation of Software Engineering Artifacts?cited by 40
  4. 2024Unveiling ChatGPT's Usage in Open Source Projects: A Mining-based Studycited by 16
  5. 2025Language Models for Code Optimization: Survey, Challenges and Future Directionscited by 15
  6. 2023RAPGen: An Approach for Fixing Code Inefficiencies in Zero-Shotcited by 14
  7. 2025SysLLMatic: Large Language Models are Software System Optimizerscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Do AI Coding Agents Contribute to Software Development? an Empirical Study of Agentic Pull Requests
  2. 2026Safer Builders, Risky Maintainers: A Comparative Study of Breaking Changes in Human vs Agentic PRs
  3. 2026PERFOPT-Bench: Evaluating Coding Agents on Software Performance Optimization
  4. 2026Humans Integrate, Agents Fix: How Agent-Authored Pull Requests Are Referenced in Practice
  5. 2025How Do Agentic AI Systems Address Performance Optimizations? A BERTopic-Based Analysis of Pull Requests
  6. 2026Investigating Autonomous Agent Contributions in the Wild: Activity Patterns and Code Change over Time
  7. 2026Are We All Using Agents the Same Way? An Empirical Study of Core and Peripheral Developers Use of Coding Agents
  8. 2025Agentic Refactoring: An Empirical Study of AI Coding Agents