CP-Agent: A Calibrated Risk-Controlled Agent for Feedback-Driven Competitive Programming
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Large language models still struggle with contest-level programming, while many agentic remedies rely on massive inference-time sampling or expensive multi-stage post-training. We study when execution feedback reliably helps an LLM CP solver and which mechanisms govern the gains. We model feedback-driven solving as a calibrated stopped process and identify three quantities: false-admission risk, program-level evidence against bad programs, and the active-state success hazard. Under held-out trace calibration and selection from a pre-declared finite controller manifest, the resulting structural certificate lower-bounds the clean success probability before false admission. We instantiate mechanisms targeting these quantities as Dual-Granularity Verification, Test Augmentation, and Experience-Driven Self-Evolving, yielding CP-Agent. Without updating any parameters, CP-Agent raises Pass@1 from 25.8% to 48.5% on LiveCodeBench Pro and improves Refine@5 by 11.0% on ICPC-Eval. Across three LLM backbones, CP-Agent lies on the cost--accuracy efficiency frontier, and ablations show that each component primarily affects its corresponding certificate quantity.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 28 of its 87 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
28 of 87 references.
Closest ancestors · 1
Same direction, newest first
Other references · 27
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2021Measuring Coding Challenge Competence With APPScited by 879
- 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 220
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 200
- 2024MapCoder: Multi-Agent Code Generation for Competitive Problem Solvingcited by 177
- 2016DeepCoder: Learning to Write Programscited by 145
- 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
- 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 100
15 more
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
- 2025Trae Agent: An LLM-based Agent for Software Engineering with Test-time Scalingcited by 93
- 2025A Survey of WebAgents: Towards Next-Generation AI Agents for Web Automation with Large Foundation Modelscited by 87
- 2024RepoAgent: An LLM-Powered Open-Source Framework for Repository-level Code Documentation Generationcited by 69
- 2025rStar2-Agent: Agentic Reasoning Technical Reportcited by 54
- 2025LiveCodeBench Pro: How Do Olympiad Medalists Judge LLMs in Competitive Programming?cited by 52
- 2024MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoningcited by 34
- 2025CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debuggingcited by 31
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
- 2025HardTests: Synthesizing High-Quality Test Cases for LLM Codingcited by 22
- 2025ICPC-Eval: Probing the Frontiers of LLM Reasoning with Competitive Programming Contestscited by 12
- 2024SiriusBI: A Comprehensive LLM-Powered Solution for Data Analytics in Business Intelligencecited by 11
- 2026GrandCode: Achieving Grandmaster Level in Competitive Programming via Agentic Reinforcement Learningcited by 3
- 2025AlgoSimBench: Identifying Algorithmically Similar Problems for Competitive Programmingcited by 2
- 2026AlgBench: To What Extent Do Large Reasoning Models Understand Algorithms?cited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Scaling Agentic Verifier for Competitive Coding
- 2026RefineRL: Advancing Competitive Programming with Self-Refinement Reinforcement Learning
- 2025SwiftSolve: A Self-Iterative, Complexity-Aware Multi-Agent Framework for Competitive Programming
- 2025CodeContests+: High-Quality Test Case Generation for Competitive Programming
- 2026AgentHPOBench: A Benchmark For Evaluating LLM Agents as Sequential Hyperparameter Optimizers
- 2026Structured Feedback Improves Repair in an LLM Agent Loop
- 2026A2utoLPBench: An Auto-Generated, Agent-Friendly LP Benchmark via Inverse-KKT Construction
- 2026Belief-Calibrated Optimization: An Explicit World Model for Agentic Optimization