ContextEvolve: Multi-Agent Context Compression for Systems Code Optimization
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Large language models are transforming systems research by automating the discovery of performance-critical algorithms for computer systems. Despite plausible codes generated by LLMs, producing solutions that meet the stringent correctness and performance requirements of systems demands iterative optimization. Test-time reinforcement learning offers high search efficiency but requires parameter updates infeasible under API-only access, while existing training-free evolutionary methods suffer from inefficient context utilization and undirected search. We introduce ContextEvolve, a multi-agent framework that achieves RL-level search efficiency under strict parameter-blind constraints by decomposing optimization context into three orthogonal dimensions: a Summarizer Agent condenses semantic state via code-to-language abstraction, a Navigator Agent distills optimization direction from trajectory analysis, and a Sampler Agent curates experience distribution through prioritized exemplar retrieval. This orchestration forms a functional isomorphism with RL-mapping to state representation, policy gradient, and experience replay-enabling principled optimization in a textual latent space. On the ADRS benchmark, ContextEvolve outperforms state-of-the-art baselines by 33.3% while reducing token consumption by 29.0%. Codes for our work are released at https://anonymous.4open.science/r/ContextEvolve-ACC
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 44 references that are in the map. First posted on arXiv 1 Feb 2026.
Builds on
35 of 44 references.
Closest ancestors · 2
Same direction, newest first
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discovery16 Jun
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering6 May
Other references · 33
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2016Neural Architecture Search with Reinforcement Learningcited by 1,489
21 more
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2023Large Language Models as Optimizerscited by 830
- 2024A Survey on Large Language Models for Code Generationcited by 646
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 343
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2023Large Language Models as Evolutionary Optimizerscited by 122
- 2023Self-planning Code Generation with Large Language Modelscited by 121
- 2024LLMOPT: Learning to Define and Solve General Optimization Problems from Scratchcited by 102
- 2024Evolutionary Computation in the Era of Large Language Model: Survey and Roadmapcited by 89
- 2024Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encodingcited by 72
- 2025Barbarians at the Gate: How AI is Upending Systems Researchcited by 48
- 2025Supporting Our AI Overlords: Redesigning Data Systems to be Agent-Firstcited by 30
- 2025Prism: Cost-Efficient Multi-LLM Serving via GPU Memory Ballooningcited by 23
- 2025LoongFlow: Directed Evolutionary Search via a Cognitive Plan-Execute-Summarize Paradigmcited by 19
- 2025CodeGrad: Integrating Multi-Step Verification with Gradient-Based LLM Refinementcited by 7
- 2025vAttention: Verified Sparse Attentioncited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Skill Evolution: Self-Evolving Context Management Policies for Long-Horizon Agent Harnesses
- 2026Meta Context Engineering via Agentic Skill Evolution
- 2026Adapting Context Compression for Long-Horizon Agents with Counterfactual Continuations
- 2025ACON: Optimizing Context Compression for Long-horizon LLM Agents
- 2026FOCUS: Training-Free Decision-Preserving Context Compression for LLM Agents
- 2026ZipRL: Adaptive Multi-Turn Context Compression with Hindsight Response Replay
- 2026Scaling Agentic Verifier for Competitive Coding
- 2026Learning to Evolve: A Self-Improving Framework for Multi-Agent Systems via Textual Parameter Graph Optimization