AOI: Context-Aware Multi-Agent Operations via Dynamic Scheduling and Hierarchical Memory Compression
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Cloud-native systems have made operational work both more powerful and harder to automate: incidents unfold across microservices, logs and metrics arrive faster than operators can inspect them, and recovery actions must be coordinated without losing the causal context that makes them safe. We present AOI (AI-Oriented Operations), a context-aware multi-agent framework for autonomous IT operations. AOI separates operational responsibility across an Observer, a read-only Probe, and a guarded Executor, and connects them through dynamic scheduling and a hierarchical memory system with LLM-based context compression. This design turns long-running incident response into an iterative loop of observation, evidence gathering, safe intervention, and memory update. Across AIOpsLab simulations and real-world Loghub-derived scenarios, AOI improves task success to 94.2%, reduces mean time to resolution by 34.4% relative to the strongest baseline, and compresses operational context by 72.4% while preserving 92.8% of diagnostic information. Ablations show that these gains come from the combination of agent specialization, adaptive scheduling, and memory-aware compression rather than from any single module alone. The results suggest that autonomous operations systems can move beyond alert classification toward reliable, context-preserving recovery in complex infrastructure.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 63 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
23 of 63 references.
Closest ancestors · 2
Same direction, newest first
- 2025Cloud Infrastructure Management in the Age of AI Agents13 Jun
- 2025AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds12 Jan
Other references · 21
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,373
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2020Reformer: The Efficient Transformercited by 1,668
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2023A Categorical Archive of ChatGPT Failurescited by 168
9 more
- 2020Loghub: A Large Collection of System Log Datasets for AI-driven Log Analyticscited by 70
- 2020A Survey on Automated Log Analysis for Reliability Engineeringcited by 50
- 2024Securing Large Language Models: Addressing Bias, Misinformation, and Prompt Attackscited by 26
- 2016Microservices: yesterday, today, and tomorrowcited by 22
- 2024Retrieval-style In-Context Learning for Few-shot Hierarchical Text Classificationcited by 16
- 2019A Survey of DevOps Concepts and Challengescited by 12
- 2018Where Are The Gaps? A Systematic Mapping Study of Infrastructure as Code Researchcited by 9
- 2023On Implementing Autonomous Supply Chains: a Multi-Agent System Approachcited by 8
- 2019Continuous Architecting with Microservices and DevOps: A Systematic Mapping Studycited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Autonomous Incident Resolution at Hyperscale: An Agentic AI Architecture for Network Operations
- 2026Agent Operating Systems (AOS): Integrating Agentic Control Planes into, and Beyond, Traditional Operating Systems
- 2026AOI: Turning Failed Trajectories into Training Signals for Autonomous Cloud Diagnosis
- 2026Autonomous Event-Driven Multi-Agent Orchestration for Enterprise AI at Scale
- 2026[AAFLOW+] Stateful Operator Abstraction with Zero-Copy Distributed KV Cache Orchestration for Multi-Agent Workflows
- 2026Rethinking AI Cloud Infrastructure for Agentic Serving Systems with the Aries Experimentation Framework
- 2026AgentCgroup: Understanding and Controlling OS Resources of AI Agents
- 2026Codified Context: Infrastructure for AI Agents in a Complex Codebase