Cloud Infrastructure Management in the Age of AI Agents
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Cloud infrastructure is the cornerstone of the modern IT industry. However, managing this infrastructure effectively requires considerable manual effort from the DevOps engineering team. We make a case for developing AI agents powered by large language models (LLMs) to automate cloud infrastructure management tasks. In a preliminary study, we investigate the potential for AI agents to use different cloud/user interfaces such as software development kits (SDK), command line interfaces (CLI), Infrastructure-as-Code (IaC) platforms, and web portals. We report takeaways on their effectiveness on different management tasks, and identify research challenges and potential solutions.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 12 of its 33 references that are in the map. First posted on arXiv 13 Jun 2025.
Builds on
12 of 33 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2024AutoCodeRover: Autonomous Program Improvementcited by 278
- 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agentscited by 115
- 2023Automatic Root Cause Analysis via Large Language Models for Cloud Incidentscited by 84
- 2024Multi-Programming Language Ensemble for Code Generation in Large Language Modelcited by 3
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025A Survey on Agentic Security: Applications, Threats and Defensescited by 20
- 2025Automated Cloud Infrastructure-as-Code Reconciliation with AI Agentscited by 5
- 2025AOI: Context-Aware Multi-Agent Operations via Dynamic Scheduling and Hierarchical Memory Compressioncited by 2
- 2025IaC Generation with LLMs: An Error Taxonomy and A Study on Configuration Knowledge Injectioncited by 2
- 2026RIVA: Leveraging LLM Agents for Reliable Configuration Drift Detectioncited by 2
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Webcited by 2
- 2026Interactive Clarification for Cloud Infrastructure-as-Code Synthesiscited by 0
- 2026Automated Synthesis of Cloud Emulatorscited by 0
- 2026Towards Agentic Cloud Engineering: Graph and Loop Engineering with a Zero-Trust Agent Harnesscited by 0
- 2026Towards Agentic Cloud Engineering: Graph and Loop Engineering with a Zero-Trust Agent Harness30 Aug 2026
- 2026Automated Synthesis of Cloud Emulators24 Aug 2026
- 2026Interactive Clarification for Cloud Infrastructure-as-Code Synthesis1 Apr 2026
- 2026Synergy: A Next-Generation General-Purpose Agent for Open Agentic Web30 Mar 2026
- 2026RIVA: Leveraging LLM Agents for Reliable Configuration Drift Detection2 Mar 2026
- 2025IaC Generation with LLMs: An Error Taxonomy and A Study on Configuration Knowledge Injection16 Dec 2025
- 2025AOI: Context-Aware Multi-Agent Operations via Dynamic Scheduling and Hierarchical Memory Compression15 Dec 2025
- 2025Automated Cloud Infrastructure-as-Code Reconciliation with AI Agents23 Oct 2025
- 2025A Survey on Agentic Security: Applications, Threats and Defenses7 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds
- 2026Why Do AI Agents Systematically Fail at Cloud Root Cause Analysis?
- 2025Governed By Agents: A Survey On The Role Of Agentic AI In Future Computing Environments
- 2026Infrastructure for the Agentic Web: Gap Analysis and Architecture from the Agentverse Platform
- 2025Engineering LLM Powered Multi-agent Framework for Autonomous CloudOps
- 2026SWE-InfraBench: Evaluating Language Models on Cloud Infrastructure Code ↗
- 2026AgentWare: Automating the Lifecycle of Agentic Applications across the Edge-to-Cloud Continuum
- 2026Towards a Systems Foundation for Agentic Cloud Management