mlsanityData to 7 Oct 2026

Software-Defined Agentic Serving

arXiv 2601.03197 ↗First posted 6 Jan 2026cs.DC cs.MAcited by 1

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

As multi-agent LLM pipelines grow in complexity, existing serving paradigms fail to adapt to the dynamic serving conditions. We argue that agentic serving systems should be programmable and system-aware, unlike existing serving which statically encode the parameters. In this work, we propose a new SDN-inspired agentic serving framework that helps control the key attributes of communication based on runtime state. This architecture enables serving-efficient, responsive agent systems and paves the way for high-level intent-driven agentic serving.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 17 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

13 of 17 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Autellix: An Efficient Serving Engine for LLM Agents as General Programs19 Feb
  2. 2024Executable Code Actions Elicit Better LLM Agents1 Feb

Other references · 11

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  4. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  6. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
  7. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  8. 2024AIOS: LLM Agent Operating Systemcited by 94
  9. 2024Large Language Model Enhanced Text-to-SQL Generation: A Surveycited by 24
  10. 2024TaskGen: A Task-Based, Memory-Infused Agentic Framework using StrictJSONcited by 5
  11. 2024SYMPHONY: Improving Memory Management for LLM Inference Workloadscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026Architectural Implications of Agentic AI Workflowscited by 2

Similar, not cited

Close in wording, no citation either way

  1. 2026A Policy-Driven Runtime Layer for Agentic LLM Serving
  2. 2025Agentic Services Computing
  3. 2026Pythia: Exploiting Workflow Predictability for Efficient Agent-Native LLM Serving
  4. 2026Efficient LLM Serving for Agentic Workflows: A Data Systems Perspective
  5. 2026VibeServe: Can AI Agents Build Bespoke LLM Serving Systems?
  6. 2026LLM-Enabled Multi-Agent Systems: Empirical Evaluation and Insights into Emerging Design Patterns & Paradigms
  7. 2025A Declarative Language for Building And Orchestrating LLM-Powered Agent Workflows
  8. 2025Survey of LLM Agent Communication with MCP: A Software Design Pattern Centric Review