mlsanityData to 14 Oct 2026

SagaLLM: Context Management, Validation, and Transaction Guarantees for Multi-Agent LLM Planning

arXiv 2503.11951 ↗First posted 15 Mar 2025cs.AIcited by 60

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

This paper introduces SagaLLM, a structured multi-agent architecture designed to address four foundational limitations of current LLM-based planning systems: unreliable self-validation, context loss, lack of transactional safeguards, and insufficient inter-agent coordination. While recent frameworks leverage LLMs for task decomposition and multi-agent communication, they often fail to ensure consistency, rollback, or constraint satisfaction across distributed workflows. SagaLLM bridges this gap by integrating the Saga transactional pattern with persistent memory, automated compensation, and independent validation agents. It leverages LLMs' generative reasoning to automate key tasks traditionally requiring hand-coded coordination logic, including state tracking, dependency analysis, log schema generation, and recovery orchestration. Although SagaLLM relaxes strict ACID guarantees, it ensures workflow-wide consistency and recovery through modular checkpointing and compensable execution. Empirical evaluations across planning domains demonstrate that standalone LLMs frequently violate interdependent constraints or fail to recover from disruptions. In contrast, SagaLLM achieves significant improvements in consistency, validation accuracy, and adaptive coordination under uncertainty, establishing a robust foundation for real-world, scalable LLM-based multi-agent systems.

Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 24 of its 63 references that are in the map. First posted on arXiv 15 Mar 2025.

Builds on

24 of 63 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Automated Design of Agentic Systems15 Aug
  2. 2024AgentScope: A Flexible yet Robust Multi-Agent Platform21 Feb
  3. 2024Understanding the planning of LLM agents: A survey5 Feb
  4. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  6. 2023A Survey of Large Language Modelscited by 2,576
  7. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  9. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  10. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  11. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  12. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
8 more
  1. 2022Text and Patterns: For Effective Chain of Thought, It Takes Two to Tangocited by 128
  2. 2025NoLiMa: Long-Context Evaluation Beyond Literal Matchingcited by 126
  3. 2024Chain of Thoughtlessness? An Analysis of CoT in Planningcited by 103
  4. 2024Found in the Middle: Calibrating Positional Attention Bias Improves Long Context Utilizationcited by 101
  5. 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 83
  6. 2024Large Language Models have Intrinsic Self-Correction Abilitycited by 46
  7. 2023Prompting Large Language Models With the Socratic Methodcited by 43
  8. 2024Failure Modes of LLMs for Causal Reasoning on Narrativescited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 11; 2026: 49.

60 papers.

Sort:

By area:

  1. 2025A Survey of Context Engineering for Large Language Modelscited by 126
  2. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agentscited by 37
  3. 2026Atomix: Timely, Transactional Tool Use for Reliable Agentic Workflowscited by 30
  4. 2025Get Experience from Practice: LLM Agents with Record & Replaycited by 23
  5. 2026From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaborationcited by 14
  6. 2026The Evolution of Tool Use in LLM Agents: From Single-Tool Call to Multi-Tool Orchestrationcited by 14
  7. 2025Agent-SAMA: State-Aware Mobile Assistantcited by 12
  8. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Frameworkcited by 12
  9. 2026DART: Semantic Recoverability for Structured Tool Agentscited by 10
  10. 2026Agent libOS: A Runtime Substrate for Capability-Controlled Self-Evolving LLM Agentscited by 10
  11. 2026Recursive Experiential-Working Memory Evolution for Long-Horizon Agent Harnessescited by 9
  12. 2025ContextPilot: Fast Long-Context Inference via Context Reusecited by 8
38 more
  1. 2026Agent Memory Below the Prompt: Persistent Q4 KV Cache for Multi-Agent LLM Inference on Edge Devicescited by 8
  2. 2026Verified Detection and Prevention of Concurrency Anomalies in Multi-Agent Large Language Model Systemscited by 8
  3. 2026Mnemosyne: Agentic Transaction Processing for Validating and Repairing AI-generated Workflowscited by 8
  4. 2025Procedural Knowledge Improves Agentic LLM Workflowscited by 7
  5. 2026PerspectiveGap: A Benchmark for Multi-Agent Orchestration Promptingcited by 6
  6. 2026ClawVM: Harness-Managed Virtual Memory for Stateful Tool-Using LLM Agentscited by 4
  7. 2026Trivium: Temporal Regret as a First-Class Objective for Causal-Memory Controllerscited by 4
  8. 2026CoAgent: Concurrency Control for Multi-Agent Systemscited by 4
  9. 2025ALAS: Transactional and Dynamic Multi-Agent LLM Planningcited by 3
  10. 2026Experience as a Compass: Multi-agent RAG with Evolving Orchestration and Agent Promptscited by 3
  11. 2026Can Agents Secure Hardware? Evaluating Agentic LLM-Driven Obfuscation for IP Protectioncited by 3
  12. 2026Robust Agent Compensation (RAC): Teaching AI Agents to Compensatecited by 3
  13. 2026PatchBoard: Schema-Grounded State Mutation for Reliable and Auditable LLM Multi-Agent Collaborationcited by 3
  14. 2026Multi-Segment Attention: Enabling Efficient KV-Cache Management for Faster Large Language Model Servingcited by 3
  15. 2026Stop Means Stop: Measuring and Repairing the Enforcement Gap in Agent-Framework Control Primitivescited by 3
  16. 2026Resume Means Resume: A Machine-Checked Conformance Contract for Checkpoint, Interrupt, and Resume Semantics in Workflow Persistence Layerscited by 3
  17. 2026Where Does Exactly-Once Live? Model, Harness, and Tool-Contract Effects on Duplicate Side Effects in LLM Agentscited by 3
  18. 2025Orchestrator: Active Inference for Multi-Agent Systems in Long-Horizon Taskscited by 2
  19. 2026Enhancing Model Context Protocol (MCP) with Context-Aware Server Collaborationcited by 2
  20. 2026Epistemic Regret Minimization: Label-Free Causal Critique Beyond Outcome Rewardcited by 2
  21. 2026Outcome Monitors: Recovery Affordances for Silent Tool Failurescited by 2
  22. 2026When AI Agents Commit: Cognitive Serializability Across Data, Evidence, Policy, and Authoritycited by 2
  23. 2025Context-Adaptive Synthesis and Compression for Enhanced Retrieval-Augmented Generation in Complex Domainscited by 1
  24. 2025AGI Requires a Coordination Layer on Top of Pattern Repositoriescited by 1
  25. 2025NormCode: A Semi-Formal Language for Auditable AI Planningcited by 1
  26. 2025AnalogSAGE: Self-evolving Analog Design Multi-Agents with Stratified Memory and Grounded Experiencecited by 1
  27. 2026TheBotCompany: Self-Organizing Multi-agent Systems for Continuous Software Developmentcited by 1
  28. 2026Towards an Agent Operating System - Lessons from Classical and Cloud OScited by 1
  29. 2026Position: Multi-Agent Systems Should Prioritize Concurrency Controlcited by 1
  30. 2026UndoBench: Separating Task Competence from Recovery Capability in Tool-Using AI Agentscited by 1
  31. 2026Autonomous Data Processing using Meta-Agentscited by 0
  32. 2026OrchMAS: Orchestrated Reasoning with Multi Collaborative Heterogeneous Scientific Expert Structured Agentscited by 0
  33. 2026Exploring Collatz Dynamics with Human-LLM Collaborationcited by 0
  34. 2026SPIN: Structural LLM Planning via Iterative Navigation for Industrial Taskscited by 0
  35. 2026A Methodology for Selecting and Composing Runtime Architecture Patterns for Production LLM Agentscited by 0
  36. 2026REPOT: Recoverable Program-of-Thought via Checkpoint Repaircited by 0
  37. 2026Engineering Trustworthy Agentic AI for Critical Systemscited by 0
  38. 2026MADE: Belief-Driven Dual-Agent Coordination for Autonomous Model Deploymentcited by 0

50 most cited of 60 All 60 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025ALAS: A Stateful Multi-LLM Agent Framework for Disruption-Aware Planning
  2. 2026SyncPlan: Long-Horizon LLM Coordination with Explicit Synchronization and Adaptive Correction
  3. 2026Architectural Design, Not Only Model Intelligence, Governs Multi-Agent LLM Performance
  4. 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agents
  5. 2024Testing and Understanding Erroneous Planning in LLM Agents through Synthesized User Inputs
  6. 2026TeamTR: Trust-Region Fine-Tuning for Multi-Agent LLM Coordination
  7. 2025CodeCRDT: Observation-Driven Coordination for Multi-Agent LLM Code Generation
  8. 2026From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution