Agent Delivery Engineering Predictive Reliability Framework
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Long-horizon LLM multi-agent systems face reliability risks invisible to infrastructure monitoring. We propose the ADE Predictive Reliability Framework (ADE-PRF), enabling proactive health trajectory prediction from passive degradation detection. ADE-PRF aggregates 20 heterogeneous signals across five layers into a Trust Margin (TM) metric (39.2-point dynamic range). Triple-method parallel prediction enables 8-hour forecasts: the Exponential method achieves MAE=1.228, Direction Accuracy=76.8%, with 99.65% within +/-10-point tolerance. Production validation spans 380,227 predictions and 280,579 validations across six agent profiles over 15 continuous days, plus seven sandbox-controlled experiments. Key findings include detection of "false prosperity" -- degradation concealed by normal surface metrics -- and immediate TM coupling with ground-truth states upon ADE plugin integration, with 16/20 factors relying on ADE-collected data. Exponential consistently outperforms Kalman. ADE-PRF provides among the earliest reliability quantification with forward-looking warnings for production LLM agents.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 32 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
11 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug
Other references · 9
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 950
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2026Channel Fracture: Three Instances of Cross-Boundary Silent Delivery Reliability Failures in Multi-Agent Systemscited by 1
- 2026Silent Failure in LLM Agent Systems: The Entropy Principle and the Inevitable Disorder of Autonomous Agentscited by 1
- 2026Intelligence Entropy Principle and the ADE Stability Engineering Frameworkcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PHMForge: Evaluating LLM Agents on Industrial Prognostics through MCP-Native, Algorithm-Grounded Tools
- 2026Beyond pass@1: A Reliability Science Framework for Long-Horizon LLM Agents
- 2026ATBench: A Diverse and Realistic Agent Trajectory Benchmark for Safety Evaluation and Diagnosis
- 2026ReliabilityBench: Evaluating LLM Agent Reliability Under Production-Like Stress Conditions
- 2026When Agents Fail to Act: A Diagnostic Framework for Tool Invocation Reliability in Multi-Agent LLM Systems
- 2026SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios
- 2026Adaptive Influence Graphs for Failure Attribution in Multi-Agent Systems
- 2026Physically-Constrained Mamba-SDE for Remaining Useful Life Prediction under Irregular Observations