mlsanityData to 14 Oct 2026

Dream2Discern: Learning from Hard Latent Variants for Runtime Failure Prediction in Multi-Agent Systems

arXiv 2610.16071 ↗First posted 12 Oct 2026cs.LG cs.AI cs.CLcited by 0

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Reliable deployment of LLM-based multi-agent systems calls for runtime auditors that predict terminal outcomes from observed execution prefixes. These auditors typically learn from a limited corpus of trajectories with verified outcomes. Expanding this corpus requires costly execution and verification, yet broader failure coverage alone provides no explicit criterion for identifying prefixes that the current auditor finds difficult to classify. To this end, we propose Dream2Discern, a runtime auditor trained through implicit augmentation guided by its own prediction loss. During Dream, we select perturbations of the auditor's representation operators to increase prediction loss on recorded prefixes, yielding hard latent variants. During Discern, the auditor learns to predict execution outcomes from these variants using the original labels. The variants are regenerated as the auditor learns, turning a limited corpus into a renewable source of hard examples and requiring no additional trajectory collection or outcome verification. Extensive evaluations on AFTraj-2K and StepShield show that Dream2Discern outperforms competitive failure auditors and achieves over 90% trajectory-level weighted accuracy on both benchmarks while balancing prediction accuracy and timeliness. Project page: https://zbox1005.github.io/dream2discern-project/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 41 of its 45 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

41 of 45 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Tracing Agentic Failure from the Flow of Success14 Jul
  2. 2026When Evidence is Sparse: Weakly Supervised Early Failure Alerting in Dialogs and LLM-Agent Trajectories3 Jun
  3. 2026CausalFlow: Causal Attribution and Counterfactual Repair for LLM Agent Failures25 May
  4. 2026AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems9 May
  5. 2026The Why Behind the Action: Unveiling Internal Drivers via Agentic Attribution21 Jan
  6. 2025Where LLM Agents Fail and How They can Learn From Failures29 Sep
  7. 2025Aegis: Automated Error Generation and Attribution for Multi-Agent Systems17 Sep
  8. 2025AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?3 Sep
  9. 2025Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems30 Apr
  10. 2025Why Do Multi-Agent LLM Systems Fail?17 Mar
  11. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation16 Aug

Other references · 30

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  6. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  8. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  9. 2023Identifying the Risks of LM Agents with an LM-Emulated Sandboxcited by 548
  10. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreakercited by 367
  11. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
  12. 2022Out-of-Distribution Detection and Selective Generation for Conditional Language Modelscited by 197
18 more
  1. 2024AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorialscited by 130
  2. 2024Language Agents as Optimizable Graphscited by 89
  3. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Modelscited by 80
  4. 2026AgentDoG: A Diagnostic Guardrail Framework for AI Agent Safety and Securitycited by 50
  5. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 46
  6. 2023Out-of-distribution Detection with Implicit Outlier Transformationcited by 43
  7. 2025Failure Prediction at Runtime for Generative Robot Policiescited by 42
  8. 2025CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thoughtcited by 23
  9. 2026Uncertainty Quantification in LLM Agents: Foundations, Emerging Challenges, and Opportunitiescited by 20
  10. 2026Your Agents Are Aging Too: Agent Lifespan Engineering for Deployed Systemscited by 9
  11. 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoringcited by 9
  12. 2026TRACES: Proactive Safety Auditing for Multi-Turn LLM Agents via Trajectory-State Modelingcited by 8
  13. 2023Max-Rank: Efficient Multiple Testing for Conformal Predictioncited by 7
  14. 2025Dive into the Agent Matrix: A Realistic Evaluation of Self-Replication Risk in LLM Agentscited by 7
  15. 2026StepShield: When, Not Whether to Intervene on Rogue Agentscited by 7
  16. 2026StepGuard: Learning Step-Level Guardrails with Scalable Supervision and Safety-Utility Balancingcited by 6
  17. 2026Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memorycited by 4
  18. 2026AgentHijack: Benchmarking Computer Use Agent Robustness to Common Environment Corruptionscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026StepFinder: A Temporal Semantic Framework for Failure Attribution in Multi-Agent Systems
  2. 2026Automata from Agent Traces: Failure and Next-Step Prediction
  3. 2026VerifyMAS: Hypothesis Verification for Failure Attribution in LLM Multi-Agent Systems
  4. 2025CORRECT: COndensed eRror RECognition via knowledge Transfer in multi-agent systems
  5. 2026Learning from Failure: Inference-Time Self-Improvement for Computer-Use Agents
  6. 2026Disentangling Task Difficulty from Run-Level Failure in Agent Failure Prediction
  7. 2026PrefixGuard: From LLM-Agent Traces to Online Failure-Warning Monitors
  8. 2026Detect Before You Attribute: Cascade Failure Attribution for Multi-Agent Systems