mlsanityData to 14 Oct 2026

MADRA: Multi-Agent Debate for Risk-Aware Embodied Planning

arXiv 2511.21460 ↗First posted 26 Nov 2025cs.AIcited by 6

On the map: LLM agents and tool use → Agent threats, guardrails and governance

Abstract (arXiv)

Ensuring the safety of embodied AI agents during task planning is critical for real-world deployment, especially in household environments where dangerous instructions pose significant risks. Existing methods often suffer from either high computational costs due to preference alignment training or over-rejection when using single-agent safety prompts. To address these limitations, we propose MADRA, a training-free Multi-Agent Debate Risk Assessment framework that leverages collective reasoning to enhance safety awareness without sacrificing task performance. MADRA employs multiple LLM-based agents to debate the safety of a given instruction, guided by a critical evaluator that scores responses based on logical soundness, risk identification, evidence quality, and clarity. Through iterative deliberation and consensus voting, MADRA significantly reduces false rejections while maintaining high sensitivity to dangerous tasks. Additionally, we introduce a hierarchical cognitive collaborative planning framework that integrates safety, memory, planning, and self-evolution mechanisms to improve task success rates through continuous learning. We also contribute SafeAware-VH, a benchmark dataset for safety-aware task planning in VirtualHome, containing 800 annotated instructions. Extensive experiments on AI2-THOR and VirtualHome demonstrate that our approach achieves over 90% rejection of unsafe tasks while ensuring that safe-task rejection is low, outperforming existing methods in both safety and execution efficiency. Our work provides a scalable, model-agnostic solution for building trustworthy embodied agents.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 35 of its 61 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

35 of 61 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Tasks19 Jun
  2. 2025A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agents20 Apr
  3. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents17 Dec
  4. 2024R-Judge: Benchmarking Safety Risk Awareness for LLM Agents18 Jan

Other references · 31

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  6. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  7. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  8. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  9. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  10. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  11. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  12. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
19 more
  1. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  2. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  4. 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
  5. 2018VirtualHome: Simulating Household Activities via Programscited by 415
  6. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 179
  7. 2020Keep CALM and Explore: Language Models for Action Generation in Text-based Gamescited by 108
  8. 2023Mindstorms in Natural Language-Based Societies of Mindcited by 107
  9. 2020Thinking Fast and Slow in AIcited by 70
  10. 2025Do as We Do, Not as You Think: the Conformity of Large Language Modelscited by 53
  11. 2024LoTa-Bench: Benchmarking Language-oriented Task Planners for Embodied Agentscited by 51
  12. 2023Vision-Language Interpreter for Robot Task Planningcited by 30
  13. 2024PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chaincited by 29
  14. 2024EPO: Hierarchical LLM Agents with Environment Preference Optimizationcited by 28
  15. 2025World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planningcited by 26
  16. 2025Safety Aware Task Planning via Large Language Models in Roboticscited by 24
  17. 2025Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Surveycited by 13
  18. 2024Multi-Agent Planning Using Visual Language Modelscited by 7
  19. 2025Adaptive Domain Modeling with Language Models: A Multi-Agent Approach to Task Planningcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agents
  2. 2026PlanGuard: A Guardrail for Multi-Step Plan Safety in Embodied Agents
  3. 2026EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents
  4. 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions
  5. 2024EARBench: Towards Evaluating Physical Risk Awareness for Task Planning of Foundation Model-based Embodied AI Agents
  6. 2026LPS-Bench: Benchmarking Safety Awareness of Computer-Use Agents in Long-Horizon Planning under Benign and Adversarial Scenarios
  7. 2026SafetyALFRED: Evaluating Safety-Conscious Planning of Multimodal Large Language Models
  8. 2025RoboSafe: Safeguarding Embodied Agents via Executable Safety Logic