mlsanityData to 14 Oct 2026

EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents

arXiv 2605.30924 ↗First posted 29 May 2026cs.CLcited by 3

On the map: LLM agents and tool use → Agent threats, guardrails and governance

also in 1 more
Abstract (arXiv)

MLLM-powered embodied agents deployed in real-world environments encounter physical hazards. However, existing approaches lack explicit mechanisms for identifying hazards and reasoning about action-conditioned risks, leading agents to either miss risky interactions or over-identify risks. To address this, we propose EMBGuard, the first MLLM-based safety guardrail for embodied agents designed to decouple physical risk reasoning from agent policy. By evaluating a (visual observation, action) pair, EMBGuard identifies hazardous configurations and provides natural language explanations of potential risks. Alongside EMBGuard, we contribute EMBHazard, a training dataset of 15.1K action-conditioned pairs, and EMBGuardTest, a benchmark of 329 manually curated real-world scenarios spanning seven physical risk categories. Through compositional variation of hazards and actions, we generate diverse risky and benign scenarios that agents may encounter during planning. Despite its compact size (2B, 4B), EMBGuard achieves performance competitive with proprietary MLLMs (e.g., GPT-5.1, Gemini-2.5-Pro) while significantly reducing the false-positive rates that hinder real-time deployment. We make the code, data, and models publicly available at https://github.com/dongwxxkchoi/EMBGuard

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 32 of its 37 references that are in the map. First posted on arXiv 29 May 2026.

Builds on

32 of 37 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025PSG-Agent: Personality-Aware Safety Guardrail for LLM-based Agents28 Sep
  2. 2025IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Tasks19 Jun
  3. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoning26 Mar
  4. 2025AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection17 Feb
  5. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agents17 Dec

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  8. 2025Gemma 3 Technical Reportcited by 1,824
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  10. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  11. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
15 more
  1. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  2. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
  3. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  4. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
  5. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
  6. 2024LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Modelscited by 52
  7. 2025An Approach to Technical AGI Safety and Securitycited by 45
  8. 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 38
  9. 2025Generating Robot Constitutions & Benchmarks for Semantic Safetycited by 33
  10. 2025Safety Aware Task Planning via Large Language Models in Roboticscited by 24
  11. 2025Subtle Risks, Critical Failures: A Framework for Diagnosing Physical Safety of LLMs for Embodied Decision Makingcited by 20
  12. 2025Embodied Agents Meet Personalization: Investigating Challenges and Solutions Through the Lens of Memory Utilizationcited by 19
  13. 2025Can AI Perceive Physical Danger and Intervene?cited by 14
  14. 2024Defining and Evaluating Physical Safety for Large Language Modelscited by 9
  15. 2024Safe Planner: Empowering Safety Awareness in Large Pre-Trained Models for Robot Task Planningcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agents
  2. 2025RoboSafe: Safeguarding Embodied Agents via Executable Safety Logic
  3. 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions
  4. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Data
  5. 2026HomeGuard: VLM-based Embodied Safeguard for Identifying Contextual Risk in Household Task
  6. 2026ICAT: Incident-Case-Grounded Adaptive Testing for Physical-Risk Prediction in Embodied World Models
  7. 2025MADRA: Multi-Agent Debate for Risk-Aware Embodied Planning
  8. 2026DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model