mlsanityData to 14 Oct 2026

GuardianBench: A Same-Scene Instruction-Contrastive Benchmark for Latent Contextual Risk in Embodied AI

arXiv 2608.21928 ↗First posted 22 Aug 2026cs.AI cs.CL cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

In embodied AI, safety risk can be latent: a benign instruction and a safe scene become hazardous only when composed. Prior work has advanced embodied safety by varying visual contexts or evaluating execution-time dynamics, but the complementary axis of fixing the scene and varying only the instruction remains underexplored. We introduce GuardianBench, an instruction-contrastive benchmark grounded in international safety standards that isolates this latent contextual risk through 3,024 instruction-scene examples organized as same-scene Safe/Unsafe contrastive pairs across various hazard categories. Benchmarking state-of-the-art vision-language models (VLMs) reveals instruction-insensitive verdicts: models disproportionately approve both instructions under a given scene; across the primary models, average pair accuracy is only 24.1%. Our systematic rationale audit localizes the dominant failure: models fail to bind the instruction-relevant cues that differentiate safe from unsafe compositions. As a post-training case study, Verdict Log-Odds Supervision (VLOS), a lightweight verdict-level objective, substantially improves performance on open-weight backbones. Together, our latent contextual risk task formulation, standards-grounded contrastive benchmark construction, pair-level and rationale-level failure diagnosis, and benchmark-enabled verdict calibration establish GuardianBench as a controlled evaluation suite for exposing and improving safety reasoning over instruction-scene compositions under latent contextual risk.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

23 of 39 references.

References · 23

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  6. 2016Concrete Problems in AI Safetycited by 1,642
  7. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  8. 2017Constrained Policy Optimizationcited by 983
  9. 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 287
  10. 2018Safe Exploration in Continuous Action Spacescited by 247
  11. 2023Safety-Gymnasium: A Unified Safe Reinforcement Learning Benchmarkcited by 143
  12. 2024SafeAgentBench: A Benchmark for Safe Task Planning of Embodied LLM Agentscited by 116
11 more
  1. 2025The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independencecited by 115
  2. 2024Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perceptioncited by 56
  3. 2025IS-Bench: Evaluating Interactive Safety of VLM-Driven Embodied Agents in Daily Household Taskscited by 41
  4. 2025A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agentscited by 30
  5. 2024EARBench: Towards Evaluating Physical Risk Awareness for Task Planning of Foundation Model-based Embodied AI Agentscited by 27
  6. 2024Bias Unveiled: Investigating Social Bias in LLM-Generated Codecited by 25
  7. 2025Subtle Risks, Critical Failures: A Framework for Diagnosing Physical Safety of LLMs for Embodied Decision Makingcited by 20
  8. 2024Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomaliescited by 19
  9. 2025SafeMind: Benchmarking and Mitigating Safety Risks in Embodied LLM Agentscited by 17
  10. 2025Exploring the Impact of Personality Traits on LLM Bias and Toxicitycited by 14
  11. 2025VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safetycited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructions
  2. 2026SafeRelBench: A Spatial-Relation-Aware Benchmark for Process-Level Safety in VLM-Driven Embodied Agents
  3. 2026HazardArena: Evaluating Semantic Safety in Vision-Language-Action Models
  4. 2026SafeBranch: Branch-Pair Safety Alignment for Embodied Agents
  5. 2026HomeGuard: VLM-based Embodied Safeguard for Identifying Contextual Risk in Household Task
  6. 2025ANNIE: Be Careful of Your Robots
  7. 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses
  8. 2026ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models