Learning of Robot Safety Policies via Adversarial Synthetic Scenarios
On the map: LLM agents and tool use → Agent threats, guardrails and governance
Abstract (arXiv)
In this work, we propose an agentic gamification framework for hazard-informed learning of robot safety policies through synthetic scenarios. We model scenario generation as an adversarial game between two agents: a Red Team that explores the space of potential failures by constructing hazardous situations, and a Blue Team that incrementally refines safety policies to prevent them. This iterative process enables efficient discovery of high-risk edge cases that are unlikely to be captured through random simulation or manual enumeration. By combining classical risk modeling with adversarial scenario generation and modern learning paradigms, this work provides a scalable pathway for embedding safety into Physical AI systems operating in complex real-world environments. The paper describes ongoing work. The contribution is a problem formulation and a proposed solution architecture.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 10 of its 13 references that are in the map. First posted on arXiv 4 Jun 2026.
Builds on
10 of 13 references.
Closest ancestors · 1
Same direction, newest first
Other references · 9
- 2024Keypoint Action Tokens Enable In-Context Imitation Learning in Roboticscited by 71
- 2024SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Modelscited by 21
- 2025MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videoscited by 17
- 2024SafeEmbodAI: a Safety Framework for Mobile Robots in Embodied AI Systemscited by 12
- 2025LongSafety: Evaluating Long-Context Safety of Large Language Modelscited by 11
- 2024InCoRo: In-Context Learning for Robotics Control with Feedback Loopscited by 9
- 2025Safe Learning for Contact-Rich Robot Tasks: A Survey from Classical Learning-Based Methods to Safe Foundation Modelscited by 6
- 2024RoboMorph: In-Context Meta-Learning for Robot Dynamics Modelingcited by 3
- 2025Safe In-Context Reinforcement Learningcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles
- 2025From Words to Collisions: LLM-Guided Evaluation and Adversarial Generation of Safety-Critical Driving Scenarios
- 2026Learning from Demonstration with Failure Awareness for Safe Robot Navigation
- 2026Yuvion LLM: An Adversarially-Aware Large Language Model for Content And AI Safety
- 2024Safeguarding AI Agents: Developing and Analyzing Safety Architectures
- 2026EMBGuard: Constructing Hazard-Aware Guardrails for Safe Planning in Embodied Agents
- 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrails
- 2025AdvEvo-MARL: Shaping Internalized Safety through Adversarial Co-Evolution in Multi-Agent Reinforcement Learning