JailWAM: Jailbreaking World Action Models in Robot Control
On the map: World models → World model security and GUI agents
Abstract (arXiv)
World Action Models (WAMs) have emerged as a promising paradigm for robotic manipulation, enabling physical interaction across diverse tasks and environments. However, their ability to directly follow high-level instructions and execute physical actions also creates potential safety risks, as adversarially designed instructions may induce unsafe robot behaviors. To systematically assess these risks, we propose JailWAM, the first jailbreak evaluation framework for WAMs. In JailWAM, we integrate three key innovations: Firstly, to address the difficulty of evaluating heterogeneous low-level action outputs, we introduce Visual-Trajectory Mapping, which transforms model-specific actions into unified visual trajectory representations, thereby facilitating consistent risk assessment across WAM architectures. Secondly, to provide efficient and fine-grained assessment of physical risks, we develop a Risk Discriminator supervised by three safety levels ordered according to physical consequence: Safety Compliance, Motion Failure, and Catastrophic Risk. This severity-aware formulation enables the risk discriminator to distinguish different physical outcomes from visual trajectories and support scalable risk screening. Thirdly, to reduce the cost of exhaustively executing adversarial candidates, we design a Dual-Path Verification Strategy that combines rapid risk screening with closed-loop physical simulation, restricting computationally expensive verification to candidates with potential safety risks. Extensive experiments in the RoboTwin simulation environment show that JailWAM achieves an 84.2% attack success rate on LingBot-VA, which indicates that WAMs may be susceptible to jailbreak attacks that induce unsafe physical behaviors. Our findings may motivate further research on the safety evaluation and alignment of future embodied robotic systems.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 25 of its 32 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
25 of 32 references.
References · 25
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2023FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Promptscited by 398
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Modelscited by 328
- 2026Causal World Modeling for Robot Controlcited by 321
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
13 more
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2025Motus: A Unified Latent Action World Modelcited by 251
- 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attackscited by 230
- 2024PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMscited by 190
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 109
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Roboticscited by 73
- 2024T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Modelscited by 66
- 2024ImgTrojan: Jailbreaking Vision-Language Models with ONE Imagecited by 57
- 2024BadRobot: Jailbreaking Embodied LLM Agents in the Physical Worldcited by 43
- 2025Jailbreaking on Text-to-Video Models via Scene Splitting Strategycited by 12
- 2025RunawayEvil: Jailbreaking the Image-to-Video Generative Modelscited by 8
- 2025AdvGrasp: Adversarial Attacks on Robotic Grasping from a Physical Perspectivecited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 14
- 2026BadWAM: When World-Action Models Dream Right but Act Wrongcited by 4
- 2026Attacking the Trusted Imagination: Oracle-Level Integrity Attacks on Imagine-then-Act World Modelscited by 3
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026TAPDreamer: Transferable Adversarial Patches for World Action Modelscited by 0
- 2026TAPDreamer: Transferable Adversarial Patches for World Action Models5 Oct 2026
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026BadWAM: When World-Action Models Dream Right but Act Wrong16 Jul 2026
- 2026Attacking the Trusted Imagination: Oracle-Level Integrity Attacks on Imagine-then-Act World Models22 Jun 2026
- 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond24 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026WorldOracle: Benchmarking Action-Conditioned World Models against Real-World Executions
- 2025Adversarial Attacks on Robotic Vision Language Action Models
- 2026ARB4WM: An Adversarial Robustness Benchmark for World Models in Continuous Control
- 2026Beyond Task Success: Behavioral and Representational Diagnostics for WAM and VLA
- 2025Preventing Robotic Jailbreaking via Multimodal Domain Adaptation
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models
- 2026Acting Through Registers
- 2026Targeting World Models to Compromise Robot Learning Pipelines