Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
On the map: World models → World model security and GUI agents
also in 1 more
Abstract (arXiv)
World models give embodied AI a predictive core: they compress observations into states, simulate action-conditioned futures, and enable planning beyond reactive control. This predictive layer, however, opens a new security boundary-compromise can propagate from data, sensors, prompts, or feedback into physical action. Rather than treating world models as an isolated component, this survey traces threats across their entire lifecycle-from data construction and representation learning, through state grounding and imagination, to trajectory evaluation, execution, and long-term adaptation via memory and tools. We show that familiar attack families: poisoning, backdoors, adversarial examples, sensor spoofing, prompt injection, trajectory manipulation, and supply-chain attacks take on distinct meanings when they corrupt world states, learned dynamics, affordance estimates, or safety costs. We also highlight a duality: world models can serve as runtime safety shields, yet when compromised or over-trusted they generate predictive safety illusions. The survey offers a lifecycle taxonomy, maps existing attacks to world-model security properties, outlines evaluation protocols for safety failures, and structures defenses across provenance, robust grounding, uncertainty-aware prediction, trajectory gating, feedback auditing, and deployment assurance.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 65 of its 188 references that are in the map. First posted on arXiv 30 Jul 2026.
Builds on
65 of 188 references.
Closest ancestors · 4
Same direction, newest first
- 2026BadWAM: When World-Action Models Dream Right but Act Wrong16 Jul
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May
- 2026Safety, Security, and Cognitive Risks in World Models1 Apr
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb
Other references · 61
- 2023Visual Instruction Tuningcited by 7,869
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2016Adversarial examples in the physical worldcited by 1,769
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2018World Modelscited by 1,513
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
38 more
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2024Genie: Generative Interactive Environmentscited by 747
- 2017Adversarial Patchcited by 517
- 2026World Action Models are Zero-shot Policiescited by 465
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2026Causal World Modeling for Robot Controlcited by 321
- 2017Adversarial Attacks on Neural Network Policiescited by 320
- 2019Label-Consistent Backdoor Attackscited by 296
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2018Stronger Data Poisoning Attacks Break Data Sanitization Defensescited by 135
- 2019Benchmarking Batch Deep Reinforcement Learning Algorithmscited by 111
- 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 75
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
- 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
- 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 38
- 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 34
- 2024Physical Backdoor Attack can Jeopardize Driving with Vision-Large-Language Modelscited by 33
- 2025Adversarial Attacks on Robotic Vision Language Action Modelscited by 32
- 2025A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agentscited by 30
- 2024Can We Trust Embodied Agents? Exploring Backdoor Attacks against Embodied LLM-based Decision-Making Systemscited by 27
- 2026WebWorld: A Large-Scale World Model for Web Agent Trainingcited by 26
- 2024UrbanWorld: An Urban World Model for 3D City Generationcited by 24
- 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variationscited by 24
- 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Modelscited by 22
- 2025FreezeVLA: Action-Freezing Attacks against Vision-Language-Action Modelscited by 21
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objectscited by 17
- 2024Robot Collapse: Supply Chain Backdoor Attacks Against VLM-based Robotic Manipulationcited by 15
- 2024Easier Said Than Done: Unpacking Intent-Behavior Gap in Jailbreaking LLM-Based Robotscited by 15
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Modelscited by 12
- 2025CHAI: Command Hijacking against embodied AIcited by 11
- 2025Attention-Guided Patch-Wise Sparse Adversarial Attacks on Vision-Language-Action Modelscited by 11
- 2025Safety of Embodied Navigation: A Surveycited by 10
- 2025BadVideo: Stealthy Backdoor Attack against Text-to-Video Generationcited by 9
- 2025VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Drivingcited by 9
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Spacecited by 9
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions
- 2026Rethinking World Models for Safety-Critical Embodied Systems
- 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses
- 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI
- 2026When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems
- 2026False Prophets: On the Security of World Models in Agentic Systems
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence