mlsanityData to 14 Oct 2026

Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation

arXiv 2607.28226 ↗First posted 30 Jul 2026cs.CR cs.AIcited by 2

On the map: World models → World model security and GUI agents

also in 1 more
Abstract (arXiv)

World models give embodied AI a predictive core: they compress observations into states, simulate action-conditioned futures, and enable planning beyond reactive control. This predictive layer, however, opens a new security boundary-compromise can propagate from data, sensors, prompts, or feedback into physical action. Rather than treating world models as an isolated component, this survey traces threats across their entire lifecycle-from data construction and representation learning, through state grounding and imagination, to trajectory evaluation, execution, and long-term adaptation via memory and tools. We show that familiar attack families: poisoning, backdoors, adversarial examples, sensor spoofing, prompt injection, trajectory manipulation, and supply-chain attacks take on distinct meanings when they corrupt world states, learned dynamics, affordance estimates, or safety costs. We also highlight a duality: world models can serve as runtime safety shields, yet when compromised or over-trusted they generate predictive safety illusions. The survey offers a lifecycle taxonomy, maps existing attacks to world-model security properties, outlines evaluation protocols for safety failures, and structures defenses across provenance, robust grounding, uncertainty-aware prediction, trajectory gating, feedback auditing, and deployment assurance.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 65 of its 188 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

65 of 188 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026BadWAM: When World-Action Models Dream Right but Act Wrong16 Jul
  2. 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May
  3. 2026Safety, Security, and Cognitive Risks in World Models1 Apr
  4. 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb

Other references · 61

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2016Adversarial examples in the physical worldcited by 1,769
  7. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  8. 2018World Modelscited by 1,513
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  10. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  11. 2023Mastering Diverse Domains through World Modelscited by 1,253
  12. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
38 more
  1. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  2. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  3. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  4. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  5. 2024Genie: Generative Interactive Environmentscited by 747
  6. 2017Adversarial Patchcited by 517
  7. 2026World Action Models are Zero-shot Policiescited by 465
  8. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  9. 2026Causal World Modeling for Robot Controlcited by 321
  10. 2017Adversarial Attacks on Neural Network Policiescited by 320
  11. 2019Label-Consistent Backdoor Attackscited by 296
  12. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  13. 2018Stronger Data Poisoning Attacks Break Data Sanitization Defensescited by 135
  14. 2019Benchmarking Batch Deep Reinforcement Learning Algorithmscited by 111
  15. 2023Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Modelscited by 75
  16. 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
  17. 2026HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worldscited by 44
  18. 2025AGENTSAFE: Benchmarking the Safety of Embodied Agents on Hazardous Instructionscited by 38
  19. 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 34
  20. 2024Physical Backdoor Attack can Jeopardize Driving with Vision-Large-Language Modelscited by 33
  21. 2025Adversarial Attacks on Robotic Vision Language Action Modelscited by 32
  22. 2025A Framework for Benchmarking and Aligning Task-Planning Safety in LLM-Based Embodied Agentscited by 30
  23. 2024Can We Trust Embodied Agents? Exploring Backdoor Attacks against Embodied LLM-based Decision-Making Systemscited by 27
  24. 2026WebWorld: A Large-Scale World Model for Web Agent Trainingcited by 26
  25. 2024UrbanWorld: An Urban World Model for 3D City Generationcited by 24
  26. 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variationscited by 24
  27. 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Modelscited by 22
  28. 2025FreezeVLA: Action-Freezing Attacks against Vision-Language-Action Modelscited by 21
  29. 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objectscited by 17
  30. 2024Robot Collapse: Supply Chain Backdoor Attacks Against VLM-based Robotic Manipulationcited by 15
  31. 2024Easier Said Than Done: Unpacking Intent-Behavior Gap in Jailbreaking LLM-Based Robotscited by 15
  32. 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Modelscited by 12
  33. 2025CHAI: Command Hijacking against embodied AIcited by 11
  34. 2025Attention-Guided Patch-Wise Sparse Adversarial Attacks on Vision-Language-Action Modelscited by 11
  35. 2025Safety of Embodied Navigation: A Surveycited by 10
  36. 2025BadVideo: Stealthy Backdoor Attack against Text-to-Video Generationcited by 9
  37. 2025VLM-SAFE: Vision-Language Model-Guided Safety-Aware Reinforcement Learning with World Models for Autonomous Drivingcited by 9
  38. 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Spacecited by 9

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions
  2. 2026Rethinking World Models for Safety-Critical Embodied Systems
  3. 2026Safety in Embodied AI: A Survey of Risks, Attacks, and Defenses
  4. 2026Physically Viable World Models: A Case for Query-Conditioned Embodied AI
  5. 2026When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control
  6. 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems
  7. 2026False Prophets: On the Security of World Models in Agentic Systems
  8. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence