mlsanityData to 7 Oct 2026

BadWAM: When World-Action Models Dream Right but Act Wrong

arXiv 2607.15207 ↗First posted 16 Jul 2026cs.LG cs.ROcited by 2

On the map: World models → World model security and GUI agents

Abstract (arXiv)

World-action models (WAMs) are emerging as a promising foundation for embodied control: rather than predicting actions alone, they learn representations that couple action generation with future world prediction. This coupling is often viewed as a source of robustness, interpretability, and safety, as a robot's action can in principle be checked against its imagined future. In this paper, we show that this assumption is fragile. We introduce BadWAM, a unified framework for modeling and evaluating World-Action Drift Attacks: a new class of WAM-specific adversarial attacks that use small visual perturbations to break the alignment between what a WAM imagines and what it executes. BadWAM characterizes this attack surface along two natural criteria: attack strength and stealthiness. When the adversary prioritizes disruption, BadWAM instantiates an action-only adversarial attack, which directly drives the model toward task-failing actions. When the adversary additionally prioritizes stealth, BadWAM instantiates an imagination-preserving adversarial attack, which seeks to induce harmful action shifts while keeping the model's predicted future close to its clean imagination. Together, these two attacks capture a spectrum of WAM-specific failures: from overt action hijacking to stealthier cases where the model appears to imagine a plausible future but executes a desynchronized action. We evaluate BadWAM across different variants of WAMs. Results show that our attacks substantially reduce task success rates under closed-loop execution. For example, our action-only attack reduces the model performance from 96.5% to 43.1% success. The results of our imagination-preserving attack further exposes a WAM-specific vulnerability: moderate future-preserving regularization can maintain strong attack performance while reducing future imagination drift.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 27 of its 35 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

27 of 35 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Attacking the Trusted Imagination: Oracle-Level Integrity Attacks on Imagine-then-Act World Models22 Jun
  2. 2026BadWorld: Adversarial Attacks on World Models15 Jun
  3. 2026JailWAM: Jailbreaking World Action Models in Robot Control7 Apr
  4. 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb

Other references · 23

  1. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  3. 2013Intriguing properties of neural networkscited by 5,114
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 656
  9. 2017Adversarial Patchcited by 514
  10. 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 499
  11. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  12. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
11 more
  1. 2018Adversarial Risk and the Dangers of Evaluating Against Weak Attackscited by 221
  2. 2019Adversarial Policies: Attacking Deep Reinforcement Learningcited by 209
  3. 2017Tactics of Adversarial Attack on Deep Reinforcement Learning Agentscited by 163
  4. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  5. 2024VLMPC: Vision-Language Model Predictive Control for Robotic Manipulationcited by 32
  6. 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 28
  7. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 25
  8. 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanismscited by 12
  9. 2026World Action Models: A Surveycited by 10
  10. 2026VT-WAM: Visual-Tactile World Action Model for Contact-Rich Manipulationcited by 10
  11. 2026Understanding and Mitigating the Video-Action Generalization Gap via Temporal Ratiocited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ARB4WM: An Adversarial Robustness Benchmark for World Models in Continuous Control
  2. 2026Safety, Security, and Cognitive Risks in World Models
  3. 2026TAPDreamer: Transferable Adversarial Patches for World Action Models
  4. 2026Hidden in Plain Sight: Diffusion-Based Unrestricted Robotic Attacks on Vision-Language-Action Models
  5. 2025Adversarial Attacks on Robotic Vision Language Action Models
  6. 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics
  7. 2026When to Trust Imagination: Adaptive Action Execution for World Action Models
  8. 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Models