Attacking the Trusted Imagination: Oracle-Level Integrity Attacks on Imagine-then-Act World Models
On the map: World models → World model security and GUI agents
Abstract (arXiv)
Many recent vision-language-action (VLA) policies adopt an imagine-then-act design. A world-action model (WAM) first imagines a short future as a latent trajectory z~, on which the action is then conditioned. We identify this trusted imagination, rather than the reactive policy, as the exposed attack surface. A downstream oracle, such as a safety gate, a visual model-predictive-control (MPC) planner, or an imagine-then-check verifier, consumes z~ as a prediction of the future. The robustness of the policy therefore does not entail the robustness of systems that rely on the WAM. The underlying phenomenon is an asymmetry. Corrupting the imagination is easy, since it requires only displacing z~ from its natural-future manifold. Steering it precisely is hard, since it must reach a specified on-manifold target. We adopt a capability-based threat model with an L-infinity-bounded observation perturbation. The attacker applies projected gradient descent through the fully differentiable observation-to-imagination map. The same off-manifold property motivates a parameter-free denoiser detector. We evaluate three targets: RynnVLA-002, LingBot-VA, and LaDi-WM. Untargeted corruption is roughly 60x stronger than random and is detected at AUC 1.0. Targeted control remains bounded. An adaptive attacker evades detection only by forgoing corruption. The reactive policy remains robust to corrupted imagination. A native imagination-driven MPC, however, exhibits the first adversary-specific task failure (at epsilon=0.01, success 0.70 versus 0.05; Fisher p < 10^-4).
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 11 of its 18 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
11 of 18 references.
Closest ancestors · 1
Same direction, newest first
Other references · 10
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2026Causal World Modeling for Robot Controlcited by 289
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 70
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Studycited by 35
- 2026SkillReducer: Optimizing LLM Agent Skills for Token Efficiencycited by 29
- 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulationcited by 24
- 2023A Dual Stealthy Backdoor: From Both Spatial and Frequency Perspectivescited by 13
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planning
- 2026Safety, Security, and Cognitive Risks in World Models
- 2026TrojanWorld: Backdooring World-Model Agents via Imagination Steering
- 2026When to Trust Imagination: Adaptive Action Execution for World Action Models
- 2026When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control
- 2026CheckVLA: Execution-Time Verification with Action-Conditioned World Model for Long-Horizon Mobile Manipulation
- 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models