mlsanityData to 14 Oct 2026

When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control

arXiv 2609.15781 ↗First posted 14 Sep 2026cs.CR cs.AI cs.LGcited by 0

On the map: World models → World model security and GUI agents

Abstract (arXiv)

Pretrained world models, learned simulators that encode an observation into a latent state and predict how it evolves under actions, are beginning to be reused as off-the-shelf dynamics backbones for control, like pretrained encoders and language models are reused today. We show that this reuse opens a supply-chain backdoor: an adversary who controls only a released checkpoint can hijack the downstream controller, even though the victim trains and evaluates entirely on clean data and never sees the trigger. The attack encodes no explicit trigger-to-action rule. Instead, the poisoned model routes trigger-bearing observations into a chosen latent region and reshapes the local dynamics there, so that the victim's own optimization (Dreamer-style actor training in imagination, or MPC/CEM planning over predicted futures) re-discovers the attacker's target action on its own. Across several control tasks and trigger families, the trigger steers the controller's action toward the attacker's target, controlling every action dimension and hijacking 100% of triggered steps on the strongest settings. The checkpoint still passes the clean-data diagnostics a victim would run before deployment, with clean-task success retaining at least ~75%. The effect is temporally gated: it appears only while the trigger is present and disappears when the trigger is removed. Trigger-blind repair is budget-dependent: moderate clean fine-tuning can preserve clean utility while leaving the triggered failure intact, whereas sufficiently aggressive adaptation can remove it only after substantially degrading clean control. The world-model backbone itself is therefore an emerging and underexamined attack surface for control. The full code and artifacts are available in our repository.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 25 of its 37 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

25 of 37 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026Stealthy World Model Manipulation via Data Poisoning17 Jun
  2. 2026Safety, Security, and Cognitive Risks in World Models1 Apr

Other references · 23

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2018World Modelscited by 1,513
  3. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,055
  4. 2018DeepMind Control Suitecited by 956
  5. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  6. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 580
  7. 2019STRIP: A Defence Against Trojan Attacks on Deep Neural Networkscited by 459
  8. 2021Neural Attention Distillation: Erasing Backdoor Triggers from Deep Neural Networkscited by 324
  9. 2017Adversarial Attacks on Neural Network Policiescited by 320
  10. 2019Label-Consistent Backdoor Attackscited by 296
  11. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  12. 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
11 more
  1. 2019Adversarial Policies: Attacking Deep Reinforcement Learningcited by 214
  2. 2017Tactics of Adversarial Attack on Deep Reinforcement Learning Agentscited by 166
  3. 2021BACKDOORL: Backdoor Attack against Competitive Reinforcement Learningcited by 68
  4. 2023Detecting Backdoors in Pre-trained Encoderscited by 55
  5. 2021Poisoning the Unlabeled Dataset of Semi-Supervised Learningcited by 44
  6. 2020Stop-and-Go: Exploring Backdoor Attacks on Deep Reinforcement Learning-based Traffic Congestion Control Systemscited by 37
  7. 2019Design of intentional backdoors in sequential modelscited by 21
  8. 2024SleeperNets: Universal Backdoor Poisoning Attacks Against Reinforcement Learning Agentscited by 19
  9. 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuningcited by 7
  10. 2025TrojanTO: Action-Level Backdoor Attacks against Trajectory Optimization Modelscited by 3
  11. 2026Beware Untrusted Simulators -- Reward-Free Backdoor Attacks in Reinforcement Learningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026TrojanWorld: Backdooring World-Model Agents via Imagination Steering
  2. 2026TRAP: Tail-aware Ranking Attack for World-Model Planning
  3. 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
  4. 2025From Poisoned to Aware: Fostering Backdoor Self-Awareness in LLMs
  5. 2026When Backdoors Meet Partial Observability: Attacking Real-World Reinforcement Learning
  6. 2026Beyond Attack Success Rate: Examining Trigger Leakage in Vision-Language Agentic Systems
  7. 2026BadWAM: When World-Action Models Dream Right but Act Wrong
  8. 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Models