mlsanityData to 7 Oct 2026

TrojanWorld: Backdooring World-Model Agents via Imagination Steering

arXiv 2609.07051 ↗First posted 7 Sep 2026cs.LG cs.CRcited by 0

On the map: World models → World model security and GUI agents

also in 1 more
Abstract (arXiv)

World models increasingly serve as the predictive core of model-based reinforcement learning agents, enabling them to simulate future dynamics and reason over imagined trajectories before acting. Their substantial training demands make pretrained world models attractive for distribution and reuse, exposing downstream systems to model supply chain threats. Backdoor attacks offer a targeted and stealthy means of exploiting such supply chains, yet their threat to interactive world-model agents remains largely unexplored. To fill this gap, we present TrojanWorld, a backdoor framework for world-model agents that induces attacker-specified behavior by steering internal imagination. A physical object placed in the scene acts as the trigger, enabling deployment-time activation through the agent's native observation pipeline without digitally manipulating the observation stream. To achieve effective, stealthy, and persistent control, TrojanWorld combines Decision-Reflective Induction to steer trigger-conditioned imagination toward attacker-specified actions using decision feedback, Clean Behavior Anchoring to preserve trigger-free predictive and behavioral fidelity, and Causal Propagation to sustain the induced preference along subsequent trajectories after the trigger disappears. Together, these mechanisms establish an end-to-end attack chain from physical perception through corrupted imagination to malicious action selection. Experiments with the TD-MPC2, DreamerV3, and R2-Dreamer systems across the DeepMind Control, MetaWorld, MyoSuite, and RoboDesk benchmarks show that under trigger activation, TrojanWorld achieves a target-action deviation as low as 0.026 while retaining at least 98.8% of the corresponding clean performance. Even after trigger removal, the compromised agent can remain trapped in the induced behavioral trajectory, continuing to execute attacker-specified actions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 46 of its 58 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

46 of 58 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Stealthy World Model Manipulation via Data Poisoning17 Jun
  2. 2026WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents22 May
  3. 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May
  4. 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb

Other references · 42

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  2. 2018World Modelscited by 1,444
  3. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  4. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  5. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  6. 2018DeepMind Control Suitecited by 935
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  8. 2024Genie: Generative Interactive Environmentscited by 706
  9. 2016Training Region-based Object Detectors with Online Hard Example Miningcited by 577
  10. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 550
  11. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  12. 2023Learning Interactive Real-World Simulatorscited by 440
30 more
  1. 2020Backdoor Learning: A Surveycited by 412
  2. 2026World Action Models are Zero-shot Policiescited by 411
  3. 2022Temporal Difference Learning for Model Predictive Controlcited by 375
  4. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  5. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  6. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  7. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  8. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  9. 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 153
  10. 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 120
  11. 2023BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learningcited by 112
  12. 2024BadAgent: Inserting and Activating Backdoor Attacks in LLM Agentscited by 106
  13. 2022How to Backdoor Diffusion Models?cited by 102
  14. 2020Adaptive Reward-Poisoning Attacks against Reinforcement Learningcited by 86
  15. 2019Distilling Policy Distillationcited by 81
  16. 2022MyoSuite -- A contact-rich simulation suite for musculoskeletal motor controlcited by 80
  17. 2024Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shiftcited by 45
  18. 2023Pre-trained Trojan Attacks for Visual Recognitioncited by 38
  19. 2019TrojDRL: Trojan Attacks on Deep Reinforcement Learning Agentscited by 29
  20. 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 29
  21. 2024Breaking the False Sense of Security in Backdoor Defense through Re-Activation Attackcited by 26
  22. 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 25
  23. 2024SleeperNets: Universal Backdoor Poisoning Attacks Against Reinforcement Learning Agentscited by 19
  24. 2025Natural Reflection Backdoor Attack on Vision Language Model for Autonomous Drivingcited by 16
  25. 2024LOTUS: Evasive and Resilient Backdoor Attacks through Sub-Partitioningcited by 13
  26. 2025Learning Massively Multitask World Models for Continuous Controlcited by 11
  27. 2025Robust Anti-Backdoor Instruction Tuning in LVLMscited by 10
  28. 2026R2-Dreamer: Redundancy-Reduced World Models without Decoders or Augmentationcited by 10
  29. 2025BEAT: Visual Backdoor Attacks on VLM-based Embodied Agents via Contrastive Trigger Learningcited by 7
  30. 2024Model Supply Chain Poisoning: Backdooring Pre-trained Models via Embedding Indistinguishabilitycited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026When the World Lies: Backdoor Attacks on Latent World Models for Downstream Control
  2. 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
  3. 2026When Backdoors Meet Partial Observability: Attacking Real-World Reinforcement Learning
  4. 2026Attacking the Trusted Imagination: Oracle-Level Integrity Attacks on Imagine-then-Act World Models
  5. 2025TrojanTO: Action-Level Backdoor Attacks against Trajectory Optimization Models
  6. 2024Robot Collapse: Supply Chain Backdoor Attacks Against VLM-based Robotic Manipulation
  7. 2026BadWAM: When World-Action Models Dream Right but Act Wrong
  8. 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models