mlsanityData to 7 Oct 2026

WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents

arXiv 2605.23220 ↗First posted 22 May 2026cs.LGcited by 6

On the map: World models → World model security and GUI agents

Abstract (arXiv)

Despite the growing use of world models as decision-making agents, their adversarial robustness remains underexplored due to the lack of dedicated automated evaluation methods. A key obstacle is that attack evaluation must be both accurate and efficient: weak manually tuned attacks can overestimate robustness, while exhaustive hyperparameter search is prohibitively expensive because each candidate requires closed-loop rollouts through learned latent dynamics. We introduce WMAttack, an automated attack-search framework for adversarial evaluation of world-model agents. WMAttack formulates robustness evaluation as a finite-budget search over attack configurations, including attack families, perturbation budgets, optimization steps, restarts, and allocation rules. To improve search accuracy, Self-Correcting Attack Search (SCAS) refines the attack proposal distribution using feedback from reward degradation, action instability, runtime cost, and rollout variability. To improve search efficiency, Representation-Guided Attack Retrieval (RGAR) retrieves effective historical configurations from representation-similar tasks, providing a warm start for unseen environments. We provide a theoretical explanation showing that proposal refinement improves finite-budget search when it shifts probability mass toward high-utility attacks. Across Atari and DeepMind Control tasks, WMAttack consistently discovers stronger attacks than the evaluated baselines, improving normalized reward drop from 0.497 to 1.034 on DreamerV3 Atari and from 0.319 to 0.682 on DMC. Ablations further show that RGAR improves initial candidate quality and SCAS improves final attack utility under fixed evaluation budgets.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 55 of its 58 references that are in the map. First posted on arXiv 22 May 2026.

Builds on

55 of 58 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May
  2. 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb

Other references · 53

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  3. 2024Qwen2.5 Technical Reportcited by 4,713
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
  7. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  8. 2023Mastering Diverse Domains through World Modelscited by 1,193
  9. 2020Mastering Atari with Discrete World Modelscited by 990
  10. 2018DeepMind Control Suitecited by 935
  11. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  12. 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 682
38 more
  1. 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
  2. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  3. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  4. 2023Learning Interactive Real-World Simulatorscited by 440
  5. 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 424
  6. 2019Minimally distorted Adversarial Examples with a Fast Adaptive Boundary Attackcited by 333
  7. 2022Transformers are Sample-Efficient World Modelscited by 317
  8. 2017Adversarial Attacks on Neural Network Policiescited by 314
  9. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  10. 2020Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observationscited by 235
  11. 2019Adversarial Policies: Attacking Deep Reinforcement Learningcited by 209
  12. 2017Tactics of Adversarial Attack on Deep Reinforcement Learning Agentscited by 163
  13. 2018Transferable Adversarial Attacks for Image and Video Object Detectioncited by 109
  14. 2024Evaluating the World Model Implicit in a Generative Modelcited by 107
  15. 2017Vulnerability of Deep Reinforcement Learning to Policy Induction Attackscited by 91
  16. 2023STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learningcited by 88
  17. 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
  18. 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
  19. 2023SafeDreamer: Safe Reinforcement Learning with World Modelscited by 50
  20. 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 35
  21. 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
  22. 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 30
  23. 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 23
  24. 2023Improving Adversarial Transferability by Stable Diffusioncited by 22
  25. 2024Learning Latent Dynamic Robust Representations for World Modelscited by 20
  26. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
  27. 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
  28. 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMscited by 13
  29. 2024Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruptioncited by 12
  30. 2026CtrlAttack: A Unified Attack on World-Model Control in Diffusion Modelscited by 6
  31. 2024CopyrightShield: Enhancing Diffusion Model Security against Copyright Infringement Attackscited by 5
  32. 2024Safe Exploration Using Bayesian World Models and Log-Barrier Optimizationcited by 4
  33. 2024LiRA: Light-Robust Adversary for Model-based Reinforcement Learning in Real Worldcited by 3
  34. 2025MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Drivingcited by 3
  35. 2025Universal Camouflage Attack on Vision-Language Models for Autonomous Drivingcited by 3
  36. 2025World Model Robustness via Surprise Recognitioncited by 3
  37. 2024Safe Deep Model-Based Reinforcement Learning with Lyapunov Functionscited by 2
  38. 2025Text Adversarial Attacks with Dynamic Outputscited by 2

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026BadWAM: When World-Action Models Dream Right but Act Wrong
  2. 2026Stealthy World Model Manipulation via Data Poisoning
  3. 2025Adversarial Attack on Black-Box Multi-Agent by Adaptive Perturbation
  4. 2026Assessing Automated Prompt Injection Attacks in Agentic Environments
  5. 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
  6. 2026Safety, Security, and Cognitive Risks in World Models
  7. 2026ToolHazard: Scaling Adversarial Environments for Security Evaluation and Alignment of LLM-based Agents
  8. 2025Adversarial Testing in LLMs: Insights into Decision-Making Vulnerabilities