WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents
On the map: World models → World model security and GUI agents
Abstract (arXiv)
Despite the growing use of world models as decision-making agents, their adversarial robustness remains underexplored due to the lack of dedicated automated evaluation methods. A key obstacle is that attack evaluation must be both accurate and efficient: weak manually tuned attacks can overestimate robustness, while exhaustive hyperparameter search is prohibitively expensive because each candidate requires closed-loop rollouts through learned latent dynamics. We introduce WMAttack, an automated attack-search framework for adversarial evaluation of world-model agents. WMAttack formulates robustness evaluation as a finite-budget search over attack configurations, including attack families, perturbation budgets, optimization steps, restarts, and allocation rules. To improve search accuracy, Self-Correcting Attack Search (SCAS) refines the attack proposal distribution using feedback from reward degradation, action instability, runtime cost, and rollout variability. To improve search efficiency, Representation-Guided Attack Retrieval (RGAR) retrieves effective historical configurations from representation-similar tasks, providing a warm start for unseen environments. We provide a theoretical explanation showing that proposal refinement improves finite-budget search when it shifts probability mass toward high-utility attacks. Across Atari and DeepMind Control tasks, WMAttack consistently discovers stronger attacks than the evaluated baselines, improving normalized reward drop from 0.497 to 1.034 on DreamerV3 Atari and from 0.319 to 0.682 on DMC. Ablations further show that RGAR improves initial candidate quality and SCAS improves final attack utility under fixed evaluation budgets.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in World model security and GUI agents, one of 11 directions in World models. Builds on 55 of its 58 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
55 of 58 references.
Closest ancestors · 2
Same direction, newest first
- 2026TRAP: Tail-aware Ranking Attack for World-Model Planning3 May
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb
Other references · 53
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,442
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2020Mastering Atari with Discrete World Modelscited by 990
- 2018DeepMind Control Suitecited by 935
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
- 2019Square Attack: a query-efficient black-box adversarial attack via random searchcited by 682
38 more
- 2020RobustBench: a standardized adversarial robustness benchmarkcited by 659
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2023Learning Interactive Real-World Simulatorscited by 440
- 2020Learning Invariant Representations for Reinforcement Learning without Reconstructioncited by 424
- 2019Minimally distorted Adversarial Examples with a Fast Adaptive Boundary Attackcited by 333
- 2022Transformers are Sample-Efficient World Modelscited by 317
- 2017Adversarial Attacks on Neural Network Policiescited by 314
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2020Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observationscited by 235
- 2019Adversarial Policies: Attacking Deep Reinforcement Learningcited by 209
- 2017Tactics of Adversarial Attack on Deep Reinforcement Learning Agentscited by 163
- 2018Transferable Adversarial Attacks for Image and Video Object Detectioncited by 109
- 2024Evaluating the World Model Implicit in a Generative Modelcited by 107
- 2017Vulnerability of Deep Reinforcement Learning to Policy Induction Attackscited by 91
- 2023STORM: Efficient Stochastic Transformer based World Models for Reinforcement Learningcited by 88
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2022A Large-scale Multiple-objective Method for Black-box Attack against Object Detectioncited by 55
- 2023SafeDreamer: Safe Reinforcement Learning with World Modelscited by 50
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 35
- 2023Diversifying the High-level Features for better Adversarial Transferabilitycited by 34
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 30
- 2025Black-Box Adversarial Attack on Vision Language Models for Autonomous Drivingcited by 23
- 2023Improving Adversarial Transferability by Stable Diffusioncited by 22
- 2024Learning Latent Dynamic Robust Representations for World Modelscited by 20
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
- 2024Object Detectors in the Open Environment: Challenges, Solutions, and Outlookcited by 13
- 2026Claudini: Autoresearch Discovers State-of-the-Art Adversarial Attack Algorithms for LLMscited by 13
- 2024Towards Robust Model-Based Reinforcement Learning Against Adversarial Corruptioncited by 12
- 2026CtrlAttack: A Unified Attack on World-Model Control in Diffusion Modelscited by 6
- 2024CopyrightShield: Enhancing Diffusion Model Security against Copyright Infringement Attackscited by 5
- 2024Safe Exploration Using Bayesian World Models and Log-Barrier Optimizationcited by 4
- 2024LiRA: Light-Robust Adversary for Model-based Reinforcement Learning in Real Worldcited by 3
- 2025MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Drivingcited by 3
- 2025Universal Camouflage Attack on Vision-Language Models for Autonomous Drivingcited by 3
- 2025World Model Robustness via Surprise Recognitioncited by 3
- 2024Safe Deep Model-Based Reinforcement Learning with Lyapunov Functionscited by 2
- 2025Text Adversarial Attacks with Dynamic Outputscited by 2
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026BadWorld: Adversarial Attacks on World Modelscited by 3
- 2026ARB4WM: An Adversarial Robustness Benchmark for World Models in Continuous Controlcited by 2
- 2026Diagnosing JEPA World Models with Action-Conditioned Predictive Consistencycited by 2
- 2026Where World Models Break: Natural-Input Failure Discoverycited by 0
- 2026TrojanWorld: Backdooring World-Model Agents via Imagination Steeringcited by 0
- 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attackscited by 0
- 2026TempQ-Jail: Query-Constrained Candidate Ranking for Text-to-Video Jailbreak Attacks25 Sep 2026
- 2026TrojanWorld: Backdooring World-Model Agents via Imagination Steering7 Sep 2026
- 2026Where World Models Break: Natural-Input Failure Discovery23 Aug 2026
- 2026Diagnosing JEPA World Models with Action-Conditioned Predictive Consistency13 Aug 2026
- 2026ARB4WM: An Adversarial Robustness Benchmark for World Models in Continuous Control15 Jun 2026
- 2026BadWorld: Adversarial Attacks on World Models15 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026BadWAM: When World-Action Models Dream Right but Act Wrong
- 2026Stealthy World Model Manipulation via Data Poisoning
- 2025Adversarial Attack on Black-Box Multi-Agent by Adaptive Perturbation
- 2026Assessing Automated Prompt Injection Attacks in Agentic Environments
- 2026Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation
- 2026Safety, Security, and Cognitive Risks in World Models
- 2026ToolHazard: Scaling Adversarial Environments for Security Evaluation and Alignment of LLM-based Agents
- 2025Adversarial Testing in LLMs: Insights into Decision-Making Vulnerabilities