mlsanityData to 7 Oct 2026

ViZDoom Competitions: Playing Doom from Pixels

arXiv 1809.03470 ↗First posted 10 Sep 2018cs.AI cs.CV cs.LGcited by 50

Not on the map. Why?

Abstract (arXiv)

This paper presents the first two editions of Visual Doom AI Competition, held in 2016 and 2017. The challenge was to create bots that compete in a multi-player deathmatch in a first-person shooter (FPS) game, Doom. The bots had to make their decisions based solely on visual information, i.e., a raw screen buffer. To play well, the bots needed to understand their surroundings, navigate, explore, and handle the opponents at the same time. These aspects, together with the competitive multi-agent aspect of the game, make the competition a unique platform for evaluating the state of the art reinforcement learning algorithms. The paper discusses the rules, solutions, results, and statistics that give insight into the agents' behaviors. Best-performing agents are described in more detail. The results of the competition lead to the conclusion that, although reinforcement learning can produce capable Doom bots, they still are not yet able to successfully compete against humans in this game. The paper also revisits the ViZDoom environment, which is a flexible, easy to use, and efficient 3D platform for research for vision-based reinforcement learning, based on a well-recognized first-person perspective game Doom.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 9; 2022: 11; 2023: 5; 2024: 13; 2025: 6; 2026: 5.

50 papers.

Sort:

By area:

  1. 2024Diffusion Models Are Real-Time Game Enginescited by 282
  2. 2021Avalanche: an End-to-End Library for Continual Learningcited by 124
  3. 2021Counter-Strike Deathmatch with Large-Scale Behavioural Cloningcited by 49
  4. 2021Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agentscited by 35
  5. 2023Facing Off World Model Backbones: RNNs, Transformers, and S4cited by 31
  6. 2022MineRL Diamond 2021 Competition: Overview, Results, and Lessons Learnedcited by 26
  7. 2021Successor Feature Landmarks for Long-Horizon Goal-Conditioned Reinforcement Learningcited by 23
  8. 2025Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agentscited by 23
  9. 2023Memory Gym: Towards Endless Tasks to Benchmark Memory Capabilities of Agentscited by 16
  10. 2020Benchmarking End-to-End Behavioural Cloning on Video Gamescited by 15
  11. 2026MultiGen: Level-Design for Editable Multiplayer Worlds in Diffusion Game Enginescited by 12
  12. 2022Task-Induced Representation Learningcited by 10
38 more
  1. 2024Towards Principled Representation Learning from Videos for Reinforcement Learningcited by 10
  2. 2025A Comprehensive Review of Multi-Agent Reinforcement Learning in Video Gamescited by 9
  3. 2023RaidEnv: Exploring New Challenges in Automated Content Balancing for Boss Raid Gamescited by 7
  4. 2024Will GPT-4 Run DOOM?cited by 6
  5. 2021Graph augmented Deep Reinforcement Learning in the GameRLand3D environmentcited by 5
  6. 2024BehAVE: Behaviour Alignment of Video Game Encodingscited by 5
  7. 2024A Behavior-Aware Approach for Deep Reinforcement Learning in Non-stationary Environments without Known Change Pointscited by 5
  8. 2021Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systemscited by 4
  9. 2021Godot Reinforcement Learning Agentscited by 4
  10. 2022Collaborative Training of Heterogeneous Reinforcement Learning Agents in Environments with Sparse Rewards: What and When to Share?cited by 4
  11. 2022SMPL: Simulated Industrial Manufacturing and Process Control Learning Environmentscited by 4
  12. 2024Craftium: Bridging Flexibility and Efficiency for Rich 3D Single- and Multi-Agent Environmentscited by 4
  13. 2021Distilling Reinforcement Learning Tricks for Video Gamescited by 3
  14. 2022Tracking and Planning with Spatial World Modelscited by 3
  15. 2022Lamarckian Platform: Pushing the Boundaries of Evolutionary Reinforcement Learning towards Asynchronous Commercial Gamescited by 3
  16. 2024Scaling Value Iteration Networks to 5000 Layers for Extreme Long-Term Planningcited by 3
  17. 2022Unified Distributed Environmentcited by 2
  18. 2024Behavioural Cloning in VizDoomcited by 2
  19. 2024Highway Value Iteration Networkscited by 2
  20. 2021Modular Networks Prevent Catastrophic Interference in Model-Based Multi-Task Reinforcement Learningcited by 1
  21. 2022Graph Neural Network based Agent in Google Research Footballcited by 1
  22. 2022DeepSim: A Reinforcement Learning Environment Build Toolkit for ROS and Gazebocited by 1
  23. 2023Handling Long and Richly Constrained Tasks through Constrained Hierarchical Reinforcement Learningcited by 1
  24. 2023Filter-Aware Model-Predictive Controlcited by 1
  25. 2024Training on Irrelevant States Implies Data Augmentation: Generalization in Contextual MDPscited by 1
  26. 2026Position: RL Researchers Need to Distinguish Between Solving Simulators and Using Simulators as a Proxycited by 1
  27. 2022Dealing with Sparse Rewards Using Graph Neural Networkscited by 0
  28. 2022Deep Q-Network for AI Soccercited by 0
  29. 2024Progressive Safeguards for Safe and Model-Agnostic Reinforcement Learningcited by 0
  30. 2024Innate-Values-driven Reinforcement Learning based Cognitive Modelingcited by 0
  31. 2024Why the Agent Made that Decision: Contrastive Explanation Learning for Reinforcement Learningcited by 0
  32. 2025Gradient-Based Neuroplastic Adaptation for Concurrent Optimization of Neuro-Fuzzy Networkscited by 0
  33. 2025Learning from Observation: A Survey of Recent Advancescited by 0
  34. 2025FOSSIL: Harnessing Feedback on Suboptimal Samples for Data-Efficient Generalisation with Imitation Learning for Embodied Vision-and-Language Taskscited by 0
  35. 2025Diffusion Guided Adversarial State Perturbations in Reinforcement Learningcited by 0
  36. 2026CAMAL: Improving Attention Alignment and Faithfulness with Segmentation Maskscited by 0
  37. 2026JAXenstein: Accelerated Benchmarking for First-Person Environmentscited by 0
  38. 2026LLMs are General Asynchronous Agentscited by 0