mlsanityData to 7 Oct 2026

Behavioural Cloning in VizDoom

arXiv 2401.03993 ↗First posted 8 Jan 2024cs.LG cs.AI cs.CVcited by 2

On the map: Offline RL and imitation learning from data → Imitation learning methods

Abstract (arXiv)

This paper describes methods for training autonomous agents to play the game "Doom 2" through Imitation Learning (IL) using only pixel data as input. We also explore how Reinforcement Learning (RL) compares to IL for humanness by comparing camera movement and trajectory data. Through behavioural cloning, we examine the ability of individual models to learn varying behavioural traits. We attempt to mimic the behaviour of real players with different play styles, and find we can train agents that behave aggressively, passively, or simply more human-like than traditional AIs. We propose these methods of introducing more depth and human-like behaviour to agents in video games. The trained IL agents perform on par with the average players in our dataset, whilst outperforming the worst players. While performance was not as strong as common RL approaches, it provides much stronger human-like behavioural traits to the agent.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Imitation learning methods, one of 13 directions in Offline RL and imitation learning from data. Builds on 24 of its 36 references that are in the map. First posted on arXiv 8 Jan 2024.

Builds on

24 of 36 references.

Closest ancestors · 3

Same direction, newest first

  1. 2021Counter-Strike Deathmatch with Large-Scale Behavioural Cloning9 Apr
  2. 2018An Algorithmic Perspective on Imitation Learning16 Nov
  3. 2018Behavioral Cloning from Observation4 May

Other references · 21

  1. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  2. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  3. 2016Generative Adversarial Imitation Learningcited by 1,576
  4. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  5. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  6. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  7. 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 260
  8. 2023Reward Design with Language Modelscited by 257
  9. 2022Multi-Game Decision Transformerscited by 212
  10. 2016ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learningcited by 178
  11. 2019Deep Learning for Audio Signal Processingcited by 92
  12. 2021Coarse-to-Fine Imitation Learning: Robot Manipulation from a Single Demonstrationcited by 92
9 more
  1. 2020Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learningcited by 84
  2. 2023Teach a Robot to FISH: Versatile Imitation from One Minute of Demonstrationscited by 74
  3. 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 71
  4. 2022EnvPool: A Highly Parallel Reinforcement Learning Environment Execution Enginecited by 58
  5. 2018ViZDoom Competitions: Playing Doom from Pixelscited by 50
  6. 2021Creating Multimodal Interactive Agents with Imitation and Self-Supervised Learningcited by 40
  7. 2022Improving Multimodal Interactive Agents with Reinforcement Learning from Human Feedbackcited by 26
  8. 2016Play and Learn: Using Video Games to Train Computer Vision Modelscited by 16
  9. 2021Formula RL: Deep Reinforcement Learning for Autonomous Racing using Telemetry Datacited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Reinforcement Learning Agent for a 2D Shooter Gamecited by 0
  2. 2026Evaluating VLMs for Autonomous Agent-Driven Geometry Clipping Detection in Video Game QAcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2020Benchmarking End-to-End Behavioural Cloning on Video Games
  2. 2024Zero-shot Imitation Policy via Search in Demonstration Dataset
  3. 2024Robust Imitation Learning for Automated Game Testing
  4. 2023Behavioral Cloning via Search in Embedded Demonstration Dataset
  5. 2019Towards Interactive Training of Non-Player Characters in Video Games
  6. 2022Improving Behavioural Cloning with Human-Driven Dynamic Dataset Augmentation
  7. 2022Behavioral Cloning via Search in Video PreTraining Latent Space
  8. 2023Mimicking To Dominate: Imitation Learning Strategies for Success in Multiagent Competitive Games