mlsanityData to 7 Oct 2026

Human-like Bots for Tactical Shooters Using Compute-Efficient Sensors

arXiv 2501.00078 ↗First posted 30 Dec 2024cs.HC cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Artificial intelligence (AI) has enabled agents to master complex video games, from first-person shooters like Counter-Strike to real-time strategy games such as StarCraft II and racing games like Gran Turismo. While these achievements are notable, applying these AI methods in commercial video game production remains challenging due to computational constraints. In commercial scenarios, the majority of computational resources are allocated to 3D rendering, leaving limited capacity for AI methods, which often demand high computational power, particularly those relying on pixel-based sensors. Moreover, the gaming industry prioritizes creating human-like behavior in AI agents to enhance player experience, unlike academic models that focus on maximizing game performance. This paper introduces a novel methodology for training neural networks via imitation learning to play a complex, commercial-standard, VALORANT-like 2v2 tactical shooter game, requiring only modest CPU hardware during inference. Our approach leverages an innovative, pixel-free perception architecture using a small set of ray-cast sensors, which capture essential spatial information efficiently. These sensors allow AI to perform competently without the computational overhead of traditional methods. Models are trained to mimic human behavior using supervised learning on human trajectory data, resulting in realistic and engaging AI agents. Human evaluation tests confirm that our AI agents provide human-like gameplay experiences while operating efficiently under computational constraints. This offers a significant advancement in AI model development for tactical shooter games and possibly other genres.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

21 of 46 references.

References · 21

  1. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  2. 2016Generative Adversarial Imitation Learningcited by 1,576
  3. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  4. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  5. 2022A Generalist Agentcited by 802
  6. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 636
  7. 2022Behavior Transformers: Cloning k modes with one stonecited by 299
  8. 2017StarCraft II: A New Challenge for Reinforcement Learningcited by 268
  9. 2018Human-level performance in first-person multiplayer games with population-based deep reinforcement learningcited by 260
  10. 2023Imitating Human Behaviour with Diffusion Modelscited by 260
  11. 2022Exploration in Deep Reinforcement Learning: A Surveycited by 158
  12. 2021Generalized Decision Transformer for Offline Hindsight Information Matchingcited by 105
9 more
  1. 2020Transformers for One-Shot Visual Imitationcited by 77
  2. 2021Imitation Learning: Progress, Taxonomies and Challengescited by 56
  3. 2021Counter-Strike Deathmatch with Large-Scale Behavioural Cloningcited by 49
  4. 2023TAIL: Task-specific Adapters for Imitation Learning with Large Pretrained Modelscited by 48
  5. 2018Imitation Learning with Concurrent Actions in 3D Gamescited by 18
  6. 2022Conditional Imitation Learning for Multi-Agent Gamescited by 13
  7. 2023Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Gamescited by 10
  8. 2023Skill Decision Transformercited by 7
  9. 2024Training Interactive Agent in Large FPS Game Map with Rule-enhanced Reinforcement Learningcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Behavioural Cloning in VizDoom
  2. 2023Visual Encoders for Data-Efficient Imitation Learning in Modern Video Games
  3. 2025Reinforcement Learning Agent for a 2D Shooter Game
  4. 2024Efficient Active Imitation Learning with Random Network Distillation
  5. 2019Towards Interactive Training of Non-Player Characters in Video Games
  6. 2023Preference-conditioned Pixel-based AI Agent For Game Testing
  7. 2023Mimicking To Dominate: Imitation Learning Strategies for Success in Multiagent Competitive Games
  8. 2020TStarBot-X: An Open-Sourced and Comprehensive Study for Efficient League Training in StarCraft II Full Game