mlsanityData to 14 Oct 2026

Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games

arXiv 2303.02160 ↗First posted 2 Mar 2023cs.HC cs.LG cs.ROcited by 11

Not on the map. Why?

Abstract (arXiv)

We aim to understand how people assess human likeness in navigation produced by people and artificially intelligent (AI) agents in a video game. To this end, we propose a novel AI agent with the goal of generating more human-like behavior. We collect hundreds of crowd-sourced assessments comparing the human-likeness of navigation behavior generated by our agent and baseline AI agents with human-generated behavior. Our proposed agent passes a Turing Test, while the baseline agents do not. By passing a Turing Test, we mean that human judges could not quantitatively distinguish between videos of a person and an AI agent navigating. To understand what people believe constitutes human-like navigation, we extensively analyze the justifications of these assessments. This work provides insights into the characteristics that people consider human-like in the context of goal-directed video game navigation, which is a key step for further improving human interactions with AI agents.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 23 of its 98 references that are in the map. First posted on arXiv 2 Mar 2023.

Builds on

23 of 98 references.

References · 23

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2017Deep reinforcement learning from human preferencescited by 3,912
  4. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,103
  5. 2022A Generalist Agentcited by 808
  6. 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 349
  7. 2019Challenges of Real-World Reinforcement Learningcited by 291
  8. 2018Unity: A General Platform for Intelligent Agentscited by 236
  9. 2022Multi-Game Decision Transformerscited by 214
  10. 2016Playing FPS Games with Deep Reinforcement Learningcited by 95
  11. 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
  12. 2021Modeling Strong and Human-Like Gameplay with KL-Regularized Searchcited by 50
11 more
  1. 2020Action Space Shaping in Deep Reinforcement Learningcited by 46
  2. 2023Emergence of Maps in the Memories of Blind Navigation Agentscited by 33
  3. 2020Deep Reinforcement Learning for Navigation in AAA Video Gamescited by 27
  4. 2019The MineRL 2019 Competition on Sample Efficient Reinforcement Learning using Human Priorscited by 26
  5. 2021The MineRL BASALT Competition on Learning from Human Feedbackcited by 24
  6. 2020"It's Unwieldy and It Takes a Lot of Time." Challenges and Opportunities for Creating Agents in Commercial Gamescited by 17
  7. 2021Navigation Turing Test (NTT): Learning to Evaluate Human-Like Navigationcited by 17
  8. 2020Learning Accurate and Human-Like Driving using Semantic Maps and Attentioncited by 10
  9. 2019A 20-Year Community Roadmap for Artificial Intelligence Research in the UScited by 8
  10. 2018Leveraging human knowledge in tabular reinforcement learning: A study of human subjectscited by 7
  11. 2019On Multi-Agent Learning in Team Sports Gamescited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 5; 2026: 1.

11 papers.

  1. 2024Will GPT-4 Run DOOM?cited by 6
  2. 2023Towards Human-Like RL: Taming Non-Naturalistic Behavior in Deep RL via Adaptive Behavioral Costs in 3D Gamescited by 4
  3. 2024Reinforcement Learning for High-Level Strategic Control in Tower Defense Gamescited by 3
  4. 2025Learning Human-Like RL Agents Through Trajectory Optimization With Action Quantizationcited by 3
  5. 2023Learning to Terminate in Object Navigationcited by 1
  6. 2024Human-like Bots for Tactical Shooters Using Compute-Efficient Sensorscited by 1
  7. 2025Path Generation and Evaluation in Video Games: A Nonparametric Statistical Approachcited by 1
  8. 2025CogniPlay: a work-in-progress Human-like model for General Game Playingcited by 1
  9. 2025Eval-PPO: Building an Efficient Threat Evaluator Using Proximal Policy Optimizationcited by 0
  10. 2025Combining Reinforcement Learning and Behavior Trees for NPCs in Video Games with AMD Scholacited by 0
  11. 2026Enhancing Human-Likeness in Reinforcement Learning Agents via Hierarchical Macro Action Quantizationcited by 0