Modeling Human Behavior Part I -- Learning and Belief Approaches
Not on the map. Why?
Abstract (arXiv)
There is a clear desire to model and comprehend human behavior. Trends in research covering this topic show a clear assumption that many view human reasoning as the presupposed standard in artificial reasoning. As such, topics such as game theory, theory of mind, machine learning, etc. all integrate concepts which are assumed components of human reasoning. These serve as techniques to attempt to both replicate and understand the behaviors of humans. In addition, next generation autonomous and adaptive systems will largely include AI agents and humans working together as teams. To make this possible, autonomous agents will require the ability to embed practical models of human behavior, which allow them not only to replicate human models as a technique to "learn", but to to understand the actions of users and anticipate their behavior, so as to truly operate in symbiosis with them. The main objective of this paper it to provide a succinct yet systematic review of the most important approaches in two areas dealing with quantitative models of human behaviors. Specifically, we focus on (i) techniques which learn a model or policy of behavior through exploration and feedback, such as Reinforcement Learning, and (ii) directly model mechanisms of human reasoning, such as beliefs and bias, without going necessarily learning via trial-and-error.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 64 of its 140 references that are in the map. First posted on arXiv 13 May 2022.
Builds on
64 of 140 references.
References · 64
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2020A Survey of Deep Active Learningcited by 547
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2018An Algorithmic Perspective on Imitation Learningcited by 455
- 2018A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progresscited by 294
- 2018Machine Theory of Mindcited by 222
- 2020Watch-And-Help: A Challenge for Social Perception and Human-AI Collaborationcited by 131
- 2019The Algorithmic Automation Problem: Prediction, Triage, and Human Effortcited by 101
- 2021Core Challenges of Social Robot Navigation: A Surveycited by 97
- 2020Learning Latent Representations to Influence Multi-Agent Interactioncited by 92
- 2019BAIL: Best-Action Imitation Learning for Batch Deep Reinforcement Learningcited by 90
- 2020Discovering Reinforcement Learning Algorithmscited by 75
38 more
- 2020Online Bayesian Goal Inference for Boundedly-Rational Planning Agentscited by 67
- 2020f-IRL: Inverse Reinforcement Learning via State Marginal Matchingcited by 67
- 2018Shared Autonomy via Deep Reinforcement Learningcited by 65
- 2019Rapid trial-and-error learning with simulation supports flexible tool use and physical reasoningcited by 60
- 2020AttendLight: Universal Attention-Based Reinforcement Learning Model for Traffic Signal Controlcited by 60
- 2020Rewriting History with Inverse RL: Hindsight Inference for Policy Improvementcited by 59
- 2018Optimizing Agent Behavior over Long Time Scales by Transporting Valuecited by 57
- 2020Predicting Goal-directed Human Attention Using Inverse Reinforcement Learningcited by 53
- 2020Model-Based Inverse Reinforcement Learning from Visual Demonstrationscited by 52
- 2019Task-Relevant Adversarial Imitation Learningcited by 45
- 2020Modeling Human Driving Behavior through Generative Adversarial Imitation Learningcited by 43
- 2020Meta-learning in natural and artificial intelligencecited by 39
- 2021The future of human-AI collaboration: a taxonomy of design knowledge for hybrid intelligence systemscited by 39
- 2020Meta-trained agents implement Bayes-optimal agentscited by 37
- 2021Human-AI Collaboration with Bandit Feedbackcited by 36
- 2019Generalization of Reinforcement Learners with Working and Episodic Memorycited by 35
- 2019Theory of Minds: Understanding Behavior in Groups Through Inverse Planningcited by 30
- 2020Too many cooks: Bayesian inference for coordinating multi-agent collaborationcited by 29
- 2019Learning to solve the credit assignment problemcited by 27
- 2019Stochastic Prediction of Multi-Agent Interactions from Partial Observationscited by 26
- 2020Reinforcement learning with human advice: a surveycited by 23
- 2020Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian Processescited by 23
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2021Human-robot collaboration and machine learning: a systematic review of recent researchcited by 20
- 2020Deep Inverse Q-learning with Constraintscited by 17
- 2020Learning to Learn Variational Semantic Memorycited by 17
- 2020Efficient Exploration of Reward Functions in Inverse Reinforcement Learning via Bayesian Optimizationcited by 16
- 2017Learning to select computationscited by 15
- 2019Winning Isn't Everything: Enhancing Game Development with Intelligent Agentscited by 15
- 2019Challenges of Human-Aware AI Systemscited by 13
- 2021Deep Interpretable Models of Theory of Mindcited by 13
- 2020StylePredict: Machine Theory of Mind for Human Driver Behavior From Trajectoriescited by 11
- 2020How to Support Users in Understanding Intelligent Systems? Structuring the Discussioncited by 9
- 2020Learning Retrospective Knowledge with Reverse Reinforcement Learningcited by 8
- 2021Human-AI Symbiosis: A Survey of Current Approachescited by 8
- 2020Inverse Reinforcement Learning from a Gradient-based Learnercited by 7
- 2021Unpacking Human Teachers' Intentions For Natural Interactive Task Learningcited by 6
- 2019Functional advantages of an adaptive Theory of Mind for robotics: a review of current architecturescited by 4
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.