Reinforcement learning with human advice: a survey
Not on the map. Why?
Abstract (arXiv)
In this paper, we provide an overview of the existing methods for integrating human advice into a Reinforcement Learning process. We first propose a taxonomy of the different forms of advice that can be provided to a learning agent. We then describe the methods that can be used for interpreting advice when its meaning is not determined beforehand. Finally, we review different approaches for integrating advice into the learning process.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 7; 2024: 4; 2025: 5; 2026: 2.
23 papers.
Sort:
By area:
- 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Futurecited by 53
- 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
- 2023Perspectives on the Social Impacts of Reinforcement Learning with Human Feedbackcited by 15
- 2023Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learningcited by 9
- 2023Hybrid Approaches for Moral Value Alignment in AI Agents: a Manifestocited by 7
- 2022Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigationcited by 3
- 2023CROP: Towards Distributional-Shift Robust Reinforcement Learning using Compact Reshaped Observation Processingcited by 3
- 2023Towards Human-Like RL: Taming Non-Naturalistic Behavior in Deep RL via Adaptive Behavioral Costs in 3D Gamescited by 3
- 2024On Bits and Bandits: Quantifying the Regret-Information Trade-offcited by 3
- 2024Opinion-Guided Reinforcement Learningcited by 3
- 2024Towards Sample-Efficiency and Generalization of Transfer and Inverse Reinforcement Learning: A Comprehensive Literature Reviewcited by 3
- 2025Interactive Imitation Learning for Dexterous Robotic Manipulation: Challenges and Perspectives -- A Surveycited by 3
11 more
- 2021Towards Interactive Reinforcement Learning with Intrinsic Feedbackcited by 2
- 2025Complex Model Transformations by Reinforcement Learning with Uncertain Human Guidancecited by 2
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrationscited by 2
- 2022Modeling Human Behavior Part II -- Cognitive approaches and Uncertaintycited by 1
- 2022Modeling Human Behavior Part I -- Learning and Belief Approachescited by 1
- 2022Contextualizing Artificially Intelligent Morality: A Meta-Ethnography of Top-Down, Bottom-Up, and Hybrid Models for Theoretical and Applied Ethics in Artificial Intelligencecited by 0
- 2023Optimal Transport for Correctional Learningcited by 0
- 2024Adaptive Querying for Reward Learning from Human Feedbackcited by 0
- 2025Robots and Children that Learn Together : Improving Knowledge Retention by Teaching Peer-Like Interactive Robotscited by 0
- 2026Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learningcited by 0
- 2026Inference-Time Policy Alignment for Fair Reinforcement Learningcited by 0
- 2026Inference-Time Policy Alignment for Fair Reinforcement Learning31 Jul 2026
- 2026Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learning8 Jul 2026
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrations29 Sep 2025
- 2025Complex Model Transformations by Reinforcement Learning with Uncertain Human Guidance25 Jun 2025
- 2025Robots and Children that Learn Together : Improving Knowledge Retention by Teaching Peer-Like Interactive Robots23 Jun 2025
- 2025Interactive Imitation Learning for Dexterous Robotic Manipulation: Challenges and Perspectives -- A Survey30 May 2025
- 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Future12 Apr 2025
- 2024Adaptive Querying for Reward Learning from Human Feedback11 Dec 2024
- 2024Towards Sample-Efficiency and Generalization of Transfer and Inverse Reinforcement Learning: A Comprehensive Literature Review15 Nov 2024
- 2024Opinion-Guided Reinforcement Learning27 May 2024
- 2024On Bits and Bandits: Quantifying the Regret-Information Trade-off26 May 2024
- 2023Hybrid Approaches for Moral Value Alignment in AI Agents: a Manifesto4 Dec 2023
11 more
- 2023Towards Human-Like RL: Taming Non-Naturalistic Behavior in Deep RL via Adaptive Behavioral Costs in 3D Games27 Sep 2023
- 2023Prompt Engineering for Healthcare: Methodologies and Applications28 Apr 2023
- 2023CROP: Towards Distributional-Shift Robust Reinforcement Learning using Compact Reshaped Observation Processing26 Apr 2023
- 2023Optimal Transport for Correctional Learning4 Apr 2023
- 2023Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learning12 Mar 2023
- 2023Perspectives on the Social Impacts of Reinforcement Learning with Human Feedback6 Mar 2023
- 2022Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation20 Jun 2022
- 2022Modeling Human Behavior Part I -- Learning and Belief Approaches13 May 2022
- 2022Modeling Human Behavior Part II -- Cognitive approaches and Uncertainty13 May 2022
- 2022Contextualizing Artificially Intelligent Morality: A Meta-Ethnography of Top-Down, Bottom-Up, and Hybrid Models for Theoretical and Applied Ethics in Artificial Intelligence15 Apr 2022
- 2021Towards Interactive Reinforcement Learning with Intrinsic Feedback2 Dec 2021
- 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Futurecited by 53
- 2023Perspectives on the Social Impacts of Reinforcement Learning with Human Feedbackcited by 15
- 2024Adaptive Querying for Reward Learning from Human Feedbackcited by 0
- 2026Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learningcited by 0
- 2026Feedback Manipulation Regularization: Enabling Offline Agent Alignment for Imitation Learning8 Jul 2026
- 2025A Comprehensive Survey of Reward Models: Taxonomy, Applications, Challenges, and Future12 Apr 2025
- 2024Adaptive Querying for Reward Learning from Human Feedback11 Dec 2024
- 2023Perspectives on the Social Impacts of Reinforcement Learning with Human Feedback6 Mar 2023
- 2023Prompt Engineering for Healthcare: Methodologies and Applicationscited by 52
- 2023Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learningcited by 9
- 2022Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigationcited by 3
- 2023CROP: Towards Distributional-Shift Robust Reinforcement Learning using Compact Reshaped Observation Processingcited by 3
- 2023Towards Human-Like RL: Taming Non-Naturalistic Behavior in Deep RL via Adaptive Behavioral Costs in 3D Gamescited by 3
- 2024On Bits and Bandits: Quantifying the Regret-Information Trade-offcited by 3
- 2024Opinion-Guided Reinforcement Learningcited by 3
- 2021Towards Interactive Reinforcement Learning with Intrinsic Feedbackcited by 2
- 2025Complex Model Transformations by Reinforcement Learning with Uncertain Human Guidancecited by 2
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrationscited by 2
- 2022Modeling Human Behavior Part II -- Cognitive approaches and Uncertaintycited by 1
- 2022Modeling Human Behavior Part I -- Learning and Belief Approachescited by 1
12 most cited of 16 All 16 (JSON)
- 2026Inference-Time Policy Alignment for Fair Reinforcement Learning31 Jul 2026
- 2025Interactive Program Synthesis for Modeling Collaborative Physical Activities from Narrated Demonstrations29 Sep 2025
- 2025Complex Model Transformations by Reinforcement Learning with Uncertain Human Guidance25 Jun 2025
- 2025Robots and Children that Learn Together : Improving Knowledge Retention by Teaching Peer-Like Interactive Robots23 Jun 2025
- 2024Opinion-Guided Reinforcement Learning27 May 2024
- 2024On Bits and Bandits: Quantifying the Regret-Information Trade-off26 May 2024
- 2023Towards Human-Like RL: Taming Non-Naturalistic Behavior in Deep RL via Adaptive Behavioral Costs in 3D Games27 Sep 2023
- 2023Prompt Engineering for Healthcare: Methodologies and Applications28 Apr 2023
- 2023CROP: Towards Distributional-Shift Robust Reinforcement Learning using Compact Reshaped Observation Processing26 Apr 2023
- 2023Optimal Transport for Correctional Learning4 Apr 2023
- 2023Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learning12 Mar 2023
- 2022Good Time to Ask: A Learning Framework for Asking for Help in Embodied Visual Navigation20 Jun 2022
12 newest of 16 All 16 (JSON)