Assistive Teaching of Motor Control Tasks to Humans
Not on the map. Why?
Abstract (arXiv)
Recent works on shared autonomy and assistive-AI technologies, such as assistive robot teleoperation, seek to model and help human users with limited ability in a fixed task. However, these approaches often fail to account for humans' ability to adapt and eventually learn how to execute a control task themselves. Furthermore, in applications where it may be desirable for a human to intervene, these methods may inhibit their ability to learn how to succeed with full self-control. In this paper, we focus on the problem of assistive teaching of motor control tasks such as parking a car or landing an aircraft. Despite their ubiquitous role in humans' daily activities and occupations, motor tasks are rarely taught in a uniform way due to their high complexity and variance. We propose an AI-assisted teaching algorithm that leverages skill discovery methods from reinforcement learning (RL) to (i) break down any motor control task into teachable skills, (ii) construct novel drill sequences, and (iii) individualize curricula to students with different capabilities. Through an extensive mix of synthetic and user studies on two motor control tasks -- parking a car with a joystick and writing characters from the Balinese alphabet -- we show that assisted teaching with skills improves student performance by around 40% compared to practicing full trajectories without skills, and practicing with individualized drills can result in up to 25% further improvement. Our source code is available at https://github.com/Stanford-ILIAD/teaching
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 18 of its 55 references that are in the map. First posted on arXiv 25 Nov 2022.
Builds on
18 of 55 references.
References · 18
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 734
- 2016The Option-Critic Architecturecited by 433
- 2015Deep Knowledge Tracingcited by 328
- 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 308
- 2016Variational Intrinsic Controlcited by 262
- 2017Stochastic Neural Networks for Hierarchical Reinforcement Learningcited by 124
- 2018Variational Option Discovery Algorithmscited by 121
- 2020Explore, Discover and Learn: Unsupervised Discovery of State-Covering Skillscited by 120
- 2017Meta Learning Shared Hierarchiescited by 93
- 2018Shared Autonomy via Deep Reinforcement Learningcited by 65
- 2017Shared Autonomy via Hindsight Optimization for Teleoperation and Teamingcited by 39
- 2020Shared Autonomy with Learned Latent Actionscited by 34
6 more
- 2018Teaching Categories to Human Learners with Visual Explanationscited by 30
- 2021LILA: Language-Informed Latent Actionscited by 27
- 2021Question Generation for Adaptive Educationcited by 22
- 2021Contrastive Reinforcement Learning of Symbolic Reasoning Domainscited by 17
- 2021Learning Latent Actions to Control Assistive Robotscited by 17
- 2020Assisted Perception: Optimizing Observations to Communicate Statecited by 10
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 1; 2026: 4.
8 papers.
- 2023Towards Modeling and Influencing the Dynamics of Human Learningcited by 11
- 2024Computational Teaching for Driving via Multi-Task Imitation Learningcited by 6
- 2023Generating Language Corrections for Teaching Physical Control Taskscited by 4
- 2025Shared Autonomy for Proximal Teachingcited by 4
- 2026CANINE: Coaching Visually Impaired Users for Interactive Navigation with a Robot Guide Dogcited by 1
- 2026Proximal State Nudging: Reducing Skill Atrophy from AI Assistancecited by 0
- 2026Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localizationcited by 0
- 2026Spatio-Temporal Retrieval-based Priors for Adaptive Computational Teaching in Drivingcited by 0
- 2026Spatio-Temporal Retrieval-based Priors for Adaptive Computational Teaching in Driving23 Jun 2026
- 2026Fix the Mind, Not the Move: Interpretable AI Assistance via Knowledge-Gap Localization4 Jun 2026
- 2026Proximal State Nudging: Reducing Skill Atrophy from AI Assistance19 May 2026
- 2026CANINE: Coaching Visually Impaired Users for Interactive Navigation with a Robot Guide Dog19 May 2026
- 2025Shared Autonomy for Proximal Teaching27 Feb 2025
- 2024Computational Teaching for Driving via Multi-Task Imitation Learning2 Oct 2024
- 2023Generating Language Corrections for Teaching Physical Control Tasks12 Jun 2023
- 2023Towards Modeling and Influencing the Dynamics of Human Learning2 Jan 2023