Learning User-Preferred Mappings for Intuitive Robot Control
Not on the map. Why?
Abstract (arXiv)
When humans control drones, cars, and robots, we often have some preconceived notion of how our inputs should make the system behave. Existing approaches to teleoperation typically assume a one-size-fits-all approach, where the designers pre-define a mapping between human inputs and robot actions, and every user must adapt to this mapping over repeated interactions. Instead, we propose a personalized method for learning the human's preferred or preconceived mapping from a few robot queries. Given a robot controller, we identify an alignment model that transforms the human's inputs so that the controller's output matches their expectations. We make this approach data-efficient by recognizing that human mappings have strong priors: we expect the input space to be proportional, reversable, and consistent. Incorporating these priors ensures that the robot learns an intuitive mapping from few examples. We test our learning approach in robot manipulation tasks inspired by assistive settings, where each user has different personal preferences and physical capabilities for teleoperating the robot arm. Our simulated and experimental results suggest that learning the mapping between inputs and robot actions improves objective and subjective performance when compared to manually defined alignments or learned alignments without intuitive priors. The supplementary video showing these user studies can be found at: https://youtu.be/rKHka0_48-Q.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 0; 2023: 0; 2024: 1.
4 papers.
- 2021LILA: Language-Informed Latent Actionscited by 27
- 2021Learning Visually Guided Latent Actions for Assistive Teleoperationcited by 12
- 2021OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulationcited by 7
- 2024Conformalized Teleoperation: Confidently Mapping Human Inputs to High-Dimensional Robot Actionscited by 6
- 2024Conformalized Teleoperation: Confidently Mapping Human Inputs to High-Dimensional Robot Actions11 Jun 2024
- 2021LILA: Language-Informed Latent Actions5 Nov 2021
- 2021OSCAR: Data-Driven Operational Space Control for Adaptive and Robust Robot Manipulation2 Oct 2021
- 2021Learning Visually Guided Latent Actions for Assistive Teleoperation2 May 2021