Context-Based Echo State Networks with Prediction Confidence for Human-Robot Shared Control
On the map: Offline RL and imitation learning from data → Robot learning from demonstration
Abstract (arXiv)
In this paper, we propose a novel lightweight learning from demonstration (LfD) model based on reservoir computing that can learn and generate multiple movement trajectories with prediction intervals, which we call as Context-based Echo State Network with prediction confidence (CESN+). CESN+ can generate movement trajectories that may go beyond the initial LfD training based on a desired set of conditions while providing confidence on its generated output. To assess the abilities of CESN+, we first evaluate its performance against Conditional Neural Movement Primitives (CNMP), a comparable framework that uses a conditional neural process to generate movement primitives. Our findings indicate that CESN+ not only outperforms CNMP but is also faster to train and demonstrates impressive performance in generating trajectories for extrapolation cases. In human-robot shared control applications, the confidence of the machine generated trajectory is a key indicator of how to arbitrate control sharing. To show the usability of the CESN+ for human-robot adaptive shared control, we have designed a proof-of-concept human-robot shared control task and tested its efficacy in adapting the sharing weight between the human and the robot by comparing it to a fixed-weight control scheme. The simulation experiments show that with CESN+ based adaptive sharing the total human load in shared control can be significantly reduced. Overall, the developed CESN+ model is a strong lightweight LfD system with desirable properties such fast training and ability to extrapolate to the new task parameters while producing robust prediction intervals for its output.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Robot learning from demonstration, one of 13 directions in Offline RL and imitation learning from data. Builds on 17 of its 44 references that are in the map. First posted on arXiv 30 Nov 2024.
Builds on
17 of 44 references.
References · 17
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
- 2021A Survey of Uncertainty in Deep Neural Networkscited by 675
- 2018Conditional Neural Processescited by 421
- 2019Deep Evidential Regressioncited by 354
- 2018Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networkscited by 278
- 2018When Gaussian Process Meets Big Data: A Review of Scalable GPscited by 205
- 2020Bayesian Neural Networks: An Introduction and Surveycited by 130
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
- 2021DEUP: Direct Epistemic Uncertainty Predictioncited by 102
- 2017Deep representation learning for human motion prediction and classificationcited by 97
- 2022Partially Observable Markov Decision Processes in Robotics: A Surveycited by 81
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
5 more
- 2018Classification Uncertainty of Deep Neural Networks Based on Gradient Informationcited by 43
- 2023Autoregressive Conditional Neural Processescited by 32
- 2018Probabilistically Safe Robot Planning with Confidence-Based Human Predictionscited by 27
- 2019Epistemic Uncertainty Samplingcited by 24
- 2021Safety Assurances for Human-Robot Interaction via Confidence-aware Game-theoretic Human Modelscited by 21
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Modulating Reservoir Dynamics via Reinforcement Learning for Efficient Robot Skill Synthesis
- 2024Learning from Demonstration with Implicit Nonlinear Dynamics Models
- 2020ACNMP: Skill Transfer and Task Extrapolation through Learning from Demonstration and Reinforcement Learning via Representation Sharing
- 2022Human-Robot Shared Control for Surgical Robot Based on Context-Aware Sim-to-Real Adaptation
- 2025Dynamics and Computational Principles of Echo State Networks: A Mathematical Perspective
- 2025Echo State Networks as State-Space Models: A Systems Perspective
- 2025Echo: An Open-Source, Low-Cost Teleoperation System with Force Feedback for Dataset Collection in Robot Learning
- 2025UF-RNN: Real-Time Adaptive Motion Generation Using Uncertainty-Driven Foresight Prediction