Explainable Hierarchical Imitation Learning for Robotic Drink Pouring
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
To accurately pour drinks into various containers is an essential skill for service robots. However, drink pouring is a dynamic process and difficult to model. Traditional deep imitation learning techniques for implementing autonomous robotic pouring have an inherent black-box effect and require a large amount of demonstration data for model training. To address these issues, an Explainable Hierarchical Imitation Learning (EHIL) method is proposed in this paper such that a robot can learn high-level general knowledge and execute low-level actions across multiple drink pouring scenarios. Moreover, with EHIL, a logical graph can be constructed for task execution, through which the decision-making process for action generation can be made explainable to users and the causes of failure can be traced out. Based on the logical graph, the framework is manipulable to achieve different targets while the adaptability to unseen scenarios can be achieved in an explainable manner. A series of experiments have been conducted to verify the effectiveness of the proposed method. Results indicate that EHIL outperforms the traditional behavior cloning method in terms of success rate, adaptability, manipulability and explainability.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 12 of its 38 references that are in the map. First posted on arXiv 16 May 2021.
Builds on
12 of 38 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2015End-to-End Training of Deep Visuomotor Policiescited by 847
- 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 286
- 2017Neural Task Programming: Learning to Generalize Across Hierarchical Taskscited by 75
- 2019Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safetycited by 48
- 2019Enhancing Explainability of Neural Networks through Architecture Constraintscited by 29
- 2016Visual Closed-Loop Control for Pouring Liquidscited by 26
- 2021Surgical Gesture Recognition Based on Bidirectional Multi-Layer Independently RNN with Explainable Spatial Feature Extractioncited by 5
- 2020Trust Considerations for Explainable Robots: A Human Factors Perspectivecited by 4
- 2016Feedback Motion Planning for Liquid Transfer using Supervised Learningcited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 5; 2024: 4; 2025: 1.
11 papers.
- 2024Play to the Score: Stage-Guided Dynamic Multi-Sensory Fusion for Robotic Manipulationcited by 19
- 2023Hierarchical Imitation Learning with Vector Quantized Modelscited by 15
- 2025SPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulationcited by 9
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learningcited by 5
- 2023Cloud-Based Hierarchical Imitation Learning for Scalable Transfer of Construction Skills from Human Workers to Assisting Robotscited by 2
- 2023Explaining Imitation Learning through Framescited by 1
- 2023Symbolic Imitation Learning: From Black-Box to Explainable Driving Policiescited by 1
- 2024Enabling robots to follow abstract instructions and complete complex dynamic taskscited by 1
- 2023CasIL: Cognizing and Imitating Skills via a Dual Cognition-Action Architecturecited by 0
- 2024Offline Imitation of Badminton Player Behavior via Experiential Contexts and Brownian Motioncited by 0
- 2024Interpretable Robotic Manipulation from Languagecited by 0
- 2025SPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulation22 Apr 2025
- 2024Play to the Score: Stage-Guided Dynamic Multi-Sensory Fusion for Robotic Manipulation2 Aug 2024
- 2024Enabling robots to follow abstract instructions and complete complex dynamic tasks17 Jun 2024
- 2024Interpretable Robotic Manipulation from Language27 May 2024
- 2024Offline Imitation of Badminton Player Behavior via Experiential Contexts and Brownian Motion19 Mar 2024
- 2023CasIL: Cognizing and Imitating Skills via a Dual Cognition-Action Architecture28 Sep 2023
- 2023Symbolic Imitation Learning: From Black-Box to Explainable Driving Policies27 Sep 2023
- 2023Cloud-Based Hierarchical Imitation Learning for Scalable Transfer of Construction Skills from Human Workers to Assisting Robots20 Sep 2023
- 2023Hierarchical Imitation Learning with Vector Quantized Models30 Jan 2023
- 2023Explaining Imitation Learning through Frames3 Jan 2023
- 2022One-Shot Domain-Adaptive Imitation Learning via Progressive Learning24 Apr 2022
Similar, not cited
Close in wording, no citation either way
- 2018One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks
- 2026COFFAIL: A Dataset of Successful and Anomalous Robot Skill Executions in the Context of Coffee Preparation ↗
- 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Types
- 2026Human-to-Robot Interaction: Learning from Video Demonstration for Robot Imitation
- 2020Scalable Multi-Task Imitation Learning with Autonomous Improvement
- 2024VITAL: Interactive Few-Shot Imitation Learning via Visual Human-in-the-Loop Corrections
- 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors
- 2023HYDRA: Hybrid Robot Actions for Imitation Learning