mlsanityData to 7 Oct 2026

Explainable Hierarchical Imitation Learning for Robotic Drink Pouring

arXiv 2105.07348 ↗First posted 16 May 2021cs.RO cs.AIcited by 11

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

Abstract (arXiv)

To accurately pour drinks into various containers is an essential skill for service robots. However, drink pouring is a dynamic process and difficult to model. Traditional deep imitation learning techniques for implementing autonomous robotic pouring have an inherent black-box effect and require a large amount of demonstration data for model training. To address these issues, an Explainable Hierarchical Imitation Learning (EHIL) method is proposed in this paper such that a robot can learn high-level general knowledge and execute low-level actions across multiple drink pouring scenarios. Moreover, with EHIL, a logical graph can be constructed for task execution, through which the decision-making process for action generation can be made explainable to users and the causes of failure can be traced out. Based on the logical graph, the framework is manipulable to achieve different targets while the adaptability to unseen scenarios can be achieved in an explainable manner. A series of experiments have been conducted to verify the effectiveness of the proposed method. Results indicate that EHIL outperforms the traditional behavior cloning method in terms of success rate, adaptability, manipulability and explainability.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 12 of its 38 references that are in the map. First posted on arXiv 16 May 2021.

Builds on

12 of 38 references.

References · 12

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2015End-to-End Training of Deep Visuomotor Policiescited by 847
  5. 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 286
  6. 2017Neural Task Programming: Learning to Generalize Across Hierarchical Taskscited by 75
  7. 2019Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safetycited by 48
  8. 2019Enhancing Explainability of Neural Networks through Architecture Constraintscited by 29
  9. 2016Visual Closed-Loop Control for Pouring Liquidscited by 26
  10. 2021Surgical Gesture Recognition Based on Bidirectional Multi-Layer Independently RNN with Explainable Spatial Feature Extractioncited by 5
  11. 2020Trust Considerations for Explainable Robots: A Human Factors Perspectivecited by 4
  12. 2016Feedback Motion Planning for Liquid Transfer using Supervised Learningcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 5; 2024: 4; 2025: 1.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2018One-Shot Hierarchical Imitation Learning of Compound Visuomotor Tasks
  2. 2026COFFAIL: A Dataset of Successful and Anomalous Robot Skill Executions in the Context of Coffee Preparation ↗
  3. 2024Adaptive Visual Imitation Learning for Robotic Assisted Feeding Across Varied Bowl Configurations and Food Types
  4. 2026Human-to-Robot Interaction: Learning from Video Demonstration for Robot Imitation
  5. 2020Scalable Multi-Task Imitation Learning with Autonomous Improvement
  6. 2024VITAL: Interactive Few-Shot Imitation Learning via Visual Human-in-the-Loop Corrections
  7. 2022VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors
  8. 2023HYDRA: Hybrid Robot Actions for Imitation Learning