mlsanityData to 7 Oct 2026

Bi-HIL: Bilateral Control-Based Multimodal Hierarchical Imitation Learning via Subtask-Level Progress Rate and Keyframe Memory for Long-Horizon Contact-Rich Robotic Manipulation

arXiv 2603.13315 ↗First posted 4 Mar 2026cs.ROcited by 2

On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning

Abstract (arXiv)

Long-horizon contact-rich robotic manipulation remains challenging due to partial observability and unstable subtask transitions under contact uncertainty. While hierarchical architectures improve temporal reasoning and bilateral imitation learning enables force-aware control, existing approaches often rely on flat policies that struggle with long-horizon coordination. We propose Bi-HIL, a bilateral control-based multimodal hierarchical imitation learning framework for long-horizon manipulation. Bi-HIL stabilizes hierarchical coordination by integrating keyframe memory with subtask-level progress rate that models phase progression within the active subtask and conditions both high- and low-level policies. We evaluate Bi-HIL on unimanual and bimanual real-robot tasks, demonstrating consistent improvements over flat and ablated variants. The results highlight the importance of explicitly modeling subtask progression together with force-aware control for robust long-horizon manipulation. For additional material, please check: https://mertcookimg.github.io/bi-hil

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 25 of its 30 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

25 of 30 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026BPP: Long-Context Robot Imitation Learning by Focusing on Key History Frames16 Feb
  2. 2025A Survey on Imitation Learning for Contact-Rich Tasks in Robotics16 Jun
  3. 2025Bi-LAT: Bilateral Control-Based Imitation Learning via Natural Language and Action Chunking with Transformers2 Apr
  4. 2024DABI: Evaluation of Data Augmentation Methods Using Downsampling in Bilateral Control-Based Imitation Learning with Images6 Oct
  5. 2024Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformer31 Jan
  6. 2024ILBiT: Imitation Learning for Robot Using Position and Torque Information based on Bilateral Control with Transformer30 Jan
  7. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation4 Jan
  8. 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators22 Sep
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
  10. 2022An Independently Learnable Hierarchical Model for Bilateral Control-Based Imitation Learning Applications16 Mar
  11. 2021Imitation Learning for Variable Speed Contact Motion for Operation up to Control Bandwidth20 Feb

Other references · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithmscited by 136
  3. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
  4. 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
  5. 2024Vision Language Models are In-Context Value Learnerscited by 84
  6. 2024FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learningcited by 79
  7. 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 64
  8. 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 61
  9. 2025SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulationcited by 36
  10. 2026TOPReward: Token Probabilities as Hidden Zero-Shot Rewards for Roboticscited by 29
  11. 2018Imitation Learning for Object Manipulation Based on Position/Force Information Using Bilateral Controlcited by 21
  12. 2024PROGRESSOR: A Perceptually Guided Reward Estimator with Self-Supervised Online Refinementcited by 11
2 more
  1. 2019Time Series Motion Generation Considering Long Short-Term Motioncited by 10
  2. 2025Bi-VLA: Bilateral Control-Based Imitation Learning via Vision-Language Fusion for Action Generationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024BiKC: Keypose-Conditioned Consistency Policy for Bimanual Robotic Manipulation
  2. 2026BiKC+: Bimanual Hierarchical Imitation with Keypose-Conditioned Coordination-Aware Consistency Policies
  3. 2025SPECI: Skill Prompts based Hierarchical Continual Imitation Learning for Robot Manipulation
  4. 2026Beyond Flat Policies: Hierarchical Post-Training for Embodied Agents in Robotic Manipulation
  5. 2026Dual-Process Atomic Skill Learning: Decoupling Semantic Reasoning and Real-Time Control
  6. 2021Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulation
  7. 2023Hierarchical Visual Policy Learning for Long-Horizon Robot Manipulation in Densely Cluttered Scenes
  8. 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment