One-Shot Dual-Arm Imitation Learning
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
We introduce One-Shot Dual-Arm Imitation Learning (ODIL), which enables dual-arm robots to learn precise and coordinated everyday tasks from just a single demonstration of the task. ODIL uses a new three-stage visual servoing (3-VS) method for precise alignment between the end-effector and target object, after which replay of the demonstration trajectory is sufficient to perform the task. This is achieved without requiring prior task or object knowledge, or additional data collection and training following the single demonstration. Furthermore, we propose a new dual-arm coordination paradigm for learning dual-arm tasks from a single demonstration. ODIL was tested on a real-world dual-arm robot, demonstrating state-of-the-art performance across six precise and coordinated tasks in both 4-DoF and 6-DoF settings, and showing robustness in the presence of distractor objects and partial occlusions. Videos are available at: https://www.robot-learning.uk/one-shot-dual-arm.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 47 of its 63 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
47 of 63 references.
Closest ancestors · 16
Same direction, newest first
- 2024Instant Policy: In-Context Imitation Learning via Graph Diffusion19 Nov
- 2024MILES: Making Imitation Learning Easy with Self-Supervision25 Oct
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learning3 Jul
- 2024Keypoint Action Tokens Enable In-Context Imitation Learning in Robotics28 Mar
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation12 Mar
- 2024DINOBot: Robot Manipulation via Retrieval and Alignment with Vision Foundation Models20 Feb
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation4 Jan
- 2023Few-Shot In-Context Imitation Learning via Implicit Graph Alignment18 Oct
- 2023One-Shot Imitation Learning: A Pose Estimation Perspective18 Oct
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators22 Sep
- 2023One-shot Imitation Learning via Interaction Warping21 Jun
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware23 Apr
4 more
- 2022Demonstrate Once, Imitate Immediately (DOME): Learning Visual Servoing for One-Shot Imitation Learning6 Apr
- 2021Transformer-based deep imitation learning for dual-arm robot manipulation1 Aug
- 2021Coarse-to-Fine Imitation Learning: Robot Manipulation from a Single Demonstration13 May
- 2020Deep Imitation Learning for Bimanual Robotic Manipulation11 Oct
Other references · 31
- 2017Attention Is All You Needcited by 60,361
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 321
- 2023RoMa: Robust Dense Feature Matchingcited by 302
19 more
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
- 2017One-Shot Imitation Learningcited by 233
- 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 233
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 228
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2019MAGSAC++, a fast, reliable and accurate robust estimatorcited by 161
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 120
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2023RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitationcited by 90
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 89
- 2024GIM: Learning Generalizable Image Matcher From Internet Videoscited by 75
- 2024OmniGlue: Generalizable Feature Matching with Foundation Model Guidancecited by 56
- 2019Efficient Bimanual Manipulation Using Learned Task Schemascited by 45
- 2023Stabilize to Act: Learning to Coordinate for Bimanual Manipulationcited by 39
- 2020FlowControl: Optical Flow Based Visual Servoingcited by 16
- 2020KOVIS: Keypoint-based Visual Servoing with Zero-Shot Sim-to-Real Transfer for Robotics Manipulationcited by 16
- 2019Siamese Convolutional Neural Network for Sub-millimeter-accurate Camera Pose Estimation and Visual Servoingcited by 12
- 2023BiRP: Learning Robot Generalized Bimanual Coordination using Relative Parameterization Method on Human Demonstrationcited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2026Action-Geometry Prediction with 3D Geometric Prior for Bimanual Manipulationcited by 5
- 2026HeRO: Hierarchical 3D Semantic Representation for Pose-aware Object Manipulationcited by 3
- 2025Learning in ImaginationLand: Omnidirectional Policies through 3D Generative Models (OP-Gen)cited by 2
- 2025Observer-Actor: Active Vision Imitation Learning with Sparse-View Gaussian Splattingcited by 2
- 2026Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulationcited by 2
- 2025Annotation-Free One-Shot Imitation Learning for Multi-Step Manipulation Taskscited by 1
- 2026In-Context Learning for Robots: Methods and Applicationscited by 1
- 2026Easy-IIL: Reducing Human Operational Burden in Interactive Imitation Learning via Assistant Expertscited by 0
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
- 2026Instant-Fold: In-Context Imitation Learning for Deformable Object Manipulation2 Jun 2026
- 2026Easy-IIL: Reducing Human Operational Burden in Interactive Imitation Learning via Assistant Experts13 Mar 2026
- 2026Action-Geometry Prediction with 3D Geometric Prior for Bimanual Manipulation27 Feb 2026
- 2026HeRO: Hierarchical 3D Semantic Representation for Pose-aware Object Manipulation21 Feb 2026
- 2025Observer-Actor: Active Vision Imitation Learning with Sparse-View Gaussian Splatting22 Nov 2025
- 2025Annotation-Free One-Shot Imitation Learning for Multi-Step Manipulation Tasks29 Sep 2025
- 2025Learning in ImaginationLand: Omnidirectional Policies through 3D Generative Models (OP-Gen)7 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2021Towards More Generalizable One-shot Visual Imitation Learning
- 2020Learning Multi-Arm Manipulation Through Collaborative Teleoperation
- 2024DA-VIL: Adaptive Dual-Arm Manipulation with Reinforcement Learning and Variable Impedance Control
- 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation
- 2022Goal-conditioned dual-action imitation learning for dexterous dual-arm robot manipulation
- 2026Tri-Manual Visuomotor Imitation Learning of Robot Policies
- 2022From One Hand to Multiple Hands: Imitation Learning for Dexterous Manipulation from Single-Camera Teleoperation
- 2024Multi-task real-robot data with gaze attention for dual-arm fine manipulation