ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation
On the map: Offline RL and imitation learning from data → Robot manipulation imitation learning
Abstract (arXiv)
One-shot imitation learning (OSIL) offers a promising way to teach robots new skills without large-scale data collection. However, current OSIL methods are primarily limited to short-horizon tasks, thus limiting their applicability to complex, long-horizon manipulations. To address this limitation, we propose ManiLong-Shot, a novel framework that enables effective OSIL for long-horizon prehensile manipulation tasks. ManiLong-Shot structures long-horizon tasks around physical interaction events, reframing the problem as sequencing interaction-aware primitives instead of directly imitating continuous trajectories. This primitive decomposition can be driven by high-level reasoning from a vision-language model (VLM) or by rule-based heuristics derived from robot state changes. For each primitive, ManiLong-Shot predicts invariant regions critical to the interaction, establishes correspondences between the demonstration and the current observation, and computes the target end-effector pose, enabling effective task execution. Extensive simulation experiments show that ManiLong-Shot, trained on only 10 short-horizon tasks, generalizes to 20 unseen long-horizon tasks across three difficulty levels via one-shot imitation, achieving a 22.8% relative improvement over the SOTA. Additionally, real-robot experiments validate ManiLong-Shot's ability to robustly execute three long-horizon manipulation tasks via OSIL, confirming its practical applicability.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Robot manipulation imitation learning, one of 13 directions in Offline RL and imitation learning from data. Builds on 41 of its 51 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
41 of 51 references.
Closest ancestors · 9
Same direction, newest first
- 2025DeCo: Task Decomposition and Skill Composition for Zero-Shot Generalization in Long-Horizon 3D Manipulation1 May
- 2024Instant Policy: In-Context Imitation Learning via Graph Diffusion19 Nov
- 2024Keypoint Abstraction using Large Models for Object-Relative Imitation Learning30 Oct
- 2024GravMAD: Grounded Spatial Value Maps Guided Action Diffusion for Generalized 3D Manipulation30 Sep
- 2024One-Shot Imitation Learning with Invariance Matching for Robotic Manipulation21 May
- 2022Graph Inverse Reinforcement Learning from Diverse Videos28 Jul
- 2022Demonstrate Once, Imitate Immediately (DOME): Learning Visual Servoing for One-Shot Imitation Learning6 Apr
- 2021Towards More Generalizable One-shot Visual Imitation Learning26 Oct
- 2019Learning One-Shot Imitation from Humans without Humans4 Nov
Other references · 32
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2023A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondencecited by 301
- 2017One-Shot Imitation Learningcited by 233
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 228
- 2021Geometric and Physical Quantities Improve E(3) Equivariant Message Passingcited by 228
- 2018One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learningcited by 148
- 2022Prompting Decision Transformer for Few-Shot Policy Generalizationcited by 146
- 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 142
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 122
20 more
- 2014Reducing the Barrier to Entry of Complex Robotic Software: a MoveIt! Case Studycited by 89
- 2021Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulationcited by 85
- 2021Lepard: Learning partial point cloud matching in rigid and deformable scenescited by 85
- 2022You Only Demonstrate Once: Category-Level Manipulation from Single Visual Demonstrationcited by 81
- 2020On the Benefits of Invariance in Neural Networkscited by 79
- 2021Accelerating Robotic Reinforcement Learning via Parameterized Action Primitivescited by 65
- 2015Reinforcement Learning with Parameterized Actionscited by 63
- 2018Neural Task Graphs: Generalizing to Unseen Tasks from a Single Video Demonstrationcited by 61
- 2021CaTGrasp: Learning Category-Level Task-Relevant Grasping in Clutter from Simulationcited by 49
- 2024FLIP: Flow-Centric Generative Planning as General-Purpose Manipulation World Modelcited by 42
- 2024Autoregressive Action Sequence Learning for Robotic Manipulationcited by 27
- 2024Trust the PRoC3S: Solving Long-Horizon Robotics Problems with LLMs and Constraint Satisfactioncited by 19
- 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulationcited by 19
- 2024Policy Adaptation via Language Optimization: Decomposing Tasks for Few-Shot Imitationcited by 18
- 2024One-Shot Transfer of Long-Horizon Extrinsic Manipulation Through Contact Retargetingcited by 9
- 2025LaViRA: Language-Vision-Robot Actions Translation for Zero-Shot Vision Language Navigation in Continuous Environmentscited by 9
- 2022TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instancecited by 8
- 2022Learning Dense Visual Descriptors using Image Augmentations for Robot Manipulation Taskscited by 7
- 2025RoboHiMan: A Hierarchical Evaluation Paradigm for Compositional Generalization in Long-Horizon Manipulationcited by 6
- 2025AdaptPNP: Integrating Prehensile and Non-Prehensile Skills for Adaptive Robotic Manipulationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Watch to Imagine: Steering Long-horizon Manipulation via Human Demonstration and Future Envisionment
- 2021Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulation
- 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning
- 2026Beyond the Majority: Long-tail Imitation Learning for Robotic Manipulation
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Play
- 2025Long-Horizon Visual Imitation Learning via Plan and Code Reflection
- 2020Modeling Long-horizon Tasks as Sequential Interaction Landscapes
- 2026POIL: Point-based One-Shot Imitation Learning with Stable Dynamical Systems