From Watch to Imagine: Steering Long-horizon Manipulation via Human Demonstration and Future Envisionment
Not on the map. Why?
Abstract (arXiv)
Generalizing to long-horizon manipulation tasks in a zero-shot setting remains a central challenge in robotics. Current multimodal foundation based approaches, despite their capabilities, typically fail to decompose high-level commands into executable action sequences from static visual input alone. To address this challenge, we introduce Super-Mimic, a hierarchical framework that enables zero-shot robotic imitation by directly inferring procedural intent from unscripted human demonstration videos. Our framework is composed of two sequential modules. First, a Human Intent Translator (HIT) parses the input video using multimodal reasoning to produce a sequence of language-grounded subtasks. These subtasks then condition a Future Dynamics Predictor (FDP), which employs a generative model that synthesizes a physically plausible video rollout for each step. The resulting visual trajectories are dynamics-aware, explicitly modeling crucial object interactions and contact points to guide the low-level controller. We validate this approach through extensive experiments on a suite of long-horizon manipulation tasks, where Super-Mimic significantly outperforms state-of-the-art zero-shot methods by over 20%. These results establish that coupling video-driven intent parsing with prospective dynamics modeling is a highly effective strategy for developing general-purpose robotic systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Sep 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Play
- 2026Triplet2Track: A Hierarchical System with Object-Centric Representations for Reliable Long-Horizon Manipulation
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
- 2025Long-Horizon Visual Imitation Learning via Plan and Code Reflection
- 2025OSVI-WM: One-Shot Visual Imitation for Unseen Tasks using World-Model-Guided Trajectory Generation
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment
- 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning