mlsanityData to 14 Oct 2026

From Watch to Imagine: Steering Long-horizon Manipulation via Human Demonstration and Future Envisionment

arXiv 2509.22205 ↗First posted 26 Sep 2025cs.ROcited by 2

Not on the map. Why?

Abstract (arXiv)

Generalizing to long-horizon manipulation tasks in a zero-shot setting remains a central challenge in robotics. Current multimodal foundation based approaches, despite their capabilities, typically fail to decompose high-level commands into executable action sequences from static visual input alone. To address this challenge, we introduce Super-Mimic, a hierarchical framework that enables zero-shot robotic imitation by directly inferring procedural intent from unscripted human demonstration videos. Our framework is composed of two sequential modules. First, a Human Intent Translator (HIT) parses the input video using multimodal reasoning to produce a sequence of language-grounded subtasks. These subtasks then condition a Future Dynamics Predictor (FDP), which employs a generative model that synthesizes a physically plausible video rollout for each step. The resulting visual trajectories are dynamics-aware, explicitly modeling crucial object interactions and contact points to guide the low-level controller. We validate this approach through extensive experiments on a suite of long-horizon manipulation tasks, where Super-Mimic significantly outperforms state-of-the-art zero-shot methods by over 20%. These results establish that coupling video-driven intent parsing with prospective dynamics modeling is a highly effective strategy for developing general-purpose robotic systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Sep 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ManiLong-Shot: Interaction-Aware One-Shot Imitation Learning for Long-Horizon Manipulation
  2. 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Play
  3. 2026Triplet2Track: A Hierarchical System with Object-Centric Representations for Reliable Long-Horizon Manipulation
  4. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAs
  5. 2025Long-Horizon Visual Imitation Learning via Plan and Code Reflection
  6. 2025OSVI-WM: One-Shot Visual Imitation for Unseen Tasks using World-Model-Guided Trajectory Generation
  7. 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment
  8. 2026NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning