RoboDreamer: Anticipatory Humanoid Locomotion with Predictive State-Space Models
On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models
Abstract (arXiv)
Humanoid locomotion requires control policies that remain stable under imperfect sensing while exploiting temporal context for consistent motion. We present RoboDreamer, a two-stage teacher--student framework that combines next-observation consistency with randomized continuous temporal masking. A teacher is first trained on clean observations, and a student is then distilled under masked recent observations, encouraging the policy to infer missing current information from history. At inference, the same masking interface is reused for implicit closed-loop action refinement and optional multi-step action chunking. Mamba is used as the temporal backbone, while matched ablations show that masking/distillation provides a substantial part of the gain and Mamba contributes additional tracking improvements with real-time latency. Experiments in IsaacLab, MuJoCo, and on a Unitree G1 demonstrate robust motion tracking under observation masking and successful real-world deployment.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). First posted on arXiv 7 Sep 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation
- 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control
- 2025Think on your feet: Seamless Transition between Human-like Locomotion in Response to Changing Commands
- 2026VioLA: Learning Generalist Humanoid Control Policies from Human Data
- 2026Learning Reusable Hybrid Motion Priors for Humanoid Locomotion from Motion Imitation
- 2026Predictive Style Matching: Natural and Robust Humanoid Locomotion
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking
- 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation