mlsanityData to 14 Oct 2026

RoboDreamer: Anticipatory Humanoid Locomotion with Predictive State-Space Models

arXiv 2609.07096 ↗First posted 7 Sep 2026cs.ROcited by 0

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

Abstract (arXiv)

Humanoid locomotion requires control policies that remain stable under imperfect sensing while exploiting temporal context for consistent motion. We present RoboDreamer, a two-stage teacher--student framework that combines next-observation consistency with randomized continuous temporal masking. A teacher is first trained on clean observations, and a student is then distilled under masked recent observations, encouraging the policy to infer missing current information from history. At inference, the same masking interface is reused for implicit closed-loop action refinement and optional multi-step action chunking. Mamba is used as the temporal backbone, while matched ablations show that masking/distillation provides a substantial part of the gain and Mamba contributes additional tracking improvements with real-time latency. Experiments in IsaacLab, MuJoCo, and on a Unitree G1 demonstrate robust motion tracking under observation masking and successful real-world deployment.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). First posted on arXiv 7 Sep 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation
  2. 2026Heracles: Bridging Precise Tracking and Generative Synthesis for General Humanoid Control
  3. 2025Think on your feet: Seamless Transition between Human-like Locomotion in Response to Changing Commands
  4. 2026VioLA: Learning Generalist Humanoid Control Policies from Human Data
  5. 2026Learning Reusable Hybrid Motion Priors for Humanoid Locomotion from Motion Imitation
  6. 2026Predictive Style Matching: Natural and Robust Humanoid Locomotion
  7. 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking
  8. 2026ω-0: A Latent Predictive World Action Model for Concurrent Humanoid Loco-Manipulation