mlsanityData to 7 Oct 2026

S2-HWM: Sparse Event-Structured Hierarchical World Model for Long-Horizon Surgical Robot Manipulation

arXiv 2608.13103 ↗First posted 13 Aug 2026cs.RO cs.SY eess.SYcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Long-horizon surgical robot manipulation is challenging because task rewards are sparse, while meaningful interaction changes occur at irregular intervals. Existing world-model agents typically imagine at primitive-step resolution, leaving variable-duration task progress implicit. Manually specified stages can provide intermediate structure, but their task specific boundaries are difficult to align with state-dependent interaction transitions. We propose S2-HWM, a Sparse Event-Structured Hierarchical World Model that learns sparse event evidence from primitive latent trajectories to coordinate an event-level manager and a primitive-step worker. The event evidence schedules manager goal updates, and each selected latent goal conditions the worker's primitive actions until the next update. The learned event evidence also forms variable-duration segments for an Event Transition Model (ETM), which predicts the next?boundary stochastic state, segment duration, and accumulated segment reward. Chaining these event-level predictions provides a variable-duration continuation beyond the primitive imagination horizon for manager learning, while the worker retains primitive-step actor-critic learning. On a SurRoL-based PegTransfer task, S2-HWM achieves a success rate of 98.7%, outperforming the flat GAS DreamerV3 baseline by 22.7 percentage points.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 3 of its 21 references that are in the map. First posted on arXiv 13 Aug 2026.

Builds on

3 of 21 references.

References · 3

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2023Mastering Diverse Domains through World Modelscited by 1,193
  3. 2024Efficient Physically-based Simulation of Soft Bodies in Embodied Environment for Surgical Robotcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Phase-and-First-Arrival VLM Feedback for Sparse-Reward Reinforcement Learning in Surgical Manipulation ↗
  2. 2026HiMem-WAM: Hierarchical Memory-Gated World Action Models for Robotic Manipulation
  3. 2026Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning
  4. 2026StageWAM: Joint-Embedding Stage Prediction for World-Action Models in Robot Manipulation
  5. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  6. 2026EV-WM: Event-Verified World Models for Long-Horizon Robotic Manipulation
  7. 2026DIM-WAM: World-Action Modeling with Diverse Historical Event Memory
  8. 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory