mlsanityData to 7 Oct 2026

SurgWMBench: A Vision-Based Benchmark for World-Modeling Surgical Instrument Motion Planning

arXiv 2608.08070 ↗First posted 8 Aug 2026cs.ROcited by 1

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Reliable surgical planning requires models that move beyond recognizing the current surgical step or imitating expert demonstrations, and instead anticipate how instrument motion reshapes subsequent operative states. Most surgical video understanding methods focus on recognizing phases, actions, or workflow states, while providing limited support for explicitly modeling instrument motion. Conversely, existing tool motion prediction methods can forecast instrument trajectories, but they generally do not capture the coupled evolution of future surgical video states. World models offer a natural framework for jointly modeling visual state transitions and instrument motion dynamics. However, existing surgical world model studies remain largely centered on visual generation quality, relying on generation-oriented metrics such as FVD and CD-FVD. These metrics are poorly aligned with instrument motion planning, as they do not directly measure whether predicted trajectories are geometrically accurate, temporally coherent, or actionable for downstream planning. This limitation is partly structural, since the field lacks public datasets and standardized evaluation protocols that provide the benchmarking infrastructure needed to assess motion-centric capabilities in surgical world models. In this paper, we introduce SurgWMBench, a vision-based benchmark for short-horizon surgical motion planning and dynamics prediction. Given intraoperative image sequences and historical instrument trajectory, SurgWMBench evaluates both near-future instrument motion prediction and stability under continuous rollout or input perturbations.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 8 of its 30 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

8 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation13 Mar
  2. 2025Cosmos-H-Surgical: Learning Surgical Robot Policies from Videos via World Modeling29 Dec

Other references · 6

  1. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  2. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 651
  3. 2023SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy Challengecited by 54
  4. 2024Surgical Robot Transformer (SRT): Imitation Learning for Surgical Taskscited by 38
  5. 2022Data Splits and Metrics for Method Benchmarking on Surgical Action Triplet Datasetscited by 23
  6. 2026SutureFormer: Learning Surgical Trajectories via Goal-conditioned Offline RL in Pixel Spacecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics
  2. 2025How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment
  3. 2026Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts
  4. 2026Surgical Video Generation From Diffusion to World Models: A Survey
  5. 2026Surgical WAM: A World-Action Model for Data-Efficient Surgical Robot Learning
  6. 2025SG2VID: Scene Graphs Enable Fine-Grained Control for Video Synthesis
  7. 2025Towards Suturing World Models: Learning Predictive Models for Robotic Surgical Tasks
  8. 2026SurgVLA-Bench: Towards Evaluating Vision-Language-Action Models for Laparoscopic Surgical Robotics