mlsanityData to 14 Oct 2026

Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts

arXiv 2608.06770 ↗First posted 7 Aug 2026cs.AI cs.CVcited by 0

On the map: World models → Medical and surgical world models

Abstract (arXiv)

Controllable surgical world models can provide a generative foundation for surgical artificial intelligence and simulation by synthesizing realistic instrument--tissue interactions. However, existing methods lack a unified multimodal control paradigm, while direct fusion of heterogeneous visual conditions often causes anatomical distortion, instrument appearance drift, and temporally inconsistent interactions. In this work, we propose {Surg-UniWorld}, a unified surgical world model with multimodal control experts. Surg-UniWorld first constructs a {Hierarchical Surgical Anchor} from first-frame appearance and hierarchical semantic masks to preserve persistent scene identity, anatomical organization, and interaction boundaries. {Anchor-Relative Modality Experts} then interpret edge, depth, and optical-flow evidence relative to the shared anchor, capturing complementary boundary, geometric, and motion information. A {Multimodal Control Expert} further performs contribution-preserving stage-wise composition of the activated modality increments and generates control hints for the Wan2.2 video diffusion backbone. To support multimodal surgical world modeling, we further construct Cholec80-SurgWAM, a benchmark for controllable surgical video generation. Extensive experiments demonstrate that Surg-UniWorld consistently outperforms existing controllable video generation methods and surgical world-model baselines in generation quality, temporal consistency, and multimodal controllability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and surgical world models, one of 11 directions in World models. Builds on 22 of its 22 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

22 of 22 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026SAW: Toward a Surgical Action World Model via Controllable and Scalable Video Generation13 Mar
  2. 2025Cosmos-H-Surgical: Learning Surgical Robot Policies from Videos via World Modeling29 Dec
  3. 2025How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment3 Nov
  4. 2025Surgical Vision World Model3 Mar

Other references · 18

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  6. 2015Holistically-Nested Edge Detectioncited by 592
  7. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  8. 2025VACE: All-in-One Video Creation and Editingcited by 479
  9. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  10. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 106
  11. 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
  12. 2025WAFT: Warping-Alone Field Transforms for Optical Flowcited by 34
6 more
  1. 2024Sim-To-Real Transfer for Visual Reinforcement Learning of Deformable Object Manipulation for Robot-Assisted Surgerycited by 26
  2. 2024SurGen: Text-Guided Diffusion Model for Surgical Video Generationcited by 20
  3. 2024SurgSora: Object-Aware Diffusion Model for Controllable Surgical Video Generationcited by 15
  4. 2021Future Frame Prediction for Robot-assisted Surgerycited by 11
  5. 2025Ophora: A Large-Scale Data-Driven Text-Guided Ophthalmic Surgical Video Generation Modelcited by 10
  6. 2025HieraSurg: Hierarchy-Aware Diffusion Model for Surgical Video Generationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics
  2. 2025SG2VID: Scene Graphs Enable Fine-Grained Control for Video Synthesis
  3. 2026SurgWMBench: A Vision-Based Benchmark for World-Modeling Surgical Instrument Motion Planning
  4. 2025SurGrID: Controllable Surgical Simulation via Scene Graph to Image Diffusion
  5. 2026SurgCast: Action-Conditioned Future Skeletons for Controllable Surgical World Models
  6. 2025SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence
  7. 2026SWoMo: Neuro-Symbolic World Model for Cataract Surgery Simulation
  8. 2026Towards Surgical World-Action Modeling: A Preliminary Joint Visual-Trajectory Forecasting for Surgical Motion Planning