Occupancy Network-Guided Autonomous Robotic Partial Nephrectomy
Not on the map. Why?
Abstract (arXiv)
Autonomous soft-tissue cancer surgery has been limited to interventions on organ surfaces, because current systems cannot perceive and adapt to anatomy once it deforms or is cut. We introduce the first vision-guided autonomous system capable of performing complete tumor resections for partial nephrectomy. Our system integrates conditional occupancy networks, trained entirely in a physics-based simulation, that infer full 3-D anatomy (tumor, margin tissue, and kidney) from single-view partial point clouds. These occupancy networks maintain intraoperative tracking even as tissue is cut and deformed, enabling adaptive planning and execution. The surgical platform combines a depth camera for capturing surface point clouds, dual robotic arms for electrosurgical cutting and vacuum-based tissue manipulation, and an autonomous control strategy for tumor resection. In patient-derived hydrogel phantoms under an open partial nephrectomy setting, the robot performed eight consecutive autonomous tumor resections comprising 77 electrosurgical cuts, with all cuts achieving negative surgical margins and 1.61 ± 0.48 mm mean absolute margin error. This work demonstrates, for the first time, a foundation for supervised autonomous closed-loop, imaging-driven, margin-negative tumor removal in phantoms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 65 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
18 of 65 references.
References · 18
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
- 2016Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registrationcited by 159
- 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 124
- 2021DiSECt: A Differentiable Simulation Engine for Autonomous Robotic Cuttingcited by 64
- 2024Sim-To-Real Transfer for Visual Reinforcement Learning of Deformable Object Manipulation for Robot-Assisted Surgerycited by 26
- 2025SRT-H: A Hierarchical Framework for Autonomous Surgery via Language Conditioned Imitation Learningcited by 26
- 2021Learning from Demonstrations for Autonomous Soft-tissue Retractioncited by 18
- 2020Non-Rigid Volume to Surface Registration using a Data-Driven Biomechanical Modelcited by 17
- 2025From Monocular Vision to Autonomous Action: Guiding Tumor Resection via 3D Reconstructioncited by 10
- 2023Registered and Segmented Deformable Object Reconstruction from a Single View Point Cloudcited by 6
- 2024LOOC: Localizing Organs using Occupancy Networks and Body Surface Depth Imagescited by 5
6 more
- 2024LUDO: Low-Latency Understanding of Deformable Objects using Point Cloud Occupancy Functionscited by 4
- 2025Autonomous Vision-Guided Resection of Central Airway Obstructioncited by 4
- 2024Tracking Tumors under Deformation from Partial Point Clouds using Occupancy Networkscited by 3
- 2023Multi-tap Resistive Sensing and FEM Modeling enables Shape and Force Estimation in Soft Robotscited by 2
- 2025CRESSim-MPM: A Material Point Method Library for Surgical Soft Body Simulation with Cutting and Suturingcited by 1
- 2025Towards Fluorescence-Guided Autonomous Robotic Partial Nephrectomy on Novel Tissue-Mimicking Hydrogel Phantomscited by 1
Built on by
Not cited yet.