SurgFormer: Scalable Learning of Organ Deformation with Resection Support and Real-Time Inference
Not on the map. Why?
Abstract (arXiv)
We introduce SurgFormer, a multiresolution gated transformer for data driven soft tissue simulation on volumetric meshes. High fidelity biomechanical solvers are often too costly for interactive use, so we train SurgFormer on solver generated data to predict nodewise displacement fields at near real time rates. SurgFormer builds a fixed mesh hierarchy and applies repeated multibranch blocks that combine local message passing, coarse global self attention, and pointwise feedforward updates, fused by learned per node, per channel gates to adaptively integrate local and long range information while remaining scalable on large meshes. For cut conditioned simulation, resection information is encoded as a learned cut embedding and provided as an additional input, enabling a unified model for both standard deformation prediction and topology altering cases. We also introduce two surgical simulation datasets generated under a unified protocol with XFEM based supervision: a cholecystectomy resection dataset and an appendectomy manipulation and resection dataset with cut and uncut cases. To our knowledge, this is the first learned volumetric surrogate setting to study XFEM supervised cut conditioned deformation within the same volumetric pipeline as standard deformation prediction. Across diverse baselines, SurgFormer achieves strong accuracy with favorable efficiency, making it a practical backbone for both tasks. Code, data, and project page: hrefhttps://mint-vu.github.io/SurgFormer/available here
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 22 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
14 of 22 references.
References · 14
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
- 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 336
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2025Geometry Aware Operator Transformer as an Efficient and Accurate Neural Surrogate for PDEs on Arbitrary Domainscited by 62
- 2024Harnessing Scale and Physics: A Multi-Graph Neural Operator Framework for PDEs on Arbitrary Geometriescited by 16
- 2026MeshGraphNet-Transformer: Scalable Mesh-based Learned Simulation for Solid Mechanicscited by 10
- 2025Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learningcited by 7
- 2024A Review on Organ Deformation Modeling Approaches for Reliable Surgical Navigation using Augmented Realitycited by 5
Built on by
Not cited yet.