mlsanityData to 14 Oct 2026

A Review on Organ Deformation Modeling Approaches for Reliable Surgical Navigation using Augmented Reality

arXiv 2408.02713 ↗First posted 5 Aug 2024physics.med-ph cs.AI cs.HCcited by 5

Not on the map. Why?

Abstract (arXiv)

Augmented Reality (AR) holds the potential to revolutionize surgical procedures by allowing surgeons to visualize critical structures within the patient's body. This is achieved through superimposing preoperative organ models onto the actual anatomy. Challenges arise from dynamic deformations of organs during surgery, making preoperative models inadequate for faithfully representing intraoperative anatomy. To enable reliable navigation in augmented surgery, modeling of intraoperative deformation to obtain an accurate alignment of the preoperative organ model with the intraoperative anatomy is indispensable. Despite the existence of various methods proposed to model intraoperative organ deformation, there are still few literature reviews that systematically categorize and summarize these approaches. This review aims to fill this gap by providing a comprehensive and technical-oriented overview of modeling methods for intraoperative organ deformation in augmented reality in surgery. Through a systematic search and screening process, 112 closely relevant papers were included in this review. By presenting the current status of organ deformation modeling methods and their clinical applications, this review seeks to enhance the understanding of organ deformation modeling in AR-guided surgery, and discuss the potential topics for future advancements.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 31 of its 193 references that are in the map. First posted on arXiv 5 Aug 2024.

Builds on

31 of 193 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2015Human Pose Estimation with Iterative Error Feedbackcited by 121
  6. 2022Colonoscopy 3D Video Dataset with Paired Depth from 2D-3D Registrationcited by 80
  7. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
  8. 2020Physics guided machine learning using simplified theoriescited by 23
  9. 2021PhysGNN: A Physics-Driven Graph Neural Network Based Model for Predicting Soft Tissue Deformation in Image-Guided Neurosurgerycited by 22
  10. 2019Learning Soft Tissue Behavior of Organs for Surgical Navigation with Convolutional Neural Networkscited by 19
  11. 2020Non-Rigid Volume to Surface Registration using a Data-Driven Biomechanical Modelcited by 17
  12. 2024An objective comparison of methods for augmented reality in laparoscopic liver resection by preoperative-to-intraoperative image fusioncited by 16
19 more
  1. 2020Learning Occupancy Function from Point Clouds for Surface Reconstructioncited by 13
  2. 2024Boundary Constraint-free Biomechanical Model-Based Surface Matching for Intraoperative Liver Deformation Correctioncited by 12
  3. 2020Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomycited by 11
  4. 2023Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgerycited by 11
  5. 2022Utility of Optical See-Through Head Mounted Displays in Augmented Reality-Assisted Surgery: A systematic reviewcited by 9
  6. 2023Non-rigid Medical Image Registration using Physics-informed Neural Networkscited by 8
  7. 2021IGCN: Image-to-graph Convolutional Network for 2D/3D Deformable Registrationcited by 6
  8. 2022The HoloLens in Medicine: A systematic Review and Taxonomycited by 6
  9. 2023Real-time simulation of viscoelastic tissue behavior with physics-guided deep learningcited by 6
  10. 2020Prostate motion modelling using biomechanically-trained deep neural networks on unstructured nodescited by 5
  11. 2022An Optimal Control Problem for Elastic Registration and Force Estimation in Augmented Surgerycited by 5
  12. 2023Comparing Regularized Kelvinlet Functions and the Finite Element Method for Registration of Medical Images to Sparse Organ Datacited by 4
  13. 2023Iterative PnP and its application in 3D-2D vascular image registration for robot navigationcited by 4
  14. 2024LIBR+: Improving Intraoperative Liver Registration by Learning the Residual of Biomechanics-Based Deformable Registrationcited by 4
  15. 2017A Real-time and Registration-free Framework for Dynamic Shape Instantiationcited by 3
  16. 2019Elastic registration based on compliance analysis and biomechanical graph matchingcited by 1
  17. 2021Kernel-based framework to estimate deformations of pneumothorax lung using relative position of anatomical landmarkscited by 1
  18. 2023Real-time elastic partial shape matching using a neural network-based adjoint methodcited by 1
  19. 2023A Dataset of Anatomical Environments for Medical Robots: Modeling Respiratory Deformationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

  1. 2025Toward Reliable AR-Guided Surgical Navigation: Interactive Deformation Modeling with Data-Driven Biomechanics and Promptscited by 3
  2. 2026DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registrationcited by 1
  3. 2026ARport: An Augmented Reality System for Markerless Image-Guided Port Placement in Robotic Surgerycited by 0
  4. 2026SurgFormer: Scalable Learning of Organ Deformation with Resection Support and Real-Time Inferencecited by 0
  5. 2026Evaluating Hybrid Quantum-Classical Models for Reduced-Order Brain Deformation Dynamicscited by 0