mlsanityData to 14 Oct 2026

Vis2Reg: Visibility-Aware Landmark-Free Geometric 3D--2D Registration for Liver Laparoscopy

arXiv 2607.17810 ↗First posted 20 Jul 2026cs.CV cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate 3D--2D liver registration, which aligns preoperative 3D models to partial, view-dependent intraoperative surface observations, is critical for AR-guided laparoscopic surgery but remains challenging due to severe occlusion, limited visibility, and the lack of 3D ground-truth supervision. Existing landmark-free approaches perform partial-to-complete geometric alignment, yet robust self-supervision under extreme partial visibility remains difficult. We propose Vis2Reg, a visibility-aware registration framework that explicitly constrains deformation using mask-consistent visible regions. We introduce a visibility-aware self-supervision that derives a visible-domain 3D supervision signal from intraoperative masks, enabled by differentiable point rasterization and mask-guided back-projection. This formulation improves robustness under severe occlusion while maintaining fully self-supervised learning. Vis2Reg combines a robust geometric rigid initialization module with an implicit neural deformation field for stable alignment. Vis2Reg achieves a Dice score of 92.6% and a Chamfer Distance of 1.43 mm on real intraoperative datasets, with 111 ms per-frame inference time, demonstrating both accuracy and practical efficiency.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 20 Jul 2026.

Builds on

9 of 27 references.

References · 9

  1. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  2. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  3. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  4. 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 290
  5. 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 84
  6. 2023Dynamic Point Fieldscited by 37
  7. 2024An objective comparison of methods for augmented reality in laparoscopic liver resection by preoperative-to-intraoperative image fusioncited by 16
  8. 2024Correspondence-Free Non-Rigid Point Set Registration Using Unsupervised Clustering Analysiscited by 10
  9. 2025Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resectioncited by 7

Built on by

Not cited yet.