Vis2Reg: Visibility-Aware Landmark-Free Geometric 3D--2D Registration for Liver Laparoscopy
Not on the map. Why?
Abstract (arXiv)
Accurate 3D--2D liver registration, which aligns preoperative 3D models to partial, view-dependent intraoperative surface observations, is critical for AR-guided laparoscopic surgery but remains challenging due to severe occlusion, limited visibility, and the lack of 3D ground-truth supervision. Existing landmark-free approaches perform partial-to-complete geometric alignment, yet robust self-supervision under extreme partial visibility remains difficult. We propose Vis2Reg, a visibility-aware registration framework that explicitly constrains deformation using mask-consistent visible regions. We introduce a visibility-aware self-supervision that derives a visible-domain 3D supervision signal from intraoperative masks, enabled by differentiable point rasterization and mask-guided back-projection. This formulation improves robustness under severe occlusion while maintaining fully self-supervised learning. Vis2Reg combines a robust geometric rigid initialization module with an implicit neural deformation field for stable alignment. Vis2Reg achieves a Dice score of 92.6% and a Chamfer Distance of 1.43 mm on real intraoperative datasets, with 111 ms per-frame inference time, demonstrating both accuracy and practical efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
9 of 27 references.
References · 9
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2020PREDATOR: Registration of 3D Point Clouds with Low Overlapcited by 290
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 84
- 2023Dynamic Point Fieldscited by 37
- 2024An objective comparison of methods for augmented reality in laparoscopic liver resection by preoperative-to-intraoperative image fusioncited by 16
- 2024Correspondence-Free Non-Rigid Point Set Registration Using Unsupervised Clustering Analysiscited by 10
- 2025Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resectioncited by 7
Built on by
Not cited yet.