EasyVis2: A Real Time Multi-view 3D Visualization System for Laparoscopic Surgery Training Enhanced by a Deep Neural Network YOLOv8-Pose
Not on the map. Why?
Abstract (arXiv)
EasyVis2 is a system designed to provide hands-free, real-time 3D visualization for laparoscopic surgery. It incorporates a surgical trocar equipped with an array of micro-cameras, which can be inserted into the body cavity to offer an enhanced field of view and a 3D perspective of the surgical procedure. A specialized deep neural network algorithm, YOLOv8-Pose, is utilized to estimate the position and orientation of surgical instruments in each individual camera view. These multi-view estimates enable the calculation of 3D poses of surgical tools, facilitating the rendering of a 3D surface model of the instruments, overlaid on the background scene, for real-time visualization. This study presents methods for adapting YOLOv8-Pose to the EasyVis2 system, including the development of a tailored training dataset. Experimental results demonstrate that, with an identical number of cameras, the new system improves 3D reconstruction accuracy and reduces computation time. Additionally, the adapted YOLOv8-Pose system shows high accuracy in 2D pose estimation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 50 references that are in the map. First posted on arXiv 21 Dec 2024.
Builds on
21 of 50 references.
References · 21
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2016RMPE: Regional Multi-person Pose Estimationcited by 340
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2013DeepPose: Human Pose Estimation via Deep Neural Networkscited by 305
- 2017CORe50: a New Dataset and Benchmark for Continuous Object Recognitioncited by 289
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2022AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Timecited by 200
9 more
- 2023Putting the Object Back into Video Object Segmentationcited by 188
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 123
- 2015DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimationcited by 117
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 69
- 2022YOLO-Pose: Enhancing YOLO for Multi Person Pose Estimation Using Object Keypoint Similarity Losscited by 68
- 2020Robust 6D Object Pose Estimation by Learning RGB-D Featurescited by 25
- 2020FFD: Fast Feature Detectorcited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.