# Mixed Reality Communication for Medical Procedures: Teaching the Placement of a Central Venous Catheter

arXiv: https://arxiv.org/abs/2312.08624 · HTML: https://mlsanity.com/paper/2312.08624/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 8 of its 41 references that are in the map.
- First posted on arXiv 14 Dec 2023.

## Builds on (most cited first, 8 of 8)

- [Matterport3D: Learning from RGB-D Data in Indoor Environments](https://mlsanity.com/paper/1709.06158/) (2017)
- [Neural RGB-D Surface Reconstruction](https://mlsanity.com/paper/2104.04532/) (2021)
- [Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors](https://mlsanity.com/paper/2105.01859/) (2021)
- [DeepDeform: Learning Non-rigid RGB-D Reconstruction with Semi-supervised Data](https://mlsanity.com/paper/1912.04302/) (2019)
- [Passing a Non-verbal Turing Test: Evaluating Gesture Animations Generated from Speech](https://mlsanity.com/paper/2107.00712/) (2021)
- [Real-time Gesture Animation Generation from Speech for Virtual Human Interaction](https://mlsanity.com/paper/2208.03244/) (2022)
- [Learning Dynamic View Synthesis With Few RGBD Cameras](https://mlsanity.com/paper/2204.10477/) (2022)
- [Remote Assistance with Mixed Reality for Procedural Tasks](https://mlsanity.com/paper/2208.03261/) (2022)

## Abstract (arXiv)

Medical procedures are an essential part of healthcare delivery, and the acquisition of procedural skills is a critical component of medical education. Unfortunately, procedural skill is not evenly distributed among medical providers. Skills may vary within departments or institutions, and across geographic regions, depending on the provider's training and ongoing experience. We present a mixed reality real-time communication system to increase access to procedural skill training and to improve remote emergency assistance. Our system allows a remote expert to guide a local operator through a medical procedure. RGBD cameras capture a volumetric view of the local scene including the patient, the operator, and the medical equipment. The volumetric capture is augmented onto the remote expert's view to allow the expert to spatially guide the local operator using visual and verbal instructions. We evaluated our mixed reality communication system in a study in which experts teach the ultrasound-guided placement of a central venous catheter (CVC) to students in a simulation setting. The study compares state-of-the-art video communication against our system. The results indicate that our system enhances and offers new possibilities for visual communication compared to video teleconference-based training.