mlsanityData to 7 Oct 2026

AI-Enhanced Virtual Reality in Medicine: A Comprehensive Survey

arXiv 2402.03093 ↗First posted 5 Feb 2024cs.CV cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

With the rapid advance of computer graphics and artificial intelligence technologies, the ways we interact with the world have undergone a transformative shift. Virtual Reality (VR) technology, aided by artificial intelligence (AI), has emerged as a dominant interaction media in multiple application areas, thanks to its advantage of providing users with immersive experiences. Among those applications, medicine is considered one of the most promising areas. In this paper, we present a comprehensive examination of the burgeoning field of AI-enhanced VR applications in medical care and services. By introducing a systematic taxonomy, we meticulously classify the pertinent techniques and applications into three well-defined categories based on different phases of medical diagnosis and treatment: Visualization Enhancement, VR-related Medical Data Processing, and VR-assisted Intervention. This categorization enables a structured exploration of the diverse roles that AI-powered VR plays in the medical domain, providing a framework for a more comprehensive understanding and evaluation of these technologies. To our best knowledge, this is the first systematic survey of AI-powered VR systems in medical settings, laying a foundation for future research in this interdisciplinary domain.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 65 references that are in the map. First posted on arXiv 5 Feb 2024.

Builds on

36 of 65 references.

References · 36

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
  4. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  5. 2016EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videoscited by 366
  6. 2021Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videoscited by 139
  7. 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 122
  8. 2023EndoSurf: Neural Surface Reconstruction of Deformable Tissues with Stereo Endoscope Videoscited by 68
  9. 2022Diffusion Deformable Model for 4D Temporal Medical Image Generationcited by 65
  10. 2018MVOR: A Multi-view RGB-D Operating Room Dataset for 2D and 3D Human Pose Estimationcited by 49
  11. 20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
  12. 2023SurgicalGPT: End-to-End Language-Vision GPT for Visual Question Answering in Surgerycited by 48
24 more
  1. 2023Surgical-VQLA: Transformer with Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgerycited by 44
  2. 2020IntrA: 3D Intracranial Aneurysm Dataset for Deep Learningcited by 41
  3. 2022D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentationcited by 35
  4. 2020Automatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgerycited by 34
  5. 2023CuNeRF: Cube-Based Neural Radiance Field for Zero-Shot Medical Image Arbitrary-Scale Super Resolutioncited by 28
  6. 2020Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studiescited by 25
  7. 2021Two-Stage Mesh Deep Learning for Automated Tooth Segmentation and Landmark Localization on 3D Intraoral Scanscited by 23
  8. 2021Exploring Segment-level Semantics for Online Phase Recognition from Surgical Videoscited by 23
  9. 2023Dynamic Scene Graph Representation for Surgical Videocited by 21
  10. 2023Point Cloud Diffusion Models for Automatic Implant Generationcited by 19
  11. 2023CAT-ViL: Co-Attention Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgerycited by 17
  12. 2020TSGCNet: Discriminative Geometric Feature Learning with Two-Stream GraphConvolutional Network for 3D Dental Model Segmentationcited by 16
  13. 2021Electrocardio Panorama: Synthesizing New ECG Views with Self-supervisioncited by 16
  14. 20233DTeethSeg'22: 3D Teeth Scan Segmentation and Labeling Challengecited by 14
  15. 2023POV-Surgery: A Dataset for Egocentric Hand and Tool Pose Estimation During Surgical Activitiescited by 14
  16. 2022MNet: Rethinking 2D/3D Networks for Anisotropic Medical Image Segmentationcited by 13
  17. 2023DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume Reconstructioncited by 10
  18. 2021Patient-specific virtual spine straightening and vertebra inpainting: An automatic framework for osteoplasty planningcited by 6
  19. 20233D Teeth Reconstruction from Panoramic Radiographs using Neural Implicit Functionscited by 6
  20. 2021SurgeonAssist-Net: Towards Context-Aware Head-Mounted Display-Based Augmented Reality for Surgical Guidancecited by 5
  21. 2023Towards multi-modal anatomical landmark detection for ultrasound-guided brain tumor resection with contrastive learningcited by 4
  22. 20233D Arterial Segmentation via Single 2D Projections and Depth Supervision in Contrast-Enhanced CT Imagescited by 4
  23. 2023GCL: Gradient-Guided Contrastive Learning for Medical Image Segmentation with Multi-Perspective Meta Labelscited by 4
  24. 20223D Intracranial Aneurysm Classification and Segmentation via Unsupervised Dual-branch Learningcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.

  1. 2024TeleOR: Real-time Telemedicine System for Full-Scene Operating Roomcited by 2
  2. 2025CPSL: Representing Volumetric Video via Content-Promoted Scene Layerscited by 0