mlsanityData to 13 Oct 2026

HoloLens 2 Research Mode as a Tool for Computer Vision Research

arXiv 2008.11239 ↗First posted 25 Aug 2020cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.

Key facts. Cited by 34 papers in the map (data through 13 Oct 2026). First posted on arXiv 25 Aug 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 2; 2022: 6; 2023: 9; 2024: 7; 2025: 3; 2026: 7.

34 papers.

Sort:

  1. 2021EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devicescited by 136
  2. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 124
  3. 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 99
  4. 2022GIMO: Gaze-Informed Human Motion Prediction in Contextcited by 81
  5. 2022FLAG: Flow-based 3D Avatar Generation from Sparse Observationscited by 54
  6. 2023IndustReal: A Dataset for Procedure Step Recognition Handling Execution Errors in Egocentric Videos in an Industrial-Like Settingcited by 47
  7. 2023HMD-NeMo: Online 3D Avatar Motion Generation From Sparse Observationscited by 17
  8. 2023Instance Tracking in 3D Scenes from Egocentric Videoscited by 17
  9. 2023STEPs: Self-Supervised Key Step Extraction and Localization from Unlabeled Procedural Videoscited by 13
  10. 2022Context-Aware Sequence Alignment using 4D Skeletal Augmentationcited by 11
  11. 2022InfraredTags: Embedding Invisible AR Markers and Barcodes Using Low-Cost, Infrared-Based 3D Printing and Imaging Toolscited by 8
  12. 2023Lazy Visual Localization via Motion Averagingcited by 8
22 more
  1. 2024SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Researchcited by 8
  2. 2025The Monado SLAM Dataset for Egocentric Visual-Inertial Trackingcited by 7
  3. 2022The HoloLens in Medicine: A systematic Review and Taxonomycited by 6
  4. 2023EVD Surgical Guidance with Retro-Reflective Tool Tracking and Spatial Reconstruction using Head-Mounted Augmented Reality Devicecited by 6
  5. 2023Human-Centric Resource Allocation for the Metaverse With Multiaccess Edge Computingcited by 3
  6. 2023HoloPOCUS: Portable Mixed-Reality 3D Ultrasound Tracking, Reconstruction and Overlaycited by 2
  7. 2024Navigate Biopsy with Ultrasound under Augmented Reality Device: Towards Higher System Performancecited by 2
  8. 2024AI-Powered Augmented Reality for Satellite Assembly, Integration and Testcited by 1
  9. 2025MR.NAVI: Mixed-Reality Navigation Assistant for the Visually Impairedcited by 1
  10. 2026DeltaDorsal: Enhancing Hand Pose Estimation with Dorsal Features in Egocentric Viewscited by 1
  11. 2026MultiCam: On-the-fly Multi-Camera Pose Estimation Using Spatiotemporal Overlaps of Known Objectscited by 1
  12. 2026SurgNavAR: An Augmented Reality Surgical Navigation Framework for Optical See-Through Head Mounted Displayscited by 1
  13. 2021SHREC 2021: Track on Skeleton-based Hand Gesture Recognition in the Wildcited by 0
  14. 2023PWR-Align: Leveraging Part-Whole Relationships for Part-wise Rigid Point Cloud Registration in Mixed Reality Applicationscited by 0
  15. 2024ARPOV: Expanding Visualization of Object Detection in AR with Panoramic Mosaic Stitchingcited by 0
  16. 2024EvenNICER-SLAM: Event-based Neural Implicit Encoding SLAMcited by 0
  17. 2024Lost in Tracking Translation: A Comprehensive Analysis of Visual SLAM in Human-Centered XR and IoT Ecosystemscited by 0
  18. 2025SigmaCollab: An Application-Driven Dataset for Physically Situated Collaborationcited by 0
  19. 2026A Mixed Reality System for Robust Manikin Localization in Childbirth Trainingcited by 0
  20. 2026Impact of Hand Impairment and Occlusions on Hand Pose Estimation Accuracy in Augmented Reality Applicationscited by 0
  21. 2026VOCA: Visual Odometry with Codec Awarenesscited by 0
  22. 2026Anomalous Frame Detection Using VLM-Based Description Comparison for Extracting Expert-Specific Actions and Contextual Decision-Making Scenes with Intra-Video Self-Similaritycited by 0