mlsanityData to 7 Oct 2026

Virtual, Augmented, and Mixed Reality for Human-Robot Interaction: A Survey and Virtual Design Element Taxonomy

arXiv 2202.11249 ↗First posted 23 Feb 2022cs.RO cs.AI cs.GRcited by 5

Not on the map. Why?

Abstract (arXiv)

Virtual, Augmented, and Mixed Reality for Human-Robot Interaction (VAM-HRI) has been gaining considerable attention in research in recent years. However, the HRI community lacks a set of shared terminology and framework for characterizing aspects of mixed reality interfaces, presenting serious problems for future research. Therefore, it is important to have a common set of terms and concepts that can be used to precisely describe and organize the diverse array of work being done within the field. In this paper, we present a novel taxonomic framework for different types of VAM-HRI interfaces, composed of four main categories of virtual design elements (VDEs). We present and justify our taxonomy and explain how its elements have been developed over the last 30 years as well as the current directions VAM-HRI is headed in the coming decade.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 13 of its 112 references that are in the map. First posted on arXiv 23 Feb 2022.

Builds on

13 of 112 references.

References · 13

  1. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  2. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 768
  3. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  4. 2017Baxter's Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturingcited by 19
  5. 2019A VR System for Immersive Teleoperation and Live Exploration with a Mobile Robotcited by 10
  6. 2017Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displayscited by 6
  7. 2019Virtual-to-Real-World Transfer Learning for Robots on Wilderness Trailscited by 4
  8. 2019Using Socially Expressive Mixed Reality Arms for Enhancing Low-Expressivity Robotscited by 3
  9. 2018A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interactioncited by 2
  10. 2019DronePick: Object Picking and Delivery Teleoperation with the Drone Controlled by a Wearable Tactile Displaycited by 2
  11. 2019Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Controlcited by 2
  12. 2019Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens -- Possibilities and Limitationscited by 2
1 more
  1. 2019Negotiation-based Human-Robot Collaboration via Augmented Realitycited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 2.

5 papers.

  1. 2025The Social Context of Human-Robot Interactionscited by 1
  2. 2023Enabling Robots to Identify Missing Steps in Robot Tasks for Guided Learning from Demonstrationcited by 0
  3. 2024RAMPA: Robotic Augmented Reality for Machine Programming by DemonstrAtioncited by 0
  4. 2026MR-SLAM: Immersive Spatial Supervision for Multi-Robot Mapping via Mixed Realitycited by 0
  5. 2026Extended Reality as a Mediation Layer for Situated Human Control in Human-Robot Teamingcited by 0