# Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together

arXiv: https://arxiv.org/abs/2202.01493 · HTML: https://mlsanity.com/paper/2202.01493/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 3 of its 18 references that are in the map.
- First posted on arXiv 3 Feb 2022.

## Builds on (most cited first, 3 of 3)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [DexPilot: Vision Based Teleoperation of Dexterous Robotic Hand-Arm System](https://mlsanity.com/paper/1910.03135/) (2019)
- [ARROCH: Augmented Reality for Robots Collaborating with a Human](https://mlsanity.com/paper/2109.10400/) (2021)

## Built on by (most cited first, 6 of 6)

- [Sora as a World Model? A Complete Survey on Text-to-Video Generation](https://mlsanity.com/paper/2403.05131/) (2024)
- [Visual-based Safe Landing for UAVs in Populated Areas: Real-time Validation in Virtual Environments](https://mlsanity.com/paper/2203.13792/) (2022)
- [Spatial Computing: Concept, Applications, Challenges and Future Directions](https://mlsanity.com/paper/2402.07912/) (2024)
- [Green Robotic Mixed Reality with Gaussian Splatting](https://mlsanity.com/paper/2504.13697/) (2025)
- [HexVIO: Towards All-Day Stereo-Inertial Tracking Through Commodity DSPs](https://mlsanity.com/paper/2610.03283/) (2026)
- [RootSLAM: Square Root Bundle Adjustment for Visual-Inertial SLAM](https://mlsanity.com/paper/2610.15157/) (2026)

## Abstract (arXiv)

Spatial computing -- the ability of devices to be aware of their surroundings and to represent this digitally -- offers novel capabilities in human-robot interaction. In particular, the combination of spatial computing and egocentric sensing on mixed reality devices enables them to capture and understand human actions and translate these to actions with spatial meaning, which offers exciting new possibilities for collaboration between humans and robots. This paper presents several human-robot systems that utilize these capabilities to enable novel robot use cases: mission planning for inspection, gesture-based control, and immersive teleoperation. These works demonstrate the power of mixed reality as a tool for human-robot interaction, and the potential of spatial computing and mixed reality to drive the future of human-robot interaction.