mlsanityData to 14 Oct 2026

IRIS: An Immersive Robot Interaction System

arXiv 2502.03297 ↗First posted 5 Feb 2025cs.RO cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

This paper introduces IRIS, an Immersive Robot Interaction System leveraging Extended Reality (XR). Existing XR-based systems enable efficient data collection but are often challenging to reproduce and reuse due to their specificity to particular robots, objects, simulators, and environments. IRIS addresses these issues by supporting immersive interaction and data collection across diverse simulators and real-world scenarios. It visualizes arbitrary rigid and deformable objects, robots from simulation, and integrates real-time sensor-generated point clouds for real-world applications. Additionally, IRIS enhances collaborative capabilities by enabling multiple users to simultaneously interact within the same virtual scene. Extensive experiments demonstrate that IRIS offers efficient and intuitive data collection in both simulated and real-world settings.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 44 of its 72 references that are in the map. First posted on arXiv 5 Feb 2025.

Builds on

44 of 72 references.

References · 44

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  7. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  8. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
  9. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  10. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
  11. 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
  12. 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 236
32 more
  1. 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 204
  2. 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
  3. 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
  4. 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
  5. 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
  6. 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
  7. 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 134
  8. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
  9. 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 77
  10. 2024OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulationcited by 71
  11. 2023ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenescited by 69
  12. 2024ALOHA 2: An Enhanced Low-Cost Hardware for Bimanual Teleoperationcited by 63
  13. 2022Holo-Dex: Teaching Dexterity with Immersive Mixed Realitycited by 57
  14. 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrationscited by 53
  15. 2019PyRep: Bringing V-REP to Deep Robot Learningcited by 44
  16. 2024Efficient Data Collection for Robotic Manipulation via Compositional Generalizationcited by 37
  17. 2020Learning Multi-Arm Manipulation Through Collaborative Teleoperationcited by 32
  18. 2024ARCap: Collecting High-quality Human Demonstrations for Robot Learning with Augmented Reality Feedbackcited by 31
  19. 2023Human-in-the-Loop Task and Motion Planning for Imitation Learningcited by 29
  20. 2023AR2-D2:Training a Robot Without a Robotcited by 27
  21. 2022Deep Black-Box Reinforcement Learning with Movement Primitivescited by 20
  22. 2017Baxter's Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturingcited by 19
  23. 2024DexHub and DART: Towards Internet Scale Robot Data Collectioncited by 12
  24. 2022Accelerating Interactive Human-like Manipulation Learning with GPU-based Simulation and High-quality Demonstrationscited by 8
  25. 2023OpenVR: Teleoperation for Manipulationcited by 8
  26. 2023MP3: Movement Primitive-Based (Re-)Planning Policycited by 8
  27. 2024ARCADE: Scalable Demonstration Collection and Generation via Augmented Reality for Imitation Learningcited by 5
  28. 2024EVE: Enabling Anyone to Train Robots using Augmented Realitycited by 4
  29. 2024ARMADA: Augmented Reality for Robot Manipulation and Robot-Free Data Acquisitioncited by 4
  30. 2023Virtual Reality Based Robot Teleoperation via Human-Scene Interactioncited by 3
  31. 2023Guided Learning from Demonstration for Robust Transferabilitycited by 2
  32. 2024IMMERTWIN: A Mixed Reality Framework for Enhanced Robotic Arm Teleoperationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learningcited by 27
  2. 2026DuoBench: A Reproducible Benchmark for Bimanual Manipulation in Simulation and the Real Worldcited by 2