mlsanityData to 7 Oct 2026

Robo-Saber: Generating and Simulating Virtual Reality Players

arXiv 2602.18319 ↗First posted 20 Feb 2026cs.GR cs.AI cs.HCcited by 0

Not on the map. Why?

Abstract (arXiv)

We present the first motion generation system for playtesting virtual reality (VR) games. Our player model generates VR headset and handheld controller movements from in-game object arrangements, guided by style exemplars and aligned to maximize simulated gameplay score. We train on the large BOXRR-23 dataset and apply our framework on the popular VR game Beat Saber. The resulting model Robo-Saber produces skilled gameplay and captures diverse player behaviors, mirroring the skill levels and movement patterns specified by input style exemplars. Robo-Saber demonstrates promise in synthesizing rich gameplay data for predictive applications and enabling a physics-based whole-body VR playtesting agent.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 67 references that are in the map. First posted on arXiv 20 Feb 2026.

Builds on

40 of 67 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  7. 2022Human Motion Diffusion Modelcited by 1,062
  8. 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 882
  9. 2023Perpetual Humanoid Control for Real-time Simulated Avatarscited by 198
  10. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 188
  11. 2021Character Controllers Using Motion VAEscited by 182
  12. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
28 more
  1. 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
  2. 2023Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Modelcited by 104
  3. 2024CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character controlcited by 103
  4. 2020Unpaired Motion Style Transfer from Video to Animationcited by 94
  5. 2025MotionStreamer: Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Spacecited by 82
  6. 2023Interactive Character Control with Auto-Regressive Motion Diffusion Modelscited by 52
  7. 2023Hierarchical Planning and Control for Box Loco-Manipulationcited by 42
  8. 2024SMooDi: Stylized Motion Diffusion Modelcited by 37
  9. 2024Generative Human Motion Stylization in Latent Spacecited by 30
  10. 2024Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion Transfercited by 30
  11. 2025Diffuse-CLoC: Guided Diffusion for Physics-based Character Look-ahead Controlcited by 27
  12. 2025PARC: Physics-based Augmentation with Reinforcement Learning for Character Controllerscited by 24
  13. 2022Neural3Points: Learning to Generate Physically Realistic Full-body Motion for Virtual Reality Userscited by 20
  14. 2023Unique Identification of 50,000+ Virtual Reality Users from Head & Hand Motion Datacited by 18
  15. 2022Style-ERD: Responsive and Coherent Online Motion Style Transfercited by 17
  16. 2025Dance Like a Chicken: Low-Rank Stylization for Human Motion Diffusioncited by 16
  17. 2025PersonaBooth: Personalized Text-to-Motion Generationcited by 14
  18. 2022Automated Play-Testing Through RL Based Human-Like Play-Styles Generationcited by 11
  19. 2020Predicting Game Difficulty and Churn Without Playerscited by 9
  20. 2024F"urElise: Capturing and Physically Synthesizing Hand Motions of Piano Performancecited by 8
  21. 2024SIM2VR: Towards Automated Biomechanical Testing in VRcited by 6
  22. 2021Predicting Game Engagement and Difficulty Using AI Playerscited by 5
  23. 2025Simulating Errors in Touchscreen Typingcited by 4
  24. 2023Estimating player completion rate in mobile puzzle games using reinforcement learningcited by 3
  25. 2023Discovering Fatigued Movements for Virtual Character Animationcited by 3
  26. 2022Personalized Game Difficulty Prediction Using Factorization Machinescited by 2
  27. 2025Diffusion-based Planning with Learned Viability Filterscited by 2
  28. 2023Results of the 2023 Census of Beat Saber Users: Virtual Reality Gaming Population Insights and Factors Affecting Virtual Reality E-Sports Performancecited by 1

Built on by

Not cited yet.