Unreal Robotics Lab: A High-Fidelity Robotics Simulator with Advanced Physics and Rendering
Not on the map. Why?
Abstract (arXiv)
High-fidelity simulation is essential for robotics research, enabling safe and efficient testing of perception, control, and navigation algorithms. However, achieving both photorealistic rendering and accurate physics modeling remains a challenge. This paper presents a novel simulation framework, the Unreal Robotics Lab (URL), that integrates the advanced rendering capabilities of the Unreal Engine with MuJoCo's high-precision physics simulation. Our approach enables realistic robotic perception while maintaining accurate physical interactions, facilitating benchmarking and dataset generation for vision-based robotics applications. The system supports complex environmental effects, such as smoke, fire, and water dynamics, which are critical to evaluating robotic performance under adverse conditions. We benchmark visual navigation and SLAM methods within our framework, demonstrating its utility for testing real-world robustness in controlled yet diverse scenarios. By bridging the gap between physics accuracy and photorealistic rendering, our framework provides a powerful tool for advancing robotics research and sim-to-real transfer. Our open-source framework is available at https://unrealroboticslab.github.io/.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 51 references that are in the map. First posted on arXiv 19 Apr 2025.
Builds on
26 of 51 references.
References · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 511
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
14 more
- 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Explorationcited by 248
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2023ViNT: A Foundation Model for Visual Navigationcited by 222
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2020Eigen-CAM: Class Activation Map using Principal Componentscited by 189
- 2022GNM: A General Navigation Model to Drive Any Robotcited by 171
- 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 138
- 2025MuJoCo Playgroundcited by 78
- 2022Approximate Convex Decomposition for 3D Meshes with Collision-Aware Concavity and Tree Searchcited by 67
- 2024Visual Whole-Body Control for Legged Loco-Manipulationcited by 62
- 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 21
- 2024The One RING: a Robotic Indoor Navigation Generalistcited by 16
- 2024EnvoDat: A Large-Scale Multisensory Dataset for Robotic Spatial Awareness and Semantic Reasoning in Heterogeneous Environmentscited by 7
- 2023Do we need scan-matching in radar odometry?cited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.