Real Robot Challenge: A Robotics Competition in the Cloud
Not on the map. Why?
Abstract (arXiv)
Dexterous manipulation remains an open problem in robotics. To coordinate efforts of the research community towards tackling this problem, we propose a shared benchmark. We designed and built robotic platforms that are hosted at MPI for Intelligent Systems and can be accessed remotely. Each platform consists of three robotic fingers that are capable of dexterous object manipulation. Users are able to control the platforms remotely by submitting code that is executed automatically, akin to a computational cluster. Using this setup, i) we host robotics competitions, where teams from anywhere in the world access our platforms to tackle challenging tasks ii) we publish the datasets collected during these competitions (consisting of hundreds of robot hours), and iii) we give researchers access to these platforms for their own projects.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Sep 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 5; 2024: 4; 2025: 3; 2026: 2.
14 papers.
Sort:
By area:
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 63
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 46
- 2024The Essential Role of Causality in Foundation World Models for Embodied AIcited by 32
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardwarecited by 23
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13
- 2024Visual Representation Learning with Stochastic Frame Predictioncited by 10
- 2023SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenescited by 9
- 2024Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challengecited by 9
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 9
- 2026ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulationcited by 4
- 2023Real Robot Challenge 2022: Learning Dexterous Manipulation from Offline Data in the Real Worldcited by 3
2 more
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2026ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulation30 Mar 2026
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulators5 Oct 2025
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies22 Jun 2025
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real World31 Mar 2025
- 2024Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge9 Jul 2024
- 2024Visual Representation Learning with Stochastic Frame Prediction11 Jun 2024
- 2024OpenBot-Fleet: A System for Collective Learning with Real Robots13 May 2024
- 2024The Essential Role of Causality in Foundation World Models for Embodied AI6 Feb 2024
- 2023AI Competitions and Benchmarks: Competition platforms8 Dec 2023
- 2023Real Robot Challenge 2022: Learning Dexterous Manipulation from Offline Data in the Real World15 Aug 2023
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardware28 Jul 2023
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardwarecited by 23
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulatorscited by 13
- 2023Real Robot Challenge 2022: Learning Dexterous Manipulation from Offline Data in the Real Worldcited by 3
- 2025Reliable and Scalable Robot Policy Evaluation with Imperfect Simulators5 Oct 2025
- 2023Real Robot Challenge 2022: Learning Dexterous Manipulation from Offline Data in the Real World15 Aug 2023
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardware28 Jul 2023
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation22 May 2023
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 63
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 46
- 2024Visual Representation Learning with Stochastic Frame Predictioncited by 10
- 2023SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenescited by 9
- 2024Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challengecited by 9
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discoverycited by 9
- 2024OpenBot-Fleet: A System for Collective Learning with Real Robotscited by 1
- 2023AI Competitions and Benchmarks: Competition platformscited by 0
- 2026AutoResearch AI: Towards AI-Powered Research Automation for Scientific Discovery22 May 2026
- 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policies22 Jun 2025
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real World31 Mar 2025
- 2024Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge9 Jul 2024
- 2024Visual Representation Learning with Stochastic Frame Prediction11 Jun 2024
- 2024OpenBot-Fleet: A System for Collective Learning with Real Robots13 May 2024
- 2023AI Competitions and Benchmarks: Competition platforms8 Dec 2023
- 2023SCENEREPLICA: Benchmarking Real-World Robot Manipulation by Creating Replicable Scenes27 Jun 2023