ROBEL: Robotics Benchmarks for Learning with Low-Cost Robots
Not on the map. Why?
Abstract (arXiv)
ROBEL is an open-source platform of cost-effective robots designed for reinforcement learning in the real world. ROBEL introduces two robots, each aimed to accelerate reinforcement learning research in different task domains: D'Claw is a three-fingered hand robot that facilitates learning dexterous manipulation tasks, and D'Kitty is a four-legged robot that facilitates learning agile legged locomotion tasks. These low-cost, modular robots are easy to maintain and are robust enough to sustain on-hardware reinforcement learning from scratch with over 14000 training hours registered on them to date. To leverage this platform, we propose an extensible set of continuous control benchmark tasks for each robot. These tasks feature dense and sparse task objectives, and additionally introduce score metrics as hardware-safety. We provide benchmark scores on an initial set of tasks using a variety of learning-based methods. Furthermore, we show that these results can be replicated across copies of the robots located in different institutions. Code, documentation, design files, detailed assembly instructions, final policies, baseline details, task videos, and all supplementary materials required to reproduce the results are available at www.roboticsbenchmarks.org.
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 9; 2022: 16; 2023: 13; 2024: 15; 2025: 10; 2026: 6.
70 papers.
Sort:
By area:
- 2021RvS: What is Essential for Offline RL via Supervised Learning?cited by 184
- 2022The Unsurprising Effectiveness of Pre-Trained Vision Models for Controlcited by 155
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learningcited by 113
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimizationcited by 96
- 2020Offline Reinforcement Learning from Images with Latent Space Modelscited by 94
- 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapescited by 92
- 2021Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Interventioncited by 90
- 2022Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulationcited by 75
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 70
- 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regressioncited by 65
38 more
- 2021Visual Adversarial Imitation Learning using Variational Modelscited by 42
- 2024Towards Generalist Robot Learning from Internet Video: A Surveycited by 40
- 2022Generative Pretraining for Black-Box Optimizationcited by 36
- 2021Mismatched No More: Joint Model-Policy Optimization for Model-Based RLcited by 35
- 2025PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policiescited by 29
- 2021Unsupervised Skill Discovery with Bottleneck Option Learningcited by 28
- 2022Learning Dexterous Manipulation from Exemplar Object Trajectories and Pre-Graspscited by 27
- 2023MoDem-V2: Visuo-Motor World Models for Real-World Robot Manipulationcited by 27
- 2023A Control-Centric Benchmark for Video Predictioncited by 25
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardwarecited by 23
- 2023ExPT: Synthetic Pretraining for Few-Shot Experimental Designcited by 22
- 2023Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Criticcited by 20
- 2024ACE : Off-Policy Actor-Critic with Causality-Aware Entropy Regularizationcited by 16
- 2022When to Update Your Model: Constrained Model-based Reinforcement Learningcited by 14
- 2025Offline Model-Based Optimization: Comprehensive Reviewcited by 14
- 2024Offline Model-Based Optimization by Learning to Rankcited by 13
- 2024Generative Adversarial Model-Based Optimization via Source Critic Regularizationcited by 10
- 2024Design Editing for Offline Model-based Optimizationcited by 10
- 2023A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learningcited by 9
- 2021Measuring Progress in Deep Reinforcement Learning Sample Efficiencycited by 8
- 2024Robust Guided Diffusion for Offline Black-Box Optimizationcited by 8
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processescited by 8
- 2022All the Feels: A dexterous hand with large-area tactile sensingcited by 7
- 2022Learning to Fold Real Garments with One Arm: A Case Study in Cloud-Based Robotics Researchcited by 6
- 2025Boosting Offline Optimizers with Surrogate Sensitivitycited by 6
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddingscited by 6
- 2022Time-Varying Propensity Score to Bridge the Gap between the Past and Presentcited by 5
- 2022RMBench: Benchmarking Deep Reinforcement Learning for Robotic Manipulator Controlcited by 5
- 2023TactoFind: A Tactile Only System for Object Retrievalcited by 5
- 2023Robotic Manipulation Datasets for Offline Compositional Reinforcement Learningcited by 5
- 2025Incorporating Surrogate Gradient Norm to Improve Offline Optimization Techniquescited by 5
- 2023Bi-Manual Block Assembly via Sim-to-Real Reinforcement Learningcited by 4
- 2025ROOT: Rethinking Offline Optimization as Distributional Translation via Probabilistic Bridgecited by 4
- 2024Image-Based Deep Reinforcement Learning with Intrinsically Motivated Stimuli: On the Execution of Complex Robotic Taskscited by 3
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrationscited by 3
- 2021Adaptive t-Momentum-based Optimization for Unknown Ratio of Outliers in Amateur Data in Imitation Learningcited by 2
- 2022Review of Metrics to Measure the Stability, Robustness and Resilience of Reinforcement Learningcited by 2
- 2022Randomized-to-Canonical Model Predictive Control for Real-world Visual Robotic Manipulationcited by 2
50 most cited of 70 All 70 (JSON)
- 2026Rethinking Learnability in Offline Data-driven Optimization1 Sep 2026
- 2026DexHoldem: Playing Texas Hold'em with Dexterous Embodied System18 May 2026
- 2026Support-Proximity Augmented Diffusion Estimation for Offline Black-Box Optimization11 May 2026
- 2026Black-Box Optimization From Small Offline Datasets via Meta Learning with Synthetic Tasks14 Apr 2026
- 2026On the Learnability of Offline Model-Based Optimization: A Ranking Perspective4 Mar 2026
- 2026Diffusion Large Language Models for Black-Box Optimization20 Jan 2026
- 2025PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policies18 Dec 2025
- 2025Lightning Grasp: High Performance Procedural Grasp Synthesis with Contact Fields10 Nov 2025
- 2025ROOT: Rethinking Offline Optimization as Distributional Translation via Probabilistic Bridge19 Sep 2025
- 2025LodeStar: Long-horizon Dexterity via Synthetic Data Augmentation from Human Demonstrations24 Aug 2025
- 2025emg2tendon: From sEMG Signals to Tendon Control in Musculoskeletal Hands29 Jul 2025
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings8 Jun 2025
38 more
- 2025Learning Design-Score Manifold to Guide Diffusion Models for Offline Optimization6 Jun 2025
- 2025Offline Model-Based Optimization: Comprehensive Review21 Mar 2025
- 2025Incorporating Surrogate Gradient Norm to Improve Offline Optimization Techniques6 Mar 2025
- 2025Boosting Offline Optimizers with Surrogate Sensitivity6 Mar 2025
- 2024Weber-Fechner Law in Temporal Difference learning derived from Control as Inference30 Dec 2024
- 2024Scalable Bayesian Optimization via Focalized Sparse Gaussian Processes29 Dec 2024
- 2024Offline Model-Based Optimization by Learning to Rank15 Oct 2024
- 2024Robust Guided Diffusion for Offline Black-Box Optimization1 Oct 2024
- 20241 Modular Parallel Manipulator for Long-Term Soft Robotic Data Collection5 Sep 2024
- 2024Benchmarking Reinforcement Learning Methods for Dexterous Robotic Manipulation with a Three-Fingered Gripper27 Aug 2024
- 2024Image-Based Deep Reinforcement Learning with Intrinsically Motivated Stimuli: On the Execution of Complex Robotic Tasks31 Jul 2024
- 2024BricksRL: A Platform for Democratizing Robotics and Reinforcement Learning Research and Education with LEGO25 Jun 2024
- 2024Design Editing for Offline Model-based Optimization22 May 2024
- 2024Perturbing the Gradient for Alleviating Meta Overfitting20 May 2024
- 2024OpenBot-Fleet: A System for Collective Learning with Real Robots13 May 2024
- 2024Towards Generalist Robot Learning from Internet Video: A Survey30 Apr 2024
- 2024ACE : Off-Policy Actor-Critic with Causality-Aware Entropy Regularization22 Feb 2024
- 2024Generative Adversarial Model-Based Optimization via Source Critic Regularization9 Feb 2024
- 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning29 Jan 2024
- 2023Self-Supervised Curriculum Generation for Autonomous Reinforcement Learning without Task-Specific Knowledge15 Nov 2023
- 2023ExPT: Synthetic Pretraining for Few-Shot Experimental Design30 Oct 2023
- 2023A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learning10 Oct 2023
- 2023MoDem-V2: Visuo-Motor World Models for Real-World Robot Manipulation25 Sep 2023
- 2023A Real-World Quadrupedal Locomotion Benchmark for Offline Reinforcement Learning13 Sep 2023
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardware28 Jul 2023
- 2023Robotic Manipulation Datasets for Offline Compositional Reinforcement Learning13 Jul 2023
- 2023HomeRobot: Open-Vocabulary Mobile Manipulation20 Jun 2023
- 2023Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic5 Jun 2023
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation22 May 2023
- 2023A Control-Centric Benchmark for Video Prediction26 Apr 2023
- 2023Bi-Manual Block Assembly via Sim-to-Real Reinforcement Learning27 Mar 2023
- 2023TactoFind: A Tactile Only System for Object Retrieval23 Mar 2023
- 2022Training Robots to Evaluate Robots: Example-Based Interactive Reward Functions for Policy Learning17 Dec 2022
- 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapes21 Nov 2022
- 2022All the Feels: A dexterous hand with large-area tactile sensing27 Oct 2022
- 2022RMBench: Benchmarking Deep Reinforcement Learning for Robotic Manipulator Control20 Oct 2022
- 2022When to Update Your Model: Constrained Model-based Reinforcement Learning15 Oct 2022
- 2022Time-Varying Propensity Score to Bridge the Gap between the Past and Present4 Oct 2022
50 newest of 70 All 70 (JSON)
- 2021RvS: What is Essential for Offline RL via Supervised Learning?cited by 184
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2020Offline Reinforcement Learning from Images with Latent Space Modelscited by 94
- 2022Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulationcited by 75
- 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regressioncited by 65
- 2021Visual Adversarial Imitation Learning using Variational Modelscited by 42
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardwarecited by 23
- 2023Robotic Manipulation Datasets for Offline Compositional Reinforcement Learningcited by 5
- 2021Adaptive t-Momentum-based Optimization for Unknown Ratio of Outliers in Amateur Data in Imitation Learningcited by 2
- 2023A Real-World Quadrupedal Locomotion Benchmark for Offline Reinforcement Learningcited by 2
- 2022Understanding Hindsight Goal Relabeling from a Divergence Minimization Perspectivecited by 0
- 2023A Real-World Quadrupedal Locomotion Benchmark for Offline Reinforcement Learning13 Sep 2023
- 2023Benchmarking Offline Reinforcement Learning on Real-Robot Hardware28 Jul 2023
- 2023Robotic Manipulation Datasets for Offline Compositional Reinforcement Learning13 Jul 2023
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation22 May 2023
- 2022Understanding Hindsight Goal Relabeling from a Divergence Minimization Perspective26 Sep 2022
- 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regression7 Jun 2022
- 2022Dexterous Imitation Made Easy: A Learning-Based Framework for Efficient Dexterous Manipulation24 Mar 2022
- 2021RvS: What is Essential for Offline RL via Supervised Learning?20 Dec 2021
- 2021Adaptive t-Momentum-based Optimization for Unknown Ratio of Outliers in Amateur Data in Imitation Learning2 Aug 2021
- 2021Visual Adversarial Imitation Learning using Variational Models16 Jul 2021
- 2020Offline Reinforcement Learning from Images with Latent Space Models21 Dec 2020
- 2022The Unsurprising Effectiveness of Pre-Trained Vision Models for Controlcited by 155
- 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learningcited by 113
- 2023HomeRobot: Open-Vocabulary Mobile Manipulationcited by 104
- 2022Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimizationcited by 96
- 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapescited by 92
- 2021Reset-Free Reinforcement Learning via Multi-Task Learning: Learning Dexterous Manipulation Behaviors without Human Interventioncited by 90
- 2021Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapescited by 70
- 2024Towards Generalist Robot Learning from Internet Video: A Surveycited by 40
- 2022Generative Pretraining for Black-Box Optimizationcited by 36
- 2021Mismatched No More: Joint Model-Policy Optimization for Model-Based RLcited by 35
- 2025PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policiescited by 29
- 2021Unsupervised Skill Discovery with Bottleneck Option Learningcited by 28
12 most cited of 53 All 53 (JSON)
- 2026Rethinking Learnability in Offline Data-driven Optimization1 Sep 2026
- 2026Support-Proximity Augmented Diffusion Estimation for Offline Black-Box Optimization11 May 2026
- 2026Black-Box Optimization From Small Offline Datasets via Meta Learning with Synthetic Tasks14 Apr 2026
- 2026On the Learnability of Offline Model-Based Optimization: A Ranking Perspective4 Mar 2026
- 2026Diffusion Large Language Models for Black-Box Optimization20 Jan 2026
- 2025PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policies18 Dec 2025
- 2025Lightning Grasp: High Performance Procedural Grasp Synthesis with Contact Fields10 Nov 2025
- 2025ROOT: Rethinking Offline Optimization as Distributional Translation via Probabilistic Bridge19 Sep 2025
- 2025emg2tendon: From sEMG Signals to Tendon Control in Musculoskeletal Hands29 Jul 2025
- 2025Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings8 Jun 2025
- 2025Offline Model-Based Optimization: Comprehensive Review21 Mar 2025
- 2025Incorporating Surrogate Gradient Norm to Improve Offline Optimization Techniques6 Mar 2025
12 newest of 53 All 53 (JSON)