From Tabula Rasa to Emergent Abilities: Discovering Robot Skills via Real-World Unsupervised Quality-Diversity
Not on the map. Why?
Abstract (arXiv)
Autonomous skill discovery aims to enable robots to acquire diverse behaviors without explicit supervision. Learning such behaviors directly on physical hardware remains challenging due to safety and data efficiency constraints. Existing methods, including Quality-Diversity Actor-Critic (QDAC), require manually defined skill spaces and carefully tuned heuristics, limiting real-world applicability. We propose Unsupervised Real-world Skill Acquisition (URSA), an extension of QDAC that enables robots to autonomously discover and master diverse, high-performing skills directly in the real world. We demonstrate that URSA successfully discovers diverse locomotion skills on a Unitree A1 quadruped in both simulation and the real world. Our approach supports both heuristic-driven skill discovery and fully unsupervised settings. We also show that the learned skill repertoire can be reused for downstream tasks such as real-world damage adaptation, where URSA outperforms all baselines in 5 out of 9 simulated and 3 out of 5 real-world damage scenarios. Our results establish a new framework for real-world robot learning that enables continuous skill discovery with limited human intervention, representing a significant step toward more autonomous and adaptable robotic systems. Demonstration videos are available at https://adaptive-intelligent-robotics.github.io/URSA.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 34 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
23 of 34 references.
References · 23
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 313
- 2014Robots that can adapt like animalscited by 204
- 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learningcited by 136
- 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 113
- 2020Learning to Walk in the Real World with Minimal Human Effortcited by 111
- 2023METRA: Scalable Unsupervised RL with Metric-Aware Abstractioncited by 86
- 2020One Solution is Not All You Need: Few-Shot Extrapolation via Structured MaxEnt RLcited by 79
- 2019Autonomous skill discovery with Quality-Diversity and Unsupervised Descriptorscited by 57
- 2023Controllability-Aware Unsupervised Skill Discoverycited by 49
- 2022Discovering Policies with DOMiNO: Diversity Optimization Maintaining Near Optimalitycited by 37
11 more
- 2020Emergent Real-World Robotic Skills via Unsupervised Off-Policy Reinforcement Learningcited by 31
- 2016Reset-free Trial-and-Error Learning for Robot Damage Recoverycited by 24
- 2019Unsupervised Learning and Exploration of Reachable Outcome Spacecited by 23
- 2024Quality-Diversity Actor-Critic: Learning High-Performing and Diverse Behaviors via Value and Successor Features Criticscited by 13
- 2019Adaptive Prior Selection for Repertoire-based Online Adaptation in Roboticscited by 11
- 2022Relevance-guided Unsupervised Discovery of Abilities with Quality-Diversity Algorithmscited by 8
- 2023Learning Diverse Skills for Local Navigation under Multi-constraint Optimalitycited by 8
- 2025Gait in Eight: Efficient On-Robot Learning for Omnidirectional Quadruped Locomotioncited by 8
- 2022Learning to Walk Autonomously via Reset-Free Quality-Diversitycited by 7
- 2021Discovering and Exploiting Sparse Rewards in a Learned Behavior Spacecited by 5
- 2023Quality-Diversity Optimisation on a Physical Robot Through Dynamics-Aware and Reset-Free Learningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Offline Diversity Maximization Under Imitation Constraints
- 2025Divide, Discover, Deploy: Factorized Skill Learning with Symmetry and Style Priors
- 2026Diverse Skill Discovery for Quadruped Robots via Unsupervised Learning
- 2024Quality Diversity for Robot Learning: Limitations and Future Directions
- 2024SkiLD: Unsupervised Skill Discovery Guided by Factor Interactions
- 2024Constrained Skill Discovery: Quadruped Locomotion with Unsupervised Reinforcement Learning
- 2021Robot Skill Adaptation via Soft Actor-Critic Gaussian Mixture Models
- 2024Unsupervised Skill Discovery for Robotic Manipulation through Automatic Task Generation