LocoMuJoCo: A Comprehensive Imitation Learning Benchmark for Locomotion
On the map: Offline RL and imitation learning from data → Real-world robot offline RL
Abstract (arXiv)
Imitation Learning (IL) holds great promise for enabling agile locomotion in embodied agents. However, many existing locomotion benchmarks primarily focus on simplified toy tasks, often failing to capture the complexity of real-world scenarios and steering research toward unrealistic domains. To advance research in IL for locomotion, we present a novel benchmark designed to facilitate rigorous evaluation and comparison of IL algorithms. This benchmark encompasses a diverse set of environments, including quadrupeds, bipeds, and musculoskeletal human models, each accompanied by comprehensive datasets, such as real noisy motion capture data, ground truth expert data, and ground truth sub-optimal data, enabling evaluation across a spectrum of difficulty levels. To increase the robustness of learned agents, we provide an easy interface for dynamics randomization and offer a wide range of partially observable tasks to train agents across different embodiments. Finally, we provide handcrafted metrics for each task and ship our benchmark with state-of-the-art baseline algorithms to ease evaluation and enable fast benchmarking.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Placed in Real-world robot offline RL, one of 13 directions in Offline RL and imitation learning from data. Builds on 15 of its 24 references that are in the map. First posted on arXiv 4 Nov 2023.
Builds on
15 of 24 references.
References · 15
- 2016Generative Adversarial Imitation Learningcited by 1,576
- 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,406
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 685
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
- 2019Relay Policy Learning: Solving Long-Horizon Tasks via Imitation and Reinforcement Learningcited by 380
- 2020dm_control: Software and Tasks for Continuous Controlcited by 368
- 2021IQ-Learn: Inverse soft-Q Learning for Imitationcited by 191
- 2018Generative Adversarial Imitation from Observationcited by 183
- 2018Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flowcited by 103
- 2022MyoSuite -- A contact-rich simulation suite for musculoskeletal motor controlcited by 80
3 more
- 2020MushroomRL: Simplifying Reinforcement Learning Researchcited by 50
- 2023LS-IQ: Implicit Reward Regularization for Inverse Reinforcement Learningcited by 28
- 2019Simitate: A Hybrid Imitation Learning Benchmarkcited by 10
Built on by
Citing papers per year: 2024: 12; 2025: 11; 2026: 8.
31 papers.
Sort:
By area:
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 101
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instructioncited by 40
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmarkcited by 30
- 2024Differentiable Biomechanics Unlocks Opportunities for Markerless Motion Capturecited by 18
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 14
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Controlcited by 13
- 2025SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blendingcited by 9
- 2024Differentiable Biomechanics for Markerless Motion Capture in Upper Limb Stroke Rehabilitation: A Comparison with Optical Motion Capturecited by 8
- 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphonecited by 8
- 2025TDMPBC: Self-Imitative Reinforcement Learning for Humanoid Robot Controlcited by 6
- 2025NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Modelscited by 5
- 2025KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capturecited by 5
19 more
- 2026Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Modelscited by 5
- 2024Learning Speed-Adaptive Walking Agent Using Imitation Learning with Physics-Informed Simulationcited by 4
- 2025Efficient Imitation under Misspecificationcited by 4
- 2024Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulationcited by 2
- 2026HARBOR: A Harness Framework for Agentic Robot Reinforcement Learningcited by 2
- 2024RILe: Reinforced Imitation Learningcited by 1
- 2024Exciting Action: Investigating Efficient Exploration for Learning Musculoskeletal Humanoid Locomotioncited by 1
- 2024The Role of Domain Randomization in Training Diffusion Policies for Whole-Body Humanoid Controlcited by 1
- 2025TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperationcited by 1
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learningcited by 1
- 2024Latent Action Priors for Locomotion with Deep Reinforcement Learningcited by 0
- 2024Unpacking the Individual Components of Diffusion Policycited by 0
- 2025BiomechGPT: Extending Motion-Language Models to Clinical Motion Understandingcited by 0
- 2025Discrete Variational Autoencoding via Policy Searchcited by 0
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
- 2026Trust Region Inverse Reinforcement Learning: Explicit Dual Ascent using Local Policy Updatescited by 0
- 2026Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Trackingcited by 0
- 2026UniExo: Unified Multi-Skill Policies for Musculoskeletal Locomotion and Co-Adaptive Exoskeleton Controlcited by 0
- 2026Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?cited by 0
- 2026Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?1 Oct 2026
- 2026UniExo: Unified Multi-Skill Policies for Musculoskeletal Locomotion and Co-Adaptive Exoskeleton Control17 Sep 2026
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning24 Jun 2026
- 2026HARBOR: A Harness Framework for Agentic Robot Reinforcement Learning7 Jun 2026
- 2026Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking6 Jun 2026
- 2026Trust Region Inverse Reinforcement Learning: Explicit Dual Ascent using Local Policy Updates10 May 2026
- 2026Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Models10 May 2026
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kinetics12 Mar 2026
- 2025Discrete Variational Autoencoding via Policy Search29 Sep 2025
- 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphone11 Jul 2025
- 2025LeVERB: Humanoid Whole-Body Control with Latent Vision-Language Instruction16 Jun 2025
- 2025SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending11 Jun 2025
19 more
- 2025BiomechGPT: Extending Motion-Language Models to Clinical Motion Understanding24 May 2025
- 2025KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture19 May 2025
- 2025TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperation19 May 2025
- 2025Efficient Imitation under Misspecification17 Mar 2025
- 2025NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Models13 Mar 2025
- 2025TDMPBC: Self-Imitative Reinforcement Learning for Humanoid Robot Control24 Feb 2025
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control18 Feb 2025
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking23 Dec 2024
- 2024Learning Speed-Adaptive Walking Agent Using Imitation Learning with Physics-Informed Simulation5 Dec 2024
- 2024Unpacking the Individual Components of Diffusion Policy27 Nov 2024
- 2024Differentiable Biomechanics for Markerless Motion Capture in Upper Limb Stroke Rehabilitation: A Comparison with Optical Motion Capture22 Nov 2024
- 2024The Role of Domain Randomization in Training Diffusion Policies for Whole-Body Humanoid Control2 Nov 2024
- 2024Latent Action Priors for Locomotion with Deep Reinforcement Learning4 Oct 2024
- 2024Exciting Action: Investigating Efficient Exploration for Learning Musculoskeletal Humanoid Locomotion16 Jul 2024
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark10 Jul 2024
- 2024RILe: Reinforced Imitation Learning12 Jun 2024
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulation15 Mar 2024
- 2024Differentiable Biomechanics Unlocks Opportunities for Markerless Motion Capture27 Feb 2024
- 2024Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulation20 Feb 2024
- 2025KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capturecited by 5
- 2024Learning Speed-Adaptive Walking Agent Using Imitation Learning with Physics-Informed Simulationcited by 4
- 2025Efficient Imitation under Misspecificationcited by 4
- 2024RILe: Reinforced Imitation Learningcited by 1
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
- 2026Trust Region Inverse Reinforcement Learning: Explicit Dual Ascent using Local Policy Updatescited by 0
- 2026Trust Region Inverse Reinforcement Learning: Explicit Dual Ascent using Local Policy Updates10 May 2026
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kinetics12 Mar 2026
- 2025KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture19 May 2025
- 2025Efficient Imitation under Misspecification17 Mar 2025
- 2024Learning Speed-Adaptive Walking Agent Using Imitation Learning with Physics-Informed Simulation5 Dec 2024
- 2024RILe: Reinforced Imitation Learning12 Jun 2024
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Controlcited by 13
- 2025NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Modelscited by 5
- 2024The Role of Domain Randomization in Training Diffusion Policies for Whole-Body Humanoid Controlcited by 1
- 2024Unpacking the Individual Components of Diffusion Policycited by 0
- 2025NIL: No-data Imitation Learning by Leveraging Pre-trained Video Diffusion Models13 Mar 2025
- 2025Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control18 Feb 2025
- 2024Unpacking the Individual Components of Diffusion Policy27 Nov 2024
- 2024The Role of Domain Randomization in Training Diffusion Policies for Whole-Body Humanoid Control2 Nov 2024
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 101
- 2024BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmarkcited by 30
- 2024Differentiable Biomechanics Unlocks Opportunities for Markerless Motion Capturecited by 18
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimickingcited by 14
- 2025SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blendingcited by 9
- 2024Differentiable Biomechanics for Markerless Motion Capture in Upper Limb Stroke Rehabilitation: A Comparison with Optical Motion Capturecited by 8
- 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphonecited by 8
- 2025TDMPBC: Self-Imitative Reinforcement Learning for Humanoid Robot Controlcited by 6
- 2026Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Modelscited by 5
- 2024Advancing Monocular Video-Based Gait Analysis Using Motion Imitation with Physics-Based Simulationcited by 2
- 2024Exciting Action: Investigating Efficient Exploration for Learning Musculoskeletal Humanoid Locomotioncited by 1
- 2025TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperationcited by 1
12 most cited of 18 All 18 (JSON)
- 2026Reusing Past Samples in Proximal Policy Optimization: When and How Does It Help?1 Oct 2026
- 2026UniExo: Unified Multi-Skill Policies for Musculoskeletal Locomotion and Co-Adaptive Exoskeleton Control17 Sep 2026
- 2026Mind Your Steps: A General Learning Framework for Accurate Humanoid Foothold Tracking6 Jun 2026
- 2026Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Models10 May 2026
- 2025Discrete Variational Autoencoding via Policy Search29 Sep 2025
- 2025Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphone11 Jul 2025
- 2025SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending11 Jun 2025
- 2025BiomechGPT: Extending Motion-Language Models to Clinical Motion Understanding24 May 2025
- 2025TeleOpBench: A Simulator-Centric Benchmark for Dual-Arm Dexterous Teleoperation19 May 2025
- 2025TDMPBC: Self-Imitative Reinforcement Learning for Humanoid Robot Control24 Feb 2025
- 2024Mimicking-Bench: A Benchmark for Generalizable Humanoid-Scene Interaction Learning via Human Mimicking23 Dec 2024
- 2024Differentiable Biomechanics for Markerless Motion Capture in Upper Limb Stroke Rehabilitation: A Comparison with Optical Motion Capture22 Nov 2024
12 newest of 18 All 18 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
- 2026FetchMan: Learning Visual Humanoid Loco-Manipulation Policies from Simulated Experiences ↗
- 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrations
- 2025Humanoid Locomotion and Manipulation: Current Progress and Challenges in Control, Planning, and Learning
- 2026InterMimicGen: Scaling Humanoid Loco-Manipulation through Self-Evolving Motion Imitation
- 2023DecAP: Decaying Action Priors for Accelerated Imitation Learning of Torque-Based Legged Locomotion Policies
- 2019Self-Imitation Learning of Locomotion Movements through Termination Curriculum
- 2025Think on your feet: Seamless Transition between Human-like Locomotion in Response to Changing Commands