UniExo: Unified Multi-Skill Policies for Musculoskeletal Locomotion and Co-Adaptive Exoskeleton Control
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Daily locomotion encompasses diverse activities and frequent transitions between them, yet most exoskeleton controllers are designed for a single activity or a narrow set of related movements. Changes in activity therefore typically require explicit mode switching and separately tuned or retrained controllers. Simulation-based learning reduces the need for hardware-based tuning but generally retains this limitation. Here we present UniExo, a framework that first constructs a multi-skill musculoskeletal human policy and then jointly trains an exoskeleton control policy with it. Four single-skill imitation experts for walking, turning, running and backward walking are distilled into a single network structured by a skill latent and subsequently fine-tuned through reinforcement learning on transition sequences. The resultant unified human policy achieves a mean tracking success rate of 94.7% on unseen clips of the four skills and exhibits greater robustness to perturbations than its constituent experts. A single hip exoskeleton controller (UniExo) is initialized from hip moment prediction of the human policy and co-adapted with it through multi-agent reinforcement learning across the four skills. This co-adaptation shifts the timing of the assistance torque and raises the fraction of positive work delivered to the hip. When deployed on a custom hip exoskeleton, the controller generalizes across four treadmill speeds in six participants and assists one participant through a continuous route of all four skills and their transitions, without skill labels or explicit mode switching. UniExo thus provides a step towards replacing activity-specific controllers with unified, user-specific controllers that support diverse locomotor activities and the transitions between them.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 14 of its 29 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
14 of 29 references.
References · 14
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,236
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2021Robust Motion In-betweeningcited by 229
- 2022MyoSuite -- A contact-rich simulation suite for musculoskeletal motor controlcited by 80
- 2023LocoMuJoCo: A Comprehensive Imitation Learning Benchmark for Locomotioncited by 33
- 2026mjlab: A Lightweight Framework for GPU-Accelerated Robot Learningcited by 26
- 2023Self Model for Embodied Intelligence: Modeling Full-Body Human Musculoskeletal System and Locomotion Control with Hierarchical Low-Dimensional Representationcited by 17
- 2025KINESIS: Motion Imitation for Human Musculoskeletal Locomotioncited by 7
- 2026Exo-Plore: Exploring Exoskeleton Control Space through Human-aligned Simulationcited by 6
- 2026Towards Embodied AI with MuscleMimic: Unlocking full-body musculoskeletal motor learning at scalecited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Hip Exoskeleton Control Policy via Predictive Neuromusculoskeletal Simulation
- 2026Musculoskeletal Motion Imitation for Learning Personalized Exoskeleton Control Policy in Impaired Gait
- 2025Arnold: A multi-task, multi-embodiment muscle transformer policy
- 2026Learning a Speed-adaptive Hip Exoskeleton Control Policy Via Sim-to-real Reinforcement Learning
- 2026Muscle Synergy Priors Enhance Biomechanical Fidelity in Predictive Musculoskeletal Locomotion Simulation
- 2026Exoskeleton Control through Learning to Reduce Biological Joint Moments in Simulations
- 2024Exciting Action: Investigating Efficient Exploration for Learning Musculoskeletal Humanoid Locomotion
- 2025ULC: A Unified and Fine-Grained Controller for Humanoid Loco-Manipulation