AGILE: A Comprehensive Workflow for Humanoid Loco-Manipulation Learning
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
Recent advances in reinforcement learning (RL) have enabled impressive humanoid behaviors in simulation, yet transferring these results to new robots remains challenging. In many real deployments, the primary bottleneck is no longer simulation throughput or algorithm design, but the absence of systematic infrastructure that links environment verification, training, evaluation, and deployment in a coherent loop. To address this gap, we present AGILE, an end-to-end workflow for humanoid RL that standardizes the policy-development lifecycle to mitigate common sim-to-real failure modes. AGILE comprises four stages: (1) interactive environment verification, (2) reproducible training, (3) unified evaluation, and (4) descriptor-driven deployment via robot/task configuration descriptors. For evaluation stage, AGILE supports both scenario-based tests and randomized rollouts under a shared suite of motion-quality diagnostics, enabling automated regression testing and principled robustness assessment. AGILE also incorporates a set of training stabilizations and algorithmic enhancements in training stage to improve optimization stability and sim-to-real transfer. With this pipeline in place, we validate AGILE across five representative humanoid skills spanning locomotion, recovery, motion imitation, and loco-manipulation on two hardware platforms (Unitree G1 and Booster T1), achieving consistent sim-to-real transfer. Overall, AGILE shows that a standardized, end-to-end workflow can substantially improve the reliability and reproducibility of humanoid RL development.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 29 of its 34 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
29 of 34 references.
Closest ancestors · 5
Same direction, newest first
- 2026Toward Reliable Sim-to-Real Predictability for MoE-based Robust Quadrupedal Locomotion31 Jan
- 2025RobotDancing: Residual-Action Reinforcement Learning Enables Robust Long-Horizon Humanoid Motion Tracking25 Sep
- 2025FastTD3: Simple, Fast, and Capable Reinforcement Learning for Humanoid Control28 May
- 2025RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning26 Apr
- 2024Learning Human-to-Humanoid Real-Time Whole-Body Teleoperation7 Mar
Other references · 24
- 2016OpenAI Gymcited by 1,736
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2018DeepMind Control Suitecited by 956
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 165
- 2020What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Studycited by 162
- 2024Expressive Whole-Body Control for Humanoid Robotscited by 139
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 112
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
- 2024ExBody2: Advanced Expressive Humanoid Whole-Body Controlcited by 88
12 more
- 2025GMT: General Motion Tracking for Humanoid Whole-Body Controlcited by 83
- 2025MuJoCo Playgroundcited by 78
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2024Humanoid Locomotion as Next Token Predictioncited by 69
- 2020Regularizing Action Policies for Smooth Control with Reinforcement Learningcited by 59
- 2024Mobile-TeleVision: Predictive Motion Priors for Humanoid Whole-Body Controlcited by 51
- 2025AMO: Adaptive Motion Optimization for Hyper-Dexterous Humanoid Whole-Body Controlcited by 51
- 2025Learning Humanoid Standing-up Control across Diverse Posturescited by 46
- 2024Symmetry Considerations for Learning Task Symmetric Robot Policiescited by 28
- 2022L2C2: Locally Lipschitz Continuous Constraint towards Stable and Smooth Reinforcement Learningcited by 27
- 2025Learning Getting-Up Policies for Real-World Humanoid Robotscited by 26
- 2024HumanVLA: Towards Vision-Language Directed Object Rearrangement by Physical Humanoidcited by 19
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulationcited by 2
- 2026Redesigning Regularization for Effective Policy Smoothingcited by 0
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interactioncited by 0
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaborationcited by 0
- 2026CoHuB: A Simulation Benchmark for Multi-Humanoid Collaboration28 Sep 2026
- 2026CoorDex: Coordinating Body and Hand Priors for Continuous Dexterous Humanoid Loco-Manipulation22 Jun 2026
- 2026MagicSim: A Unified Infrastructure for Executable Embodied Interaction16 Jun 2026
- 2026Redesigning Regularization for Effective Policy Smoothing11 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025STRIDE: Automating Reward Design, Deep Reinforcement Learning Training and Feedback Optimization in Humanoid Robotics Locomotion
- 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulation
- 2026Switch: Learning Agile Skills Switching for Humanoid Robots
- 2026REFINE-DP: Diffusion Policy Fine-tuning for Humanoid Loco-manipulation via Reinforcement Learning
- 2026HuMBLE: Human Motion-Driven Behavior Learning for Embodied Locomotion ↗
- 2026HuGo: LLMs as Whole-Body Policy Code Designers for Humanoid Loco-Manipulation
- 2026Towards Bridging the Gap between Large-Scale Pretraining and Efficient Finetuning for Humanoid Control
- 2026HALO:Closing Sim-to-Real Gap for Heavy-loaded Humanoid Agile Motion Skills via Differentiable Simulation