Optimization-Based Control for Dynamic Legged Robots
Not on the map. Why?
Abstract (arXiv)
In a world designed for legs, quadrupeds, bipeds, and humanoids have the opportunity to impact emerging robotics applications from logistics, to agriculture, to home assistance. The goal of this survey is to cover the recent progress toward these applications that has been driven by model-based optimization for the real-time generation and control of movement. The majority of the research community has converged on the idea of generating locomotion control laws by solving an optimal control problem (OCP) in either a model-based or data-driven manner. However, solving the most general of these problems online remains intractable due to complexities from intermittent unidirectional contacts with the environment, and from the many degrees of freedom of legged robots. This survey covers methods that have been pursued to make these OCPs computationally tractable, with specific focus on how environmental contacts are treated, how the model can be simplified, and how these choices affect the numerical solution methods employed. The survey focuses on model-based optimization, covering its recent use in a stand alone fashion, and suggesting avenues for combination with learning-based formulations to further accelerate progress in this growing field.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 Nov 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 1; 2024: 11; 2025: 15; 2026: 8.
35 papers.
Sort:
By area:
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 99
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2023RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotioncited by 26
- 2024CTS: Concurrent Teacher-Student Reinforcement Learning for Legged Locomotioncited by 25
- 2025Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skillscited by 22
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 20
- 2025Design and Control of a Bipedal Robotic Charactercited by 18
- 2024A Learning Framework for Diverse Legged Robot Locomotion Using Barrier-Based Style Rewardscited by 12
- 2024Reinforcement Learning for Blind Stair Climbing with Legged and Wheeled-Legged Robotscited by 8
- 2024Control-oriented Clustering of Visual Latent Representationcited by 8
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Taskscited by 4
- 2025Chasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement Learningcited by 4
23 more
- 2025Robot Crash Course: Learning Soft and Stylized Fallingcited by 4
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulationcited by 3
- 2024Is Linear Feedback on Smoothed Dynamics Sufficient for Stabilizing Contact-Rich Plans?cited by 2
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correctioncited by 2
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planningcited by 2
- 2026CACTO-BIC: Scalable Actor-Critic Learning via Biased Sampling and GPU-Accelerated Trajectory Optimizationcited by 2
- 2026TurboMPC: Fast, Scalable, and Differentiable Model Predictive Control on the GPUcited by 2
- 2025Constrained Reinforcement Learning for Unstable Point-Feet Bipedal Locomotion Applied to the Bolt Robotcited by 1
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLMcited by 1
- 2025MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotioncited by 1
- 2024Primitive Agentic First-Order Optimizationcited by 0
- 2024Principles of frugal inference and controlcited by 0
- 2024Autotuning Bipedal Locomotion MPC with GRFM-Net for Efficient Sim-to-Real Transfercited by 0
- 2025Learning Impact-Rich Rotational Maneuvers via Centroidal Velocity Rewards and Sim-to-Real Techniques: A One-Leg Hopper Flip Case Studycited by 0
- 2025Whole-Body Constrained Learning for Legged Locomotion via Hierarchical Optimizationcited by 0
- 2025Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllerscited by 0
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priorscited by 0
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulationcited by 0
- 2026RL-Augmented MPC for Non-Gaited Legged and Hybrid Locomotioncited by 0
- 2026Stability of Control Lyapunov Function Guided Reinforcement Learningcited by 0
- 2026Constrained Whole-Body Tracking for Humanoid Robotscited by 0
- 2026Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargetingcited by 0
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulationcited by 0
- 2026Opt2VLA: Force-Aware Vision-Language-Action for Contact-Rich Humanoid Whole-Body Manipulation21 Sep 2026
- 2026Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargeting4 Aug 2026
- 2026TurboMPC: Fast, Scalable, and Differentiable Model Predictive Control on the GPU23 Jun 2026
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulation4 Jun 2026
- 2026Constrained Whole-Body Tracking for Humanoid Robots29 May 2026
- 2026Stability of Control Lyapunov Function Guided Reinforcement Learning3 May 2026
- 2026RL-Augmented MPC for Non-Gaited Legged and Hybrid Locomotion11 Mar 2026
- 2026CACTO-BIC: Scalable Actor-Critic Learning via Biased Sampling and GPU-Accelerated Trajectory Optimization23 Feb 2026
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning22 Dec 2025
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation26 Nov 2025
- 2025Robot Crash Course: Learning Soft and Stylized Falling13 Nov 2025
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors29 Oct 2025
23 more
- 2025Chasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement Learning23 Sep 2025
- 2025MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion14 Aug 2025
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM6 Aug 2025
- 2025Constrained Reinforcement Learning for Unstable Point-Feet Bipedal Locomotion Applied to the Bolt Robot4 Aug 2025
- 2025Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllers17 Jun 2025
- 2025Whole-Body Constrained Learning for Legged Locomotion via Hierarchical Optimization5 Jun 2025
- 2025Learning Impact-Rich Rotational Maneuvers via Centroidal Velocity Rewards and Sim-to-Real Techniques: A One-Leg Hopper Flip Case Study18 May 2025
- 2025Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skills16 Mar 2025
- 2025Generative Predictive Control: Flow Matching Policies for Dynamic and Difficult-to-Demonstrate Tasks19 Feb 2025
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpit18 Feb 2025
- 2025Design and Control of a Bipedal Robotic Character9 Jan 2025
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024Is Linear Feedback on Smoothed Dynamics Sufficient for Stabilizing Contact-Rich Plans?10 Nov 2024
- 2024Control-oriented Clustering of Visual Latent Representation7 Oct 2024
- 2024A Learning Framework for Diverse Legged Robot Locomotion Using Barrier-Based Style Rewards24 Sep 2024
- 2024Autotuning Bipedal Locomotion MPC with GRFM-Net for Efficient Sim-to-Real Transfer24 Sep 2024
- 2024Principles of frugal inference and control20 Jun 2024
- 2024Primitive Agentic First-Order Optimization7 Jun 2024
- 2024CTS: Concurrent Teacher-Student Reinforcement Learning for Legged Locomotion17 May 2024
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approaches3 Apr 2024
- 2024Reinforcement Learning for Blind Stair Climbing with Legged and Wheeled-Legged Robots9 Feb 2024
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Control30 Jan 2024
- 2023RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotion29 May 2023
- 2024Reinforcement Learning for Versatile, Dynamic, and Robust Bipedal Locomotion Controlcited by 99
- 2024CTS: Concurrent Teacher-Student Reinforcement Learning for Legged Locomotioncited by 25
- 2024A Learning Framework for Diverse Legged Robot Locomotion Using Barrier-Based Style Rewardscited by 12
- 2024Reinforcement Learning for Blind Stair Climbing with Legged and Wheeled-Legged Robotscited by 8
- 2025Chasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement Learningcited by 4
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulationcited by 3
- 2026CACTO-BIC: Scalable Actor-Critic Learning via Biased Sampling and GPU-Accelerated Trajectory Optimizationcited by 2
- 2025Constrained Reinforcement Learning for Unstable Point-Feet Bipedal Locomotion Applied to the Bolt Robotcited by 1
- 2025Learning Impact-Rich Rotational Maneuvers via Centroidal Velocity Rewards and Sim-to-Real Techniques: A One-Leg Hopper Flip Case Studycited by 0
- 2025Whole-Body Constrained Learning for Legged Locomotion via Hierarchical Optimizationcited by 0
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulationcited by 0
- 2026RL-Augmented MPC for Non-Gaited Legged and Hybrid Locomotioncited by 0
12 most cited of 15 All 15 (JSON)
- 2026Shooting for Contact: Contact-Implicit Multiple Shooting for Dynamic Motion Retargeting4 Aug 2026
- 2026Accelerating and Scaling MPC-Guided Reinforcement Learning for Humanoid Locomotion and Manipulation4 Jun 2026
- 2026Constrained Whole-Body Tracking for Humanoid Robots29 May 2026
- 2026Stability of Control Lyapunov Function Guided Reinforcement Learning3 May 2026
- 2026RL-Augmented MPC for Non-Gaited Legged and Hybrid Locomotion11 Mar 2026
- 2026CACTO-BIC: Scalable Actor-Critic Learning via Biased Sampling and GPU-Accelerated Trajectory Optimization23 Feb 2026
- 2025Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation26 Nov 2025
- 2025Chasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement Learning23 Sep 2025
- 2025Constrained Reinforcement Learning for Unstable Point-Feet Bipedal Locomotion Applied to the Bolt Robot4 Aug 2025
- 2025Whole-Body Constrained Learning for Legged Locomotion via Hierarchical Optimization5 Jun 2025
- 2025Learning Impact-Rich Rotational Maneuvers via Centroidal Velocity Rewards and Sim-to-Real Techniques: A One-Leg Hopper Flip Case Study18 May 2025
- 2024A Learning Framework for Diverse Legged Robot Locomotion Using Barrier-Based Style Rewards24 Sep 2024
12 newest of 15 All 15 (JSON)
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpitcited by 76
- 2023RL + Model-based Control: Using On-demand Optimal Control to Learn Versatile Legged Locomotioncited by 26
- 2024A Survey of Optimization-based Task and Motion Planning: From Classical To Learning Approachescited by 20
- 2025Design and Control of a Bipedal Robotic Charactercited by 18
- 2024Control-oriented Clustering of Visual Latent Representationcited by 8
- 2025Robot Crash Course: Learning Soft and Stylized Fallingcited by 4
- 2024Is Linear Feedback on Smoothed Dynamics Sufficient for Stabilizing Contact-Rich Plans?cited by 2
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correctioncited by 2
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planningcited by 2
- 2026TurboMPC: Fast, Scalable, and Differentiable Model Predictive Control on the GPUcited by 2
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLMcited by 1
- 2025MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotioncited by 1
12 most cited of 16 All 16 (JSON)
- 2026TurboMPC: Fast, Scalable, and Differentiable Model Predictive Control on the GPU23 Jun 2026
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning22 Dec 2025
- 2025Robot Crash Course: Learning Soft and Stylized Falling13 Nov 2025
- 2025One-shot Adaptation of Humanoid Whole-body Motion with Walking Priors29 Oct 2025
- 2025MASH: Cooperative-Heterogeneous Multi-Agent Reinforcement Learning for Single Humanoid Robot Locomotion14 Aug 2025
- 2025INTENTION: Inferring Tendencies of Humanoid Robot Motion Through Interactive Intuition and Grounded VLM6 Aug 2025
- 2025Feedback-MPPI: Fast Sampling-Based MPC via Rollout Differentiation -- Adios low-level controllers17 Jun 2025
- 2025HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpit18 Feb 2025
- 2025Design and Control of a Bipedal Robotic Character9 Jan 2025
- 2024CrossTracker: Robust Multi-modal 3D Multi-Object Tracking via Cross Correction28 Nov 2024
- 2024Is Linear Feedback on Smoothed Dynamics Sufficient for Stabilizing Contact-Rich Plans?10 Nov 2024
- 2024Control-oriented Clustering of Visual Latent Representation7 Oct 2024
12 newest of 16 All 16 (JSON)