When Is a Learned Command Adapter Worth It? Closed-Loop Identification and Counterfactual Auditing of Frozen Locomotion Policies
Not on the map. Why?
Abstract (arXiv)
Adding a learned adapter to a frozen, command-conditioned locomotion policy is worthwhile only if the interface exposes improvements that are both real and recoverable from deployment-time observations. We introduce an adapter necessity audit that separates global operating-point gain,same-state counterfactual headroom, deployment gain over a cross-fitted fixed action, and state-allocation gain over a frequency-matched randomized policy. Source-cluster learner refits map these quantities and constraint violations to a GO/NO-GO/ABSTAIN decision. Closed-loop command- response identification provides optional decision features. On Go2, an archived scale-prefix diagnostic finds 5.2% same-state headroom but only 0.55% recovered allocation gain. Our confirmatory audit evaluates direct, scale, heading, and yaw interventions on twenty independent clusters for each of three query distributions induced by direct control, VGCC, and MPC, using 200 full learner refits. At 1% deployment and allocation thresholds and a 5% violation tolerance, direct queries return NO-GO, while VGCC and MPC queries ABSTAIN. VGCC has the largest mean deployment gain (1.34%), but its allocation lower bound is 0.09% and its violation upper bound is 6.25%. A deployment-representative twenty-cluster H1 audit also returns NO-GO, whereas a learner-level synthetic control returns GO. The audit therefore tests whether observable signal justifies state-dependent adaptation rather than presuming that an adapter is valuable.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
24 of 40 references.
References · 24
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 773
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
- 2016The Option-Critic Architecturecited by 448
- 2015Illuminating search spaces by mapping elitescited by 425
- 2022Temporal Difference Learning for Model Predictive Controlcited by 397
12 more
- 2022Learning robust perceptive locomotion for quadrupedal robots in the wildcited by 382
- 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 313
- 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 297
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2018Residual Reinforcement Learning for Robot Controlcited by 274
- 2018Residual Policy Learningcited by 164
- 2022Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behaviorcited by 138
- 2018A predictive safety filter for learning-based control of constrained nonlinear dynamical systemscited by 118
- 2017Information Theoretic Model Predictive Control: Theory and Applications to Autonomous Drivingcited by 90
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
- 2025RSL-RL: A Learning Library for Robotics Researchcited by 49
- 2026A Statistical Test for the Benefits of Personalizing Interventionscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.