Behavior Cloning Under PD Control: A Finite-Horizon Theory of Gain-Dependent Error Amplification
Not on the map. Why?
Abstract (arXiv)
Behavior cloning (BC) on position-controlled robots is shaped by the PD loop that executes policy actions. We give a finite-horizon, nonasymptotic analysis of how controller gains affect BC failure. Independent sub-Gaussian action errors propagate through gain-dependent closed-loop dynamics into sub-Gaussian position errors. The resulting failure tail is controlled by controller amplification multiplied by validation loss and generalization slack, so validation loss alone can mis-rank gains. Under shape-preserving upper-bound assumptions, the analysis separates label difficulty, injection strength, and contraction, ranking compliant-overdamped gains as tightest and stiff-underdamped gains as loosest, with the mixed regimes system-dependent. In the canonical scalar second-order PD system, stationary position-error variance increases with stiffness and decreases with damping over the stable range, and exact zero-order-hold discretization inherits the ordering to leading order. This extends the error-attenuation explanation of bronars et al. (2026) to finite-horizon failure bounds.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 31 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
17 of 31 references.
References · 17
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
- 2021Implicit Behavioral Cloningcited by 442
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 373
- 2018A Tour of Reinforcement Learning: The View from Continuous Controlcited by 129
- 2024Is Behavior Cloning All You Need? Understanding Horizon in Imitation Learningcited by 74
- 2021Feedback in Imitation Learning: The Three Regimes of Covariate Shiftcited by 68
- 2018The Gap Between Model-Based and Model-Free Methods on the Linear Quadratic Regulator: An Asymptotic Viewpointcited by 36
- 2023Provable Guarantees for Generative Behavior Cloning: Bridging Low-Level Stability and High-Level Behaviorcited by 33
- 2025The Pitfalls of Imitation Learning when Actions are Continuouscited by 25
5 more
- 2023On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfercited by 20
- 2019Learning Variable Impedance Control for Contact Sensitive Taskscited by 15
- 2023Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregressioncited by 14
- 2023Torque-based Deep Reinforcement Learning for Task-and-Robot Agnostic Learning on Bipedal Robots Using Sim-to-Real Transfercited by 12
- 2026Tune to Learn: How Controller Gains Shape Robot Policy Learningcited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Stable-BC: Controlling Covariate Shift with Stable Behavior Cloning
- 2024How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation
- 2026Beyond Imitation: Self-Improving Robot Policies via Off-Policy Q-Planning
- 2024From Imitation to Refinement -- Residual RL for Precise Assembly
- 2026Is Online Interaction Necessary for Recovery? A Minimalist Approach to Robust Planning via Perturbation ↗
- 2026Understanding Behavior Cloning with Action Quantization
- 2026Measuring the Stability Assumption Behind Action Chunking
- 2025Action Chunking and Exploratory Data Collection Yield Exponential Improvements in Behavior Cloning for Continuous Control