Temporal Attention for Adaptive Control of Euler-Lagrange Systems with Unobservable Memory
Not on the map. Why?
Abstract (arXiv)
Adaptive control of Euler-Lagrange systems is challenging when friction is governed by a finite-horizon internal state that is not directly observable from joint measurements. In this setting, the measured closed-loop state is no longer Markovian, and standard certainty-equivalence adaptive laws may lose their convergence guarantees. The paper proposes a meta-control architecture in which the gains of a computed-torque controller are generated by a self-attention block processing a short window of recent motion history. The number of attention heads is selected before policy training through a surrogate analysis of the autocovariance of the memory-state gradient along the temporal window. This surrogate is based on a temporal adaptation of an incremental rank-tracking framework previously developed by the authors. The selected head count is then fixed and used as an architectural hyperparameter in a reinforcement-learning stage, where the policy is trained under a shielded admissibility constraint. The approach is tested on a 2-DOF manipulator with nonlinear friction and variable payload. In the short and matched memory regimes, the single-layer attention-only meta-controller outperforms a deeper Transformer baseline, with tracking-error reductions of 12 and 19 percentage points, respectively. The reported effect sizes are large, with d approximately -1.1 and -2.1, and Mann-Whitney p < 0.05 in both cases. In the long memory regime, however, the advantage disappears. Four out of ten training runs show either divergence or payload-invariant policy collapse, revealing a weakness in the static Phase-1 head-count prescription. This motivates moving rank-tracking inside the reinforcement-learning loop, allowing attention heads to be pruned or grown at runtime instead of fixed before training.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
9 of 24 references.
References · 9
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2018DARTS: Differentiable Architecture Searchcited by 1,798
- 2017Constrained Policy Optimizationcited by 983
- 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
- 2019Control Barrier Functions: Theory and Applicationscited by 372
- 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 316
- 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
- 2021Differentiable Architecture Search for Reinforcement Learningcited by 4
- 2026INCRT: An Incremental Transformer That Determines Its Own Architecturecited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.