mlsanityData to 14 Oct 2026

Temporal Attention for Adaptive Control of Euler-Lagrange Systems with Unobservable Memory

arXiv 2605.06877 ↗First posted 7 May 2026cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Adaptive control of Euler-Lagrange systems is challenging when friction is governed by a finite-horizon internal state that is not directly observable from joint measurements. In this setting, the measured closed-loop state is no longer Markovian, and standard certainty-equivalence adaptive laws may lose their convergence guarantees. The paper proposes a meta-control architecture in which the gains of a computed-torque controller are generated by a self-attention block processing a short window of recent motion history. The number of attention heads is selected before policy training through a surrogate analysis of the autocovariance of the memory-state gradient along the temporal window. This surrogate is based on a temporal adaptation of an incremental rank-tracking framework previously developed by the authors. The selected head count is then fixed and used as an architectural hyperparameter in a reinforcement-learning stage, where the policy is trained under a shielded admissibility constraint. The approach is tested on a 2-DOF manipulator with nonlinear friction and variable payload. In the short and matched memory regimes, the single-layer attention-only meta-controller outperforms a deeper Transformer baseline, with tracking-error reductions of 12 and 19 percentage points, respectively. The reported effect sizes are large, with d approximately -1.1 and -2.1, and Mann-Whitney p < 0.05 in both cases. In the long memory regime, however, the advantage disappears. Four out of ten training runs show either divergence or payload-invariant policy collapse, revealing a weakness in the static Phase-1 head-count prescription. This motivates moving rank-tracking inside the reinforcement-learning loop, allowing attention heads to be pruned or grown at runtime instead of fixed before training.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 24 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

9 of 24 references.

References · 9

  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  2. 2018DARTS: Differentiable Architecture Searchcited by 1,798
  3. 2017Constrained Policy Optimizationcited by 983
  4. 2018Efficient Neural Architecture Search via Parameter Sharingcited by 837
  5. 2019Control Barrier Functions: Theory and Applicationscited by 372
  6. 2020Responsive Safety in Reinforcement Learning by PID Lagrangian Methodscited by 316
  7. 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
  8. 2021Differentiable Architecture Search for Reinforcement Learningcited by 4
  9. 2026INCRT: An Incremental Transformer That Determines Its Own Architecturecited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.