mlsanityData to 14 Oct 2026

ALPHABET: A Laplace-Pole History Aggregator with Banked Exponential Transport

arXiv 2608.24051 ↗First posted 25 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Can a sequence model remain competitive with only a few thousand parameters and an explicitly auditable prediction interface? We introduce ALPHABET, a compact linear-time model that compresses temporal history into stable complex pole modes: a direct bank synthesizes its modal states back into the feature trajectory, an independent cascaded bank analyzes the transformed trajectory without resynthesis, and an affine head reads only modal energies and lag moments from both banks. We characterize the temporal information this descriptor retains: for a stationary, fully observed feature process, each mode energy is a frequency-localized measurement of the second-order spectrum, the continuum of such measurements identifies the spectrum, and almost every mode separates any fixed finite set of spectrally distinct classes. On a Gaussian control with matched low-lag statistics, the learned descriptor approaches the Bayes oracle where raw autocovariances remain at chance. Across the fixed 82-task registry, ALPHABET attains mean rank 3.97 in the complete ten-family comparison. At the common-width D=64 runtime anchor, its 6,437 parameters deliver 5.02 times faster inference and 3.93 times faster complete training steps than the nine baselines on average.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 47 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

17 of 47 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  5. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  6. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  7. 2016CNN Architectures for Large-Scale Audio Classificationcited by 704
  8. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
  9. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
  10. 2018The UCR Time Series Archivecited by 431
  11. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 408
  12. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 387
5 more
  1. 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
  2. 2019ROCKET: Exceptionally fast and accurate time series classification using random convolutional kernelscited by 339
  3. 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 231
  4. 2020MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classificationcited by 190
  5. 2021The Complex-Pole Filter Representation (COFRE) for spectral modeling of fNIRS signalscited by 1

Built on by

Not cited yet.