Cumsum-Composable Phase Transport for Low-Cost Streaming Keyword Spotting
Not on the map. Why?
Abstract (arXiv)
State-space sequence models are attractive for streaming speech because they maintain compact recurrent state, but scan-style training kernels can have unfavorable constants for short audio tasks. We study cumsum-composable phase transport, a streaming-native temporal layer for keyword spotting. Each layer projects acoustic frames to complex channels, transports them by learned unitary rotations, accumulates a finite window using prefix differences, and applies a gated residual update. The same prefix representation gives exact batched training with ordinary cumulative sums and exact online inference with one prefix update per frame. Unitary transport is the key constraint: inverse rotations have norm one, keeping prefix terms well conditioned while memory is supplied by windows or block readouts. On Google Speech Commands v2 with 12 labels, mel+cumsum models retain competitive accuracy with compact baselines. The strongest single-seed run reaches 97.3% test accuracy; a 51.6K-parameter tied model also reaches 97.3%, and a 24.8K tied model reaches 96.8% versus 97.1% for a 25.6K MelCNNMaxPool baseline. In a matched cumsum-versus-scan benchmark, cumsum+window gives comparable accuracy, 94.82% versus 94.33%, while training 1.07x faster and reducing single-example latency from 7.09 ms to 5.01 ms on a Tesla T4. These results support cumsum phase transport as a simple low-cost temporal primitive for streaming keyword spotting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 21 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
15 of 21 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 752
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
- 2017Hello Edge: Keyword Spotting on Microcontrollerscited by 110
- 2021LEAF: A Learnable Frontend for Audio Classificationcited by 69
- 2019Temporal Convolution for Real-time Keyword Spotting on Mobile Devicescited by 49
3 more
- 2021Broadcasted Residual Learning for Efficient Keyword Spottingcited by 48
- 2020Streaming keyword spotting on mobile devicescited by 47
- 2022Latency Control for Keyword Spottingcited by 1
Built on by
Not cited yet.