AIRE-Prune: Asymptotic Impulse-Response Energy for State Pruning in State Space Models
Not on the map. Why?
Abstract (arXiv)
State space models (SSMs) often sacrifice capacity, search space, or stability to offset the memory and compute costs of large state dimensions. We introduce a structured post-training pruning method for SSMs -- AIRE-Prune (Asymptotic Impulse-Response Energy for State PRUN(E)) -- that reduces each layer's state dimension by directly minimizing long-run output-energy distortion. AIRE-Prune assigns every state a closed-form asymptotic impulse-response energy-based score, i.e., the total impulse-response energy it contributes over an infinite horizon (time), and normalizes these scores layer-wise to enable global cross-layer comparison and selection. This extends modal truncation from single systems to deep stacks and aligns pruning with asymptotic response energy rather than worst-case gain. Across diverse sequence benchmarks, AIRE-Prune reveals substantial redundancy in SISO and MIMO SSMs with average pruning of 60.8%, with average accuracy drop of 0.29% without retraining, while significantly lowering compute. Code: https://github.com/falcon-arrow/AIRE-Prune.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
21 of 35 references.
References · 21
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2022Simplified State Space Layers for Sequence Modelingcited by 776
- 2018Speech Commands: A Dataset for Limited-Vocabulary Speech Recognitioncited by 741
- 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
- 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
- 2017To prune, or not to prune: exploring the efficacy of pruning for model compressioncited by 596
- 2019The State of Sparsity in Deep Neural Networkscited by 471
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
- 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
9 more
- 2017Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Sciencecited by 325
- 2018ListOps: A Diagnostic Dataset for Latent Tree Learningcited by 128
- 2020Layer-adaptive sparsity for the Magnitude-based Pruningcited by 122
- 2019One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizerscited by 102
- 2018Learning long-range spatial dependencies with horizontal gated-recurrent unitscited by 98
- 2023Effectively Modeling Time Series with Simple Discrete State Spacescited by 54
- 2024State-Free Inference of State-Space Models: The Transfer Function Approachcited by 18
- 2023Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networkscited by 15
- 2024Layer-Adaptive State Pruning for Deep State Space Modelscited by 10
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Continuity Laws for Sequential Modelscited by 0
- 2026Continuity Laws for Sequential Models8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot
- 2026S4oP: Operator-level Pruning of Structured State Space Models for Resource-Constrained Devices
- 2025Efficient Unstructured Pruning of Mamba State-Space Models for Resource-Constrained Environments
- 2025On Pruning State-Space LLMs
- 2026Flash PD-SSM: Memory-Optimized Structured Sparse State-Space Models
- 2025The Curious Case of In-Training Compression of State Space Models
- 2024Rethinking Token Reduction for State Space Models
- 2026Priming: Hybrid State Space Models From Pre-trained Transformers