mlsanityData to 7 Oct 2026

textttlrnnx: A library for Linear RNNs

arXiv 2602.08810 ↗First posted 9 Feb 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Linear recurrent neural networks (LRNNs) provide a structured approach to sequence modeling that bridges classical linear dynamical systems and modern deep learning, offering both expressive power and theoretical guarantees on stability and trainability. In recent years, multiple LRNN-based architectures have been proposed, each introducing distinct parameterizations, discretization schemes, and implementation constraints. However, existing implementations are fragmented across different software frameworks, often rely on framework-specific optimizations, and in some cases require custom CUDA kernels or lack publicly available code altogether. As a result, using, comparing, or extending LRNNs requires substantial implementation effort. To address this, we introduce textttlrnnx, a unified software library that implements several modern LRNN architectures under a common interface. The library exposes multiple levels of control, allowing users to work directly with core components or higher-level model abstractions. textttlrnnx aims to improve accessibility, reproducibility, and extensibility of LRNN research and applications. We make our code available under a permissive MIT license.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

18 of 29 references.

References · 18

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  6. 2020Longformer: The Long-Document Transformercited by 3,362
  7. 2020Reformer: The Efficient Transformercited by 1,658
  8. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  9. 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
  10. 2022Simplified State Space Layers for Sequence Modelingcited by 776
  11. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
  12. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
6 more
  1. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  2. 2024Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Modelscited by 232
  3. 2024S7: Selective and Simplified State Space Layers for Sequence Modelingcited by 17
  4. 2024STREAM: A Universal State-Space Model for Sparse Geometric Datacited by 2
  5. 2025Let SSMs be ConvNets: State-space Modeling with Optimal Tensor Contractionscited by 2
  6. 2025Lyra: An Efficient and Expressive Subquadratic Architecture for Modeling Biological Sequencescited by 2

Built on by

Not cited yet.