{"total":187,"rows":[{"id":"2412.06464","title":"Gated Delta Networks: Improving Mamba2 with Delta Rule","created":"2024-12-09","cited_by_count":532,"area":null},{"id":"2406.06484","title":"Parallelizing Linear Transformers with the Delta Rule over Sequence Length","created":"2024-06-10","cited_by_count":396,"area":null},{"id":"2510.26692","title":"Kimi Linear: An Expressive, Efficient Attention Architecture","created":"2025-10-30","cited_by_count":196,"area":"deeprl"},{"id":"2406.07522","title":"Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling","created":"2024-06-11","cited_by_count":174,"area":"ssm"},{"id":"2505.23719","title":"TiRex: Zero-Shot Forecasting Across Long and Short Horizons with Enhanced In-Context Learning","created":"2025-05-29","cited_by_count":120,"area":null},{"id":"2406.03689","title":"Evaluating the World Model Implicit in a Generative Model","created":"2024-06-06","cited_by_count":113,"area":"wm"},{"id":"2411.12537","title":"Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues","created":"2024-11-19","cited_by_count":101,"area":"ssm"},{"id":"2603.15569","title":"Mamba-3: Improved Sequence Modeling using State Space Principles","created":"2026-03-16","cited_by_count":89,"area":"lr"},{"id":"2502.10297","title":"DeltaProduct: Improving State-Tracking in Linear RNNs via Householder Products","created":"2025-02-14","cited_by_count":75,"area":null},{"id":"2510.00636","title":"Expected Attention: KV Cache Compression by Estimating Attention from Future Queries Distribution","created":"2025-10-01","cited_by_count":74,"area":"inference"},{"id":"2512.24695","title":"Nested Learning: The Illusion of Deep Learning Architectures","created":"2025-12-31","cited_by_count":72,"area":null},{"id":"2505.23735","title":"ATLAS: Learning to Optimally Memorize the Context at Test Time","created":"2025-05-29","cited_by_count":66,"area":null},{"id":"2504.13173","title":"It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization","created":"2025-04-17","cited_by_count":64,"area":null},{"id":"2503.03961","title":"A Little Depth Goes a Long Way: The Expressive Power of Log-Depth Transformers","created":"2025-03-05","cited_by_count":53,"area":null},{"id":"2506.05233","title":"MesaNet: Sequence Modeling by Locally Optimal Test-Time Training","created":"2025-06-05","cited_by_count":47,"area":null},{"id":"2507.06952","title":"What Has a Foundation Model Found? Using Inductive Bias to Probe for World Models","created":"2025-07-09","cited_by_count":47,"area":"wm"},{"id":"2405.17394","title":"The Expressive Capacity of State Space Models: A Formal Language Perspective","created":"2024-05-27","cited_by_count":46,"area":null},{"id":"2506.04761","title":"Log-Linear Attention","created":"2025-06-05","cited_by_count":40,"area":null},{"id":"2408.01129","title":"A Survey of Mamba","created":"2024-08-02","cited_by_count":39,"area":"ssm"},{"id":"2407.19115","title":"Towards Scalable and Stable Parallelization of Nonlinear RNNs","created":"2024-07-26","cited_by_count":38,"area":null},{"id":"2503.02854","title":"(How) Do Language Models Track State?","created":"2025-03-04","cited_by_count":34,"area":null},{"id":"2505.16381","title":"PaTH Attention: Position Encoding via Accumulating Householder Transformations","created":"2025-05-22","cited_by_count":34,"area":null},{"id":"2505.19488","title":"Understanding Transformer from the Perspective of Associative Memory","created":"2025-05-26","cited_by_count":34,"area":null},{"id":"2511.05963","title":"Next-Latent Prediction Transformers Learn Compact World Models","created":"2025-11-08","cited_by_count":31,"area":"wm"},{"id":"2606.18206","title":"Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformers","created":"2026-06-16","cited_by_count":28,"area":null},{"id":"2405.15731","title":"Understanding the differences in Foundation Models: Attention, State Space Models, and Recurrent Neural Networks","created":"2024-05-24","cited_by_count":26,"area":null},{"id":"2405.20131","title":"Language Models Need Inductive Biases to Count Inductively","created":"2024-05-30","cited_by_count":25,"area":null},{"id":"2405.21064","title":"Recurrent neural networks: vanishing and exploding gradients are not the end of the story","created":"2024-05-31","cited_by_count":25,"area":null},{"id":"2511.16652","title":"Evolution Strategies at the Hyperscale","created":"2025-11-20","cited_by_count":25,"area":null},{"id":"2502.07827","title":"Implicit Language Models are RNNs: Balancing Parallelization and Expressivity","created":"2025-02-10","cited_by_count":22,"area":"lr"},{"id":"2412.06148","title":"The Computational Limits of State-Space Models and Mamba via the Lens of Circuit Complexity","created":"2024-12-09","cited_by_count":21,"area":"ssm"},{"id":"2504.05646","title":"Lattice: Learning to Efficiently Compress the Memory","created":"2025-04-08","cited_by_count":19,"area":null},{"id":"2406.03386","title":"Learning Long Range Dependencies on Graphs via Random Walks","created":"2024-06-05","cited_by_count":18,"area":null},{"id":"2501.00658","title":"Understanding and Mitigating Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing","created":"2024-12-31","cited_by_count":18,"area":"ssm"},{"id":"2502.20129","title":"Finite State Automata Inside Transformers with Chain-of-Thought: A Mechanistic Study on State Tracking","created":"2025-02-27","cited_by_count":18,"area":"lr"},{"id":"2505.17761","title":"Structured Linear CDEs: Maximally Expressive and Parallel-in-Time Sequence Models","created":"2025-05-23","cited_by_count":18,"area":null},{"id":"2509.22284","title":"Structured Sparse Transition Matrices to Enable State Tracking in State-Space Models","created":"2025-09-26","cited_by_count":16,"area":null},{"id":"2410.03170","title":"Autoregressive Large Language Models are Computationally Universal","created":"2024-10-04","cited_by_count":15,"area":null},{"id":"2412.09925","title":"Simulating Hard Attention Using Soft Attention","created":"2024-12-13","cited_by_count":15,"area":null},{"id":"2510.21450","title":"ParaRNN: Unlocking Parallel Training of Nonlinear RNNs for Large Language Models","created":"2025-10-24","cited_by_count":15,"area":null},{"id":"2602.24281","title":"Memory Caching: RNNs with Growing Memory","created":"2026-02-27","cited_by_count":15,"area":null},{"id":"2410.22391","title":"A Large Recurrent Action Model: xLSTM enables Fast Inference for Robotics Tasks","created":"2024-10-29","cited_by_count":14,"area":"deeprl"},{"id":"2511.07378","title":"Transformers Provably Learn Chain-of-Thought Reasoning with Length Generalization","created":"2025-11-10","cited_by_count":14,"area":"lr"},{"id":"2410.17980","title":"Scaling Stick-Breaking Attention: An Efficient Implementation and In-depth Study","created":"2024-10-23","cited_by_count":13,"area":null},{"id":"2411.04165","title":"Bio-xLSTM: Generative modeling, representation and in-context learning of biological and chemical sequences","created":"2024-11-06","cited_by_count":13,"area":null},{"id":"2507.12549","title":"The Serial Scaling Hypothesis","created":"2025-07-16","cited_by_count":13,"area":null},{"id":"2506.00744","title":"Blending Complementary Memory Systems in Hybrid Quadratic-Linear Transformers","created":"2025-05-31","cited_by_count":12,"area":null},{"id":"2412.19634","title":"Deep Continuous-Time State-Space Models for Marked Event Sequences","created":"2024-12-27","cited_by_count":11,"area":null},{"id":"2502.10178","title":"From Markov to Laplace: How Mamba In-Context Learns Markov Chains","created":"2025-02-14","cited_by_count":11,"area":"ssm"},{"id":"2507.06607","title":"Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation","created":"2025-07-09","cited_by_count":11,"area":"lr"},{"id":"2407.08112","title":"How Well Can a Long Sequence Model Model Long Sequences? Comparing Architechtural Inductive Biases on Long-Context Abilities","created":"2024-07-11","cited_by_count":9,"area":null},{"id":"2411.17066","title":"Relations, Negations, and Numbers: Looking for Logic in Generative Text-to-Image Models","created":"2024-11-26","cited_by_count":9,"area":null},{"id":"2501.15570","title":"ARWKV: Pretrain is not what we need, an RNN-Attention-Based Language Model Born from Transformer","created":"2025-01-26","cited_by_count":9,"area":"safety"},{"id":"2505.12171","title":"Learning to Dissipate Energy in Oscillatory State-Space Models","created":"2025-05-17","cited_by_count":9,"area":null},{"id":"2511.17388","title":"Selective Rotary Position Embedding","created":"2025-11-21","cited_by_count":9,"area":null},{"id":"2603.01959","title":"The Expressive Limits of Diagonal SSMs for State-Tracking","created":"2026-03-02","cited_by_count":9,"area":null},{"id":"2506.10918","title":"Sequential-Parallel Duality in Prefix Scannable Models","created":"2025-06-12","cited_by_count":8,"area":"ssm"},{"id":"2508.08435","title":"Fast weight programming and linear transformers: from machine learning to neurobiology","created":"2025-08-11","cited_by_count":8,"area":null},{"id":"2511.07343","title":"TNT: Improving Chunkwise Training for Test-Time Memorization","created":"2025-11-10","cited_by_count":8,"area":null},{"id":"2602.10743","title":"Kalman Linear Attention: Parallel Bayesian Filtering For Efficient Language Modelling and State Tracking","created":"2026-02-11","cited_by_count":8,"area":null},{"id":"2603.03612","title":"Why Are Linear RNNs More Parallelizable?","created":"2026-03-04","cited_by_count":8,"area":null},{"id":"2603.14360","title":"M$^2$RNN: Non-Linear RNNs with Matrix-Valued States for Scalable Language Modeling","created":"2026-03-15","cited_by_count":8,"area":null},{"id":"2412.07752","title":"FlashRNN: I/O-Aware Optimization of Traditional RNNs on modern hardware","created":"2024-12-10","cited_by_count":7,"area":null},{"id":"2506.11891","title":"Understanding Input Selectivity in Mamba: Impact on Approximation Power, Memorization, and Associative Recall Capacity","created":"2025-06-13","cited_by_count":7,"area":"ssm"},{"id":"2508.16817","title":"Predictability Enables Parallelization of Nonlinear State Space Models","created":"2025-08-22","cited_by_count":7,"area":null},{"id":"2510.13903","title":"Benefits and Limitations of Communication in Multi-Agent Reasoning","created":"2025-10-14","cited_by_count":7,"area":"lr"},{"id":"2604.21100","title":"Preconditioned DeltaNet: Curvature-aware Sequence Modeling for Linear Recurrences","created":"2026-04-22","cited_by_count":7,"area":null},{"id":"2607.15178","title":"T^2MLR: Transformer with Temporal Middle-Layer Recurrence","created":"2026-07-16","cited_by_count":7,"area":null},{"id":"2405.19036","title":"State Space Models are Provably Comparable to Transformers in Dynamic Token Selection","created":"2024-05-29","cited_by_count":6,"area":null},{"id":"2410.03810","title":"Exploring the Limitations of Mamba in COPY and CoT Reasoning","created":"2024-10-04","cited_by_count":6,"area":"lr"},{"id":"2503.01544","title":"Compositional Reasoning with Transformers, RNNs, and Chain of Thought","created":"2025-03-03","cited_by_count":6,"area":"lr"},{"id":"2505.21785","title":"Born a Transformer -- Always a Transformer? On the Effect of Pretraining on Architectural Abilities","created":"2025-05-27","cited_by_count":6,"area":null},{"id":"2602.14814","title":"Learning State-Tracking from Code Using Linear RNNs","created":"2026-02-16","cited_by_count":6,"area":null},{"id":"2605.30233","title":"Do Language Models Track Entities Across State Changes?","created":"2026-05-28","cited_by_count":6,"area":null},{"id":"2607.20594","title":"When Does Recurrence Become an Algorithm? Convergence Selection in Weight-Tied Looped Transformers","created":"2026-07-22","cited_by_count":6,"area":null},{"id":"2607.25357","title":"Raven: High-Recall Sequence Modeling with Sparse Memory Routing","created":"2026-07-28","cited_by_count":6,"area":null},{"id":"2502.10420","title":"Position: Stop Acting Like Language Model Agents Are Normal Agents","created":"2025-02-04","cited_by_count":5,"area":"agents"},{"id":"2503.10799","title":"Fixed-Point RNNs: Interpolating from Diagonal to Dense","created":"2025-03-13","cited_by_count":5,"area":"ssm"},{"id":"2506.01153","title":"Weight-Space Linear Recurrent Neural Networks","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2507.00449","title":"Overcoming Long-Context Limitations of State-Space Models via Context-Dependent Sparse Attention","created":"2025-07-01","cited_by_count":5,"area":null},{"id":"2507.17257","title":"Agent Identity Evals: Measuring Agentic Identity","created":"2025-07-23","cited_by_count":5,"area":"agents"},{"id":"2508.07102","title":"Towards High-Order Mean Flow Generative Models: Feasibility, Expressivity, and Provably Efficient Criteria","created":"2025-08-09","cited_by_count":5,"area":"diffusion"},{"id":"2606.06479","title":"Pretraining Recurrent Networks without Recurrence","created":"2026-06-04","cited_by_count":5,"area":null},{"id":"2410.18572","title":"Taipan: Efficient and Expressive State Space Language Models with Selective Attention","created":"2024-10-24","cited_by_count":4,"area":"ssm"},{"id":"2501.00712","title":"Rethinking Addressing in Language Models via Contexualized Equivariant Positional Encoding","created":"2025-01-01","cited_by_count":4,"area":"lr"},{"id":"2502.02209","title":"On the Expressivity of Selective State-Space Layers: A Multivariate Polynomial Approach","created":"2025-02-04","cited_by_count":4,"area":"ssm"},{"id":"2502.16249","title":"Linear Attention for Efficient Bidirectional Sequence Modeling","created":"2025-02-22","cited_by_count":4,"area":null},{"id":"2504.01935","title":"Critical Thinking: Which Kinds of Complexity Govern Optimal Reasoning Length?","created":"2025-04-02","cited_by_count":4,"area":"lr"},{"id":"2505.21749","title":"Revisiting Bi-Linear State Transitions in Recurrent Neural Networks","created":"2025-05-27","cited_by_count":4,"area":null},{"id":"2508.13214","title":"Too Easily Fooled? Prompt Injection Breaks LLMs on Frustratingly Simple Multiple-Choice Questions","created":"2025-08-16","cited_by_count":4,"area":"safety"},{"id":"2508.16745","title":"Beyond Memorization: Extending Reasoning Depth with Recurrence, Memory and Test-Time Compute Scaling","created":"2025-08-22","cited_by_count":4,"area":"lr"},{"id":"2509.21716","title":"A Unifying Framework for Parallelizing Sequential Models with Linear Dynamical Systems","created":"2025-09-26","cited_by_count":4,"area":null},{"id":"2510.19315","title":"Transformers are Inherently Succinct","created":"2025-10-22","cited_by_count":4,"area":null},{"id":"2603.02193","title":"Symbol-Equivariant Recurrent Reasoning Models","created":"2026-03-02","cited_by_count":4,"area":"lr"},{"id":"2603.08859","title":"Expressivity-Efficiency Tradeoffs for Hybrid Sequence Models","created":"2026-03-09","cited_by_count":4,"area":null},{"id":"2605.07755","title":"Rethinking State Tracking in Recurrent Models Through Error Control Dynamics","created":"2026-05-08","cited_by_count":4,"area":null},{"id":"2607.14144","title":"The Capability Convergence Hypothesis: Capability from Access Structure, Not Scale","created":"2026-07-14","cited_by_count":4,"area":null},{"id":"2406.16993","title":"Are Vision xLSTM Embedded UNet More Reliable in Medical 3D Image Segmentation?","created":"2024-06-24","cited_by_count":3,"area":null},{"id":"2503.01450","title":"Investigating Memory in Model-Free RL with POPGym Arcade","created":"2025-03-03","cited_by_count":3,"area":"deeprl"},{"id":"2505.01475","title":"CodeSSM: Towards State Space Models for Code Understanding","created":"2025-05-02","cited_by_count":3,"area":null}],"next_cursor":"100"}