Black-Mamba: Biologically-Inspired Leaky Accumulation for Conceptual Knowledge under Distribution Drift
On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs
Abstract (arXiv)
Forecasting under real-world conditions is inherently non-stationary, as the conditional distribution of future observations evolves over time. Recent test-time adaptive sequence models address this challenge by updating internal states during inference, but tie adaptation to instantaneous prediction errors or surprise. This coupling can conflate persistent distribution shift with stochastic innovations, leading to unnecessary updates and inefficient adaptation. We introduce Black-Mamba, a test-time adaptive forecasting architecture that formulates online adaptation as evidence-gated state tracking under distribution drift. The model augments a base predictor with a dynamic memory updated when temporally accumulated surprisal provides sufficient evidence of a regime change. This turns adaptation into a selective, event-driven process rather than a continuous one. Across multiple forecasting benchmarks with non-stationary dynamics, Black-Mamba achieves competitive or improved predictive performance compared to existing test-time adaptation methods while significantly reducing the number of memory updates during inference. Together with mathematical analysis and biological evidence, these results suggest that accumulated surprisal provides a principled signal for distinguishing persistent drift from transient noise, yielding more efficient and robust adaptation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 20 of its 31 references that are in the map. First posted on arXiv 21 Jul 2026.
Builds on
20 of 31 references.
References · 20
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,400
- 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 329
- 2024Titans: Learning to Memorize at Test Timecited by 303
- 2024SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time seriescited by 81
- 2025ATLAS: Learning to Optimally Memorize the Context at Test Timecited by 57
- 2026Memory Caching: RNNs with Growing Memorycited by 12
- 2026Test-Time Training with KV Binding Is Secretly Linear Attentioncited by 10
8 more
- 2025TransMamba: A Sequence-Level Hybrid Transformer-Mamba Language Modelcited by 7
- 2025On the Expressiveness of Softmax Attention: A Recurrent Neural Network Perspectivecited by 6
- 2025Understanding and Enhancing Mamba-Transformer Hybrids for Memory Recall and Language Modelingcited by 4
- 2025Transformers as Intrinsic Optimizers: Forward Inference through the Energy Principlecited by 3
- 2026MoVE: Mixture of Value Embeddings -- A New Axis for Scaling Parametric Memory in Autoregressive Modelscited by 2
- 2025Hydra: Dual Exponentiated Memory for Multivariate Time Series Analysiscited by 1
- 2026Attention Is Not Retention: The Orthogonality Constraint in Infinite-Context Architecturescited by 1
- 2026Prometheus Mind: Retrofitting Memory to Frozen Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ForecastCompass: Guiding Agentic Forecasting with Adaptive Factor Memory
- 2026Dynamic TMoE: A Drift-Aware Dynamic Mixture of Experts Framework for Non-Stationary Time Series Forecasting
- 2026MemCast: Memory-Driven Time Series Forecasting with Experience-Conditioned Reasoning
- 2026When Tomorrow Becomes Today: Self-Evolving Policies for Agentic Time-Series Forecasting
- 2026Blackboard Intelligence Can Surpass Autoregressive on Globally Constrained Problems
- 2026RAG or Learning? Understanding the Limits of LLM Adaptation under Continuous Knowledge Drift in the Real World
- 2026Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams
- 2026What Should World Models Forget? Stratified Retention for Continual Adaptation