mlsanityData to 7 Oct 2026

SpectralGuard: Detecting Memory Collapse Attacks in State Space Models

arXiv 2603.12414 ↗First posted 12 Mar 2026cs.LG cs.CRcited by 0

On the map: State-space sequence models (S4, Mamba) → Core SSM architectures for language

Abstract (arXiv)

State Space Models (SSMs) such as Mamba achieve linear-time sequence processing through input-dependent recurrence, but this mechanism introduces a critical safety vulnerability. We show that the spectral radius rho(A-bar) of the discretized transition operator governs effective memory horizon: when an adversary drives rho toward zero through gradient-based Hidden State Poisoning, memory collapses from millions of tokens to mere dozens, silently destroying reasoning capacity without triggering output-level alarms. We prove an Evasion Existence Theorem showing that for any output-only defense, adversarial inputs exist that simultaneously induce spectral collapse and evade detection, then introduce SpectralGuard, a real-time monitor that tracks spectral stability across all model layers. SpectralGuard achieves F1=0.961 against non-adaptive attackers and retains F1=0.842 under the strongest adaptive setting, with sub-15ms per-token latency. Causal interventions and cross-architecture transfer to hybrid SSM-Attention systems confirm that spectral monitoring provides a principled, deployable safety layer for recurrent foundation models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Core SSM architectures for language, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 46 of its 60 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

46 of 60 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Hidden State Poisoning Attacks against Mamba-based Language Models5 Jan
  2. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality31 May
  3. 2024Jamba: A Hybrid Transformer-Mamba Language Model28 Mar
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spaces1 Dec
  5. 2022Simplified State Space Layers for Sequence Modeling9 Aug
  6. 2021Efficiently Modeling Long Sequences with Structured State Spaces31 Oct

Other references · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2014Explaining and Harnessing Adversarial Examplescited by 7,287
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  6. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  8. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,346
  9. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,565
  10. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,378
  11. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
  12. 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
28 more
  1. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  2. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  3. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  4. 2022Red Teaming Language Models with Language Modelscited by 983
  5. 2021Ethical and social risks of harm from Language Modelscited by 957
  6. 2022In-context Learning and Induction Headscited by 930
  7. 2022Toy Models of Superpositioncited by 928
  8. 2023RWKV: Reinventing RNNs for the Transformer Eracited by 814
  9. 2019Universal Adversarial Triggers for Attacking and Analyzing NLPcited by 709
  10. 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
  11. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 600
  12. 2023Retentive Network: A Successor to Transformer for Large Language Modelscited by 594
  13. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  14. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 495
  15. 2023Jailbreaking ChatGPT via Prompt Engineering: An Empirical Studycited by 478
  16. 2024Mechanistic Interpretability for AI Safety -- A Reviewcited by 415
  17. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  18. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 388
  19. 2018Black-box Generation of Adversarial Text Sequences to Evade Deep Learning Classifierscited by 341
  20. 2017Stable Architectures for Deep Neural Networkscited by 340
  21. 2023Are aligned neural networks adversarially aligned?cited by 305
  22. 2021Unsolved Problems in ML Safetycited by 291
  23. 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Trickedcited by 226
  24. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  25. 2019Certified Robustness to Adversarial Word Substitutionscited by 164
  26. 2019Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagationcited by 87
  27. 2017Maximum Principle Based Algorithms for Deep Learningcited by 77
  28. 2023Copy Suppression: Comprehensively Understanding an Attention Headcited by 73

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Safety, Security, and Cognitive Risks in State-Space Models: A Systematic Threat Analysis with Spectral, Stateful, and Capacity Attacks
  2. 2026SMSR: Certified Defence Against Runtime Memory Poisoning in Persistent LLM Agent Systems
  3. 2026MemPoison: Uncovering Persistent Memory Threats and Structural Blind Spots in LLM Agents
  4. 2026Why Formal Monitors Fail: Attack Distribution Entropy as a Coverage Bound for LTL-Based LLM Agent Safety
  5. 2026SpecGuard: Inference-Time Backdoor Detection For Free
  6. 2026Forensic Trajectory Signatures for Agent Memory Poisoning Detection
  7. 2026Membrane: A Self-Evolving Contrastive Safety Memory for LLM Agent Defense
  8. 2026The Price of Safety: Benign-Case Utility and Token Overhead of Memory-Poisoning Defenses in LLM Agents