mlsanityData to 7 Oct 2026

Catching Contamination Before Generation: Spectral Kill Switches for Agents

arXiv 2511.05804 ↗First posted 8 Nov 2025cs.LG cs.SY eess.SPcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Agentic language models compose multi step reasoning chains, yet intermediate steps can be corrupted by inconsistent context, retrieval errors, or adversarial inputs, which makes post hoc evaluation too late because errors propagate before detection. We introduce a diagnostic that requires no additional training and uses only the forward pass to emit a binary accept or reject signal during agent execution. The method analyzes token graphs induced by attention and computes two spectral statistics in early layers, namely the high frequency energy ratio and spectral entropy. We formalize these signals, establish invariances, and provide finite sample estimators with uncertainty quantification. Under a two regime mixture assumption with a monotone likelihood ratio property, we show that a single threshold on the high frequency energy ratio is optimal in the Bayes sense for detecting context inconsistency. Empirically, the high frequency energy ratio exhibits robust bimodality during context verification across multiple model families, which enables gating decisions with overhead below one millisecond on our hardware and configurations. We demonstrate integration into retrieval augmented agent pipelines and discuss deployment as an inline safety monitor. The approach detects contamination while the model is still processing the text, before errors commit to the reasoning chain.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 30 of its 52 references that are in the map. First posted on arXiv 8 Nov 2025.

Builds on

30 of 52 references.

References · 30

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  7. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  8. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  9. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  10. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  11. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  12. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
18 more
  1. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  2. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  3. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,130
  4. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  5. 2023Progress measures for grokking via mechanistic interpretabilitycited by 822
  6. 2020A Primer in BERTology: What we know about how BERT workscited by 807
  7. 2017Selective Classification for Deep Neural Networkscited by 799
  8. 2020Quantifying Attention Flow in Transformerscited by 759
  9. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  10. 2017Graph Signal Processing: Overview, Challenges and Applicationscited by 409
  11. 2021Unsolved Problems in ML Safetycited by 291
  12. 2018Analysis Methods in Neural Language Processing: A Surveycited by 276
  13. 2017CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filterscited by 203
  14. 2020Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AIcited by 166
  15. 2024Collective Constitutional AI: Aligning a Language Model with Public Inputcited by 120
  16. 2023Evaluating Language-Model Agents on Realistic Autonomous Taskscited by 94
  17. 2018Interpretable Graph Convolutional Neural Networks for Inference on Noisy Knowledge Graphscited by 5
  18. 2025Training-Free Spectral Fingerprints of Voice Processing in Transformerscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Lost in the Noise: How Reasoning Models Fail with Contextual Distractors
  2. 2026Topology-Conditioned Backdoors: Language Models That Insert Vulnerabilities When They Infer They Are in a Multi-Agent System
  3. 2026Safe Context Switching for Agents in the Wild: Mitigating Subspace Interference via Orthogonal Adaptation
  4. 2026BekchiAI: Measuring, Observing, and Controlling LLM Agents in One Click
  5. 2026Agentic Control in Variational Language Models
  6. 2026Agent Safety From Within: Detecting Harmful Trajectories from LLM Internal States
  7. 2026Trace-Level Analysis of Information Contamination in Multi-Agent Systems
  8. 2026Adversarial Pragmatics for AI Safety Evaluation: A Diagnostic Framework and Seed Benchmark for Language-Mediated Control