mlsanityData to 7 Oct 2026

Spectral Guardrails for Agents in the Wild: Detecting Tool Use Hallucinations via Attention Topology

arXiv 2602.08082 ↗First posted 8 Feb 2026cs.LG cs.AI eess.SPcited by 2

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Deploying autonomous agents in the wild requires reliable safeguards against tool use failures. We propose a training free guardrail based on spectral analysis of attention topology that complements supervised approaches. On Llama 3.1 8B, our method achieves 97.7% recall with multi-feature detection and 86.1% recall with 81.0% precision for balanced deployment, without requiring any labeled training data. Most remarkably, we discover that single layer spectral features act as near-perfect hallucination detectors: Llama L26 Smoothness achieves 98.2% recall (213/217 hallucinations caught) with a single threshold, and Mistral L3 Entropy achieves 94.7% recall. This suggests hallucination is not merely a wrong token but a thermodynamic state change: the model's attention becomes noise when it errs. Through controlled cross-model evaluation on matched domains (N=1000, T=0.3, same General domain, hallucination rates 20--22%), we reveal the ``Loud Liar'' phenomenon: Llama 3.1 8B's failures are spectrally catastrophic and dramatically easier to detect, while Mistral 7B achieves the best discrimination (AUC 0.900). These findings establish spectral analysis as a principled, efficient framework for agent safety.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 15 of its 27 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

15 of 27 references.

References · 15

  1. 2023Let's Verify Step by Stepcited by 3,598
  2. 2023Mistral 7Bcited by 3,065
  3. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  4. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  5. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  6. 2023The Internal State of an LLM Knows When It's Lyingcited by 644
  7. 2024INSIDE: LLMs' Internal States Retain the Power of Hallucination Detectioncited by 317
  8. 2020Hutch++: Optimal Stochastic Trace Estimationcited by 62
  9. 2025Hallucination Detection in LLMs Using Spectral Features of Attention Mapscited by 42
  10. 2024A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagationcited by 21
  11. 2026Internal Representations as Indicators of Hallucinations in Agent Tool Selectioncited by 18
  12. 2025Towards Mechanistic Interpretability of Graph Transformers via Attention Graphscited by 12
3 more
  1. 2024Prompt-Guided Internal States for Hallucination Detection of Large Language Modelscited by 8
  2. 2025A Graph Signal Processing Framework for Hallucination Detection in Large Language Modelscited by 2
  3. 2025LLM Hallucination Detection: HSADcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.