The Quantum Sieve Tracer: A Hybrid Framework for Layer-Wise Activation Tracing in Large Language Models
On the map: Mechanistic interpretability → Circuits and mechanistic analysis
Abstract (arXiv)
Mechanistic interpretability aims to reverse-engineer the internal computations of Large Language Models (LLMs), yet separating sparse semantic signals from high-dimensional polysemantic noise remains a significant challenge. This paper introduces the Quantum Sieve Tracer, a hybrid quantum-classical framework designed to characterize factual recall circuits. We implement a modular pipeline that first localizes critical layers using classical causal tracing, then maps specific attention head activations into an exponentially large quantum Hilbert space. Using open-weight models (Meta Llama-3.2-1B and Alibaba Qwen2.5-1.5B-Instruct), we perform a two-stage analysis that reveals a fundamental architectural divergence. While Qwen's layer 7 circuit functions as a classic Recall Hub, we discover that Llama's layer 9 acts as an Interference Suppression circuit, where ablating the identified heads paradoxically improves factual recall. Our results demonstrate that quantum kernels can distinguish between these constructive (recall) and reductive (suppression) mechanisms, offering a high-resolution tool for analyzing the fine-grained topology of attention.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Circuits and mechanistic analysis, one of 13 directions in Mechanistic interpretability. Builds on 3 of its 7 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
3 of 7 references.
References · 3
- 2023Qwen Technical Reportcited by 3,344
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2022In-context Learning and Induction Headscited by 964
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Entanglement as Memory: Mechanistic Interpretability of Quantum Language Models
- 2026Architecture, Not Scale: Circuit Localization in Large Language Models
- 2026QLAM: A Quantum Long-Attention Memory Approach to Long-Sequence Token Modeling
- 2026Circuit Hypernetworks for Quantum-Augmented Diffusion Language Models
- 2026It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention
- 2026Semantic Uncertainty Quantification of Hallucinations in LLMs: A Quantum Tensor Network Based Method
- 2026The Quantum Shortcut: Complex Phase-State Dynamics Reduce the Optimization Steps of Sequence Models
- 2026In-context superposition: human-like working memory interference in large language models