mlsanityData to 14 Oct 2026

Logical subspace in LLMs

arXiv 2609.32907 ↗First posted 26 Sep 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent work has identified a human brain network specialized for abstract formal reasoning (Kean et al., 2025). Does the same hold true in language models? To answer this question, we introduce the minimal viable subspace (MVS) method, which searches for the lowest-rank activation subspace at a layer that preserves task performance when everything outside that subspace is ablated. Using MVS, we demonstrate low-rank subspaces supporting logical inference on Gemma and Qwen models. Furthermore, these subspaces exhibit a clear dissociation from model capacities on other tasks, such that retaining these late logic subspaces preserves inference while impairing factual knowledge, working memory, cognitive control, and arithmetic. Conversely, ablating them reduces logical inference accuracy to chance while largely sparing these other capacities. Our results suggest a functionally localizable core machinery for logic akin to that in the human brain.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 37 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

18 of 37 references.

References · 18

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  4. 2022Emergent Analogical Reasoning in Large Language Modelscited by 240
  5. 2023Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representationscited by 209
  6. 2023Interpretability at Scale: Identifying Causal Mechanisms in Alpacacited by 103
  7. 2024RAVEL: Evaluating Interpretability Methods on Disentangling Language Model Representationscited by 79
  8. 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
  9. 2024Identifying Functionally Important Features with End-to-End Sparse Dictionary Learningcited by 67
  10. 2024Talking Heads: Understanding Inter-layer Communication in Transformer Language Modelscited by 41
  11. 2025Emergent Symbolic Mechanisms Support Abstract Reasoning in Large Language Modelscited by 31
  12. 2023When can transformers reason with abstract symbols?cited by 24
6 more
  1. 2026LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signalscited by 24
  2. 2018Interpreting Encoding and Decoding Modelscited by 21
  3. 2025The Geometry of Reasoning: Flowing Logics in Representation Spacecited by 21
  4. 2025Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformerscited by 16
  5. 2026Modular Cognitive Architecture Emerges in Large Language Modelscited by 3
  6. 2026Beyond Language: Format-Agnostic Reasoning Subspaces in Large Language Modelscited by 1

Built on by

Not cited yet.