Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large Language Models (LLMs) display striking surface fluency yet systematically fail at tasks requiring symbolic reasoning, arithmetic accuracy, and logical consistency. This paper offers a structural diagnosis of such failures, revealing a persistent gap between textitcomprehension and textitcompetence. Through controlled experiments and architectural analysis, we demonstrate that LLMs often articulate correct principles without reliably applying them--a failure rooted not in knowledge access, but in computational execution. We term this phenomenon the computational textitsplit-brain syndrome, where instruction and action pathways are geometrically and functionally dissociated. This core limitation recurs across domains, from mathematical operations to relational inferences, and explains why model behavior remains brittle even under idealized prompting. We argue that LLMs function as powerful pattern completion engines, but lack the architectural scaffolding for principled, compositional reasoning. Our findings delineate the boundary of current LLM capabilities and motivate future models with metacognitive control, principle lifting, and structurally grounded execution. This diagnosis also clarifies why mechanistic interpretability findings may reflect training-specific pattern coordination rather than universal computational principles, and why the geometric separation between instruction and execution pathways suggests limitations in neural introspection and mechanistic analysis.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 45 of its 72 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
45 of 72 references.
Closest ancestors · 6
Same direction, newest first
- 2025Empowering LLMs with Logical Reasoning: A Comprehensive Survey21 Feb
- 2024Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs31 Jul
- 2024Multi-Step Reasoning with Large Language Models, a Survey16 Jul
- 2024LLMs for Relational Reasoning: How Far are We?17 Jan
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning20 May
- 2022ReAct: Synergizing Reasoning and Acting in Language Models6 Oct
Other references · 39
- 2017Attention Is All You Needcited by 60,361
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2022Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasetscited by 629
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
- 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 503
27 more
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
- 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 302
- 2023Physics of Language Models: Part 3.1, Knowledge Storage and Extractioncited by 270
- 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problemscited by 260
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 256
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
- 2019Neural Logic Machinescited by 145
- 2023What Formal Languages Can Transformers Express? A Surveycited by 124
- 2024Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Processcited by 108
- 2022Interpretable Scientific Discovery with Symbolic Regression: A Reviewcited by 105
- 2024Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristicscited by 97
- 2024Functional Benchmarks for Robust Evaluation of Reasoning Performance, and the Reasoning Gapcited by 79
- 2024Transformers Can Do Arithmetic with the Right Embeddingscited by 78
- 2024Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Modelscited by 68
- 2024On Limitations of the Transformer Architecturecited by 63
- 2024LLM Circuit Analyses Are Consistent Across Training and Scalecited by 63
- 2025How do language models learn facts? Dynamics, curricula and hallucinationscited by 37
- 2024Towards Universality: Studying Mechanistic Similarity Across Language Model Architecturescited by 31
- 2024Logically Consistent Language Models via Neuro-Symbolic Integrationcited by 30
- 2024Automatically Identifying Local and Global Circuits with Linear Computation Graphscited by 24
- 2025Comment on The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 23
- 2021Differentiable Logic Machinescited by 18
- 2024Arithmetic Reasoning with LLM: Prolog Generation & Permutationcited by 17
- 2024Teaching Transformers Causal Reasoning through Axiomatic Trainingcited by 12
- 2024OccamLLM: Fast and Exact Language Model Arithmetic in a Single Stepcited by 7
- 2025How well do LLMs reason over tabular data, really?cited by 6
- 2025IGC: Integrating a Gated Calculator into an LLM to Solve Arithmetic Tasks Reliably and Efficientlycited by 1
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Limited Reasoning Space: The cage of long-horizon reasoning in LLMscited by 3
- 2026CircuChain: Disentangling Competence and Compliance in LLM Circuit Analysiscited by 1
- 2026Think Twice Before You Write -- an Entropy-based Decoding Strategy to Enhance LLM Reasoningcited by 1
- 2026Detecting Differences Is Not Understanding Structure: Large Language Models Fail at Graph Isomorphismcited by 1
- 2026Agentic Frameworks for Reasoning Tasks: An Empirical Studycited by 0
- 2026Scaffolding the Strategist: Architecture-Dependent Reasoning Interventions in Hotelling Spatial Marketscited by 0
- 2026Solver-Hard Is Not Model-Hard: A Hardness-Controlled Diagnostic for LLM Constraint Reasoningcited by 0
- 2026LUMOS: Tracing Parametric Knowledge from Training Data to Behavioral Outputs in LLMscited by 0
- 2026FON: A Draft-Revise Dual-Organ Language Model without Sequence-Level Quadratic Attentioncited by 0
- 2026FON: A Draft-Revise Dual-Organ Language Model without Sequence-Level Quadratic Attention12 Oct 2026
- 2026LUMOS: Tracing Parametric Knowledge from Training Data to Behavioral Outputs in LLMs2 Oct 2026
- 2026Solver-Hard Is Not Model-Hard: A Hardness-Controlled Diagnostic for LLM Constraint Reasoning19 Jul 2026
- 2026Scaffolding the Strategist: Architecture-Dependent Reasoning Interventions in Hotelling Spatial Markets3 Jul 2026
- 2026Detecting Differences Is Not Understanding Structure: Large Language Models Fail at Graph Isomorphism8 Jun 2026
- 2026Agentic Frameworks for Reasoning Tasks: An Empirical Study17 Apr 2026
- 2026Think Twice Before You Write -- an Entropy-based Decoding Strategy to Enhance LLM Reasoning10 Mar 2026
- 2026Limited Reasoning Space: The cage of long-horizon reasoning in LLMs22 Feb 2026
- 2026CircuChain: Disentangling Competence and Compliance in LLM Circuit Analysis29 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
- 2025Semantic Deception: When Reasoning Models Can't Compute an Addition
- 2026ReEfBench: Quantifying the Reasoning Efficiency of LLMs
- 2025Reasoning LLMs are Wandering Solution Explorers
- 2026A Four-Stage Decomposition of Word-Problem Solving and Mechanistic Fragility in LLM Math Reasoning
- 2025Three tiers of computation in transformers and in brain architectures
- 2025Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM
- 2025A Review of Developmental Interpretability in Large Language Models