mlsanityData to 14 Oct 2026

Encoded but Not Decoded: Layer-Localized Evidence for a Three-Level Gap in LLM Syntax

arXiv 2609.29848 ↗First posted 24 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

A language model can fail a syntactic test in two distinct ways: by not encoding the relevant structure, or by encoding it but failing to use it at the output. Behavioral evaluation alone cannot tell these apart. We propose a three-level evaluation framework (behavioral deployment, LM-head readout, and probe recoverability) measured on the same items under the same binary decision. Using a compact trilingual (English, Chinese, German) control-dependency benchmark, we find that probe recoverability exceeds or equals LM-head readout, which in turn exceeds or equals behavioral deployment, across seven models and all three languages in the aggregate. The recoverability surplus is never negative across all 14 (model, task) conditions. The disconnect concentrates in subject-control, where a nearest-noun heuristic gives the wrong answer. The single largest gap (0.653) appears on Qwen3-0.6B Instruct in question answering. The gap persists at Qwen3-14B Instruct. Instruction tuning degrades deployment more than encoding in percentage terms. We rule out option-position bias, late-layer erasure, output-formatting artifacts, and probe-training variance. The pattern is consistent with decoding that favors surface shortcuts, and the behavior-probe gap measures the strength of that preference. Activation patching shows the gap is layer-localized. Under instruction tuning, the LM-head-decoded layer shifts approximately ten layers later than the probe-decoded layer. These findings argue that behavioral evaluation understates what models encode, while probing alone overstates what they deploy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

26 of 43 references.

References · 26

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  3. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  4. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  5. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
  6. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  7. 2019Designing and Interpreting Probes with Control Taskscited by 640
  8. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
  9. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
  10. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 438
  11. 2021Causal Abstractions of Neural Networkscited by 422
  12. 2016Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependenciescited by 354
14 more
  1. 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 307
  2. 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 281
  3. 2018Colorless green recurrent networks dream hierarchicallycited by 213
  4. 2020Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Biascited by 191
  5. 2020Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?cited by 151
  6. 2024Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Trackingcited by 149
  7. 2023Jump to Conclusions: Short-Cutting Transformers With Linear Transformationscited by 90
  8. 2022Probing for the Usage of Grammatical Numbercited by 59
  9. 2025The LLM Already Knows: Estimating LLM-Perceived Question Difficulty via Hidden Representationscited by 29
  10. 2025Revisiting LLM Value Probing Strategies: Are They Robust and Expressive?cited by 8
  11. 2025AdaDecode: Accelerating LLM Decoding with Adaptive Layer Parallelismcited by 7
  12. 2025Mechanisms vs. Outcomes: Probing for Syntax Fails to Explain Performance on Targeted Syntactic Evaluationscited by 7
  13. 2025Quantifying Language Disparities in Multilingual Large Language Modelscited by 7
  14. 2024Large Language Models as Neurolinguistic Subjects: Discrepancy between Performance and Competencecited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Atomic Instruction Gap: Instruction-Tuned LLMs Struggle with Simple, Self-Contained Directives
  2. 2026Is my model perplexed for the right reason? Contrasting LLMs' Benchmark Behavior with Token-Level Perplexity
  3. 2026Language-Conditioned Token and Reasoning Efficiency in Large Language Models: A Paired Cross-Lingual Study Protocol
  4. 2025RCScore: Quantifying Response Consistency in Large Language Models
  5. 2024Benchmarking Large Language Models on Controllable Generation under Diversified Instructions
  6. 2026RIFT: Reordered Instruction Following Testbed To Evaluate Instruction Following in Singular Multistep Prompt Structures
  7. 2023FollowEval: A Multi-Dimensional Benchmark for Assessing the Instruction-Following Capability of Large Language Models
  8. 2026LinguaMap: Which Layers of LLMs Speak Your Language and How to Tune Them?