mlsanityData to 14 Oct 2026

Verbalizable Representations Form a Global Workspace in Language Models

arXiv 2607.15495 ↗First posted 16 Jul 2026cs.CL cs.AI cs.LGcited by 75

Not on the map. Why?

Abstract (arXiv)

Out of everything the human brain processes, only a small fraction is consciously accessible, in the sense of being available for verbal report, deliberate control, and flexible reasoning. In this paper, we present evidence that an analogous functional distinction has emerged in large language models. Using a new interpretability technique, the Jacobian lens, we identify the representations a model is poised to verbalize at any point in its processing. These representations, which we collectively call the J-space, exhibit the functional properties characteristic of a global workspace: their contents can be reported, deliberately summoned and held, used to carry the intermediate steps of silent reasoning, and passed as arguments to arbitrary downstream computations, while automatic processing such as text parsing and routine inference proceeds without them. The J-space also has structural signatures that global workspace theory associates with conscious access: it carries coherent content only in an intermediate band of layers, holds on the order of tens of concepts at a time, and is broadcast by the model's weights more widely than other representations. These properties make it a practical window into a model's unspoken thinking. In alignment audits, it reveals strategic deliberation, evaluation awareness, and trained-in misaligned dispositions that never appear in the model's outputs. We find that post-training installs the Assistant's point of view in the workspace, and we introduce counterfactual reflection training, which improves behavior by training only what a model would say if interrupted and asked to reflect. These results indicate that language models maintain a small, privileged set of representations bearing some of the functional hallmarks of conscious access, and that decoding these representations sheds light on ongoing cognitive processes.

Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). Builds on 100 of its 171 references that are in the map. First posted on arXiv 16 Jul 2026.

Builds on

100 of 171 references.

References · 100

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  6. 2020Learning to summarize from human feedbackcited by 2,588
  7. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
  8. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  9. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
  10. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  11. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
  12. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
38 more
  1. 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
  2. 2018Neural Network Acceptability Judgmentscited by 958
  3. 2023Steering Language Models With Activation Engineeringcited by 922
  4. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
  5. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  6. 2019Designing and Interpreting Probes with Control Taskscited by 640
  7. 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
  8. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
  9. 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
  10. 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
  11. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 435
  12. 2014On the Number of Linear Regions of Deep Neural Networkscited by 381
  13. 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 376
  14. 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
  15. 2023Function Vectors in Large Language Modelscited by 308
  16. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  17. 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
  18. 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 235
  19. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
  20. 2023Linearity of Relation Decoding in Transformer Language Modelscited by 200
  21. 2024Transcoders Find Interpretable LLM Feature Circuitscited by 200
  22. 2016Using Fast Weights to Attend to the Recent Pastcited by 170
  23. 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 169
  24. 2023Linear Representations of Sentiment in Large Language Modelscited by 163
  25. 2024A is for Absorption: Studying Feature Splitting and Absorption in Sparse Autoencoderscited by 160
  26. 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 160
  27. 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 158
  28. 2024The Remarkable Robustness of LLMs: Stages of Inference?cited by 146
  29. 2023Taken out of context: On measuring situational awareness in LLMscited by 143
  30. 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 143
  31. 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 136
  32. 2023Future Lens: Anticipating Subsequent Tokens from a Single Hidden Statecited by 121
  33. 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 113
  34. 2024Automatically Interpreting Millions of Features in Large Language Modelscited by 113
  35. 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 112
  36. 2023The geometry of hidden representations of large transformer modelscited by 112
  37. 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 111
  38. 2017The Consciousness Priorcited by 107

50 most cited of 100 All 100 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 75.

75 papers.

Sort:

By area:

  1. 2026Looped Transformers under the Jacobian Lens: Does the Global Workspace Survive Recurrence?cited by 6
  2. 2026Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futurescited by 2
  3. 2026The Ignition Is Real, and It Lives at the Readout: Latent composition, difficulty-clocked ignition, and the interface-constituted commit in a recurrent-depth reasonercited by 2
  4. 2026Logic Before Language: Pre-pretraining on Formal Derivations Fosters Skill Acquisition and Compressibilitycited by 2
  5. 2026Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentivescited by 2
  6. 2026LastOPD: Taming Collapse in Latent On-Policy Distillationcited by 2
  7. 2026Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Modelcited by 1
  8. 2026Temperature-driven inversion and nonlinear dynamics in ChatGPT-like AIscited by 1
  9. 2026Divergent large language model predictions from convergent representations in ambiguous word pairscited by 1
  10. 2026Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does Socited by 1
  11. 2026Measure, Don't Optimize: Forecasting Recovery in LLM Unlearningcited by 1
  12. 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7Bcited by 1
38 more
  1. 2026Measuring the Assistant's Harmlessness Preferences on the User Turncited by 1
  2. 2026PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learningcited by 1
  3. 2026From Dependency to Compositionality: A Neurosymbolic Lifting of LLM Outputs via Combinatory Categorial Grammarcited by 0
  4. 2026The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoningcited by 0
  5. 2026Many-body Tipping Dynamics of ChatGPT-like AIscited by 0
  6. 2026From Found to Designed: Concepts as a Design Axis for Large Language Modelscited by 0
  7. 2026RepBench: Compiling Benchmarks into Capability Representations for Large Language Modelscited by 0
  8. 2026GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoningcited by 0
  9. 2026The ethics of artificial intelligence in the life sciences: Universality, cultural diversity and an architecture of carecited by 0
  10. 2026Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probescited by 0
  11. 2026Backdoor Decontamination Dynamics in LLM Agentscited by 0
  12. 2026Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Formcited by 0
  13. 2026Towards Computational Provenance: Carrying Causal-State Evidence in Generated Textcited by 0
  14. 2026J-Miner: Recovering the Decision Logic of Fine-Tuned LLM Classifiers as Compact Rulescited by 0
  15. 2026Can Large Language Models "Hyper-Thread"?cited by 0
  16. 2026Reading Is Not Using: Retrieval, Judgment, and the Design of AI Financial Research Workflowscited by 0
  17. 2026Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspacecited by 0
  18. 2026Short Horizons and Sparse Concepts: a Mathematical View of the Readout in the J-lenscited by 0
  19. 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognitioncited by 0
  20. 2026Gradland: On Phenomenal Experience, Differentiated Across Many Dimensionscited by 0
  21. 2026The Platonic brain bridge hypothesis: human brain networks as an architectural prior for multimodal large language modelscited by 0
  22. 2026A primer on evaluation methods for large language models in healthcarecited by 0
  23. 2026Using OCR Heads to Verbalize Image Semanticscited by 0
  24. 2026Decodable but Misrouted: Sparse Features Uncover a Readout Gap in Vision-Language Models for Harmful Meme Detectioncited by 0
  25. 2026Function Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computationcited by 0
  26. 2026Xeno-Interpretability: Investigating the Alien Minds of LLMscited by 0
  27. 2026From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulnesscited by 0
  28. 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
  29. 2026Slow Decay and Silenced Expression: Iterated Subliminal Trait Transfer in Language-Model Lineagescited by 0
  30. 2026A Spectral Theory of Grokking: Weight Decay induces Feature Learningcited by 0
  31. 2026Who Put the I in AI? Provenance and the Admissibility of Machine Self-Reportcited by 0
  32. 2026Guarded Gradient-Based Activation Steering of Shutdown Responses in Qwen3.5-0.8B: A Minimum-Step Policycited by 0
  33. 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steeringcited by 0
  34. 2026Decodable In-Context State and Model Output Across Trainingcited by 0
  35. 2026Residual Streams Read, Recurrent States Remember: The Global Workspace in Mamba Modelscited by 0
  36. 2026From Latents to Wires: Surgical Post-Editing on Large Language Modelscited by 0
  37. 2026Activation Flow: Manufacturing Activations for Steeringcited by 0
  38. 2026Logical subspace in LLMscited by 0

50 most cited of 75 All 75 (JSON)