Verbalizable Representations Form a Global Workspace in Language Models
Not on the map. Why?
Abstract (arXiv)
Out of everything the human brain processes, only a small fraction is consciously accessible, in the sense of being available for verbal report, deliberate control, and flexible reasoning. In this paper, we present evidence that an analogous functional distinction has emerged in large language models. Using a new interpretability technique, the Jacobian lens, we identify the representations a model is poised to verbalize at any point in its processing. These representations, which we collectively call the J-space, exhibit the functional properties characteristic of a global workspace: their contents can be reported, deliberately summoned and held, used to carry the intermediate steps of silent reasoning, and passed as arguments to arbitrary downstream computations, while automatic processing such as text parsing and routine inference proceeds without them. The J-space also has structural signatures that global workspace theory associates with conscious access: it carries coherent content only in an intermediate band of layers, holds on the order of tens of concepts at a time, and is broadcast by the model's weights more widely than other representations. These properties make it a practical window into a model's unspoken thinking. In alignment audits, it reveals strategic deliberation, evaluation awareness, and trained-in misaligned dispositions that never appear in the model's outputs. We find that post-training installs the Assistant's point of view in the workspace, and we introduce counterfactual reflection training, which improves behavior by training only what a model would say if interrupted and asked to reflect. These results indicate that language models maintain a small, privileged set of representations bearing some of the functional hallmarks of conscious access, and that decoding these representations sheds light on ongoing cognitive processes.
Key facts. Cited by 75 papers in the map (data through 14 Oct 2026). Builds on 100 of its 171 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
100 of 171 references.
References · 100
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2020Learning to summarize from human feedbackcited by 2,588
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,420
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,336
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
38 more
- 2022Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 smallcited by 1,165
- 2018Neural Network Acceptability Judgmentscited by 958
- 2023Steering Language Models With Activation Engineeringcited by 922
- 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 886
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2019Designing and Interpreting Probes with Control Taskscited by 640
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 623
- 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
- 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 435
- 2014On the Number of Linear Regions of Deep Neural Networkscited by 381
- 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 376
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 311
- 2023Function Vectors in Large Language Modelscited by 308
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2024Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Modelscited by 235
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 235
- 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
- 2023Linearity of Relation Decoding in Transformer Language Modelscited by 200
- 2024Transcoders Find Interpretable LLM Feature Circuitscited by 200
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 169
- 2023Linear Representations of Sentiment in Large Language Modelscited by 163
- 2024A is for Absorption: Studying Feature Splitting and Absorption in Sparse Autoencoderscited by 160
- 2024Improving Instruction-Following in Language Models through Activation Steeringcited by 160
- 2025Agentic Misalignment: How LLMs Could Be Insider Threatscited by 158
- 2024The Remarkable Robustness of LLMs: Stages of Inference?cited by 146
- 2023Taken out of context: On measuring situational awareness in LLMscited by 143
- 2024Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Attention Lenscited by 143
- 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 136
- 2023Future Lens: Anticipating Subsequent Tokens from a Single Hidden Statecited by 121
- 2024Looking Inward: Language Models Can Learn About Themselves by Introspectioncited by 113
- 2024Automatically Interpreting Millions of Features in Large Language Modelscited by 113
- 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 112
- 2023The geometry of hidden representations of large transformer modelscited by 112
- 2024AtP*: An efficient and scalable method for localizing LLM behaviour to componentscited by 111
- 2017The Consciousness Priorcited by 107
50 most cited of 100 All 100 (JSON)
Built on by
Citing papers per year: 2026: 75.
75 papers.
Sort:
By area:
- 2026Looped Transformers under the Jacobian Lens: Does the Global Workspace Survive Recurrence?cited by 6
- 2026Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futurescited by 2
- 2026The Ignition Is Real, and It Lives at the Readout: Latent composition, difficulty-clocked ignition, and the interface-constituted commit in a recurrent-depth reasonercited by 2
- 2026Logic Before Language: Pre-pretraining on Formal Derivations Fosters Skill Acquisition and Compressibilitycited by 2
- 2026Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentivescited by 2
- 2026LastOPD: Taming Collapse in Latent On-Policy Distillationcited by 2
- 2026Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Modelcited by 1
- 2026Temperature-driven inversion and nonlinear dynamics in ChatGPT-like AIscited by 1
- 2026Divergent large language model predictions from convergent representations in ambiguous word pairscited by 1
- 2026Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does Socited by 1
- 2026Measure, Don't Optimize: Forecasting Recovery in LLM Unlearningcited by 1
- 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7Bcited by 1
38 more
- 2026Measuring the Assistant's Harmlessness Preferences on the User Turncited by 1
- 2026PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learningcited by 1
- 2026From Dependency to Compositionality: A Neurosymbolic Lifting of LLM Outputs via Combinatory Categorial Grammarcited by 0
- 2026The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoningcited by 0
- 2026Many-body Tipping Dynamics of ChatGPT-like AIscited by 0
- 2026From Found to Designed: Concepts as a Design Axis for Large Language Modelscited by 0
- 2026RepBench: Compiling Benchmarks into Capability Representations for Large Language Modelscited by 0
- 2026GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoningcited by 0
- 2026The ethics of artificial intelligence in the life sciences: Universality, cultural diversity and an architecture of carecited by 0
- 2026Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probescited by 0
- 2026Backdoor Decontamination Dynamics in LLM Agentscited by 0
- 2026Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Formcited by 0
- 2026Towards Computational Provenance: Carrying Causal-State Evidence in Generated Textcited by 0
- 2026J-Miner: Recovering the Decision Logic of Fine-Tuned LLM Classifiers as Compact Rulescited by 0
- 2026Can Large Language Models "Hyper-Thread"?cited by 0
- 2026Reading Is Not Using: Retrieval, Judgment, and the Design of AI Financial Research Workflowscited by 0
- 2026Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspacecited by 0
- 2026Short Horizons and Sparse Concepts: a Mathematical View of the Readout in the J-lenscited by 0
- 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognitioncited by 0
- 2026Gradland: On Phenomenal Experience, Differentiated Across Many Dimensionscited by 0
- 2026The Platonic brain bridge hypothesis: human brain networks as an architectural prior for multimodal large language modelscited by 0
- 2026A primer on evaluation methods for large language models in healthcarecited by 0
- 2026Using OCR Heads to Verbalize Image Semanticscited by 0
- 2026Decodable but Misrouted: Sparse Features Uncover a Readout Gap in Vision-Language Models for Harmful Meme Detectioncited by 0
- 2026Function Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computationcited by 0
- 2026Xeno-Interpretability: Investigating the Alien Minds of LLMscited by 0
- 2026From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulnesscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026Slow Decay and Silenced Expression: Iterated Subliminal Trait Transfer in Language-Model Lineagescited by 0
- 2026A Spectral Theory of Grokking: Weight Decay induces Feature Learningcited by 0
- 2026Who Put the I in AI? Provenance and the Admissibility of Machine Self-Reportcited by 0
- 2026Guarded Gradient-Based Activation Steering of Shutdown Responses in Qwen3.5-0.8B: A Minimum-Step Policycited by 0
- 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steeringcited by 0
- 2026Decodable In-Context State and Model Output Across Trainingcited by 0
- 2026Residual Streams Read, Recurrent States Remember: The Global Workspace in Mamba Modelscited by 0
- 2026From Latents to Wires: Surgical Post-Editing on Large Language Modelscited by 0
- 2026Activation Flow: Manufacturing Activations for Steeringcited by 0
- 2026Logical subspace in LLMscited by 0
50 most cited of 75 All 75 (JSON)
- 2026Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs14 Oct 2026
- 2026Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models14 Oct 2026
- 2026Are You Reading the Right Thing? Rethinking Internal Signals for Prompt-Injection Detection14 Oct 2026
- 2026DANGERLENS: Probing Dangerous Representations Hidden by Safety Alignment14 Oct 2026
- 2026Phantom Merge: When Your Large Language Model Agents Pick One but Tell You About Another12 Oct 2026
- 2026Do correct answers have stable latent knowledge support?11 Oct 2026
- 2026S-Space: Exploring Spatial Workspace in Multimodal Language Models9 Oct 2026
- 2026U-Space: Uncovering When and Why Uncertainty Arises in Language Models6 Oct 2026
- 2026JLD: Perceptual Distance Through A Jacobian Lens5 Oct 2026
- 2026DV-Lens: Revealing the Functional Organization of Language Model Parameters3 Oct 2026
- 2026From Latent Space to Jacobian Space: Measuring, Evading, and Training Against Safety-Content Accessibility3 Oct 2026
- 2026hacktrace: behavior-supervised detection of reward hacking during code generation2 Oct 2026
38 more
- 2026Latent-MOPD: Latent Multi-Teacher On-Policy Distillation1 Oct 2026
- 2026The Persona Is Still There, but Who Is Speaking? Latent Identity Reversion in Persistent AI Agents1 Oct 2026
- 2026What Can Analogy Tell Us About Artificial Consciousness?1 Oct 2026
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation29 Sep 2026
- 2026PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learning29 Sep 2026
- 2026Capacity, Responsiveness and Alignment: What Makes a Latent Structure Actionable28 Sep 2026
- 2026Signatures of semantic search in the activations of large language models28 Sep 2026
- 2026Language Models Act on Hidden Valence28 Sep 2026
- 2026A mechanistic study of language model introspection28 Sep 2026
- 2026Persona Following Is Not Selective Control: The Neutrality Gap in LLM User Simulation28 Sep 2026
- 2026TULIP: Targeted LLM Unlearning at Layers Identified Per-Input28 Sep 2026
- 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths28 Sep 2026
- 2026BOReFT: Manifold Steering of Language Models for Black-box Optimization27 Sep 2026
- 2026When Does the Concept of "Dog" Emerge in an Audio LLM?27 Sep 2026
- 2026Logical subspace in LLMs26 Sep 2026
- 2026Activation Flow: Manufacturing Activations for Steering26 Sep 2026
- 2026From Latents to Wires: Surgical Post-Editing on Large Language Models26 Sep 2026
- 2026Residual Streams Read, Recurrent States Remember: The Global Workspace in Mamba Models26 Sep 2026
- 2026Decodable In-Context State and Model Output Across Training25 Sep 2026
- 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steering24 Sep 2026
- 2026Guarded Gradient-Based Activation Steering of Shutdown Responses in Qwen3.5-0.8B: A Minimum-Step Policy23 Sep 2026
- 2026LastOPD: Taming Collapse in Latent On-Policy Distillation23 Sep 2026
- 2026A Spectral Theory of Grokking: Weight Decay induces Feature Learning22 Sep 2026
- 2026Slow Decay and Silenced Expression: Iterated Subliminal Trait Transfer in Language-Model Lineages22 Sep 2026
- 2026Measuring the Assistant's Harmlessness Preferences on the User Turn20 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulness19 Sep 2026
- 2026Xeno-Interpretability: Investigating the Alien Minds of LLMs17 Sep 2026
- 2026Decodable but Misrouted: Sparse Features Uncover a Readout Gap in Vision-Language Models for Harmful Meme Detection16 Sep 2026
- 2026Using OCR Heads to Verbalize Image Semantics16 Sep 2026
- 2026A primer on evaluation methods for large language models in healthcare13 Sep 2026
- 2026The Platonic brain bridge hypothesis: human brain networks as an architectural prior for multimodal large language models10 Sep 2026
- 2026Gradland: On Phenomenal Experience, Differentiated Across Many Dimensions8 Sep 2026
- 2026Where Should Language Sit in a Multimodal Model? Lessons from What Language Does to Human Perception and Cognition7 Sep 2026
- 2026Knowing, and Saying It Only When Asked: LLM Endognostics and the Schizognosis of Minerva-7B2 Sep 2026
- 2026Looped Transformers under the Jacobian Lens: Does the Global Workspace Survive Recurrence?1 Sep 2026
- 2026Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentives26 Aug 2026
- 2026Short Horizons and Sparse Concepts: a Mathematical View of the Readout in the J-lens26 Aug 2026
50 newest of 75 All 75 (JSON)
- 2026The Ignition Is Real, and It Lives at the Readout: Latent composition, difficulty-clocked ignition, and the interface-constituted commit in a recurrent-depth reasonercited by 2
- 2026The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoningcited by 0
- 2026GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoningcited by 0
- 2026Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspacecited by 0
- 2026From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulnesscited by 0
- 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Pathscited by 0
- 2026S-Space: Exploring Spatial Workspace in Multimodal Language Modelscited by 0
- 2026S-Space: Exploring Spatial Workspace in Multimodal Language Models9 Oct 2026
- 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths28 Sep 2026
- 2026From Concept Alignment to Causal Grounding: An Intervention Test of Chain-of-Thought Faithfulness19 Sep 2026
- 2026Can We Read the Mind of an Audio LLM? A Verbalizable, Multilingual Middle-Layer Workspace25 Aug 2026
- 2026The Ignition Is Real, and It Lives at the Readout: Latent composition, difficulty-clocked ignition, and the interface-constituted commit in a recurrent-depth reasoner4 Aug 2026
- 2026GradCuit: Credit-Assigned Gradient Flow Enables Robust and Interpretable Test-Time Latent Reasoning3 Aug 2026
- 2026The Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoning23 Jul 2026
- 2026Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentivescited by 2
- 2026PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learningcited by 1
- 2026Backdoor Decontamination Dynamics in LLM Agentscited by 0
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systemscited by 0
- 2026hacktrace: behavior-supervised detection of reward hacking during code generationcited by 0
- 2026Phantom Merge: When Your Large Language Model Agents Pick One but Tell You About Anothercited by 0
- 2026Phantom Merge: When Your Large Language Model Agents Pick One but Tell You About Another12 Oct 2026
- 2026hacktrace: behavior-supervised detection of reward hacking during code generation2 Oct 2026
- 2026PR-OPD: Privileged Representation On-policy Self-Distillation for Agentic Reinforcement Learning29 Sep 2026
- 2026When the Agent Becomes the Kernel: A Systematization of Security on the Path to AI-Native Operating Systems20 Sep 2026
- 2026Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentives26 Aug 2026
- 2026Backdoor Decontamination Dynamics in LLM Agents11 Aug 2026
- 2026RepBench: Compiling Benchmarks into Capability Representations for Large Language Modelscited by 0
- 2026Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probescited by 0
- 2026Guarded Gradient-Based Activation Steering of Shutdown Responses in Qwen3.5-0.8B: A Minimum-Step Policycited by 0
- 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steeringcited by 0
- 2026Signatures of semantic search in the activations of large language modelscited by 0
- 2026Signatures of semantic search in the activations of large language models28 Sep 2026
- 2026Adaptive Multi-Value Control in LLMs via Causal Activation Steering24 Sep 2026
- 2026Guarded Gradient-Based Activation Steering of Shutdown Responses in Qwen3.5-0.8B: A Minimum-Step Policy23 Sep 2026
- 2026Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes7 Aug 2026
- 2026RepBench: Compiling Benchmarks into Capability Representations for Large Language Models30 Jul 2026
- 2026Measure, Don't Optimize: Forecasting Recovery in LLM Unlearningcited by 1
- 2026From Latents to Wires: Surgical Post-Editing on Large Language Modelscited by 0
- 2026TULIP: Targeted LLM Unlearning at Layers Identified Per-Inputcited by 0
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisationcited by 0
- 2026Are You Reading the Right Thing? Rethinking Internal Signals for Prompt-Injection Detectioncited by 0
- 2026Are You Reading the Right Thing? Rethinking Internal Signals for Prompt-Injection Detection14 Oct 2026
- 2026Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation29 Sep 2026
- 2026TULIP: Targeted LLM Unlearning at Layers Identified Per-Input28 Sep 2026
- 2026From Latents to Wires: Surgical Post-Editing on Large Language Models26 Sep 2026
- 2026Measure, Don't Optimize: Forecasting Recovery in LLM Unlearning11 Aug 2026
- 2026Latent-MOPD: Latent Multi-Teacher On-Policy Distillation1 Oct 2026
- 2026LastOPD: Taming Collapse in Latent On-Policy Distillation23 Sep 2026
- 2026Looped Transformers under the Jacobian Lens: Does the Global Workspace Survive Recurrence?cited by 6
- 2026Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futurescited by 2
- 2026Logic Before Language: Pre-pretraining on Formal Derivations Fosters Skill Acquisition and Compressibilitycited by 2
- 2026Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Modelcited by 1
- 2026Temperature-driven inversion and nonlinear dynamics in ChatGPT-like AIscited by 1
- 2026Divergent large language model predictions from convergent representations in ambiguous word pairscited by 1
- 2026Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does Socited by 1
- 2026Measuring the Assistant's Harmlessness Preferences on the User Turncited by 1
- 2026From Dependency to Compositionality: A Neurosymbolic Lifting of LLM Outputs via Combinatory Categorial Grammarcited by 0
- 2026Many-body Tipping Dynamics of ChatGPT-like AIscited by 0
- 2026From Found to Designed: Concepts as a Design Axis for Large Language Modelscited by 0
- 2026The ethics of artificial intelligence in the life sciences: Universality, cultural diversity and an architecture of carecited by 0
12 most cited of 45 All 45 (JSON)
- 2026Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs14 Oct 2026
- 2026Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models14 Oct 2026
- 2026Do correct answers have stable latent knowledge support?11 Oct 2026
- 2026U-Space: Uncovering When and Why Uncertainty Arises in Language Models6 Oct 2026
- 2026JLD: Perceptual Distance Through A Jacobian Lens5 Oct 2026
- 2026DV-Lens: Revealing the Functional Organization of Language Model Parameters3 Oct 2026
- 2026From Latent Space to Jacobian Space: Measuring, Evading, and Training Against Safety-Content Accessibility3 Oct 2026
- 2026The Persona Is Still There, but Who Is Speaking? Latent Identity Reversion in Persistent AI Agents1 Oct 2026
- 2026What Can Analogy Tell Us About Artificial Consciousness?1 Oct 2026
- 2026Capacity, Responsiveness and Alignment: What Makes a Latent Structure Actionable28 Sep 2026
- 2026Language Models Act on Hidden Valence28 Sep 2026
- 2026A mechanistic study of language model introspection28 Sep 2026
12 newest of 45 All 45 (JSON)