The Granularity Axis: A Micro-to-Macro Latent Direction for Social Roles in Language Models
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are routinely prompted to take on social roles ranging from individuals to institutions, yet it remains unclear whether their internal representations encode the granularity of such roles, from micro-level individual experience to macro-level organizational, institutional, or national reasoning. We show that they do. We define a contrast-based Granularity Axis as the difference between mean macro- and micro-role hidden states. In Qwen3-8B, this axis aligns with the principal axis (PC1) of the role representation space at cosine 0.972 and accounts for 52.6% of its variance, indicating that granularity is the dominant geometric axis organizing prompted social roles. We construct 75 social roles across five granularity levels and collect 91,200 role-conditioned responses over shared questions and prompt variants, then extract role-level hidden states and project them onto the axis. Role projections increase monotonically across all five levels, remain stable across layers, prompt variants, endpoint definitions, held-out splits, and score-filtered subsets, and transfer to Llama-3.1-8B-Instruct. The axis is also causally relevant: activation steering along it shifts response granularity in the predicted direction, with Llama moving from 2.00 to 3.17 on a five-point macro scale under positive steering on prompts that admit local responses. The two models differ in controllability, suggesting that steering depends on each model's default operating regime. Overall, our findings suggest that social role granularity is not merely a stylistic surface feature, but a structured, ordered, and causally manipulable latent direction in role-conditioned language model behavior.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 90 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
52 of 90 references.
References · 52
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
- 2022Toy Models of Superpositioncited by 928
- 2023ChatDev: Communicative Agents for Software Developmentcited by 893
38 more
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
- 2023Steering Language Models With Activation Engineeringcited by 824
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 412
- 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
- 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
- 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 220
- 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
- 2024Not All Language Model Features Are One-Dimensionally Linearcited by 201
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
- 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
- 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
- 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 154
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 151
- 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
- 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
- 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 76
- 2023Aligning Large Language Models with Human Preferences through Representation Engineeringcited by 71
- 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
- 2023Improving Activation Steering in Language Models with Mean-Centringcited by 64
- 2023On the steerability of large language models toward data-driven personascited by 53
- 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 51
- 2023Epidemic Modeling with Generative Agentscited by 49
- 2024Large Language Models Assume People are More Rational than We Really arecited by 49
- 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
- 2023Personas as a Way to Model Truthfulness in Language Modelscited by 46
- 2025LLM-based Human Simulations Have Not Yet Been Reliablecited by 30
- 2024Large Language Models Show Human-like Social Desirability Biases in Survey Responsescited by 27
- 2025Representation Engineering for Large-Language Models: Survey and Research Challengescited by 18
- 2026PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebracited by 11
- 2026Where is the Mind? Persona Vectors and LLM Individuationcited by 7
- 2024RNR: Teaching Large Language Models to Follow Roles and Rulescited by 6
- 2026A Systematic Analysis of the Impact of Persona Steering on LLM Capabilitiescited by 5
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.