mlsanityData to 7 Oct 2026

The Granularity Axis: A Micro-to-Macro Latent Direction for Social Roles in Language Models

arXiv 2605.06196 ↗First posted 7 May 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) are routinely prompted to take on social roles ranging from individuals to institutions, yet it remains unclear whether their internal representations encode the granularity of such roles, from micro-level individual experience to macro-level organizational, institutional, or national reasoning. We show that they do. We define a contrast-based Granularity Axis as the difference between mean macro- and micro-role hidden states. In Qwen3-8B, this axis aligns with the principal axis (PC1) of the role representation space at cosine 0.972 and accounts for 52.6% of its variance, indicating that granularity is the dominant geometric axis organizing prompted social roles. We construct 75 social roles across five granularity levels and collect 91,200 role-conditioned responses over shared questions and prompt variants, then extract role-level hidden states and project them onto the axis. Role projections increase monotonically across all five levels, remain stable across layers, prompt variants, endpoint definitions, held-out splits, and score-filtered subsets, and transfer to Llama-3.1-8B-Instruct. The axis is also causally relevant: activation steering along it shifts response granularity in the predicted direction, with Llama moving from 2.00 to 3.17 on a five-point macro scale under positive steering on prompts that admit local responses. The two models differ in controllability, suggesting that steering depends on each model's default operating regime. Overall, our findings suggest that social role granularity is not merely a stylistic surface feature, but a structured, ordered, and causally manipulable latent direction in role-conditioned language model behavior.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 52 of its 90 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

52 of 90 references.

References · 52

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  5. 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
  7. 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
  8. 2023Representation Engineering: A Top-Down Approach to AI Transparencycited by 1,239
  9. 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,009
  10. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 960
  11. 2022Toy Models of Superpositioncited by 928
  12. 2023ChatDev: Communicative Agents for Software Developmentcited by 893
38 more
  1. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  2. 2023Steering Language Models With Activation Engineeringcited by 824
  3. 2023Whose Opinions Do Language Models Reflect?cited by 759
  4. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  5. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
  6. 2024Scaling and evaluating sparse autoencoderscited by 530
  7. 2024Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Modelscited by 412
  8. 2023Character-LLM: A Trainable Agent for Role-Playingcited by 335
  9. 2025Persona Vectors: Monitoring and Controlling Character Traits in Language Modelscited by 303
  10. 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 220
  11. 2023Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language Modelscited by 204
  12. 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 203
  13. 2024Not All Language Model Features Are One-Dimensionally Linearcited by 201
  14. 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 191
  15. 2023InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviewscited by 177
  16. 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
  17. 2023In-Context Impersonation Reveals Large Language Models' Strengths and Biasescited by 154
  18. 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
  19. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 151
  20. 2024CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluationcited by 139
  21. 2024From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agentscited by 76
  22. 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 76
  23. 2023Aligning Large Language Models with Human Preferences through Representation Engineeringcited by 71
  24. 2023Simulating Social Media Using Large Language Models to Evaluate Alternative News Feed Algorithmscited by 64
  25. 2023Improving Activation Steering in Language Models with Mean-Centringcited by 64
  26. 2023On the steerability of large language models toward data-driven personascited by 53
  27. 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 51
  28. 2023Epidemic Modeling with Generative Agentscited by 49
  29. 2024Large Language Models Assume People are More Rational than We Really arecited by 49
  30. 2024The Oscars of AI Theater: A Survey on Role-Playing with Language Modelscited by 47
  31. 2023Personas as a Way to Model Truthfulness in Language Modelscited by 46
  32. 2025LLM-based Human Simulations Have Not Yet Been Reliablecited by 30
  33. 2024Large Language Models Show Human-like Social Desirability Biases in Survey Responsescited by 27
  34. 2025Representation Engineering for Large-Language Models: Survey and Research Challengescited by 18
  35. 2026PERSONA: Dynamic and Compositional Inference-Time Personality Control via Activation Vector Algebracited by 11
  36. 2026Where is the Mind? Persona Vectors and LLM Individuationcited by 7
  37. 2024RNR: Teaching Large Language Models to Follow Roles and Rulescited by 6
  38. 2026A Systematic Analysis of the Impact of Persona Steering on LLM Capabilitiescited by 5

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.