ZenGen: Social Mind for LLMs
Not on the map. Why?
Abstract (arXiv)
As large language models move from isolated task solving toward long-term service in human environments, they require social intelligence: the ability to infer mental states, track social relations, reason over norms, and adapt behavior under context. This report presents ZenGen, an integrated framework for measuring, internalizing, and grounding social intelligence. For measurement, we introduce SoMBench, a psychology-grounded benchmark spanning 3 primary dimensions, 17 secondary dimensions, and 71 task paradigms. It controls question format, narrative perspective, and context length across 284 shared scenarios and 3,481 expert-verified instances. Evaluation of 20 representative LLMs reveals substantial headroom: the best model achieves only 72.08% overall accuracy, and none of the 17 secondary dimensions reaches the 90% near-ceiling band. For internalization, we develop ZenGen, a diagnosis-driven training recipe combining supervised fine-tuning, on-policy distillation, and rubric-based reinforcement learning. Across five social-cognition benchmarks, ZenGen consistently outperforms its base models, with ZenGen-27B-Stage2 achieving the best average score and ZenGen-32B-Stage2 remaining competitive with DeepSeek-V4-Pro. For deployment-time grounding, we build Actio, a harness-controlled inference architecture that routes four typed supports into reasoning: PRISM for procedural guidance, Starling for runtime mental-state representation, SAGE for reusable experience, and gated RAG for external social and normative knowledge. Across five base models and three benchmarks, the full harness improves 14 of 15 model-benchmark pairs and is best or tied for best in 8, demonstrating the effectiveness of typed runtime support. Together, these results show that socially intelligent LLMs require coordinated advances in evaluation, parametric internalization, and deployment-time grounding.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 74 references that are in the map. First posted on arXiv 26 Jul 2026.
Builds on
16 of 74 references.
References · 16
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2020Aligning AI With Shared Human Valuescited by 723
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2025ELEPHANT: Measuring and understanding social sycophancy in LLMscited by 129
- 2025Reinforcement Learning Optimization for Large-Scale Learning: An Efficient and User-Friendly Scaling Librarycited by 101
- 2024Explore Theory of Mind: Program-guided adversarial data generation for theory of mind reasoningcited by 33
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Modelscited by 29
- 2025Large Language Models as Theory of Mind Aware Generative Agents with Counterfactual Reflectioncited by 13
- 2026Towards Natural Personalization: Evaluating Long-Horizon Preference Following in Personalized User-LLM Interactionscited by 10
4 more
- 2026BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMscited by 10
- 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversationscited by 7
- 2026CogToM: A Comprehensive Theory of Mind Benchmark inspired by Human Cognition for Large Language Modelscited by 4
- 2026DeepBias: Adaptive In-depth Probing of Social Biases in LVLMscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024EgoSocialArena: Benchmarking the Social Intelligence of Large Language Models from a First-person Perspective
- 2023Understanding Social Reasoning in Language Models with Language Models
- 2025SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environments
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark
- 2025Humanizing LLMs: A Survey of Psychological Measurements with Tools, Datasets, and Human-Agent Applications
- 2025Psyche-R1: Towards Reliable Psychological LLMs through Unified Empathy, Expertise, and Reasoning
- 2024CogBench: a large language model walks into a psychology lab
- 2026CoMMET: A Psychologically Grounded Benchmark for Evaluating Theory of Mind in Multimodal LLMs