mlsanityData to 14 Oct 2026

Understanding Mental States to Guide Social Influence in Multi-Person Group Dialogue

arXiv 2601.13687 ↗First posted 20 Jan 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Existing dynamic Theory of Mind (ToM) benchmarks mostly place language models in a passive role: the model reads a sequence of connected scenarios and reports what people believe, feel, intend, and do as these states change. In real social interaction, ToM is also used for action: a speaker plans what to say in order to shift another person's mental-state trajectory toward a goal. We introduce SocialMindChange, a benchmark that moves from tracking minds to changing minds in social interaction. Each instance defines a social context with 4 characters and five connected scenes. The model plays one character and generates dialogue across the five scenes to reach the target while remaining consistent with the evolving states of all participants. SocialMindChange also includes selected higher-order states. Using a structured four-step framework, we construct 1,200 social contexts, covering 6000 scenarios and over 90,000 questions, each validated for realism and quality. Evaluations on ten state-of-the-art LLMs show that their average performance is 54.2% below human performance. This gap suggests that current LLMs still struggle to maintain and change mental-state representations across long, linked interactions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

22 of 31 references.

References · 22

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  3. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,135
  4. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  5. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 515
  6. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
  7. 2023Large Language Models Fail on Trivial Alterations to Theory-of-Mind Taskscited by 292
  8. 2022Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMscited by 220
  9. 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
  10. 2023FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactionscited by 171
  11. 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 163
  12. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 145
10 more
  1. 2023Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilitiescited by 89
  2. 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 85
  3. 2024ToMBench: Benchmarking Theory of Mind in Large Language Modelscited by 72
  4. 2018Evaluating Theory of Mind in Question Answeringcited by 64
  5. 2023NormBank: A Knowledge Bank of Situational Social Normscited by 60
  6. 2024MuMA-ToM: Multi-modal Multi-Agent Theory of Mindcited by 51
  7. 2024Towards a Client-Centered Assessment of LLM Therapists by Client Simulationcited by 24
  8. 2025Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human Statescited by 19
  9. 2025MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mindcited by 13
  10. 2025ToM-SSI: Evaluating Theory of Mind in Situated Social Interactionscited by 5

Built on by

Not cited yet.