mlsanityData to 7 Oct 2026

SocialVeil: Probing Social Intelligence of Language Agents under Communication Barriers

arXiv 2602.05115 ↗First posted 4 Feb 2026cs.AI cs.CLcited by 2

On the map: LLM agents and tool use → Social simulation and multi-agent debate

Abstract (arXiv)

Large language models (LLMs) are increasingly evaluated in interactive environments to test their social intelligence. However, existing benchmarks often assume idealized communication between agents, limiting our ability to diagnose whether LLMs can maintain and repair interactions in more realistic, imperfect settings. To close this gap, we present textscSocialVeil, a social learning environment that can simulate social interaction under cognitive-difference-induced communication barriers. Grounded in a systematic literature review of communication challenges in human interaction, textscSocialVeil introduces three representative types of such disruption, semantic vagueness, sociocultural mismatch, and emotional interference. We also introduce two barrier-aware evaluation metrics, unresolved confusion and mutual understanding, to evaluate interaction quality under impaired communication. Experiments across 720 scenarios and four frontier LLMs show that barriers consistently impair performance, with mutual understanding reduced by over 45% on average, and confusion elevated by nearly 50%. Human evaluations validate the fidelity of these simulated barriers (ICC≈0.78, Pearson r≈0.80). We further demonstrate that adaptation strategies (Repair Instruction and Interactive learning) only have a modest effect far from barrier-free performance. This work takes a step toward bringing social interaction environments closer to real-world communication, opening opportunities for exploring the social intelligence of LLM agents.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use. Builds on 21 of its 63 references that are in the map. First posted on arXiv 4 Feb 2026.

Builds on

21 of 63 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agents20 Mar
  2. 2023Generative Agents: Interactive Simulacra of Human Behavior7 Apr

Other references · 19

  1. 2024Qwen2.5 Technical Reportcited by 4,713
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  4. 2025Why Do Multi-Agent LLM Systems Fail?cited by 559
  5. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  6. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 350
  7. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 300
  8. 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
  9. 2019Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)cited by 173
  10. 2023Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Modelscited by 161
  11. 2024SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agentscited by 89
  12. 2024AgentSense: Benchmarking Social Intelligence of Language Agents through Interactive Scenarioscited by 37
7 more
  1. 2025The Personality Illusion: Revealing Dissociation Between Self-Reports & Behavior in LLMscited by 35
  2. 2024Can LLM "Self-report"?: Evaluating the Validity of Self-report Scales in Measuring Personality Design in LLM-based Chatbotscited by 19
  3. 2024ChatGPT Based Data Augmentation for Improved Parameter-Efficient Debiasing of LLMscited by 18
  4. 2024Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMscited by 12
  5. 2024In-Context Learning May Not Elicit Trustworthy Reasoning: A-Not-B Errors in Pretrained Language Modelscited by 8
  6. 2025LIFELONG SOTOPIA: Evaluating Social Intelligence of Language Agents Over Lifelong Social Interactionscited by 7
  7. 2025The Incomplete Bridge: How AI Research (Mis)Engages with Psychologycited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environments
  2. 2024Towards Objectively Benchmarking Social Intelligence for Language Agents at Action Level
  3. 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversations
  4. 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark
  5. 2026Communicate-Predict-Act: Evaluating Social Intelligence of Agents
  6. 2023Understanding Social Reasoning in Language Models with Language Models
  7. 2026Playing social deduction games with reinforcement fine-tuned large language models
  8. 2024EgoSocialArena: Benchmarking the Social Intelligence of Large Language Models from a First-person Perspective