EUDAIMONIA: Evaluating Undesirable Dynamics in AI
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used as conversational partners for companionship, emotional disclosure, and interpersonal advice, but the social dynamics of these interactions can create harms that are not captured by current evaluations in real-world settings. We introduce the Social AI Design Code, a set of principles for keeping LLMs from encouraging harmful intimacy, dependence, or prolonged engagement, which we developed with input from psychologists and trust-and-safety practitioners. To evaluate these risks in natural and diverse user-LLM interactions, we operationalize the code with EUDAIMONIA, a benchmark of 969 opening-turn queries and 3,147 design-requirement violation checks built from WildChat through weak-to-strong filtration, multi-model relabeling, and controlled rewriting. Evaluating 26 recent LLMs, we find rapid but uneven progress: within 19 months, Grok shifted from the highest to the lowest violation rate, with Grok-4.7 violating only 13.8% of checks. Although Claude-Opus-5.5 and GPT-6-Astra outperform Grok-4.7 on general benchmarks, they violate more checks, showing that greater capability does not guarantee adherence to our design code. Extended thinking does not reduce violation rates, suggesting these failures are social-alignment problems rather than deficits solvable through test-time reasoning alone. Finally, we evaluate models on 229 multi-turn WildChat continuations, violation rates increase, but cross-model trends mirror those in opening turns, showing that our findings generalize to multi-turn interactions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 94 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
27 of 94 references.
References · 27
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 629
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agentscited by 367
- 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
- 2023Understanding Social Reasoning in Language Models with Language Modelscited by 172
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
- 2024The Dark Side of AI Companionship: A Taxonomy of Harmful Algorithmic Behaviors in Human-AI Relationshipscited by 62
- 2024OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Modelscited by 54
15 more
- 2024SocialBench: Sociality Evaluation of Role-Playing Conversational Agentscited by 50
- 2024NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Modelscited by 48
- 2024Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language Modelscited by 37
- 2025DarkBench: Benchmarking Dark Patterns in Large Language Modelscited by 28
- 2024InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Contextcited by 26
- 2025Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Modelscited by 25
- 2023NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violationcited by 24
- 2023SocialDial: A Benchmark for Socially-Aware Dialogue Systemscited by 22
- 2025"My Boyfriend is AI": A Computational Analysis of Human-AI Companionship in Reddit's AI Communitycited by 20
- 2023Chatbots as social companions: How people perceive consciousness, human likeness, and social health benefits in machinescited by 17
- 2025Cancer-Myth: Evaluating Large Language Models on Patient Questions with False Presuppositionscited by 15
- 2025SocialEval: Evaluating Social Intelligence of Large Language Modelscited by 12
- 2026Evaluating Language Models for Harmful Manipulationcited by 6
- 2025The Siren Song of LLMs: How Users Perceive and Respond to Dark Patterns in Large Language Modelscited by 4
- 2025MINDS: A Cross-cultural Dialogue Corpus for Social Norm Classification and Adherence Detectioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Are Large Language Models Aligned with People's Social Intuitions for Human-Robot Interactions?
- 2023Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark
- 2026Beyond Right and Wrong: Evaluating Second-order Social Reasoning in Large Language Models
- 2025SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environments
- 2026ExpressionCueLens: A Cross-Cultural Analysis of Human-AI Companion Conversations on Social Media ↗
- 2026The Governance of Human-LLM Interaction: Safety Gating, Civility Steering, and Affective Default Lock-In
- 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversations
- 2025The Social Laboratory: A Psychometric Framework for Multi-Agent LLM Evaluation