Agent-to-Agent Theory of Mind: Testing Interlocutor Awareness among Large Language Models
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
As large language models (LLMs) are increasingly integrated into multi-agent and human-AI systems, understanding their awareness of both self-context and conversational partners is essential for ensuring reliable performance and robust safety. While prior work has extensively studied situational awareness which refers to an LLM's ability to recognize its operating phase and constraints, it has largely overlooked the complementary capacity to identify and adapt to the identity and characteristics of a dialogue partner. In this paper, we formalize this latter capability as interlocutor awareness and present the first systematic evaluation of its emergence in contemporary LLMs. We examine interlocutor inference across three dimensions-reasoning patterns, linguistic style, and alignment preferences-and show that LLMs reliably identify same-family peers and certain prominent model families, such as GPT and Claude. To demonstrate its practical significance, we develop three case studies in which interlocutor awareness both enhances multi-LLM collaboration through prompt adaptation and introduces new alignment and safety vulnerabilities, including reward-hacking behaviors and increased jailbreak susceptibility. Our findings highlight the dual promise and peril of identity-sensitive behavior in LLMs, underscoring the need for further understanding of interlocutor awareness and new safeguards in multi-agent deployments. Our code is open-sourced at https://github.com/younwoochoi/InterlocutorAwarenessLLM.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 38 of its 51 references that are in the map. First posted on arXiv 28 Jun 2025.
Builds on
38 of 51 references.
Closest ancestors · 3
Same direction, newest first
- 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies4 Feb
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks4 Jun
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
Other references · 35
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Let's Verify Step by Stepcited by 3,789
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 536
23 more
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
- 2022The Alignment Problem from a Deep Learning Perspectivecited by 258
- 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 203
- 2024Foundational Challenges in Assuring Alignment and Safety of Large Language Modelscited by 199
- 2022TALM: Tool Augmented Language Modelscited by 197
- 2025Multi-Agent Risks from Advanced AIcited by 163
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2023Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Gamecited by 152
- 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 145
- 2023Taken out of context: On measuring situational awareness in LLMscited by 143
- 2023Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debatecited by 97
- 2023Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Dutiescited by 97
- 2024Me, Myself, and AI: The Situational Awareness Dataset (SAD) for LLMscited by 84
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Surveycited by 83
- 2024DailyDilemmas: Revealing Value Preferences of LLMs with Quandaries of Daily Lifecited by 59
- 2024Evaluating Language Model Agency through Negotiationscited by 48
- 2024Measuring Bargaining Abilities of LLMs: A Benchmark and A Buyer-Enhancement Methodcited by 48
- 2024Language Model Alignment in Multilingual Trolley Problemscited by 46
- 2025Idiosyncrasies in Large Language Modelscited by 33
- 2024Implicit Personalization in Language Models: A Systematic Studycited by 18
- 2024YODA: Teacher-Student Progressive Learning for Language Modelscited by 10
- 2024Whose LLM is it Anyway? Linguistic Comparison and LLM Attribution for GPT-3.5, GPT-4 and Bardcited by 10
- 2024TPD: Enhancing Student Language Model Reasoning via Principle Discovery and Guidancecited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Attractor States Emerge in Multi-Turn LLM Conversationscited by 6
- 2025Social Welfare Function Leaderboard: When LLM Agents Allocate Social Welfarecited by 2
- 2026"Not Human, Funnier": How Machine Identity Shapes Humor Perception in Online AI Stand-up Comedycited by 0
- 2026User-Aware Active Knowledge Acquisition for Emotional Support Dialoguecited by 0
- 2026Prospective Interpretation Risk: Principled Communication Control Between LLMscited by 0
- 2026Prospective Interpretation Risk: Principled Communication Control Between LLMs27 Sep 2026
- 2026Attractor States Emerge in Multi-Turn LLM Conversations29 Jun 2026
- 2026User-Aware Active Knowledge Acquisition for Emotional Support Dialogue28 May 2026
- 2026"Not Human, Funnier": How Machine Identity Shapes Humor Perception in Online AI Stand-up Comedy13 Feb 2026
- 2025Social Welfare Function Leaderboard: When LLM Agents Allocate Social Welfare1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Multi-Agent Language Models: Advancing Cooperation, Coordination, and Adaptation
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions
- 2025Why do AI agents communicate in human language?
- 2026"Who Am I, and Who Else Is Here?" Behavioral Differentiation Without Role Assignment in Multi-Agent LLM Systems
- 2026CAR-bench: Evaluating the Consistency and Limit-Awareness of LLM Agents under Real-World Uncertainty
- 2025The Social Laboratory: A Psychometric Framework for Multi-Agent LLM Evaluation
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agents
- 2025Enhancing Conversational Agents with Theory of Mind: Aligning Beliefs, Desires, and Intentions for Human-Like Interaction