# LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models

arXiv: https://arxiv.org/abs/2402.02896 · HTML: https://mlsanity.com/paper/2402.02896/

## Key facts

- Cited by 33 papers in the map (data through 14 Oct 2026).
- Placed in Social simulation and multi-agent debate, one of 16 directions in LLM agents and tool use.
- Builds on 13 of its 31 references that are in the map.
- First posted on arXiv 5 Feb 2024.

## Placed in

- LLM agents and tool use / [Social simulation and multi-agent debate](https://mlsanity.com/agents/social-simulation-and-multi-agent-debate/)

## Builds on (most cited first, 13 of 13)

- [Generative Agents: Interactive Simulacra of Human Behavior](https://mlsanity.com/paper/2304.03442/) (2023)
- [Personalizing Dialogue Agents: I have a dog, do you have pets too?](https://mlsanity.com/paper/1801.07243/) (2018)
- [MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action](https://mlsanity.com/paper/2303.11381/) (2023)
- [Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language](https://mlsanity.com/paper/2204.00598/) (2022)
- [A Persona-Based Neural Conversation Model](https://mlsanity.com/paper/1603.06155/) (2016)
- [Multi-Agent Cooperation and the Emergence of (Natural) Language](https://mlsanity.com/paper/1612.07182/) (2016)
- [Mindstorms in Natural Language-Based Societies of Mind](https://mlsanity.com/paper/2305.17066/) (2023)
- [Analysing Lexical Semantic Change with Contextualised Word Representations](https://mlsanity.com/paper/2004.14118/) (2020)
- [What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability](https://mlsanity.com/paper/2305.11707/) (2023)
- [Identifying and Manipulating the Personality Traits of Language Models](https://mlsanity.com/paper/2212.10276/) (2022)
- [Maximizing Stylistic Control and Semantic Accuracy in NLG: Personality Variation and Discourse Contrast](https://mlsanity.com/paper/1907.09527/) (2019)
- [On the Effectiveness of Creating Conversational Agent Personalities Through Prompting](https://mlsanity.com/paper/2310.11182/) (2023)
- [Semantic Variation in Online Communities of Practice](https://mlsanity.com/paper/1806.05847/) (2018)

## Built on by (most cited first, 30 of 33)

- [BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded Data](https://mlsanity.com/paper/2410.16491/) (2024)
- [Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning](https://mlsanity.com/paper/2511.00222/) (2025)
- [Evaluating Large Language Models with Psychometrics](https://mlsanity.com/paper/2406.17675/) (2024)
- [Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents](https://mlsanity.com/paper/2502.13012/) (2025)
- [Unmasking Conversational Bias in AI Multiagent Systems](https://mlsanity.com/paper/2501.14844/) (2025)
- [Trust-Oriented Adaptive Guardrails for Large Language Models](https://mlsanity.com/paper/2408.08959/) (2024)
- [The influence of persona and conversational task on social interactions with a LLM-controlled embodied conversational agent](https://mlsanity.com/paper/2411.05653/) (2024)
- [FACET: Teacher-Centred LLM-Based Multi-Agent Systems-Towards Personalized Educational Worksheets](https://mlsanity.com/paper/2508.11401/) (2025)
- [Rediscovering the Latent Dimensions of Personality with Large Language Models as Trait Descriptors](https://mlsanity.com/paper/2409.09905/) (2024)
- [Attractor States Emerge in Multi-Turn LLM Conversations](https://mlsanity.com/paper/2606.30571/) (2026)
- [AI Debaters are More Persuasive when Arguing in Alignment with Their Own Beliefs](https://mlsanity.com/paper/2510.13912/) (2025)
- [Do Persona-Infused LLMs Affect Performance in a Strategic Reasoning Game?](https://mlsanity.com/paper/2512.06867/) (2025)
- [Exploring Big Five Personality and AI Capability Effects in LLM-Simulated Negotiation Dialogues](https://mlsanity.com/paper/2506.15928/) (2025)
- [Evaluating the Simulation of Human Personality-Driven Susceptibility to Misinformation with LLMs](https://mlsanity.com/paper/2506.23610/) (2025)
- [Neural Transparency: Mechanistic Interpretability Interfaces for Anticipating Model Behaviors for Personalized AI](https://mlsanity.com/paper/2511.00230/) (2025)
- [AI-exhibited Personality Traits Can Shape Human Self-concept through Conversations](https://mlsanity.com/paper/2601.12727/) (2026)
- [Understanding Persuasive Interactions between Generative Social Agents and Humans: The Knowledge-based Persuasion Model (KPM)](https://mlsanity.com/paper/2602.11483/) (2026)
- [Integrating Personality into Digital Humans: A Review of LLM-Driven Approaches for Virtual Reality](https://mlsanity.com/paper/2503.16457/) (2025)
- [Dynamic Personality Adaptation in Large Language Models via State Machines](https://mlsanity.com/paper/2602.22157/) (2026)
- [Enhancing Safety of Large Language Models via Embedding Space Separation](https://mlsanity.com/paper/2603.20206/) (2026)
- [IDIOLEX: Unified and Continuous Representations for Idiolectal and Stylistic Variation](https://mlsanity.com/paper/2604.04704/) (2026)
- [LLM Agent-Based Simulation of Student Activities and Mental Health Using Smartphone Sensing Data](https://mlsanity.com/paper/2508.02679/) (2025)
- [The Adaptation Paradox: Agency vs. Mimicry in Companion Chatbots](https://mlsanity.com/paper/2509.12525/) (2025)
- [TACLA: An LLM-Based Multi-Agent Tool for Transactional Analysis Training in Education](https://mlsanity.com/paper/2510.17913/) (2025)
- [LLMs for Resource Allocation: A Participatory Budgeting Approach to Inferring Preferences](https://mlsanity.com/paper/2508.06060/) (2025)
- [Interpolative Decoding: Exploring the Spectrum of Personality Traits in LLMs](https://mlsanity.com/paper/2512.19937/) (2025)
- [Never say never: Exploring the effects of available knowledge on agent persuasiveness in controlled physiotherapy motivation dialogues](https://mlsanity.com/paper/2602.12924/) (2026)
- [InnerPond: Fostering Inter-Self Dialogue with a Multi-Agent Approach for Introspection](https://mlsanity.com/paper/2603.27563/) (2026)
- [An Interactive Paradigm for Deep Research](https://mlsanity.com/paper/2605.24266/) (2026)
- [Synthetic Counteradaptation: A Principle of Human-AI Co-evolution](https://mlsanity.com/paper/2606.15503/) (2026)

## Abstract (arXiv)

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an endeavour is important to ensure that agents remain consistent to their assigned traits yet are able to engage in open, naturalistic dialogues. In our experiments, we condition GPT-3.5 on personality profiles through prompting and create a two-group population of LLM agents using a simple variability-inducing sampling algorithm. We then administer personality tests and submit the agents to a collaborative writing task, finding that different profiles exhibit different degrees of personality consistency and linguistic alignment to their conversational partners. Our study seeks to lay the groundwork for better understanding of dialogue-based interaction between LLMs and highlights the need for new approaches to crafting robust, more human-like LLM personas for interactive environments.