Attractor States Emerge in Multi-Turn LLM Conversations
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly used in open-ended multi-agent settings, but the long-run dynamics of model--model interaction remain poorly understood. We study whether open-ended LLM discussions exhibit attractor-like behavior, i.e. topic-independent stable sets of behaviors which conversations settle into. Across 7 LLMs and 20 controversial topics, we compare self-play and mixed-play dyadic debates, tracking trajectories in representation space, discourse traits, and stances. We find self-play trajectories to be model-specific attractors that draw their conversation partners asymmetrically in mixed-play debates, influencing the other models' stylistic choices and behavior. For example, Claude Haiku is a strong attractor of other models in latent space, corresponding to other models taking on its traits like metacommentary, and models like GPT-4.1 nano are especially malleable. Our results suggest that open-ended LLM interactions are partially predictable from model-specific attractors, but shaped by structured and asymmetric partner influence. Overall, our analysis sheds some light on the complex behavior of open-ended multi-agent interaction, which we hope is helpful in designing, predicting, and monitoring autonomous agentic systems in the real world.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 28 of its 49 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
28 of 49 references.
References · 28
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 266
- 2023Simulating Opinion Dynamics with Networks of LLM-based Agentscited by 154
- 2025Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond)cited by 141
16 more
- 2024On the Conversational Persuasiveness of Large Language Models: A Randomized Controlled Trialcited by 109
- 2024Systematic Biases in LLM Simulations of Debatescited by 99
- 2026The Assistant Axis: Situating and Stabilizing the Default Persona of Language Modelscited by 90
- 2025Beyond Single-Turn: A Survey on Multi-Turn Interactions with Large Language Modelscited by 62
- 2024Measuring and Controlling Instruction (In)Stability in Language Model Dialogscited by 53
- 2024LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Modelscited by 33
- 2025TRUTH DECAY: Quantifying Multi-Turn Sycophancy in Language Modelscited by 33
- 2026How LLMs Distort Our Written Languagecited by 21
- 2025Corrupted by Reasoning: Reasoning Language Models Become Free-Riders in Public Goods Gamescited by 20
- 2025Unveiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasingcited by 15
- 2025Language-Driven Opinion Dynamics in Agent-Based Simulations with LLMscited by 13
- 2025The Lock-in Hypothesis: Stagnation by Algorithmcited by 11
- 2025Beyond One-Way Influence: Bidirectional Opinion Dynamics in Multi-Turn Human-LLM Interactionscited by 6
- 2025Agent-to-Agent Theory of Mind: Testing Interlocutor Awareness among Large Language Modelscited by 5
- 2025Geometric Dynamics of Agentic Loops in Large Language Modelscited by 4
- 2025The Chameleon Nature of LLMs: Quantifying Multi-Turn Stance Instability in Search-Enabled Language Modelscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loopscited by 35
- 2026Testing Interchangeability in LLM Agent Teamscited by 1
- 2026Relational Positioning as a Measurable Risk Object: History-Carried Lock-in and Self-Confabulation in Multi-Turn Human-AI Dialoguecited by 0
- 2026If It's Not Buggy, Don't Fix It: On the Dynamics of Iterative Bug-fixing with LLMscited by 0
- 2026ANIMASK: What the Model Contributes to Role Play in Simulated Story Worldscited by 0
- 2026Towards Better Exploration in Sequential Test-Time Scalingcited by 0
- 2026Towards Better Exploration in Sequential Test-Time Scaling30 Sep 2026
- 2026ANIMASK: What the Model Contributes to Role Play in Simulated Story Worlds15 Sep 2026
- 2026If It's Not Buggy, Don't Fix It: On the Dynamics of Iterative Bug-fixing with LLMs9 Sep 2026
- 2026Testing Interchangeability in LLM Agent Teams4 Sep 2026
- 2026Relational Positioning as a Measurable Risk Object: History-Carried Lock-in and Self-Confabulation in Multi-Turn Human-AI Dialogue13 Jul 2026
- 2026Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops8 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Collective Opinion Dynamics in Structured LLM Populations
- 2024When LLMs Play the Telephone Game: Cultural Attractors as Conceptual Tools to Evaluate LLMs in Multi-turn Settings
- 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Models
- 2026"Who Am I, and Who Else Is Here?" Behavioral Differentiation Without Role Assignment in Multi-Agent LLM Systems
- 2025Emergent Convergence in Multi-Agent LLM Annotation
- 2025Disentangling Interaction and Bias Effects in Opinion Dynamics of Large Language Models
- 2025How Do LLMs Persuade? Linear Probes Can Uncover Persuasion Dynamics in Multi-Turn Conversations
- 2025Towards Simulating Social Influence Dynamics with LLM-based Multi-agents