mlsanityData to 7 Oct 2026

Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models

arXiv 2304.13835 ↗First posted 26 Apr 2023cs.CL cs.LGcited by 53

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Current dialogue research primarily studies pairwise (two-party) conversations, and does not address the everyday setting where more than two speakers converse together. In this work, we both collect and evaluate multi-party conversations to study this more general case. We use the LIGHT environment to construct grounded conversations, where each participant has an assigned character to role-play. We thus evaluate the ability of language models to act as one or more characters in such conversations. Models require two skills that pairwise-trained models appear to lack: (1) being able to decide when to talk; (2) producing coherent utterances grounded on multiple characters. We compare models trained on our new dataset to existing pairwise-trained dialogue models, as well as large language models with few-shot prompting. We find that our new dataset, MultiLIGHT, which we will publicly release, can help bring significant improvements in the group setting.

Key facts. Cited by 53 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 19 of its 32 references that are in the map. First posted on arXiv 26 Apr 2023.

Builds on

19 of 32 references.

References · 19

  1. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  2. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  3. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  4. 2020Towards a Human-like Open-Domain Chatbotcited by 467
  5. 2020The Pushshift Reddit Datasetcited by 289
  6. 2015Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Modelscited by 207
  7. 2022BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagecited by 197
  8. 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 178
  9. 2015The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systemscited by 172
  10. 2019Queens are Powerful too: Mitigating Gender Bias in Dialogue Generationcited by 152
  11. 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
  12. 2022Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completioncited by 102
7 more
  1. 2022Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agentscited by 62
  2. 2022The CRINGE Loss: Learning what language not to modelcited by 39
  3. 2020Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directionscited by 34
  4. 2015A Survey of Available Corpora for Building Data-Driven Dialogue Systemscited by 33
  5. 2021Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identitycited by 22
  6. 2019Generating Interactive Worlds with Textcited by 13
  7. 2023Mephisto: A Framework for Portable, Reproducible, and Iterative Crowdsourcingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 10; 2024: 20; 2025: 12; 2026: 11.

53 papers.

Sort:

By area:

  1. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  2. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  3. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  4. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviorscited by 580
  5. 2023RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Modelscited by 173
  6. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agentcited by 92
  7. 2024LLM Discussion: Enhancing the Creativity of Large Language Models via Discussion Framework and Role-Playcited by 65
  8. 2024Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Charactercited by 61
  9. 2024MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Modelscited by 41
  10. 2024Proactive Conversational Agents with Inner Thoughtscited by 35
  11. 2024CodeAgent: Autonomous Communicative Agents for Code Reviewcited by 33
  12. 2023Interactive Natural Language Processingcited by 31
38 more
  1. 2025Enhancing Persona Consistency for LLMs' Role-Playing using Persona-Aware Contrastive Learningcited by 27
  2. 2023Balancing Autonomy and Alignment: A Multi-Dimensional Taxonomy for Autonomous LLM-powered Multi-Agent Architecturescited by 25
  3. 2023RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Modelscited by 21
  4. 2024RoleBreak: Character Hallucination as a Jailbreak Attack in Role-Playing Systemscited by 19
  5. 2025MASTER: A Multi-Agent System with LLM Specialized MCTScited by 15
  6. 2024LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultationcited by 14
  7. 2025Thinking in Character: Advancing Role-Playing Agents with Role-Aware Reasoningcited by 14
  8. 2023Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulationscited by 11
  9. 2024CharacterGPT: A Persona Reconstruction Framework for Role-Playing Agentscited by 10
  10. 2024Unveiling the Secrets of Engaging Conversations: Factors that Keep Users Hooked on Role-Playing Dialog Agentscited by 7
  11. 2024SimulBench: Evaluating Language Models with Creative Simulation Taskscited by 7
  12. 2024Mixed-Session Conversation with Egocentric Memorycited by 7
  13. 2025The Rise of Darkness: Safety-Utility Trade-Offs in Role-Playing Dialogue Agentscited by 7
  14. 2023PIPPA: A Partially Synthetic Conversational Datasetcited by 6
  15. 2024RNR: Teaching Large Language Models to Follow Roles and Rulescited by 6
  16. 2024Decoding Hate: Exploring Language Models' Reactions to Hate Speechcited by 6
  17. 2025Multi-Party Conversational Agents: A Surveycited by 6
  18. 2024Enhancing Role-playing Systems through Aggressive Queries: Evaluation and Improvementcited by 5
  19. 2026Character-R1: Enhancing Role-Aware Reasoning in Role-Playing Agents via RLVRcited by 5
  20. 2024Dynamic Generation of Personalities with Large Language Modelscited by 4
  21. 2024Large Language Model-based Role-Playing for Personalized Medical Jargon Extractioncited by 4
  22. 2025Conversational Agents as Catalysts for Critical Thinking: Challenging Social Influence in Group Decision-makingcited by 4
  23. 2025Issue-Oriented Agent-Based Framework for Automated Review Comment Generationcited by 4
  24. 2026Speak or Stay Silent: Context-Aware Turn-Taking in Multi-Party Dialoguecited by 4
  25. 2026Voluntary Collusion with Secret Tools in Competing LLM Agentscited by 4
  26. 2024WHoW: A Cross-domain Approach for Analysing Conversation Moderationcited by 3
  27. 2025Enabling Chatbots with Eyes and Ears: An Immersive Multimodal Conversation System for Dynamic Interactionscited by 3
  28. 2025SMAGDi: Socratic Multi Agent Interaction Graph Distillation for Efficient High Accuracy Reasoningcited by 3
  29. 2026Context Learning for Multi-Agent Discussioncited by 2
  30. 2026MafiaScope: Non-Invasive, Time-Resolved Belief Probing for LLM Agents in Social Deduction Gamescited by 2
  31. 2024Designing and Evaluating Dialogue LLMs for Co-Creative Improvised Theatrecited by 1
  32. 2025A Multi-Agent Generative AI Framework for IC Module-Level Verification Automationcited by 1
  33. 2026When2Speak: A Dataset for Temporal Participation and Turn-Taking in Multi-Party Conversations for Large Language Modelscited by 1
  34. 2024Dialogue You Can Trust: Human and AI Perspectives on Generated Conversationscited by 0
  35. 2025Towards Understanding Multi-Round Large Language Model Reasoning: Approximability, Learnability and Generalizabilitycited by 0
  36. 2025Whom to Respond To? A Transformer-Based Model for Multi-Party Social Robot Interactioncited by 0
  37. 2026SCENE: Recognizing Social Norms and Sanctioning in Group Chatscited by 0
  38. 2026Through the Lens of Character: Resolving Modality-Role Interference in Multimodal Role-Playing Agentcited by 0

50 most cited of 53 All 53 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026"Who Am I, and Who Else Is Here?" Behavioral Differentiation Without Role Assignment in Multi-Agent LLM Systems
  2. 2023The Use of Multiple Conversational Agent Interlocutors in Learning
  3. 2025A Survey on Multi-Turn Interaction Capabilities of Large Language Models
  4. 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agents
  5. 2026GroupMemBench: Benchmarking LLM Agent Memory in Multi-Party Conversations
  6. 2025Multimodal Conversation Structure Understanding
  7. 2023Grounding Gaps in Language Model Generations
  8. 2024Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs