mlsanityData to 7 Oct 2026

Cohesive Conversations: Enhancing Authenticity in Multi-Agent Simulated Dialogues

arXiv 2407.09897 ↗First posted 13 Jul 2024cs.CLcited by 11

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

This paper investigates the quality of multi-agent dialogues in simulations powered by Large Language Models (LLMs). Analyzing dialogues and memory over multiple sessions revealed significant issues such as repetition, inconsistency, and hallucination, exacerbated by the propagation of erroneous information. To combat these challenges, we propose a novel Screening, Diagnosis, and Regeneration (SDR) framework that detects and corrects utterance errors through a comprehensive process involving immediate issue identification, evidence gathering from past dialogues, and LLM analysis for utterance revision. By incorporating our SDR framework to Generative Agents (Park et al., 2023), we enhance the diversity, consistency, and factualness of the generated dialogues. This work presents a pioneering approach to enhancing dialogue quality in multi-agent simulations, establishing a new standard for future research in the field.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 50 references that are in the map. First posted on arXiv 13 Jul 2024.

Builds on

36 of 50 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects7 Jan
  2. 2023Theory of Mind for Multi-Agent Collaboration via Large Language Models16 Oct
  3. 2023An In-depth Survey of Large Language Model-based Artificial Intelligence Agents23 Sep
  4. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  5. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  6. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration11 Jul

Other references · 30

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  5. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  8. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  9. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  10. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  11. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  12. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
18 more
  1. 2022Self-critiquing models for assisting human evaluatorscited by 372
  2. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  3. 2023Can large language models provide useful feedback on research papers? A large-scale empirical analysiscited by 195
  4. 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
  5. 2023Human-like Summarization Evaluation with ChatGPTcited by 126
  6. 2023LLMs cannot find reasoning errors, but can correct them given the error locationcited by 85
  7. 2023PLACES: Prompting Language Models for Social Conversation Synthesiscited by 72
  8. 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
  9. 2024Is this the real life? Is this just fantasy? The Misleading Success of Simulating Social Interactions With LLMscited by 59
  10. 2022Dialog Inpainting: Turning Documents into Dialogscited by 56
  11. 2019Evaluating Coherence in Dialogue Systems using Entailmentcited by 53
  12. 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
  13. 2023Errors are Useful Prompts: Instruction Guided Task Programming with Verifier-Assisted Iterative Promptingcited by 45
  14. 2023The language of prompting: What linguistic properties make a prompt successful?cited by 43
  15. 2022Listening to Affected Communities to Define Extreme Speech: Dataset and Experimentscited by 21
  16. 2023Simple LLM Prompting is State-of-the-Art for Robust and Multilingual Dialogue Evaluationcited by 19
  17. 2022FRMT: A Benchmark for Few-Shot Region-Aware Machine Translationcited by 18
  18. 2023Ambient Adventures: Teaching ChatGPT on Developing Complex Storiescited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 3.

11 papers.

  1. 2024Exploring and Controlling Diversity in LLM-Agent Conversationcited by 12
  2. 2025ToMAP: Training Opponent-Aware LLM Persuaders with Theory of Mindcited by 12
  3. 2025Scaling Personality Control in LLMs with Big Five Scaler Promptscited by 4
  4. 2025Enabling Chatbots with Eyes and Ears: An Immersive Multimodal Conversation System for Dynamic Interactionscited by 3
  5. 2025Post Persona Alignment for Multi-Session Dialogue Generationcited by 3
  6. 2026MechMath Agent Team: LLM Driven Agents for Mathematical Researchcited by 3
  7. 2025MADS: Multi-Agent Dialogue Simulation for Diverse Persuasion Data Generationcited by 2
  8. 2026Paper Circle: An Open-source Multi-agent Research Discovery and Analysis Frameworkcited by 2
  9. 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarioscited by 1
  10. 2025Convergence of Outputs When Two Large Language Models Interact in a Multi-Agentic Setupcited by 0
  11. 2026Evaluating LLM-Simulated Conversations in Modeling Inconsistent and Uncollaborative Behaviors in Human Social Interactioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Adaptive Multi-Agent Response Refinement in Conversational Systems
  2. 2026ReIn: Conversational Error Recovery with Reasoning Inception
  3. 2025ToolACE-MT: Non-Autoregressive Generation for Agentic Multi-Turn Interaction
  4. 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation
  5. 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agents
  6. 2025SDialog: A Python Toolkit for End-to-End Agent Building, User Simulation, Dialog Generation, and Evaluation
  7. 2024Interactive Dialogue Agents via Reinforcement Learning on Hindsight Regenerations
  8. 2026Conversation for Non-verifiable Learning: Self-Evolving LLMs through Meta-Evaluation