Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
The emergence of large language models (LLMs) further improves the capabilities of open-domain dialogue systems and can generate fluent, coherent, and diverse responses. However, LLMs still lack a crucial ability: communication skills. This limitation renders them more like information seeking tools rather than anthropomorphic chatbots. Communication skills, such as topic transition, proactively asking questions, concept guidance, empathy, and summarising often should be taken into consideration, to make LLMs more anthropomorphic and proactive during the conversation, thereby increasing the interest of users and attracting them to chat for longer. However, enabling these communication skills in black-box LLMs remains a key challenge because they do not have the same utterance formation mode as real people: think before speaking. Inspired by linguistics and cognitive science, we empower LLMs with communication skills through inner monologues. To evaluate various communication skills, we construct a benchmark named Cskills, which can also more comprehensively evaluate the dialogue generation ability of the model. Experimental results show that the proposed CSIM strategy improves the backbone models and outperforms the baselines.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 38 of its 57 references that are in the map. First posted on arXiv 13 Nov 2023.
Builds on
38 of 57 references.
Closest ancestors · 1
Same direction, newest first
Other references · 37
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
- 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
- 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
- 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
- 2020Recipes for building an open-domain chatbotcited by 593
- 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
25 more
- 2020Towards a Human-like Open-Domain Chatbotcited by 470
- 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
- 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
- 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 298
- 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 116
- 2020Knowledge-Grounded Dialogue Generation with Pre-trained Language Modelscited by 107
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 98
- 2019Proactive Human-Machine Conversation with Explicit Conversation Goalscited by 88
- 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
- 2023Improving Language Models via Plug-and-Play Retrieval Feedbackcited by 87
- 2020PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learningcited by 79
- 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
- 2020DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterancescited by 36
- 2019Conversing by Reading: Contentful Neural Conversation with On-demand Machine Readingcited by 32
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2023Think Outside the Code: Brainstorming Boosts Large Language Models in Code Generationcited by 19
- 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
- 2021Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systemscited by 17
- 2022Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policycited by 17
- 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Humancited by 14
- 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
- 2020Generating Dialogue Responses from a Semantic Latent Spacecited by 5
- 2022Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injectioncited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 5.
11 papers.
- 2025PonderLM: Pretraining Language Models to Ponder in Continuous Spacecited by 44
- 2024IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologuescited by 40
- 2024Do LLMs Play Dice? Exploring Probability Distribution Sampling in Large Language Models for Behavioral Simulationcited by 14
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Trainingcited by 9
- 2026Beyond Preset Identities: How Agents Form Stances and Boundaries in Generative Societiescited by 2
- 2025A Fully Automated Pipeline for Conversational Discourse Annotation: Tree Scheme Generation and Labeling with Large Language Modelscited by 1
- 2025Dream to Chat: Model-based Reinforcement Learning on Dialogues with User Belief Modelingcited by 1
- 2026A Concise Agent is Less Expert: Revealing Side Effects of Using Style Features on Conversational Agentscited by 1
- 2026CAST: Achieving Stable LLM-based Text Analysis for Data Analyticscited by 0
- 2026Towards High-Level Semantic Intelligencecited by 0
- 2026ToSCA: Leveraging Hierarchical Reinforcement Learning on Temporal and Strategic Abstractions of Conversational Agentscited by 0
- 2026ToSCA: Leveraging Hierarchical Reinforcement Learning on Temporal and Strategic Abstractions of Conversational Agents22 Aug 2026
- 2026Towards High-Level Semantic Intelligence27 Jul 2026
- 2026Beyond Preset Identities: How Agents Form Stances and Boundaries in Generative Societies24 Mar 2026
- 2026CAST: Achieving Stable LLM-based Text Analysis for Data Analytics26 Jan 2026
- 2026A Concise Agent is Less Expert: Revealing Side Effects of Using Style Features on Conversational Agents15 Jan 2026
- 2025Dream to Chat: Model-based Reinforcement Learning on Dialogues with User Belief Modeling23 Aug 2025
- 2025Adaptive-VP: A Framework for LLM-Based Virtual Patients that Adapts to Trainees' Dialogue to Facilitate Nurse Communication Training31 May 2025
- 2025PonderLM: Pretraining Language Models to Ponder in Continuous Space27 May 2025
- 2025A Fully Automated Pipeline for Conversational Discourse Annotation: Tree Scheme Generation and Labeling with Large Language Models11 Apr 2025
- 2024IM-RAG: Multi-Round Retrieval-Augmented Generation Through Learning Inner Monologues15 May 2024
- 2024Do LLMs Play Dice? Exploring Probability Distribution Sampling in Large Language Models for Behavioral Simulation13 Apr 2024
Similar, not cited
Close in wording, no citation either way
- 2026Understanding Large Language Models
- 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialogue
- 2024Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Model
- 2025Towards Anthropomorphic Conversational AI Part I: A Practical Framework
- 2024On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation
- 2024Plan-Grounded Large Language Models for Dual Goal Conversational Settings
- 2024Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs
- 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning