mlsanityData to 14 Oct 2026

Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue

arXiv 2311.07445 ↗First posted 13 Nov 2023cs.CL cs.AIcited by 11

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

The emergence of large language models (LLMs) further improves the capabilities of open-domain dialogue systems and can generate fluent, coherent, and diverse responses. However, LLMs still lack a crucial ability: communication skills. This limitation renders them more like information seeking tools rather than anthropomorphic chatbots. Communication skills, such as topic transition, proactively asking questions, concept guidance, empathy, and summarising often should be taken into consideration, to make LLMs more anthropomorphic and proactive during the conversation, thereby increasing the interest of users and attracting them to chat for longer. However, enabling these communication skills in black-box LLMs remains a key challenge because they do not have the same utterance formation mode as real people: think before speaking. Inspired by linguistics and cognitive science, we empower LLMs with communication skills through inner monologues. To evaluate various communication skills, we construct a benchmark named Cskills, which can also more comprehensively evaluate the dialogue generation ability of the model. Experimental results show that the proposed CSIM strategy improves the backbone models and outperforms the baselines.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 38 of its 57 references that are in the map. First posted on arXiv 13 Nov 2023.

Builds on

38 of 57 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb

Other references · 37

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
  7. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,077
  8. 2020Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inferencecited by 938
  9. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  10. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 669
  11. 2020Recipes for building an open-domain chatbotcited by 593
  12. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
25 more
  1. 2020Towards a Human-like Open-Domain Chatbotcited by 470
  2. 2023Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflictscited by 341
  3. 2023Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervisioncited by 318
  4. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 298
  5. 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
  6. 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaborationcited by 116
  7. 2020Knowledge-Grounded Dialogue Generation with Pre-trained Language Modelscited by 107
  8. 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
  9. 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 98
  10. 2019Proactive Human-Machine Conversation with Explicit Conversation Goalscited by 88
  11. 2020Few-Shot Text Generation with Pattern-Exploiting Trainingcited by 87
  12. 2023Improving Language Models via Plug-and-Play Retrieval Feedbackcited by 87
  13. 2020PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learningcited by 79
  14. 2019Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphscited by 59
  15. 2020DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterancescited by 36
  16. 2019Conversing by Reading: Contentful Neural Conversation with On-demand Machine Readingcited by 32
  17. 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
  18. 2023Think Outside the Code: Brainstorming Boosts Large Language Models in Code Generationcited by 19
  19. 2021Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoderscited by 18
  20. 2021Thinking Clearly, Talking Fast: Concept-Guided Non-Autoregressive Generation for Open-Domain Dialogue Systemscited by 17
  21. 2022Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policycited by 17
  22. 2023ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Humancited by 14
  23. 2023GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generationcited by 9
  24. 2020Generating Dialogue Responses from a Semantic Latent Spacecited by 5
  25. 2022Achieving Conversational Goals with Unsupervised Post-hoc Knowledge Injectioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 5.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Understanding Large Language Models
  2. 2024Should We Fine-Tune or RAG? Evaluating Different Techniques to Adapt LLMs for Dialogue
  3. 2024Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Model
  4. 2025Towards Anthropomorphic Conversational AI Part I: A Practical Framework
  5. 2024On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation
  6. 2024Plan-Grounded Large Language Models for Dual Goal Conversational Settings
  7. 2024Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs
  8. 2026LLM-Driven Multi-Turn Task-Oriented Dialogue Synthesis for Realistic Reasoning