mlsanityData to 7 Oct 2026

Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Model

arXiv 2411.04496 ↗First posted 7 Nov 2024cs.CLcited by 2

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

To increase social bonding with interlocutors, humans naturally acquire the ability to respond appropriately in a given situation by considering which conversational skill is most suitable for the response - a process we call skill-of-mind. For large language model (LLM)-based conversational agents, planning appropriate conversational skills, as humans do, is challenging due to the complexity of social dialogue, especially in interactive scenarios. To address this, we propose a skill-of-mind-annotated conversation dataset, named Multifaceted Skill-of-Mind, which includes multi-turn and multifaceted conversational skills across various interactive scenarios (e.g., long-term, counseling, task-oriented), grounded in diverse social contexts (e.g., demographics, persona, rules of thumb). This dataset consists of roughly 100K conversations. Using this dataset, we introduce a new family of skill-of-mind-infused LLMs, named Thanos, with model sizes of 1B, 3B, and 8B parameters. With extensive experiments, these models successfully demonstrate the skill-of-mind process and exhibit strong generalizability in inferring multifaceted skills across a variety of domains. Moreover, we show that Thanos significantly enhances the quality of responses generated by LLM-based conversational agents and promotes prosocial behavior in human evaluations.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 40 of its 58 references that are in the map. First posted on arXiv 7 Nov 2024.

Builds on

40 of 58 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents18 Oct
  2. 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents13 Oct

Other references · 38

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  5. 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
  7. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
  8. 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
  9. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  10. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
  11. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  12. 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
26 more
  1. 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
  2. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
  3. 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
  4. 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
  5. 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 130
  6. 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
  7. 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
  8. 2023Training Socially Aligned Language Models on Simulated Social Interactionscited by 77
  9. 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
  10. 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
  11. 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 60
  12. 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
  13. 2023On the Creativity of Large Language Modelscited by 57
  14. 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
  15. 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 45
  16. 2021PhotoChat: A Human-Human Dialogue Dataset with Photo Sharing Behavior for Joint Image-Text Modelingcited by 43
  17. 2021Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causescited by 43
  18. 2024Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Modelscited by 30
  19. 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
  20. 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
  21. 2024LangBridge: Multilingual Reasoning Without Multilingual Supervisioncited by 22
  22. 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
  23. 2018Towards Empathetic Open-domain Conversation Models: a New Benchmark and Datasetcited by 18
  24. 2024Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Datasetcited by 15
  25. 2022BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasetscited by 13
  26. 2024Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledgecited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversations
  2. 2023Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue
  3. 2025Infusing Theory of Mind into Socially Intelligent LLM Agents
  4. 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions
  5. 2024Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs
  6. 2025Enhancing Conversational Agents with Theory of Mind: Aligning Beliefs, Desires, and Intentions for Human-Like Interaction
  7. 2025LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue
  8. 2025Decompose-ToM: Enhancing Theory of Mind Reasoning in Large Language Models through Simulation and Task Decomposition