Thanos: Enhancing Conversational Agents with Skill-of-Mind-Infused Large Language Model
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
To increase social bonding with interlocutors, humans naturally acquire the ability to respond appropriately in a given situation by considering which conversational skill is most suitable for the response - a process we call skill-of-mind. For large language model (LLM)-based conversational agents, planning appropriate conversational skills, as humans do, is challenging due to the complexity of social dialogue, especially in interactive scenarios. To address this, we propose a skill-of-mind-annotated conversation dataset, named Multifaceted Skill-of-Mind, which includes multi-turn and multifaceted conversational skills across various interactive scenarios (e.g., long-term, counseling, task-oriented), grounded in diverse social contexts (e.g., demographics, persona, rules of thumb). This dataset consists of roughly 100K conversations. Using this dataset, we introduce a new family of skill-of-mind-infused LLMs, named Thanos, with model sizes of 1B, 3B, and 8B parameters. With extensive experiments, these models successfully demonstrate the skill-of-mind process and exhibit strong generalizability in inferring multifaceted skills across a variety of domains. Moreover, we show that Thanos significantly enhances the quality of responses generated by LLM-based conversational agents and promotes prosocial behavior in human evaluations.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 40 of its 58 references that are in the map. First posted on arXiv 7 Nov 2024.
Builds on
40 of 58 references.
Closest ancestors · 2
Same direction, newest first
- 2023SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents18 Oct
- 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents13 Oct
Other references · 38
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 820
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 649
- 2024WildChat: 1M ChatGPT Interaction Logs in the Wildcited by 598
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 460
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
- 2019Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Goodcited by 207
26 more
- 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
- 2019PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variablecited by 145
- 2020Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skillscited by 130
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
- 2024Aligning to Thousands of Preferences via System Message Generalizationcited by 84
- 2023Training Socially Aligned Language Models on Simulated Social Interactionscited by 77
- 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
- 2023Prompted LLMs as Chatbot Modules for Long Open-domain Conversationcited by 61
- 2021CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systemscited by 60
- 2024Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theorycited by 60
- 2023On the Creativity of Large Language Modelscited by 57
- 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
- 2023Faithful Persona-based Conversational Dataset Generation with Large Language Modelscited by 45
- 2021PhotoChat: A Human-Human Dialogue Dataset with Photo Sharing Behavior for Joint Image-Text Modelingcited by 43
- 2021Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causescited by 43
- 2024Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Modelscited by 30
- 2021Think Before You Speak: Explicitly Generating Implicit Commonsense Knowledge for Response Generationcited by 26
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
- 2024LangBridge: Multilingual Reasoning Without Multilingual Supervisioncited by 22
- 2023DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AIcited by 21
- 2018Towards Empathetic Open-domain Conversation Models: a New Benchmark and Datasetcited by 18
- 2024Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Datasetcited by 15
- 2022BotsTalk: Machine-sourced Framework for Automatic Curation of Large-scale Multi-skill Dialogue Datasetscited by 13
- 2024Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledgecited by 8
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025SI-Bench: Benchmarking Social Intelligence of Large Language Models in Human-to-Human Conversations
- 2023Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue
- 2025Infusing Theory of Mind into Socially Intelligent LLM Agents
- 2025A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions
- 2024Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMs
- 2025Enhancing Conversational Agents with Theory of Mind: Aligning Beliefs, Desires, and Intentions for Human-Like Interaction
- 2025LLMs and their Limited Theory of Mind: Evaluating Mental State Annotations in Situated Dialogue
- 2025Decompose-ToM: Enhancing Theory of Mind Reasoning in Large Language Models through Simulation and Task Decomposition