DeliData: A dataset for deliberation in multi-party problem solving
Not on the map. Why?
Abstract (arXiv)
Group deliberation enables people to collaborate and solve problems, however, it is understudied due to a lack of resources. To this end, we introduce the first publicly available dataset containing collaborative conversations on solving a well-established cognitive task, consisting of 500 group dialogues and 14k utterances. In 64% of these conversations, the group members are able to find a better solution than they had identified individually, and in 43.8% of the groups who had a correct answer as their final solution, none of the participants had solved the task correctly by themselves. Furthermore, we propose a novel annotation schema that captures deliberation cues and release all 14k utterances annotated with it. Finally, we use the proposed dataset to develop and evaluate two methods for generating deliberation utterances. The data collection platform, dataset and annotated corpus are publicly available at https://delibot.xyz.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 16 of its 59 references that are in the map. First posted on arXiv 11 Aug 2021.
Builds on
16 of 59 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 156
- 2019What makes a good conversation? How controllable attributes affect human judgmentscited by 140
- 2019Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Trainingcited by 110
- 2021I Beg to Differ: A study of constructive disagreement in online conversationscited by 18
- 2016Conversational Markers of Constructive Discussionscited by 17
4 more
- 2018WikiConv: A Corpus of the Complete Conversational History of a Large Online Collaborative Communitycited by 16
- 2020What Changed Your Mind: The Roles of Dynamic Topics and Discourse in Argumentation Processcited by 8
- 2015Strategic Dialogue Management via Deep Reinforcement Learningcited by 6
- 2019Learning Multi-Party Turn-Taking Models from Dialogue Logscited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 4; 2025: 9; 2026: 10.
26 papers.
Sort:
By area:
- 2022Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 31
- 2025Frictional Agent Alignment Framework: Slow Down and Don't Break Thingscited by 10
- 2025TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialoguescited by 9
- 2025Evaluation and Facilitation of Online Discussions in the LLM Era: A Surveycited by 8
- 2024Any Other Thoughts, Hedgehog? Linking Deliberation Chains in Collaborative Dialoguescited by 6
- 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomescited by 6
- 2025Towards a Perspectivist Turn in Argument Quality Assessmentcited by 5
- 2024Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Modelscited by 4
- 2022What makes you change your mind? An empirical investigation in online group decision-making conversationscited by 3
- 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaborationcited by 2
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systemscited by 1
- 2024The effect of diversity on group decision-makingcited by 1
14 more
- 2025Achieving Unanimous Consensus Through Multi-Agent Deliberationcited by 1
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotationcited by 1
- 2026Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetrycited by 1
- 2024Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 0
- 2025Conversational DNA: A Visual Language and Interactive Atlas of Human and AI Dialoguecited by 0
- 2025Capturing Opinion Shifts in Deliberative Discourse through Frequency-based Quantum deep learning methodscited by 0
- 2026MPCEval: A Benchmark for Multi-Party Conversation Generationcited by 0
- 2026DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solvingcited by 0
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Predictioncited by 0
- 2026From Propositional to Perceptual Asymmetry: Extending Frictive Policy Optimization to Asymmetric Partial Information Dialoguecited by 0
- 2026TIDES: A Longitudinal Bilingual Dataset for Modeling Multi-Party Social Dynamicscited by 0
- 2026TRIBE: Predicting Team Performance via Communication Behavior Ensemblescited by 0
- 2026Illusion of Alignment: Detecting Hidden Disagreement in Collaborative Dialoguecited by 0
- 2026From Process Loss to Assembly Bonus: Human-Grounded Diagnosis of Multi-Agent LLM Collaborationcited by 0
- 2026From Process Loss to Assembly Bonus: Human-Grounded Diagnosis of Multi-Agent LLM Collaboration6 Sep 2026
- 2026Illusion of Alignment: Detecting Hidden Disagreement in Collaborative Dialogue8 Aug 2026
- 2026TRIBE: Predicting Team Performance via Communication Behavior Ensembles7 Aug 2026
- 2026TIDES: A Longitudinal Bilingual Dataset for Modeling Multi-Party Social Dynamics3 Aug 2026
- 2026From Propositional to Perceptual Asymmetry: Extending Frictive Policy Optimization to Asymmetric Partial Information Dialogue29 Jun 2026
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction26 Jun 2026
- 2026DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solving3 Jun 2026
- 2026Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry5 Mar 2026
- 2026MPCEval: A Benchmark for Multi-Party Conversation Generation5 Mar 2026
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotation11 Feb 2026
- 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaboration26 Oct 2025
- 2025Capturing Opinion Shifts in Deliberative Discourse through Frequency-based Quantum deep learning methods26 Sep 2025
14 more
- 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomes7 Sep 2025
- 2025Conversational DNA: A Visual Language and Interactive Atlas of Human and AI Dialogue11 Aug 2025
- 2025Frictional Agent Alignment Framework: Slow Down and Don't Break Things26 May 2025
- 2025Achieving Unanimous Consensus Through Multi-Agent Deliberation2 Apr 2025
- 2025TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues12 Mar 2025
- 2025Evaluation and Facilitation of Online Discussions in the LLM Era: A Survey3 Mar 2025
- 2025Towards a Perspectivist Turn in Argument Quality Assessment20 Feb 2025
- 2024Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Models15 Dec 2024
- 2024Any Other Thoughts, Hedgehog? Linking Deliberation Chains in Collaborative Dialogues25 Oct 2024
- 2024The effect of diversity on group decision-making2 Feb 2024
- 2024Let's Negotiate! A Survey of Negotiation Dialogue Systems2 Feb 2024
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2022Let's Negotiate! A Survey of Negotiation Dialogue Systems18 Dec 2022
- 2022What makes you change your mind? An empirical investigation in online group decision-making conversations25 Jul 2022
- 2025Frictional Agent Alignment Framework: Slow Down and Don't Break Thingscited by 10
- 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomescited by 6
- 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaborationcited by 2
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systemscited by 1
- 2026From Process Loss to Assembly Bonus: Human-Grounded Diagnosis of Multi-Agent LLM Collaborationcited by 0
- 2026From Process Loss to Assembly Bonus: Human-Grounded Diagnosis of Multi-Agent LLM Collaboration6 Sep 2026
- 2025Learning "Partner-Aware" Collaborators in Multi-Party Collaboration26 Oct 2025
- 2025Collaborate, Deliberate, Evaluate: How LLM Alignment Affects Coordinated Multi-Agent Outcomes7 Sep 2025
- 2025Frictional Agent Alignment Framework: Slow Down and Don't Break Things26 May 2025
- 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systems14 Jul 2023
- 2022Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 31
- 2025TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialoguescited by 9
- 2025Evaluation and Facilitation of Online Discussions in the LLM Era: A Surveycited by 8
- 2024Any Other Thoughts, Hedgehog? Linking Deliberation Chains in Collaborative Dialoguescited by 6
- 2025Towards a Perspectivist Turn in Argument Quality Assessmentcited by 5
- 2022What makes you change your mind? An empirical investigation in online group decision-making conversationscited by 3
- 2024The effect of diversity on group decision-makingcited by 1
- 2025Achieving Unanimous Consensus Through Multi-Agent Deliberationcited by 1
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotationcited by 1
- 2026Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetrycited by 1
- 2024Let's Negotiate! A Survey of Negotiation Dialogue Systemscited by 0
- 2025Conversational DNA: A Visual Language and Interactive Atlas of Human and AI Dialoguecited by 0
12 most cited of 20 All 20 (JSON)
- 2026Illusion of Alignment: Detecting Hidden Disagreement in Collaborative Dialogue8 Aug 2026
- 2026TRIBE: Predicting Team Performance via Communication Behavior Ensembles7 Aug 2026
- 2026TIDES: A Longitudinal Bilingual Dataset for Modeling Multi-Party Social Dynamics3 Aug 2026
- 2026From Propositional to Perceptual Asymmetry: Extending Frictive Policy Optimization to Asymmetric Partial Information Dialogue29 Jun 2026
- 2026Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction26 Jun 2026
- 2026DeliChess: A Multi-party Dialogue Dataset for Deliberation in Chess Puzzle Solving3 Jun 2026
- 2026Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry5 Mar 2026
- 2026MPCEval: A Benchmark for Multi-Party Conversation Generation5 Mar 2026
- 2026The Consensus Trap: Dissecting Subjectivity and the "Ground Truth" Illusion in Data Annotation11 Feb 2026
- 2025Capturing Opinion Shifts in Deliberative Discourse through Frequency-based Quantum deep learning methods26 Sep 2025
- 2025Conversational DNA: A Visual Language and Interactive Atlas of Human and AI Dialogue11 Aug 2025
- 2025Achieving Unanimous Consensus Through Multi-Agent Deliberation2 Apr 2025
12 newest of 20 All 20 (JSON)