Characterizing Language Use in a Collaborative Situated Game
Not on the map. Why?
Abstract (arXiv)
Cooperative video games, where multiple participants must coordinate by communicating and reasoning under uncertainty in complex environments, yield a rich source of language data. We collect the Portal Dialogue Corpus: a corpus of 11.5 hours of spoken human dialogue in the co-op mode of the popular Portal 2 virtual puzzle game, comprising 24.5K total utterances. We analyze player language and behavior, identifying a number of linguistic phenomena that rarely appear in most existing chitchat or task-oriented dialogue corpora, including complex spatial reference, clarification and repair, and ad-hoc convention formation. To support future analyses of language use in complex, situated, collaborative problem-solving scenarios, we publicly release the corpus, which comprises player videos, audio, transcripts, game state data, and both manual and automatic annotations of language data.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 27 of its 88 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
27 of 88 references.
References · 27
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 760
- 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 345
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
- 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 202
- 2019The Hanabi Challenge: A New Frontier for AI Researchcited by 194
- 2018Decoupling Strategy and Generation in Negotiation Dialoguescited by 156
- 2021Collaborating with Humans without Human Datacited by 139
- 2020Task-Oriented Dialogue as Dataflow Synthesiscited by 122
- 2023Decomposing Uncertainty for Large Language Models through Input Clarification Ensemblingcited by 113
- 2023Clarify When Necessary: Resolving Ambiguity Through Interaction with LMscited by 93
- 2019Executing Instructions in Situated Collaborative Interactionscited by 68
- 2021MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Taskscited by 62
15 more
- 2017Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddingscited by 59
- 2023LILO: Learning Interpretable Libraries by Compressing and Documenting Codecited by 46
- 2023Grounding Gaps in Language Model Generationscited by 45
- 2019A Natural Language Corpus of Common Grounding under Continuous and Partially-Observable Contextcited by 35
- 2019Characterizing the dynamics of learning in repeated reference gamescited by 34
- 2015A Survey of Available Corpora for Building Data-Driven Dialogue Systemscited by 33
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
- 2024Talk Less, Interact Better: Evaluating In-context Conversational Adaptation in Multimodal LLMscited by 18
- 2021Learning to communicate about shared procedural abstractionscited by 15
- 2023"You Are An Expert Linguistic Annotator": Limits of LLMs as Analyzers of Abstract Meaning Representationcited by 15
- 2024Grounding Language in Multi-Perspective Referential Communicationcited by 12
- 2023The timing bottleneck: Why timing and overlap are mission-critical for conversational user interfaces, speech recognition and dialogue systemscited by 9
- 2024Conversational Grounding: Annotation and Analysis of Grounding Acts and Grounding Unitscited by 8
- 2024A Dialogue Game for Eliciting Balanced Collaborationcited by 4
- 2025Collaborative Problem-Solving in an Optimization Gamecited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.