mlsanityData to 14 Oct 2026

Maintaining Common Ground in Dynamic Environments

arXiv 2105.14207 ↗First posted 29 May 2021cs.CL cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Common grounding is the process of creating and maintaining mutual understandings, which is a critical aspect of sophisticated human communication. While various task settings have been proposed in existing literature, they mostly focus on creating common ground under static context and ignore the aspect of maintaining them overtime under dynamic context. In this work, we propose a novel task setting to study the ability of both creating and maintaining common ground in dynamic environments. Based on our minimal task formulation, we collected a large-scale dataset of 5,617 dialogues to enable fine-grained evaluation and analysis of various dialogue systems. Through our dataset analyses, we highlight novel challenges introduced in our setting, such as the usage of complex spatio-temporal expressions to create and maintain common ground. Finally, we conduct extensive experiments to assess the capabilities of our baseline dialogue system and discuss future prospects of our research.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 40 of its 64 references that are in the map. First posted on arXiv 29 May 2021.

Builds on

40 of 64 references.

References · 40

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  3. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  4. 2017Non-local Neural Networkscited by 2,293
  5. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  6. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  7. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  8. 2017Dense-Captioning Events in Videoscited by 793
  9. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  10. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
  11. 2018TVQA: Localized, Compositional Video Question Answeringcited by 467
  12. 2019Tracking without bells and whistlescited by 382
28 more
  1. 2017A simple neural network module for relational reasoningcited by 346
  2. 2019Towards Real-Time Multi-Object Trackingcited by 311
  3. 2019Vision-and-Dialog Navigationcited by 250
  4. 2017Deal or No Deal? End-to-End Learning for Negotiation Dialoguescited by 209
  5. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  6. 2019CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoningcited by 137
  7. 2019Audio-Visual Scene-Aware Dialogcited by 123
  8. 2016GuessWhat?! Visual object discovery through multi-modal dialoguecited by 113
  9. 2019Executing Instructions in Situated Collaborative Interactionscited by 69
  10. 2019Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Videocited by 60
  11. 2017Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddingscited by 59
  12. 2017Colors in Context: A Pragmatic Neural Model for Grounded Language Understandingcited by 57
  13. 2019The PhotoBook Dataset: Building Common Ground through Visually-Grounded Dialoguecited by 46
  14. 2018Talk the Walk: Navigating New York City through Grounded Dialoguecited by 44
  15. 2020Towards Ecologically Valid Research on Language User Interfacescited by 42
  16. 2018Weakly-Supervised Video Object Grounding from Text by Loss Weighting and Object Interactioncited by 40
  17. 2019A Natural Language Corpus of Common Grounding under Continuous and Partially-Observable Contextcited by 35
  18. 2020Situated and Interactive Multimodal Conversationscited by 35
  19. 2020Video Object Grounding using Semantic Roles in Language Descriptioncited by 25
  20. 2017Hierarchical Text Generation and Planning for Strategic Dialoguecited by 23
  21. 2020BiST: Bi-directional Spatio-Temporal Reasoning for Video-Grounded Dialoguescited by 22
  22. 2020Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contextscited by 22
  23. 2018Game-Based Video-Context Dialoguecited by 15
  24. 2018Video Description: A Survey of Methods, Datasets and Evaluation Metricscited by 13
  25. 2019Grounded Agreement Games: Emphasizing Conversational Grounding in Visual Dialogue Settingscited by 10
  26. 2018The division of labor in communication: Speakers help listeners account for asymmetries in visual perspectivecited by 6
  27. 2019An Annotated Corpus of Reference Resolution for Interpreting Common Groundingcited by 6
  28. 2020A Linguistic Analysis of Visually Grounded Dialogues Based on Spatial Expressionscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 2.

9 papers.