mlsanityData to 14 Oct 2026

MDC-R: The Minecraft Dialogue Corpus with Reference

arXiv 2506.22062 ↗First posted 27 Jun 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

We introduce the Minecraft Dialogue Corpus with Reference (MDC-R). MDC-R is a new language resource that supplements the original Minecraft Dialogue Corpus (MDC) with expert annotations of anaphoric and deictic reference. MDC's task-orientated, multi-turn, situated dialogue in a dynamic environment has motivated multiple annotation efforts, owing to the interesting linguistic phenomena that this setting gives rise to. We believe it can serve as a valuable resource when annotated with reference, too. Here, we discuss our method of annotation and the resulting corpus, and provide both a quantitative and a qualitative analysis of the data. Furthermore, we carry out a short experiment demonstrating the usefulness of our corpus for referring expression comprehension.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 57 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

24 of 57 references.

References · 24

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2020Longformer: The Long-Document Transformercited by 3,413
  3. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  4. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 904
  5. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  6. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  7. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  8. 2018VirtualHome: Simulating Household Activities via Programscited by 415
  9. 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 333
  10. 2016Modeling Context Between Objects for Referring Expression Understandingcited by 251
  11. 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
  12. 2016GuessWhat?! Visual object discovery through multi-modal dialoguecited by 113
12 more
  1. 2019Executing Instructions in Situated Collaborative Interactionscited by 69
  2. 2021MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Taskscited by 62
  3. 2022Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021cited by 23
  4. 2019What You See is What You Get: Visual Pronoun Coreference Resolution in Dialoguescited by 18
  5. 2023Advancing Visual Grounding with Scene Knowledge: Benchmark and Methodcited by 17
  6. 2019Why Build an Assistant in Minecraft?cited by 14
  7. 2023Dialogue Games for Benchmarking Language Understanding: Motivation, Taxonomy, Strategycited by 12
  8. 2020Give Me Something to Eat: Referring Expression Comprehension with Commonsense Knowledgecited by 9
  9. 2022VD-PCR: Improving Visual Dialog with Pronoun Coreference Resolutioncited by 7
  10. 2022Who are you referring to? Coreference resolution in image narrationscited by 7
  11. 2022Find Someone Who: Visual Commonsense Understanding in Human-Centric Groundingcited by 4
  12. 2023Semi-supervised multimodal coreference resolution in image narrationscited by 4

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

  1. 2025Referential ambiguity and clarification requests: comparing human and LLM behaviourcited by 5
  2. 2025Making Dialogue Grounding Data Rich: A Three-Tier Data Synthesis Framework for Generalized Referring Expression Comprehensioncited by 0