How Should Agents Ask Questions For Situated Learning? An Annotated Dialogue Corpus
Not on the map. Why?
Abstract (arXiv)
Intelligent agents that are confronted with novel concepts in situated environments will need to ask their human teammates questions to learn about the physical world. To better understand this problem, we need data about asking questions in situated task-based interactions. To this end, we present the Human-Robot Dialogue Learning (HuRDL) Corpus - a novel dialogue corpus collected in an online interactive virtual environment in which human participants play the role of a robot performing a collaborative tool-organization task. We describe the corpus data and a corresponding annotation scheme to offer insight into the form and content of questions that humans ask to facilitate learning in a situated environment. We provide the corpus as an empirically-grounded resource for improving question generation in situated intelligent agents.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 2 of its 29 references that are in the map. First posted on arXiv 11 Jun 2021.
Builds on
2 of 29 references.
References · 2
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 4; 2024: 4; 2025: 1.
11 papers.
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questionscited by 32
- 2022Dialog Acts for Task-Driven Embodied Agentscited by 13
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Datasetcited by 11
- 2024Simulating User Agents for Embodied Conversational-AIcited by 6
- 2025Referential ambiguity and clarification requests: comparing human and LLM behaviourcited by 5
- 2024Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requestscited by 4
- 2024SCOUT: A Situated and Multi-Modal Human-Robot Dialogue Corpuscited by 4
- 2021Decision-Theoretic Question Generation for Situated Reference Resolution: An Empirical Study and Computational Modelcited by 3
- 2023"Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Datasetcited by 3
- 2023Interaction is all You Need? A Study of Robots Ability to Understand and Executecited by 1
- 2023Navigating to Success in Multi-Modal Human-Robot Collaboration: Analysis and Corpus Releasecited by 0
- 2025Referential ambiguity and clarification requests: comparing human and LLM behaviour14 Jul 2025
- 2024SCOUT: A Situated and Multi-Modal Human-Robot Dialogue Corpus19 Nov 2024
- 2024Simulating User Agents for Embodied Conversational-AI31 Oct 2024
- 2024Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions9 Feb 2024
- 2024Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests30 Jan 2024
- 2023Interaction is all You Need? A Study of Robots Ability to Understand and Execute13 Nov 2023
- 2023Navigating to Success in Multi-Modal Human-Robot Collaboration: Analysis and Corpus Release26 Oct 2023
- 2023"Are you telling me to put glasses on the dog?'' Content-Grounded Annotation of Instruction Clarification Requests in the CoDraw Dataset4 Jun 2023
- 2023Instruction Clarification Requests in Multimodal Collaborative Dialogue Games: Tasks, and an Analysis of the CoDraw Dataset28 Feb 2023
- 2022Dialog Acts for Task-Driven Embodied Agents26 Sep 2022
- 2021Decision-Theoretic Question Generation for Situated Reference Resolution: An Empirical Study and Computational Model12 Oct 2021