# Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue

arXiv: https://arxiv.org/abs/1703.03714 · HTML: https://mlsanity.com/paper/1703.03714/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Mar 2017.

## Built on by (most cited first, 4 of 4)

- [Envisioning Narrative Intelligence: A Creative Visual Storytelling Anthology](https://mlsanity.com/paper/2310.04529/) (2023)
- [SCOUT: A Situated and Multi-Modal Human-Robot Dialogue Corpus](https://mlsanity.com/paper/2411.12844/) (2024)
- [Navigating to Success in Multi-Modal Human-Robot Collaboration: Analysis and Corpus Release](https://mlsanity.com/paper/2310.17568/) (2023)
- [Towards an Adaptive Social Game-Playing Robot: An Offline Reinforcement Learning-Based Framework](https://mlsanity.com/paper/2509.16858/) (2025)

## Abstract (arXiv)

Our overall program objective is to provide more natural ways for soldiers to interact and communicate with robots, much like how soldiers communicate with other soldiers today. We describe how the Wizard-of-Oz (WOz) method can be applied to multimodal human-robot dialogue in a collaborative exploration task. While the WOz method can help design robot behaviors, traditional approaches place the burden of decisions on a single wizard. In this work, we consider two wizards to stand in for robot navigation and dialogue management software components. The scenario used to elicit data is one in which a human-robot team is tasked with exploring an unknown environment: a human gives verbal instructions from a remote location and the robot follows them, clarifying possible misunderstandings as needed via dialogue. We found the division of labor between wizards to be workable, which holds promise for future software development.