# Ask No More: Deciding when to guess in referential visual dialogue

arXiv: https://arxiv.org/abs/1805.06960 · HTML: https://mlsanity.com/paper/1805.06960/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 17 May 2018.

## Built on by (most cited first, 3 of 3)

- [Taking Action Towards Graceful Interaction: The Effects of Performing Actions on Modelling Policies for Instruction Clarification Requests](https://mlsanity.com/paper/2401.17039/) (2024)
- [An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games](https://mlsanity.com/paper/2102.00424/) (2021)
- [Using Perspectival Words Is Harder Than Vocabulary Words for Humans and Even More So for Multimodal Language Models](https://mlsanity.com/paper/2506.00065/) (2025)

## Abstract (arXiv)

Our goal is to explore how the abilities brought in by a dialogue manager can be included in end-to-end visually grounded conversational agents. We make initial steps towards this general goal by augmenting a task-oriented visual dialogue model with a decision-making component that decides whether to ask a follow-up question to identify a target referent in an image, or to stop the conversation to make a guess. Our analyses show that adding a decision making component produces dialogues that are less repetitive and that include fewer unnecessary questions, thus potentially leading to more efficient and less unnatural interactions.