Open-domain clarification question generation without question examples
Not on the map. Why?
Abstract (arXiv)
An overarching goal of natural language processing is to enable machines to communicate seamlessly with humans. However, natural language can be ambiguous or unclear. In cases of uncertainty, humans engage in an interactive process known as repair: asking questions and seeking clarification until their uncertainty is resolved. We propose a framework for building a visually grounded question-asking model capable of producing polar (yes-no) clarification questions to resolve misunderstandings in dialogue. Our model uses an expected information gain objective to derive informative questions from an off-the-shelf image captioner without requiring any supervised question-answer data. We demonstrate our model's ability to pose questions that improve communicative success in a goal-oriented 20 questions game with synthetic and human answerers.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 19 Oct 2021.
Builds on
12 of 20 references.
References · 12
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2018Multilingual Constituency Parsing with Self-Attention and Pre-Trainingcited by 117
- 2016GuessWhat?! Visual object discovery through multi-modal dialoguecited by 112
- 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 110
- 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 70
- 2017ShapeWorld - A new test methodology for multimodal language understandingcited by 37
- 2020ClarQ: A large-scale and diverse dataset for Clarification Question Generationcited by 31
- 2017Learning by Asking Questionscited by 25
- 2019Interactive Classification by Asking Informative Questionscited by 16
- 2017Question Asking as Program Generationcited by 12
- 2018Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialogcited by 11
- 2019Modeling question asking using neural program generationcited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 7; 2024: 6; 2025: 3; 2026: 1.
20 papers.
Sort:
By area:
- 2024Polos: Multimodal Metric Learning from Human Feedback for Image Captioningcited by 46
- 2022ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situationscited by 36
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2024A Survey of Conversational Searchcited by 22
- 2024ChatShop: Interactive Information Seeking with Language Agentscited by 21
- 2024CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrievalcited by 18
- 2023Zero-shot Clarifying Question Generation for Conversational Searchcited by 14
- 2024Contextualized Evaluations: Judging Language Model Responses to Underspecified Queriescited by 12
- 2021Database Search Results Disambiguation for Task-Oriented Dialog Systemscited by 9
- 2023JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Modelscited by 6
- 2023Asking More Informative Questions for Grounded Retrievalcited by 6
- 2024I Could've Asked That: Reformulating Unanswerable Questionscited by 6
8 more
- 2023Symbolic Planning and Code Generation for Grounded Dialoguecited by 5
- 2022Switching to Discriminative Image Captioning by Relieving a Bottleneck of Reinforcement Learningcited by 4
- 2026DRPG (Decompose, Retrieve, Plan, Generate): An Agentic Framework for Academic Rebuttalcited by 4
- 2023The Knowledge Alignment Problem: Bridging Human and External Knowledge for Large Language Modelscited by 3
- 2023Rescue Conversations from Dead-ends: Efficient Exploration for Task-oriented Dialogue Policy Optimizationcited by 1
- 2025How2: How to learn from procedural How-to questionscited by 1
- 2025Sherlock Your Queries: Learning to Ask the Right Questions for Dialogue-Based Retrievalcited by 1
- 2025Which Questions Improve Learning the Most? Utility Estimation of Questions with LM-based Simulationscited by 0
- 2026DRPG (Decompose, Retrieve, Plan, Generate): An Agentic Framework for Academic Rebuttal26 Jan 2026
- 2025Sherlock Your Queries: Learning to Ask the Right Questions for Dialogue-Based Retrieval21 Oct 2025
- 2025How2: How to learn from procedural How-to questions13 Oct 2025
- 2025Which Questions Improve Learning the Most? Utility Estimation of Questions with LM-based Simulations24 Feb 2025
- 2024Contextualized Evaluations: Judging Language Model Responses to Underspecified Queries11 Nov 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024I Could've Asked That: Reformulating Unanswerable Questions24 Jul 2024
- 2024CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrieval28 Apr 2024
- 2024ChatShop: Interactive Information Seeking with Language Agents15 Apr 2024
- 2024Polos: Multimodal Metric Learning from Human Feedback for Image Captioning28 Feb 2024
- 2023Asking More Informative Questions for Grounded Retrieval14 Nov 2023
- 2023JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models7 Nov 2023
8 more
- 2023Symbolic Planning and Code Generation for Grounded Dialogue26 Oct 2023
- 2023The Knowledge Alignment Problem: Bridging Human and External Knowledge for Large Language Models23 May 2023
- 2023Rescue Conversations from Dead-ends: Efficient Exploration for Task-oriented Dialogue Policy Optimization5 May 2023
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback21 Apr 2023
- 2023Zero-shot Clarifying Question Generation for Conversational Search30 Jan 2023
- 2022ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situations20 Dec 2022
- 2022Switching to Discriminative Image Captioning by Relieving a Bottleneck of Reinforcement Learning6 Dec 2022
- 2021Database Search Results Disambiguation for Task-Oriented Dialog Systems15 Dec 2021
- 2022ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral Situationscited by 36
- 2023Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedbackcited by 31
- 2024A Survey of Conversational Searchcited by 22
- 2024CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrievalcited by 18
- 2023Zero-shot Clarifying Question Generation for Conversational Searchcited by 14
- 2024Contextualized Evaluations: Judging Language Model Responses to Underspecified Queriescited by 12
- 2021Database Search Results Disambiguation for Task-Oriented Dialog Systemscited by 9
- 2023JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Modelscited by 6
- 2023Asking More Informative Questions for Grounded Retrievalcited by 6
- 2024I Could've Asked That: Reformulating Unanswerable Questionscited by 6
- 2023Symbolic Planning and Code Generation for Grounded Dialoguecited by 5
- 2022Switching to Discriminative Image Captioning by Relieving a Bottleneck of Reinforcement Learningcited by 4
12 most cited of 17 All 17 (JSON)
- 2025Sherlock Your Queries: Learning to Ask the Right Questions for Dialogue-Based Retrieval21 Oct 2025
- 2025How2: How to learn from procedural How-to questions13 Oct 2025
- 2025Which Questions Improve Learning the Most? Utility Estimation of Questions with LM-based Simulations24 Feb 2025
- 2024Contextualized Evaluations: Judging Language Model Responses to Underspecified Queries11 Nov 2024
- 2024A Survey of Conversational Search21 Oct 2024
- 2024I Could've Asked That: Reformulating Unanswerable Questions24 Jul 2024
- 2024CLARINET: Augmenting Language Models to Ask Clarification Questions for Retrieval28 Apr 2024
- 2023Asking More Informative Questions for Grounded Retrieval14 Nov 2023
- 2023JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models7 Nov 2023
- 2023Symbolic Planning and Code Generation for Grounded Dialogue26 Oct 2023
- 2023The Knowledge Alignment Problem: Bridging Human and External Knowledge for Large Language Models23 May 2023
- 2023Rescue Conversations from Dead-ends: Efficient Exploration for Task-oriented Dialogue Policy Optimization5 May 2023
12 newest of 17 All 17 (JSON)