Reasoning about Intent for Ambiguous Requests
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models often respond to ambiguous requests by implicitly committing to one interpretation, frustrating users and creating safety risks when that interpretation is wrong. We propose generating a single structured response that enumerates the different ways an ambiguous request can be interpreted, each coupled with a corresponding answer. Our models are trained with reinforcement learning using a dual reward objective: recall on ambiguous inputs to maximise coverage of valid interpretations, and precision on unambiguous ones to suppress spurious alternatives. Training requires only multiple valid answers per input as supervision, no clarification questions or explicit interpretations are needed. Experiments on conversational question answering and semantic parsing demonstrate that our method achieves higher coverage of valid answers than baseline approaches. Human evaluation confirms that predicted interpretations are meaningful and explain their corresponding answers. Our approach promotes transparency with explicit interpretations, avoids additional interaction rounds by producing all interpretations in a single generation, and supports downstream applications through its structured output format.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 59 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
15 of 59 references.
Closest ancestors · 1
Same direction, newest first
- 2025Qwen3 Technical Report14 May
Other references · 14
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
- 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
- 2023ClarifyGPT: Empowering LLM-based Code Generation with Intention Clarificationcited by 38
- 2025Spectrum Tuning: Post-Training for Distributional Coverage and In-Context Steerabilitycited by 20
- 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactionscited by 19
- 2025AmbiSQL: Interactive Ambiguity Detection and Resolution for Text-to-SQLcited by 11
2 more
- 2025Asking a Language Model for Diverse Responsescited by 9
- 2025Language Models Identify Ambiguities and Exploit Loopholescited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Act or Clarify? Modeling Sensitivity to Uncertainty and Cost in Communicationcited by 1
- 2026Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generationcited by 1
- 2026Open Tabular Insight Extraction: Where Do We Stand, and Where Should We Go?cited by 0
- 2026What Is a Clarification? Estimating Model-Dependent Input Ambiguitycited by 0
- 2026What Is a Clarification? Estimating Model-Dependent Input Ambiguity14 Oct 2026
- 2026Open Tabular Insight Extraction: Where Do We Stand, and Where Should We Go?7 Sep 2026
- 2026Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generation25 May 2026
- 2026Act or Clarify? Modeling Sensitivity to Uncertainty and Cost in Communication2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025A2Search: Ambiguity-Aware Question Answering with Reinforcement Learning
- 2024Aligning Language Models to Explicitly Handle Ambiguity
- 2025ChatR1: Reinforcement Learning for Conversational Reasoning and Retrieval Augmented Question Answering
- 2025It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge
- 2025An Empirical Study of the Role of Incompleteness and Ambiguity in Interactions with Large Language Models
- 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RL
- 2026A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models
- 2026Small Language Model Helps Resolve Semantic Ambiguity of LLM Prompt