mlsanityData to 14 Oct 2026

Reasoning about Intent for Ambiguous Requests

arXiv 2511.10453 ↗First posted 13 Nov 2025cs.CL cs.AIcited by 4

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models often respond to ambiguous requests by implicitly committing to one interpretation, frustrating users and creating safety risks when that interpretation is wrong. We propose generating a single structured response that enumerates the different ways an ambiguous request can be interpreted, each coupled with a corresponding answer. Our models are trained with reinforcement learning using a dual reward objective: recall on ambiguous inputs to maximise coverage of valid interpretations, and precision on unambiguous ones to suppress spurious alternatives. Training requires only multiple valid answers per input as supervision, no clarification questions or explicit interpretations are needed. Experiments on conversational question answering and semantic parsing demonstrate that our method achieves higher coverage of valid answers than baseline approaches. Human evaluation confirms that predicted interpretations are meaningful and explain their corresponding answers. Our approach promotes transparency with explicit interpretations, avoids additional interaction rounds by producing all interpretations in a single generation, and supports downstream applications through its structured output format.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 59 references that are in the map. First posted on arXiv 13 Nov 2025.

Builds on

15 of 59 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Qwen3 Technical Report14 May

Other references · 14

  1. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  4. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  5. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  6. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  7. 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
  8. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 105
  9. 2023ClarifyGPT: Empowering LLM-based Code Generation with Intention Clarificationcited by 38
  10. 2025Spectrum Tuning: Post-Training for Distributional Coverage and In-Context Steerabilitycited by 20
  11. 2025BIRD-INTERACT: Re-imagining Text-to-SQL Evaluation for Large Language Models via Lens of Dynamic Interactionscited by 19
  12. 2025AmbiSQL: Interactive Ambiguity Detection and Resolution for Text-to-SQLcited by 11
2 more
  1. 2025Asking a Language Model for Diverse Responsescited by 9
  2. 2025Language Models Identify Ambiguities and Exploit Loopholescited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A2Search: Ambiguity-Aware Question Answering with Reinforcement Learning
  2. 2024Aligning Language Models to Explicitly Handle Ambiguity
  3. 2025ChatR1: Reinforcement Learning for Conversational Reasoning and Retrieval Augmented Question Answering
  4. 2025It Depends: Resolving Referential Ambiguity in Minimal Contexts with Commonsense Knowledge
  5. 2025An Empirical Study of the Role of Incompleteness and Ambiguity in Interactions with Large Language Models
  6. 2026Abstain-R1: Calibrated Abstention and Post-Refusal Clarification via Verifiable RL
  7. 2026A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models
  8. 2026Small Language Model Helps Resolve Semantic Ambiguity of LLM Prompt