Diversity is Not Ambiguity: Toward Accurate and Efficient Ambiguity Detection for Open-Domain QA
Not on the map. Why?
Abstract (arXiv)
How can question answering (QA) systems determine whether a query is ambiguous? Ambiguity detection is essential in open-domain QA, as misclassification leads to answering the wrong interpretation or unnecessary clarification. However, existing methods conflate answer diversity with ambiguity, leading to inaccurate predictions. They also process queries uniformly, resulting in wasteful computation. We propose ARCHIVE (Ambiguity Recognition via Cascaded Hypothesis Inspection and Conflict Verification), an accurate and efficient framework that detects ambiguity via logical conflict: a query is ambiguous when its valid answers cannot all be true under a single interpretation. ARCHIVE combines a lightweight early-exit encoder for surface-detectable cases with a conflict reasoning module that models logical relations among answers, reinforced by an invariance objective for robustness to noisy answer sets. We present QuireQA, a 4,703-query benchmark spanning factoid, non-factoid, and ill-formed queries. Experiments show ARCHIVE outperforms competitors, improving F1-amb by up to 10.4% and F1-unamb by up to 21.6%, while operating 16× faster than the best competitor.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 40 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
19 of 40 references.
References · 19
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
- 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 390
- 2023Decomposing Uncertainty for Large Language Models through Input Clarification Ensemblingcited by 114
- 2023Clarify When Necessary: Resolving Ambiguity Through Interaction with LMscited by 98
7 more
- 2024Aligning Language Models to Explicitly Handle Ambiguitycited by 56
- 2020ORCAS: 18 Million Clicked Query-Document Pairs for Analyzing Searchcited by 34
- 2021Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLPcited by 31
- 2023Answering Ambiguous Questions via Iterative Promptingcited by 13
- 2022Query Refinement Prompts for Closed-Book Long-Form Question Answeringcited by 12
- 2025Clarifying Ambiguities: on the Role of Ambiguity Types in Prompting Methods for Clarification Generationcited by 10
- 2025Detecting Ambiguities to Guide Query Rewrite for Robust Conversations in Enterprise AI Assistantscited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering
- 2025A2Search: Ambiguity-Aware Question Answering with Reinforcement Learning
- 2023Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language Models
- 2025MARCH: Evaluating the Intersection of Ambiguity Interpretation and Multi-hop Inference
- 2025AmbiSQL: Interactive Ambiguity Detection and Resolution for Text-to-SQL
- 2026Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering
- 2025Disambiguation in Conversational Question Answering in the Era of LLMs and Agents: A Survey
- 2025Ambiguity in LLMs is a concept missing problem