First Ask Then Answer: A Framework Design for AI Dialogue Based on Supplementary Questioning with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) often struggle to deliver accurate and actionable answers when user-provided information is incomplete or ill-specified. We propose a new interaction paradigm, First Ask Then Answer (FATA), in which, through prompt words, LLMs are guided to proactively generate multidimensional supplementary questions for users prior to response generation. Subsequently, by integrating user-provided supplementary information with the original query through sophisticated prompting techniques, we achieve substantially improved response quality and relevance. In contrast to existing clarification approaches -- such as the CLAM framework oriented to ambiguity and the self-interrogation Self-Ask method -- FATA emphasizes completeness (beyond mere disambiguation) and user participation (inviting human input instead of relying solely on model-internal reasoning). It also adopts a single-turn strategy: all clarifying questions are produced at once, thereby reducing dialogue length and improving efficiency. Conceptually, FATA uses the reasoning power of LLMs to scaffold user expression, enabling non-expert users to formulate more comprehensive and contextually relevant queries. To evaluate FATA, we constructed a multi-domain benchmark and compared it with two controls: a baseline prompt (B-Prompt) and a context-enhanced expert prompt (C-Prompt). Experimental results show that FATA outperforms B-Prompt by approximately 40% in aggregate metrics and exhibits a coefficient of variation 8% lower than C-Prompt, indicating superior stability.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 17 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
11 of 17 references.
References · 11
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
- 2023Rephrase and Respond: Let Large Language Models Ask Better Questions for Themselvescited by 123
- 2024Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questionscited by 76
- 2022CLAM: Selective Clarification for Ambiguous Questions with Generative Language Modelscited by 69
- 2023A New Dialogue Response Generation Agent for Large Language Models by Asking Questions to Detect User's Intentionscited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models
- 2025An Empirical Study of the Role of Incompleteness and Ambiguity in Interactions with Large Language Models
- 2026Asking Questions the Right Way: A Multi-Agent Conversational System for Prompt Formulation in Complex Task Resolution
- 2025Agent-Based Detection and Resolution of Incompleteness and Ambiguity in Interactions with Large Language Models
- 2025Benchmarking Contextual Understanding for In-Car Conversational Systems
- 2025A Survey of Large Language Model Agents for Question Answering
- 2023Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration
- 2024Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoning