mlsanityData to 14 Oct 2026

Closing the Expression Gap in LLM Instructions via Socratic Questioning

arXiv 2510.27410 ↗First posted 31 Oct 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A fundamental bottleneck in human-AI collaboration is the ``intention expression gap," the difficulty for humans to effectively convey complex, high-dimensional thoughts to AI. This challenge often traps users in inefficient trial-and-error loops and is exacerbated by the diverse expertise levels of users. We reframe this problem from passive instruction following to a Socratic collaboration paradigm, proposing an agent that actively probes for information to resolve its uncertainty about user intent. we name the proposed agent Nous, trained to acquire proficiency in this inquiry policy. The core mechanism of Nous is a training framework grounded in the first principles of information theory. Within this framework, we define the information gain from dialogue as an intrinsic reward signal, which is fundamentally equivalent to the reduction of Shannon entropy over a structured task space. This reward design enables us to avoid reliance on costly human preference annotations or external reward models. To validate our framework, we develop an automated simulation pipeline to generate a large-scale, preference-based dataset for the challenging task of scientific diagram generation. Comprehensive experiments, including ablations, subjective and objective evaluations, and tests across user expertise levels, demonstrate the effectiveness of our proposed framework. Nous achieves leading efficiency and output quality, while remaining robust to varying user expertise. In conclusion, our research provides a systematic methodology and a new perspective for addressing the issue of ambiguous intentions in complex human-machine collaboration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 31 Oct 2025.

Builds on

40 of 62 references.

References · 40

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2017Deep reinforcement learning from human preferencescited by 3,912
  6. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  7. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  8. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  9. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
  10. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
  11. 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 204
  12. 2020Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systemscited by 139
28 more
  1. 2025SEED-GRPO: Semantic Entropy Enhanced GRPO for Uncertainty-Aware Policy Optimizationcited by 89
  2. 2024Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questionscited by 76
  3. 2022Reincarnating Reinforcement Learning: Reusing Prior Computation to Accelerate Progresscited by 65
  4. 2023Prompting Large Language Models With the Socratic Methodcited by 43
  5. 2024Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Modelscited by 39
  6. 2019Guided Dialog Policy Learning: Reward Estimation for Multi-Domain Task-Oriented Dialogcited by 37
  7. 2018Large-Scale Multi-Domain Belief Tracking with Knowledge Sharingcited by 29
  8. 2023Active Preference Inference using Language Models and Probabilistic Reasoningcited by 29
  9. 2023Asking Clarification Questions to Handle Ambiguity in Open-Domain QAcited by 26
  10. 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 24
  11. 2024Learning to Ask Informative Questions: Enhancing LLMs with Preference Optimization and Expected Information Gaincited by 21
  12. 2017A Conditional Variational Framework for Dialog Generationcited by 16
  13. 2021An Asymptotic Test for Conditional Independence using Analytic Kernel Embeddingscited by 12
  14. 2025CoCoA: Confidence and Context-Aware Adaptive Decoding for Resolving Knowledge Conflicts in Large Language Modelscited by 10
  15. 2020Dialog Policy Learning for Joint Clarification and Active Learning Queriescited by 9
  16. 2024Collaborative human-AI trust (CHAI-T): A process framework for active management of trust in human-AI collaborationcited by 9
  17. 2023Conditional independence testing under misspecified inductive biasescited by 7
  18. 2025InfoPO: On Mutual Information Maximization for Large Language Model Alignmentcited by 7
  19. 2023Conditional Independence Testing with Heteroskedastic Data and Applications to Causal Discoverycited by 6
  20. 2024Improving Active Learning with a Bayesian Representation of Epistemic Uncertaintycited by 4
  21. 2025A Systematic Review of Human-AI Co-Creativitycited by 4
  22. 2025Curiosity by Design: An LLM-based Coding Assistant Asking Clarification Questionscited by 4
  23. 2021What Does The User Want? Information Gain for Hierarchical Dialogue Policy Optimisationcited by 3
  24. 2025ALFred: An Active Learning Framework for Real-world Semi-supervised Anomaly Detection with Adaptive Thresholdscited by 3
  25. 2023Scalable Causal Structure Learning via Amortized Conditional Independence Testingcited by 2
  26. 2024Active Learning with Context Sampling and One-vs-Rest Entropy for Semantic Segmentationcited by 2
  27. 2025Reversing the Paradigm: Building AI-First Systems with Human Guidancecited by 1
  28. 2025OFAL: An Oracle-Free Active Learning Frameworkcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Gricean Norms as a Basis for Effective Collaboration
  2. 2025WHEN TO ACT, WHEN TO WAIT: Modeling the Intent-Action Alignment Problem in Dialogue
  3. 2025Collaborative Causal Sensemaking: Closing the Complementarity Gap in Human-AI Decision Support
  4. 2024Language Models in Dialogue: Conversational Maxims for Human-AI Interactions
  5. 2025Theory of Mind in Action: The Instruction Inference Task in Dynamic Human-Agent Collaboration
  6. 2026AgentIF-OneDay: A Task-level Instruction-Following Benchmark for General AI Agents in Daily Scenarios
  7. 2024Do LLMs "know" internally when they follow instructions?
  8. 2025The Behavior Gap: Evaluating Zero-shot LLM Agents in Complex Task-Oriented Dialogs