"None of the Above":Measure Uncertainty in Dialog Response Retrieval
Not on the map. Why?
Abstract (arXiv)
This paper discusses the importance of uncovering uncertainty in end-to-end dialog tasks, and presents our experimental results on uncertainty classification on the Ubuntu Dialog Corpus. We show that, instead of retraining models for this specific purpose, the original retrieval model's underlying confidence concerning the best prediction can be captured with trivial additional computation.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 2; 2024: 1.
7 papers.
- 2023Uncertainty in Natural Language Processing: Sources, Quantification, and Applicationscited by 44
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuningcited by 39
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Modelscited by 26
- 2021On the Calibration and Uncertainty of Neural Learning to Rank Modelscited by 24
- 2024Can Tool-augmented Large Language Models be Aware of Incomplete Conditions?cited by 8
- 2021Evaluating Predictive Uncertainty under Distributional Shift on Dialogue Datasetcited by 0
- 2023On the Calibration and Uncertainty with P'olya-Gamma Augmentation for Dialog Retrieval Modelscited by 0
- 2024Can Tool-augmented Large Language Models be Aware of Incomplete Conditions?18 Jun 2024
- 2023Uncertainty in Natural Language Processing: Sources, Quantification, and Applications5 Jun 2023
- 2023On the Calibration and Uncertainty with P'olya-Gamma Augmentation for Dialog Retrieval Models15 Mar 2023
- 2022InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning25 May 2022
- 2022Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models30 Apr 2022
- 2021Evaluating Predictive Uncertainty under Distributional Shift on Dialogue Dataset1 Sep 2021
- 2021On the Calibration and Uncertainty of Neural Learning to Rank Models12 Jan 2021