mlsanityData to 7 Oct 2026

Dialogue Response Prefetching Based on Semantic Similarity and Prediction Confidence of Language Model

arXiv 2508.04403 ↗First posted 6 Aug 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Prefetching of dialogue responses has been investigated to reduce user-perceived latency (UPL), which refers to the user's waiting time before receiving the system's response, in spoken dialogue systems. To reduce the UPL, it is necessary to predict complete user utterances before the end of the user's speech, typically by language models, to prepare prefetched dialogue responses. In this study, we proposed a prediction confidence model (PCM) that determines whether prefetching is possible or not by estimating the semantic similarity between the predicted complete user utterance and the complete user utterance. We evaluated our PCM based on the differences between the predicted complete user utterance and the complete user utterance.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 20 references that are in the map. First posted on arXiv 6 Aug 2025.

Builds on

13 of 20 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 201
  6. 2024WavChat: A Survey of Spoken Dialogue Modelscited by 88
  7. 2023SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue Agentscited by 71
  8. 2023Personalized Predictive ASR for Latency Reduction in Voice Assistantscited by 6
  9. 2024Human Latency Conversational Turns for Spoken Avatar Systemscited by 5
  10. 2023A Transformer-based Response Evaluator for Open-Domain Spoken Conversationcited by 4
  11. 2024JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Datasetcited by 2
  12. 2024Predictive Speech Recognition and End-of-Utterance Detection Towards Spoken Dialog Systemscited by 2
1 more
  1. 2022Proceedings of the Dialogue Robot Competition 2022cited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025Thai Semantic End-of-Turn Detection for Real-Time Voice Agentscited by 2
  2. 2026DynBranch: Speculative Subgraph Reuse for Dynamic Agentic LLM Servingcited by 0