Conversational Feedback in Scripted versus Spontaneous Dialogues: A Comparative Analysis
Not on the map. Why?
Abstract (arXiv)
Scripted dialogues such as movie and TV subtitles constitute a widespread source of training data for conversational NLP models. However, there are notable linguistic differences between these dialogues and spontaneous interactions, especially regarding the occurrence of communicative feedback such as backchannels, acknowledgments, or clarification requests. This paper presents a quantitative analysis of such feedback phenomena in both subtitles and spontaneous conversations. Based on conversational data spanning eight languages and multiple genres, we extract lexical statistics, classifications from a dialogue act tagger, expert annotations and labels derived from a fine-tuned Large Language Model (LLM). Our main empirical findings are that (1) communicative feedback is markedly less frequent in subtitles than in spontaneous dialogues and (2) subtitles contain a higher proportion of negative feedback. We also show that dialogues generated by standard LLMs lie much closer to scripted dialogues than spontaneous interactions in terms of communicative feedback.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 8 of its 96 references that are in the map. First posted on arXiv 27 Sep 2023.
Builds on
8 of 96 references.
References · 8
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2017Scattertext: a Browser-Based Tool for Visualizing how Corpora Differcited by 22
- 2023SocialDial: A Benchmark for Socially-Aware Dialogue Systemscited by 22
- 2021Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead?cited by 16
- 2023Unraveling ChatGPT: A Critical Analysis of AI-Generated Goal-Oriented Dialogues and Annotationscited by 14
- 2018ISO-Standard Domain-Independent Dialogue Act Tagging for Conversational Agentscited by 12
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 3; 2026: 2.
10 papers.
- 2023Grounding Gaps in Language Model Generationscited by 45
- 2024Large Language Models Know What To Say But Not When To Speakcited by 11
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questionscited by 9
- 2024Benchmarking Advanced Text Anonymisation Methods: A Comparative Study on Novel and Traditional Approachescited by 5
- 2024Classification of Spontaneous and Scripted Speech for Multilingual Audiocited by 4
- 2025Beyond Words: Multimodal LLM Knows When to Speakcited by 4
- 2023Measuring Entrainment in Spontaneous Code-switched Speechcited by 2
- 2026Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requestscited by 2
- 2025Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Modelscited by 1
- 2026Evaluating Language Models in Realistic Conversational Contextscited by 0
- 2026Evaluating Language Models in Realistic Conversational Contexts24 Jun 2026
- 2026Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requests12 Jan 2026
- 2025Investigating the Representation of Backchannels and Fillers in Fine-tuned Language Models24 Sep 2025
- 2025Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questions10 Jun 2025
- 2025Beyond Words: Multimodal LLM Knows When to Speak20 May 2025
- 2024Classification of Spontaneous and Scripted Speech for Multilingual Audio16 Dec 2024
- 2024Large Language Models Know What To Say But Not When To Speak21 Oct 2024
- 2024Benchmarking Advanced Text Anonymisation Methods: A Comparative Study on Novel and Traditional Approaches22 Apr 2024
- 2023Grounding Gaps in Language Model Generations15 Nov 2023
- 2023Measuring Entrainment in Spontaneous Code-switched Speech13 Nov 2023