mlsanityData to 7 Oct 2026

Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks

arXiv 2409.10070 ↗First posted 16 Sep 2024cs.CL cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully remains challenging due to the need to understand speaker interactions and capture relevant information. Indeed, abstractive models used for dialog summarization may generate summaries that contain inconsistencies. We suggest using the semantic information proposed for performing Spoken Language Understanding (SLU) in human-machine dialogue systems for goal-oriented human-human dialogues to obtain a more semantically faithful summary regarding the task. This study introduces three key contributions: First, we propose an exploration of how incorporating task-related information can enhance the summarization process, leading to more semantically accurate summaries. Then, we introduce a new evaluation criterion based on task semantics. Finally, we propose a new dataset version with increased annotated data standardized for research on task-oriented dialogue summarization. The study evaluates these methods using the DECODA corpus, a collection of French spoken dialogues from a call center. Results show that integrating models with task-related information improves summary accuracy, even with varying word error rates.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 20 references that are in the map. First posted on arXiv 16 Sep 2024.

Builds on

14 of 20 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  4. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  5. 2019CamemBERT: a Tasty French Language Modelcited by 368
  6. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  7. 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 292
  8. 2017Faithful to the Original: Fact Aware Neural Abstractive Summarizationcited by 141
  9. 2021Entity-level Factual Consistency of Abstractive Text Summarizationcited by 118
  10. 2018Abstractive Dialogue Summarization with Sentence-Gated Modeling Optimized by Dialogue Actscited by 44
  11. 2021CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuningcited by 44
  12. 2020BARThez: a Skilled Pretrained French Sequence-to-Sequence Modelcited by 39
2 more
  1. 2020How Domain Terminology Affects Meeting Summarization Performancecited by 14
  2. 2022Analyzing and Evaluating Faithfulness in Dialogue Summarizationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.