mlsanityData to 14 Oct 2026

Systematic Exploration of Dialogue Summarization Approaches for Reproducibility, Comparative Assessment, and Methodological Innovations for Advancing Natural Language Processing in Abstractive Summarization

arXiv 2410.15962 ↗First posted 21 Oct 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reproducibility in scientific research, particularly within the realm of natural language processing (NLP), is essential for validating and verifying the robustness of experimental findings. This paper delves into the reproduction and evaluation of dialogue summarization models, focusing specifically on the discrepancies observed between original studies and our reproduction efforts. Dialogue summarization is a critical aspect of NLP, aiming to condense conversational content into concise and informative summaries, thus aiding in efficient information retrieval and decision-making processes. Our research involved a thorough examination of several dialogue summarization models using the AMI (Augmented Multi-party Interaction) dataset. The models assessed include Hierarchical Memory Networks (HMNet) and various versions of Pointer-Generator Networks (PGN), namely PGN(DKE), PGN(DRD), PGN(DTS), and PGN(DALL). The primary objective was to evaluate the informativeness and quality of the summaries generated by these models through human assessment, a method that introduces subjectivity and variability in the evaluation process. The analysis began with Dataset 1, where the sample standard deviation of 0.656 indicated a moderate dispersion of data points around the mean.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 21 Oct 2024.

Builds on

13 of 31 references.

References · 13

  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  4. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  5. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  6. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  7. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 535
  8. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
  9. 2018Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networkscited by 142
  10. 2016Neural Summarization by Extracting Sentences and Wordscited by 116
  11. 2018Multi-Reward Reinforced Summarization with Saliency and Entailmentcited by 73
  12. 2021Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarizationcited by 46
1 more
  1. 2024Advanced Neural Network Architecture for Enhanced Multi-Lead ECG Arrhythmia Detection through Optimized Feature Extractioncited by 2

Built on by

Not cited yet.