mlsanityData to 7 Oct 2026

Controllable Abstractive Dialogue Summarization with Sketch Supervision

arXiv 2105.14064 ↗First posted 28 May 2021cs.CL cs.AIcited by 27

Not on the map. Why?

Abstract (arXiv)

In this paper, we aim to improve abstractive dialogue summarization quality and, at the same time, enable granularity control. Our model has two primary components and stages: 1) a two-stage generation strategy that generates a preliminary summary sketch serving as the basis for the final summary. This summary sketch provides a weakly supervised signal in the form of pseudo-labeled interrogative pronoun categories and key phrases extracted using a constituency parser. 2) A simple strategy to control the granularity of the final summary, in that our model can automatically determine or control the number of generated summary sentences for a given dialogue by predicting and highlighting different text spans from the source text. Our model achieves state-of-the-art performance on the largest dialogue summarization corpus SAMSum, with as high as 50.79 in ROUGE-L score. In addition, we conduct a case study and show competitive human evaluation results and controllability to human-annotated summaries.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 46 of its 64 references that are in the map. First posted on arXiv 28 May 2021.

Builds on

46 of 64 references.

References · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  7. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  8. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  9. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  10. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  11. 2015Teaching Machines to Read and Comprehendcited by 1,039
  12. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
34 more
  1. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
  2. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  3. 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
  4. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  5. 2019Text Summarization with Pretrained Encoderscited by 553
  6. 2019SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarizationcited by 530
  7. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  8. 2015A Neural Attention Model for Abstractive Sentence Summarizationcited by 394
  9. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 364
  10. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 215
  11. 2019Pay Less Attention with Lightweight and Dynamic Convolutionscited by 211
  12. 2018Constituency Parsing with a Self-Attentive Encodercited by 196
  13. 2019TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agentscited by 188
  14. 2020TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented Dialoguecited by 185
  15. 2018Bottom-Up Abstractive Summarizationcited by 177
  16. 2018Fast Abstractive Summarization with Reinforce-Selected Sentence Rewritingcited by 158
  17. 2019HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarizationcited by 120
  18. 2017Controllable Abstractive Summarizationcited by 110
  19. 2018Training Complex Models with Multi-Task Weak Supervisioncited by 106
  20. 2016Controlling Output Length in Neural Encoder-Decoderscited by 75
  21. 2020Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarizationcited by 72
  22. 2015Better Summarization Evaluation with Word Embeddings for ROUGEcited by 66
  23. 2019Positional Encoding to Control Output Sequence Lengthcited by 56
  24. 2018Abstractive Dialogue Summarization with Sentence-Gated Modeling Optimized by Dialogue Actscited by 44
  25. 2019Neural Extractive Text Summarization with Syntactic Compressioncited by 36
  26. 2018Abstract Meaning Representation for Multi-Document Summarizationcited by 35
  27. 2020Incorporating Commonsense Knowledge into Abstractive Dialogue Summarization via Heterogeneous Graph Networkscited by 22
  28. 2018Neural Latent Extractive Document Summarizationcited by 20
  29. 2020Improving Limited Labeled Dialogue State Tracking with Self-Supervisioncited by 16
  30. 2020Probing Task-Oriented Dialogue Representation from Language Modelscited by 15
  31. 2020Length-controllable Abstractive Summarization by Guiding with Summary Prototypecited by 9
  32. 2018Data-driven Summarization of Scientific Articlescited by 8
  33. 2016Abstractive Meeting Summarization UsingDependency Graph Fusioncited by 6
  34. 2018Dial2Desc: End-to-end Dialogue Description Generationcited by 5

Built on by

Cited by year

Citing papers per year: 2021: 3; 2022: 13; 2023: 6; 2024: 3; 2025: 2.

27 papers.

Sort:

By area:

  1. 2022Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluationcited by 141
  2. 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answeringcited by 126
  3. 2022An Empirical Survey on Long Document Summarization: Datasets, Models and Metricscited by 74
  4. 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
  5. 2021A Survey on Dialogue Summarization: Recent Advances and New Frontierscited by 51
  6. 2023ChatGPT vs Human-authored Text: Insights into Controllable Text Summarization and Sentence Style Transfercited by 49
  7. 2021CONFIT: Toward Faithful Dialogue Summarization with Linguistically-Informed Contrastive Fine-tuningcited by 44
  8. 2023OmniVec: Learning robust representations with cross modal sharingcited by 44
  9. 2022ClidSum: A Benchmark Dataset for Cross-Lingual Dialogue Summarizationcited by 25
  10. 2024Analyzing LLM Behavior in Dialogue Summarization: Unveiling Circumstantial Hallucination Trendscited by 25
  11. 2022Dialogue Summaries as Dialogue States (DS2), Template-Guided Summarization for Few-shot Dialogue State Trackingcited by 21
  12. 2023Controllable Text Summarization: Unraveling Challenges, Approaches, and Prospects -- A Surveycited by 18
15 more
  1. 2022Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarizationcited by 14
  2. 2025OmniVec2 -- A Novel Transformer based Network for Large Scale Multimodal and Multitask Learningcited by 13
  3. 2022Seamlessly Integrating Factual Information and Social Content with Persuasive Dialoguecited by 11
  4. 2023SWING: Balancing Coverage and Faithfulness for Dialogue Summarizationcited by 10
  5. 2022UniDU: Towards A Unified Generative Dialogue Understanding Frameworkcited by 9
  6. 2022Human-in-the-loop Abstractive Dialogue Summarizationcited by 8
  7. 2023Reference Matters: Benchmarking Factual Error Correction for Dialogue Summarization with Fine-grained Evaluation Frameworkcited by 7
  8. 2022A Focused Study on Sequence Length for Dialogue Summarizationcited by 6
  9. 2024Bridging Research and Readers: A Multi-Modal Automated Academic Papers Interpretation Systemcited by 5
  10. 2022Post-Training Dialogue Summarization using Pseudo-Paraphrasingcited by 4
  11. 2025OpeNLGauge: An Explainable Metric for NLG Evaluation with Open-Weights LLMscited by 4
  12. 2022Taxonomy of Abstractive Dialogue Summarization: Scenarios, Approaches and Future Directionscited by 3
  13. 2022Meeting Summarization: A Survey of the State of the Artcited by 3
  14. 2024ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responsescited by 2
  15. 2023Dialogue Agents 101: A Beginner's Guide to Critical Ingredients for Designing Effective Conversational Systemscited by 1