mlsanityData to 7 Oct 2026

Summary Workbench: Unifying Application and Evaluation of Text Summarization Models

arXiv 2210.09587 ↗First posted 18 Oct 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents Summary Workbench, a new tool for developing and evaluating text summarization models. New models and evaluation measures can be easily integrated as Docker-based plugins, allowing to examine the quality of their summaries against any input and to evaluate them using various evaluation measures. Visual analyses combining multiple measures provide insights into the models' strengths and weaknesses. The tool is hosted at urlhttps://tldr.demo.webis.de and also supports local deployment for private resources.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 18 Oct 2022.

Builds on

30 of 48 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  8. 2020Longformer: The Long-Document Transformercited by 3,362
  9. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
  10. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  11. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  12. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
18 more
  1. 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
  2. 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
  3. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  4. 2019Leveraging Pre-trained Checkpoints for Sequence Generation Taskscited by 182
  5. 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
  6. 2020The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Modelscited by 125
  7. 2021CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarizationcited by 120
  8. 2020What Have We Achieved on Text Summarization?cited by 65
  9. 2019Leveraging BERT for Extractive Text Summarization on Lecturescited by 63
  10. 2021Long-Span Summarization via Local Attention and Content Selectioncited by 24
  11. 2021Unsupervised Extractive Summarization using Pointwise Mutual Informationcited by 23
  12. 2021Convex Aggregation for Opinion Summarizationcited by 21
  13. 2020SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metricscited by 18
  14. 2020Biased TextRank: Unsupervised Graph-Based Content Extractioncited by 14
  15. 2021Generating Informative Conclusions for Argumentative Textscited by 14
  16. 2021SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarizationcited by 13
  17. 2021SummerTime: Text Summarization Toolkit for Non-expertscited by 6
  18. 2021Summary Explorer: Visualizing the State of the Art in Text Summarizationcited by 4

Built on by

Not cited yet.