TSTR: Too Short to Represent, Summarize with Details! Intro-Guided Extended Summary Generation
Not on the map. Why?
Abstract (arXiv)
Many scientific papers such as those in arXiv and PubMed data collections have abstracts with varying lengths of 50-1000 words and average length of approximately 200 words, where longer abstracts typically convey more information about the source paper. Up to recently, scientific summarization research has typically focused on generating short, abstract-like summaries following the existing datasets used for scientific summarization. In domains where the source text is relatively long-form, such as in scientific documents, such summary is not able to go beyond the general and coarse overview and provide salient information from the source document. The recent interest to tackle this problem motivated curation of scientific datasets, arXiv-Long and PubMed-Long, containing human-written summaries of 400-600 words, hence, providing a venue for research in generating long/extended summaries. Extended summaries facilitate a faster read while providing details beyond coarse information. In this paper, we propose TSTR, an extractive summarizer that utilizes the introductory information of documents as pointers to their salient information. The evaluations on two existing large-scale extended summarization datasets indicate statistically significant improvement in terms of Rouge and average Rouge (F1) scores (except in one case) as compared to strong baselines and state-of-the-art. Comprehensive human evaluations favor our generated extended summaries in terms of cohesion and completeness.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 2 Jun 2022.
Builds on
24 of 46 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2021Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality Metricscited by 285
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
12 more
- 2018Bottom-Up Abstractive Summarizationcited by 177
- 2019Extractive Summarization of Long Documents by Combining Global and Local Contextcited by 59
- 2021Hierarchical Learning for Generation with Long Source Sequencescited by 32
- 2016Revisiting Summarization Evaluation for Scientific Articlescited by 31
- 2020Enhancing Extractive Text Summarization with Topic-Aware Graph Neural Networkscited by 22
- 2017Scientific Article Summarization Using Citation-Context and Article's Discourse Structurecited by 17
- 2017Scientific document summarization via citation contextualization and scientific discoursecited by 12
- 2020On Generating Extended Summaries of Long Documentscited by 10
- 2020Aspect and Opinion Aware Abstractive Review Summarization with Reinforced Hard Typed Decodercited by 4
- 2020Fact-level Extractive Summarization with Hierarchical Graph Mask on BERTcited by 4
- 2021Summaformers @ LaySumm 20, LongSumm 20cited by 4
- 2020A Study of Human Summaries of Scientific Articlescited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 2.
4 papers.
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11
- 2025PosterSum: A Multimodal Benchmark for Scientific Poster Summarizationcited by 10
- 2023Citance-Contextualized Summarization of Scientific Paperscited by 4
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claimscited by 1
- 2025PosterSum: A Multimodal Benchmark for Scientific Poster Summarization24 Feb 2025
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations12 Feb 2025
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2023Citance-Contextualized Summarization of Scientific Papers4 Nov 2023