ATSumm: Auxiliary information enhanced approach for abstractive disaster Tweet Summarization with sparse training data
Not on the map. Why?
Abstract (arXiv)
The abundance of situational information on Twitter poses a challenge for users to manually discern vital and relevant information during disasters. A concise and human-interpretable overview of this information helps decision-makers in implementing efficient and quick disaster response. Existing abstractive summarization approaches can be categorized as sentence-based or key-phrase-based approaches. This paper focuses on sentence-based approach, which is typically implemented as a dual-phase procedure in literature. The initial phase, known as the extractive phase, involves identifying the most relevant tweets. The subsequent phase, referred to as the abstractive phase, entails generating a more human-interpretable summary. In this study, we adopt the methodology from prior research for the extractive phase. For the abstractive phase of summarization, most existing approaches employ deep learning-based frameworks, which can either be pre-trained or require training from scratch. However, to achieve the appropriate level of performance, it is imperative to have substantial training data for both methods, which is not readily available. This work presents an Abstractive Tweet Summarizer (ATSumm) that effectively addresses the issue of data sparsity by using auxiliary information. We introduced the Auxiliary Pointer Generator Network (AuxPGN) model, which utilizes a unique attention mechanism called Key-phrase attention. This attention mechanism incorporates auxiliary information in the form of key-phrases and their corresponding importance scores from the input tweets. We evaluate the proposed approach by comparing it with 10 state-of-the-art approaches across 13 disaster datasets. The evaluation results indicate that ATSumm achieves superior performance compared to state-of-the-art approaches, with improvement of 4-80% in ROUGE-N F1-score.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 36 of its 88 references that are in the map. First posted on arXiv 10 May 2024.
Builds on
36 of 88 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
- 2015Teaching Machines to Read and Comprehendcited by 1,039
24 more
- 2015Pointer Networkscited by 882
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 809
- 2019Unified Language Model Pre-training for Natural Language Understanding and Generationcited by 668
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2022News Summarization and Evaluation in the Era of GPT-3cited by 324
- 2015LSTM: A Search Space Odysseycited by 315
- 2020ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingcited by 221
- 2016Incorporating Copying Mechanism in Sequence-to-Sequence Learningcited by 217
- 2016Modeling Coverage for Neural Machine Translationcited by 110
- 2018CrisisMMD: Multimodal Twitter Datasets from Natural Disasterscited by 88
- 2016Twitter as a Lifeline: Human-annotated Twitter Corpora for NLP of Crisis-related Messagescited by 43
- 2021HumAID: Human-Annotated Disaster Incidents Data from Twitter with Deep Learning Benchmarkscited by 38
- 2021ASPECTNEWS: Aspect-Oriented Summarization of News Documentscited by 37
- 2021Incorporating Domain Knowledge for Extractive Summarization of Legal Case Documentscited by 23
- 2022CAVES: A Dataset to facilitate Explainable Classification and Summarization of Concerns towards COVID Vaccinescited by 16
- 2021DepressionNet: A Novel Summarization Boosted Deep Framework for Depression Detection on Social Mediacited by 10
- 2018empathi: An ontology for Emergency Managing and Planning about Hazard Crisiscited by 6
- 2022CrisisLTLSum: A Benchmark for Local Crisis Event Timeline Extraction and Summarizationcited by 6
- 2022OntoDSumm : Ontology based Tweet Summarization for Disaster Eventscited by 4
- 2022EnDSUM: Entropy and Diversity based Disaster Tweet Summarizationcited by 4
- 2022Cross-Lingual Query-Based Summarization of Crisis-Related Social Media: An Abstractive Approach Using Transformerscited by 3
- 2023PORTRAIT: a hybrid aPproach tO cReate extractive ground-TRuth summAry for dIsaster evenTcited by 3
- 2023IKDSumm: Incorporating Key-phrases into BERT for extractive Disaster Tweet Summarizationcited by 3
- 2022Knowledge-aware Document Summarization: A Survey of Knowledge, Embedding Methods and Architecturescited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.