Lay Text Summarisation Using Natural Language Processing: A Narrative Literature Review
Not on the map. Why?
Abstract (arXiv)
Summarisation of research results in plain language is crucial for promoting public understanding of research findings. The use of Natural Language Processing to generate lay summaries has the potential to relieve researchers' workload and bridge the gap between science and society. The aim of this narrative literature review is to describe and compare the different text summarisation approaches used to generate lay summaries. We searched the databases Web of Science, Google Scholar, IEEE Xplore, Association for Computing Machinery Digital Library and arXiv for articles published until 6 May 2022. We included original studies on automatic text summarisation methods to generate lay summaries. We screened 82 articles and included eight relevant papers published between 2020 and 2021, all using the same dataset. The results show that transformer-based methods such as Bidirectional Encoder Representations from Transformers (BERT) and Pre-training with Extracted Gap-sentences for Abstractive Summarization (PEGASUS) dominate the landscape of lay text summarisation, with all but one study using these methods. A combination of extractive and abstractive summarisation methods in a hybrid approach was found to be most effective. Furthermore, pre-processing approaches to input text (e.g. applying extractive summarisation) or determining which sections of a text to include, appear critical. Evaluation metrics such as Recall-Oriented Understudy for Gisting Evaluation (ROUGE) were used, which do not consider readability. To conclude, automatic lay text summarisation is under-explored. Future research should consider long document lay text summarisation, including clinical trial reports, and the development of evaluation metrics that consider readability of the lay summary.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 82 references that are in the map. First posted on arXiv 24 Mar 2023.
Builds on
35 of 82 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2017Mask R-CNNcited by 7,259
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 895
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
23 more
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2020Med-BERT: pre-trained contextualized embeddings on large-scale structured electronic health records for disease predictioncited by 368
- 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
- 2021The GEM Benchmark: Natural Language Generation, its Evaluation and Metricscited by 239
- 2020Synthesizer: Rethinking Self-Attention in Transformer Modelscited by 204
- 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
- 2021Data Augmentation Approaches in Natural Language Processing: A Surveycited by 82
- 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 81
- 2020GO FIGURE: A Meta Evaluation of Factuality in Summarizationcited by 75
- 2020Growth rates of modern science: A latent piecewise growth curve approach to model publication numbers from established and new literature databasescited by 75
- 2015Better Summarization Evaluation with Word Embeddings for ROUGEcited by 66
- 2019Extractive Summarization of Long Documents by Combining Global and Local Contextcited by 59
- 2020Improving Zero and Few-Shot Abstractive Summarization with Intermediate Fine-tuning and Data Augmentationcited by 53
- 2022Beyond Text Generation: Supporting Writers with Continuous Automatic Text Summariescited by 47
- 2020Automated Lay Language Summarization of Biomedical Scientific Reviewscited by 46
- 2017A Supervised Approach to Extractive Summarisation of Scientific Paperscited by 33
- 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
- 2022Automatic Text Summarization Methods: A Comprehensive Reviewcited by 17
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervisioncited by 15
- 2022WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphscited by 6
- 2021Summaformers @ LaySumm 20, LongSumm 20cited by 4
Built on by
Citing papers per year: 2024: 1.
1 paper.