Prompting LLMs with content plans to enhance the summarization of scientific articles
Not on the map. Why?
Abstract (arXiv)
This paper presents novel prompting techniques to improve the performance of automatic summarization systems for scientific articles. Scientific article summarization is highly challenging due to the length and complexity of these documents. We conceive, implement, and evaluate prompting techniques that provide additional contextual information to guide summarization systems. Specifically, we feed summarizers with lists of key terms extracted from articles, such as author keywords or automatically generated keywords. Our techniques are tested with various summarization models and input texts. Results show performance gains, especially for smaller models summarizing sections separately. This evidences that prompting is a promising approach to overcoming the limitations of less powerful systems. Our findings introduce a new research direction of using prompts to aid smaller models.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 42 references that are in the map. First posted on arXiv 13 Dec 2023.
Builds on
12 of 42 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2018A Discourse-Aware Attention Model for Abstractive Summarization of Long Documentscited by 477
- 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2021LongT5: Efficient Text-To-Text Transformer for Long Sequencescited by 232
- 2019BIGPATENT: A Large-Scale Dataset for Abstractive and Coherent Summarizationcited by 155
- 2021Planning with Learned Entity Prompts for Abstractive Summarizationcited by 75
- 2017Contextualizing Citations for Scientific Summarization using Word Embeddings and Domain Knowledgecited by 5
Built on by
Citing papers per year: 2025: 2.
2 papers.