mlsanityData to 14 Oct 2026

Transformer Based Implementation for Automatic Book Summarization

arXiv 2301.07057 ↗First posted 17 Jan 2023cs.CL cs.AI cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Document Summarization is the procedure of generating a meaningful and concise summary of a given document with the inclusion of relevant and topic-important points. There are two approaches: one is picking up the most relevant statements from the document itself and adding it to the Summary known as Extractive and the other is generating sentences for the Summary known as Abstractive Summarization. Training a machine learning model to perform tasks that are time-consuming or very difficult for humans to evaluate is a major challenge. Book Abstract generation is one of such complex tasks. Traditional machine learning models are getting modified with pre-trained transformers. Transformer based language models trained in a self-supervised fashion are gaining a lot of attention; when fine-tuned for Natural Language Processing(NLP) downstream task like text summarization. This work is an attempt to use Transformer based techniques for Abstract generation.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 17 Jan 2023.

Builds on

11 of 25 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  5. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
  6. 2021Recursively Summarizing Books with Human Feedbackcited by 290
  7. 2019Leveraging BERT for Extractive Text Summarization on Lecturescited by 63
  8. 2021The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architecturescited by 16
  9. 2015Generating News Headlines with Recurrent Neural Networkscited by 10
  10. 2018Bidirectional Attentional Encoder-Decoder Model and Bidirectional Beam Search for Abstractive Summarizationcited by 4
  11. 2022Efficient comparison of sentence embeddingscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 0; 2025: 1.

2 papers.