Exploring Content Selection in Summarization of Novel Chapters
Not on the map. Why?
Abstract (arXiv)
We present a new summarization task, generating summaries of novel chapters using summary/chapter pairs from online study guides. This is a harder task than the news summarization task, given the chapter length as well as the extreme paraphrasing and generalization found in the summaries. We focus on extractive summarization, which requires the creation of a gold-standard set of extractive summaries. We present a new metric for aligning reference summary sentences with chapter sentences to create gold extracts and also experiment with different alignment methods. Our experiments demonstrate significant improvement over prior alignment approaches for our task as shown through automatic metrics and a crowd-sourced pyramid analysis. We make our data collection scripts available at https://github.com/manestay/novel-chapter-dataset .
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 5; 2024: 5; 2025: 4; 2026: 1.
29 papers.
Sort:
By area:
- 2021Recursively Summarizing Books with Human Feedbackcited by 287
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
- 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
- 2021"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understandingcited by 48
- 2022Learning to Revise References for Faithful Summarizationcited by 28
- 2023Personality Understanding of Fictional Characters during Book Readingcited by 20
- 2022SNaC: Coherence Error Detection for Narrative Summarizationcited by 19
- 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writerscited by 19
- 2022TVShowGuess: Character Comprehension in Stories as Speaker Guessingcited by 17
17 more
- 2021StreamHover: Livestream Transcript Summarization and Annotationcited by 15
- 2022A Survey of Machine Narrative Reading Comprehension Assessmentscited by 10
- 2025NexusSum: Hierarchical LLM Agents for Long-Form Narrative Summarizationcited by 10
- 2023Generating EDU Extracts for Plan-Guided Summary Re-Rankingcited by 9
- 2024Select and Summarize: Scene Saliency for Movie Script Summarizationcited by 9
- 2023The Current State of Summarizationcited by 6
- 2022CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writingcited by 5
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarizationcited by 5
- 2023Hybrid Long Document Summarization using C2F-FAR and ChatGPT: A Practical Studycited by 5
- 2025Fine-Tuned LLMs are "Time Capsules" for Tracking Societal Bias Through Bookscited by 4
- 2024Previously on the Stories: Recap Snippet Identification for Story Readingcited by 3
- 2024The State and Fate of Summarization Datasets: A Surveycited by 3
- 2026Contrastive Learning with Narrative Twins for Modeling Story Saliencecited by 2
- 2023AbLit: A Resource for Analyzing and Generating Abridged Versions of English Literaturecited by 1
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themescited by 1
- 2022Novel Chapter Abstractive Summarization using Spinal Tree Aware Sub-Sentential Content Selectioncited by 0
- 2025Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understandingcited by 0
- 2026Contrastive Learning with Narrative Twins for Modeling Story Salience12 Jan 2026
- 2025NexusSum: Hierarchical LLM Agents for Long-Form Narrative Summarization30 May 2025
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themes29 May 2025
- 2025Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding1 Apr 2025
- 2025Fine-Tuned LLMs are "Time Capsules" for Tracking Societal Bias Through Books7 Feb 2025
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024Select and Summarize: Scene Saliency for Movie Script Summarization4 Apr 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writers2 Mar 2024
- 2024Previously on the Stories: Recap Snippet Identification for Story Reading11 Feb 2024
- 2023Hybrid Long Document Summarization using C2F-FAR and ChatGPT: A Practical Study1 Jun 2023
- 2023Generating EDU Extracts for Plan-Guided Summary Re-Ranking28 May 2023
17 more
- 2023Personality Understanding of Fictional Characters during Book Reading17 May 2023
- 2023The Current State of Summarization8 May 2023
- 2023AbLit: A Resource for Analyzing and Generating Abridged Versions of English Literature13 Feb 2023
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarization2 Dec 2022
- 2022CREATIVESUMM: Shared Task on Automatic Summarization for Creative Writing10 Nov 2022
- 2022Novel Chapter Abstractive Summarization using Spinal Tree Aware Sub-Sentential Content Selection9 Nov 2022
- 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Way23 May 2022
- 2022SNaC: Coherence Error Detection for Narrative Summarization19 May 2022
- 2022A Survey of Machine Narrative Reading Comprehension Assessments30 Apr 2022
- 2022TVShowGuess: Character Comprehension in Stories as Speaker Guessing16 Apr 2022
- 2022Learning to Revise References for Faithful Summarization13 Apr 2022
- 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehension26 Mar 2022
- 2021Recursively Summarizing Books with Human Feedback22 Sep 2021
- 2021"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understanding12 Sep 2021
- 2021StreamHover: Livestream Transcript Summarization and Annotation11 Sep 2021
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarization18 May 2021
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarization14 Apr 2021
- 2021Recursively Summarizing Books with Human Feedbackcited by 287
- 2021BookSum: A Collection of Datasets for Long-form Narrative Summarizationcited by 184
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021SummScreen: A Dataset for Abstractive Screenplay Summarizationcited by 80
- 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
- 2022SQuALITY: Building a Long-Document Summarization Dataset the Hard Waycited by 50
- 2021"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understandingcited by 48
- 2022Learning to Revise References for Faithful Summarizationcited by 28
- 2023Personality Understanding of Fictional Characters during Book Readingcited by 20
- 2022SNaC: Coherence Error Detection for Narrative Summarizationcited by 19
- 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writerscited by 19
- 2022TVShowGuess: Character Comprehension in Stories as Speaker Guessingcited by 17
12 most cited of 28 All 28 (JSON)
- 2026Contrastive Learning with Narrative Twins for Modeling Story Salience12 Jan 2026
- 2025Tell, Don't Show: Leveraging Language Models' Abstractive Retellings to Model Literary Themes29 May 2025
- 2025Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding1 Apr 2025
- 2025Fine-Tuned LLMs are "Time Capsules" for Tracking Societal Bias Through Books7 Feb 2025
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024Select and Summarize: Scene Saliency for Movie Script Summarization4 Apr 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Reading Subtext: Evaluating Large Language Models on Short Story Summarization with Writers2 Mar 2024
- 2024Previously on the Stories: Recap Snippet Identification for Story Reading11 Feb 2024
- 2023Hybrid Long Document Summarization using C2F-FAR and ChatGPT: A Practical Study1 Jun 2023
- 2023Generating EDU Extracts for Plan-Guided Summary Re-Ranking28 May 2023
- 2023Personality Understanding of Fictional Characters during Book Reading17 May 2023
12 newest of 28 All 28 (JSON)