TalkSumm: A Dataset and Scalable Annotation Method for Scientific Paper Summarization Based on Conference Talks
Not on the map. Why?
Abstract (arXiv)
Currently, no large-scale training data is available for the task of scientific paper summarization. In this paper, we propose a novel method that automatically generates summaries for scientific papers, by utilizing videos of talks at scientific conferences. We hypothesize that such talks constitute a coherent and concise description of the papers' content, and can form the basis for good summaries. We collected 1716 papers and their corresponding videos, and created a dataset of paper summaries. A model trained on this dataset achieves similar performance as models trained on a dataset of summaries created manually. In addition, we validated the quality of our summaries by human experts.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 3; 2024: 5; 2025: 3.
20 papers.
Sort:
By area:
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 68
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
- 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Paperscited by 16
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervisioncited by 15
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11
- 2025PosterSum: A Multimodal Benchmark for Scientific Poster Summarizationcited by 10
- 2021Extractive Research Slide Generation Using Windowed Labeling Rankingcited by 7
- 2024Knowledge-Centric Templatic Views of Documentscited by 5
- 2021Summaformers @ LaySumm 20, LongSumm 20cited by 4
- 2023Citance-Contextualized Summarization of Scientific Paperscited by 4
8 more
- 2022An Exploration of Post-Editing Effectiveness in Text Summarizationcited by 3
- 2024M3AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Datasetcited by 3
- 2024The State and Fate of Summarization Datasets: A Surveycited by 3
- 2025NUTSHELL: A Dataset for Abstract Generation from Scientific Talkscited by 3
- 2022SciBERTSUM: Extractive Summarization for Scientific Documentscited by 2
- 2022SuMe: A Dataset Towards Summarizing Biomedical Mechanismscited by 2
- 2023SPEC: Summary Preference Decomposition for Low-Resource Abstractive Summarizationcited by 1
- 2022Community-Driven Comprehensive Scientific Paper Summarization: Insight from cvpaper.challengecited by 0
- 2025PosterSum: A Multimodal Benchmark for Scientific Poster Summarization24 Feb 2025
- 2025NUTSHELL: A Dataset for Abstract Generation from Scientific Talks24 Feb 2025
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations12 Feb 2025
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Papers22 Mar 2024
- 2024M3AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset21 Mar 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Knowledge-Centric Templatic Views of Documents13 Jan 2024
- 2023Citance-Contextualized Summarization of Scientific Papers4 Nov 2023
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge14 May 2023
- 2023SPEC: Summary Preference Decomposition for Low-Resource Abstractive Summarization24 Mar 2023
- 2022An Exploration of Post-Editing Effectiveness in Text Summarization13 Jun 2022
8 more
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervision12 May 2022
- 2022SuMe: A Dataset Towards Summarizing Biomedical Mechanisms10 May 2022
- 2022Community-Driven Comprehensive Scientific Paper Summarization: Insight from cvpaper.challenge17 Mar 2022
- 2022SciBERTSUM: Extractive Summarization for Scientific Documents21 Jan 2022
- 2021Automated scholarly paper review: Concepts, technologies, and challenges15 Nov 2021
- 2021Extractive Research Slide Generation Using Windowed Labeling Ranking6 Jun 2021
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents28 Jan 2021
- 2021Summaformers @ LaySumm 20, LongSumm 2010 Jan 2021
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021DOC2PPT: Automatic Presentation Slides Generation from Scientific Documentscited by 68
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
- 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Paperscited by 16
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervisioncited by 15
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11
- 2021Extractive Research Slide Generation Using Windowed Labeling Rankingcited by 7
- 2024Knowledge-Centric Templatic Views of Documentscited by 5
- 2021Summaformers @ LaySumm 20, LongSumm 20cited by 4
- 2023Citance-Contextualized Summarization of Scientific Paperscited by 4
- 2022An Exploration of Post-Editing Effectiveness in Text Summarizationcited by 3
12 most cited of 19 All 19 (JSON)
- 2025NUTSHELL: A Dataset for Abstract Generation from Scientific Talks24 Feb 2025
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations12 Feb 2025
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Papers22 Mar 2024
- 2024M3AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset21 Mar 2024
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methods5 Mar 2024
- 2024Knowledge-Centric Templatic Views of Documents13 Jan 2024
- 2023Citance-Contextualized Summarization of Scientific Papers4 Nov 2023
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge14 May 2023
- 2023SPEC: Summary Preference Decomposition for Low-Resource Abstractive Summarization24 Mar 2023
- 2022An Exploration of Post-Editing Effectiveness in Text Summarization13 Jun 2022
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervision12 May 2022
12 newest of 19 All 19 (JSON)