TLDR: Extreme Summarization of Scientific Documents
Not on the map. Why?
Abstract (arXiv)
We introduce TLDR generation, a new form of extreme summarization, for scientific papers. TLDR generation involves high source compression and requires expert background knowledge and understanding of complex domain-specific language. To facilitate study on this task, we introduce SciTLDR, a new multi-target dataset of 5.4K TLDRs over 3.2K papers. SciTLDR contains both author-written and expert-derived TLDRs, where the latter are collected using a novel annotation protocol that produces high-quality summaries while minimizing annotation burden. We propose CATTS, a simple yet effective learning strategy for generating TLDRs that exploits titles as an auxiliary training signal. CATTS improves upon strong baselines under both automated metrics and human evaluations. Data and code are publicly available at https://github.com/allenai/scitldr.
Key facts. Cited by 136 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 21; 2023: 25; 2024: 31; 2025: 23; 2026: 16.
136 papers.
Sort:
By area:
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 227
- 2024Generative Representational Instruction Tuningcited by 227
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2022Task-aware Retrieval with Instructionscited by 107
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
38 more
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 50
- 2021D2S: Document-to-Slide Generation Via Query-Based Text Summarizationcited by 48
- 2021Aspect-Controllable Opinion Summarizationcited by 47
- 2022EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domaincited by 39
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
- 2021Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documentscited by 33
- 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26
- 2024What Can Natural Language Processing Do for Peer Review?cited by 24
- 2021Control Prefixes for Parameter-Efficient Text Generationcited by 23
- 2024Efficient Solutions For An Intriguing Failure of LLMs: Long Context Window Does Not Mean LLMs Can Analyze Long Sequences Flawlesslycited by 23
- 2022EntSUM: A Data Set for Entity-Centric Summarizationcited by 22
- 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
- 2021Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLPcited by 21
- 2021Automated scholarly paper review: Concepts, technologies, and challengescited by 21
- 2022Retrieval augmentation of large language models for lay language generationcited by 21
- 2024ACLSum: A New Dataset for Aspect-based Summarization of Scientific Publicationscited by 20
- 2024MASSW: A New Dataset and Benchmark Tasks for AI-Assisted Scientific Workflowscited by 19
- 2021Refocusing on Relevance: Personalization in NLGcited by 18
- 2024PaperWeaver: Enriching Topical Paper Alerts by Contextualizing Recommended Papers with User-collected Paperscited by 18
- 2025SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Taskscited by 17
- 2023The ACL OCL Corpus: Advancing Open Science in Computational Linguisticscited by 16
- 2024LimGen: Probing the LLMs for Generating Suggestive Limitations of Research Paperscited by 16
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervisioncited by 15
- 2025How Far Are AI Scientists from Changing the World?cited by 15
- 2021Generating Informative Conclusions for Argumentative Textscited by 14
- 2021Bursting Scientific Filter Bubbles: Boosting Innovation via Novel Author Discoverycited by 13
- 2022X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documentscited by 12
- 2023Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagationcited by 12
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2024LitLLMs, LLMs for Literature Review: Are we there yet?cited by 12
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentationscited by 11
- 2021TLDR9+: A Large Scale Resource for Extreme Summarization of Social Media Postscited by 10
- 2025PosterSum: A Multimodal Benchmark for Scientific Poster Summarizationcited by 10
- 2025Constrained Entropic Unlearning: A Primal-Dual Framework for Large Language Modelscited by 10
- 2021Towards Generating Citation Sentences for Multiple References with Intent Controlcited by 9
- 2023The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfacescited by 9
- 2024MoDEM: Mixture of Domain Expert Modelscited by 9
50 most cited of 136 All 136 (JSON)
- 2026Hypotheses-Guided Self Distillation for Continual Personalization31 Aug 2026
- 2026HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts30 Aug 2026
- 2026Information Satisfaction: A Reader-Centered Axis for Summarization Evaluation14 Aug 2026
- 2026TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter17 Jul 2026
- 2026Harnessing the Latent Space: From Steering Vectors to Model Calibrators for Control and Trust30 Jun 2026
- 2026The ACUTE Protocol: Operationalizing Language Model Activations for Better Calibration, Utility, and Trust5 Jun 2026
- 2026LLMSurgeon: Diagnosing Data Mixture of Large Language Models28 May 2026
- 2026NanoResearch: Co-Evolving Skills, Memory, and Policy for Personalized Research Automation11 May 2026
- 2026TUR-DPO: Topology- and Uncertainty-Aware Direct Preference Optimization30 Apr 2026
- 2026MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts7 Apr 2026
- 2026Paper Espresso: From Paper Overload to Research Insight6 Apr 2026
- 2026Do We Need Bigger Models for Science? Task-Aware Retrieval with Small Language Models2 Apr 2026
38 more
- 2026SciZoom: A Large-scale Benchmark for Hierarchical Scientific Summarization across the LLM Era17 Mar 2026
- 2026BLooP: Zero-Shot Abstractive Summarization using Large Language Models with Bigram Lookahead Promotion12 Mar 2026
- 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Public9 Jan 2026
- 2026Hi-ZFO: Hierarchical Zeroth- and First-Order LLM Fine-Tuning via Importance-Guided Tensor Selection9 Jan 2026
- 2025Not too long do read: Evaluating LLM-generated extreme scientific summaries29 Dec 2025
- 2025Deep Literature Survey Automation with an Iterative Workflow24 Oct 2025
- 2025AcademicEval: Live Long-Context LLM Benchmark20 Oct 2025
- 2025BOE-XSUM: Extreme Summarization in Clear Language of Spanish Legal Decrees and Notifications29 Sep 2025
- 2025Document Summarization with Conformal Importance Guarantees24 Sep 2025
- 2025Introducing Spotlight: A Novel Approach for Generating Captivating Key Information from Documents13 Sep 2025
- 2025Attributes as Textual Genes: Leveraging LLMs as Genetic Algorithm Simulators for Conditional Synthetic Data Generation2 Sep 2025
- 2025Can Smaller LLMs do better? Unlocking Cross-Domain Potential through Parameter-Efficient Fine-Tuning for Text Summarization1 Sep 2025
- 2025Evaluating the Evaluators: Are readability metrics good measures of readability?26 Aug 2025
- 2025SurveyGen: Quality-Aware Scientific Survey Generation with Large Language Models25 Aug 2025
- 2025Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation19 Aug 2025
- 2025DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections16 Aug 2025
- 2025Hallucination Detection and Mitigation in Scientific Text Simplification using Ensemble Approaches: DS@GT at CLEF 2025 SimpleText15 Aug 2025
- 2025How Far Are AI Scientists from Changing the World?31 Jul 2025
- 2025Question-Answer Extraction from Scientific Articles Using Knowledge Graphs and Large Language Models18 Jul 2025
- 2025SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks1 Jul 2025
- 2025Constrained Entropic Unlearning: A Primal-Dual Framework for Large Language Models5 Jun 2025
- 2025Adaptive LoRA Merge with Parameter Pruning for Low-Resource Generation30 May 2025
- 2025INFERENCEDYNAMICS: Efficient Routing Across LLMs through Structured Capability and Knowledge Profiling22 May 2025
- 2025Key, Value, Compress: A Systematic Exploration of KV Cache Compression Techniques14 Mar 2025
- 2025PosterSum: A Multimodal Benchmark for Scientific Poster Summarization24 Feb 2025
- 2025What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations12 Feb 2025
- 2025TrueReason: An Exemplar Personalised Learning System Integrating Reasoning with Foundational Models23 Jan 2025
- 2024LitLLMs, LLMs for Literature Review: Are we there yet?15 Dec 2024
- 2024Automated Literature Review Using NLP Techniques and LLM-Based Retrieval-Augmented Generation27 Nov 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024Enhancing literature review with LLM and NLP methods. Algorithmic trading case23 Oct 2024
- 2024CCSBench: Evaluating Compositional Controllability in LLMs for Scientific Document Summarization16 Oct 2024
- 2024MoDEM: Mixture of Domain Expert Models9 Oct 2024
- 2024Model-based Preference Optimization in Abstractive Summarization without Human Feedback27 Sep 2024
- 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publications25 Sep 2024
- 2024Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization5 Aug 2024
- 2024Efficient Solutions For An Intriguing Failure of LLMs: Long Context Window Does Not Mean LLMs Can Analyze Long Sequences Flawlessly3 Aug 2024
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery16 Jun 2024
50 newest of 136 All 136 (JSON)
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 227
- 2024Model-based Preference Optimization in Abstractive Summarization without Human Feedbackcited by 7
- 2022Methodological reflections for AI alignment research using human feedbackcited by 5
- 2026TUR-DPO: Topology- and Uncertainty-Aware Direct Preference Optimizationcited by 0
- 2026TUR-DPO: Topology- and Uncertainty-Aware Direct Preference Optimization30 Apr 2026
- 2024Model-based Preference Optimization in Abstractive Summarization without Human Feedback27 Sep 2024
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 217 Nov 2023
- 2022Methodological reflections for AI alignment research using human feedback22 Dec 2022
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2025TrueReason: An Exemplar Personalised Learning System Integrating Reasoning with Foundational Modelscited by 2
- 2026MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstractscited by 1
- 2026MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts7 Apr 2026
- 2025TrueReason: An Exemplar Personalised Learning System Integrating Reasoning with Foundational Models23 Jan 2025
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables22 May 2023
- 2022Galactica: A Large Language Model for Sciencecited by 736
- 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 402
- 2024Generative Representational Instruction Tuningcited by 227
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2022Task-aware Retrieval with Instructionscited by 107
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2024A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discoverycited by 96
- 2021MS2: Multi-Document Summarization of Medical Studiescited by 80
- 2021Can We Automate Scientific Reviewing?cited by 63
- 2023FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledgecited by 55
- 2022Making Science Simple: Corpora for the Lay Summarisation of Scientific Literaturecited by 54
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 50
12 most cited of 121 All 121 (JSON)
- 2026Hypotheses-Guided Self Distillation for Continual Personalization31 Aug 2026
- 2026Information Satisfaction: A Reader-Centered Axis for Summarization Evaluation14 Aug 2026
- 2026TAPR: Enhancing LLM Performance with a Task-Aware Prompt Rewriter17 Jul 2026
- 2026Harnessing the Latent Space: From Steering Vectors to Model Calibrators for Control and Trust30 Jun 2026
- 2026The ACUTE Protocol: Operationalizing Language Model Activations for Better Calibration, Utility, and Trust5 Jun 2026
- 2026LLMSurgeon: Diagnosing Data Mixture of Large Language Models28 May 2026
- 2026Paper Espresso: From Paper Overload to Research Insight6 Apr 2026
- 2026Do We Need Bigger Models for Science? Task-Aware Retrieval with Small Language Models2 Apr 2026
- 2026SciZoom: A Large-scale Benchmark for Hierarchical Scientific Summarization across the LLM Era17 Mar 2026
- 2026BLooP: Zero-Shot Abstractive Summarization using Large Language Models with Bigram Lookahead Promotion12 Mar 2026
- 2026LLMs as Science Journalists: Supporting Early-stage Researchers in Communicating Their Science to the Public9 Jan 2026
- 2026Hi-ZFO: Hierarchical Zeroth- and First-Order LLM Fine-Tuning via Importance-Guided Tensor Selection9 Jan 2026
12 newest of 121 All 121 (JSON)