Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articles
Not on the map. Why?
Abstract (arXiv)
Multi-document summarization is a challenging task for which there exists little large-scale datasets. We propose Multi-XScience, a large-scale multi-document summarization dataset created from scientific articles. Multi-XScience introduces a challenging multi-document summarization task: writing the related-work section of a paper based on its abstract and the articles it references. Our work is inspired by extreme summarization, a dataset construction protocol that favours abstractive modeling approaches. Descriptive statistics and empirical results---using several state-of-the-art models trained on the Multi-XScience dataset---reveal that Multi-XScience is well suited for abstractive models.
Key facts. Cited by 96 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 17; 2023: 17; 2024: 26; 2025: 17; 2026: 12.
96 papers.
Sort:
By area:
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
- 2024LitLLM: A Toolkit for Scientific Literature Reviewcited by 61
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
- 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articlescited by 45
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
- 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
- 2021Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documentscited by 33
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2023Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answeringcited by 28
- 2023Summarizing Multiple Documents with Conversational Structure for Meta-Review Generationcited by 27
38 more
- 2024Answer is All You Need: Instruction-following Text Embedding via Answering the Questioncited by 26
- 2023PIT: Optimization of Dynamic Sparse Deep Learning Models via Permutation Invariant Transformationcited by 25
- 2021Overview of the 2021 Key Point Analysis Shared Taskcited by 23
- 2025Paper2Video: Automatic Video Generation from Scientific Paperscited by 23
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
- 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
- 2024On Positional Bias of Faithfulness for Long-form Summarizationcited by 22
- 2022Open Domain Multi-document Summarization: A Comprehensive Study of Model Brittleness under Retrievalcited by 20
- 2023Automated Metrics for Medical Multi-Document Summarization Disagree with Human Evaluationscited by 18
- 2023SciReviewGen: A Large-scale Dataset for Automatic Literature Review Generationcited by 17
- 2024From Single to Multi: How LLMs Hallucinate in Multi-Document Summarizationcited by 17
- 2025SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Taskscited by 17
- 2023Generating a Structured Summary of Numerous Academic Papers: Dataset and Methodcited by 16
- 2022CiteSum: Citation Text-guided Scientific Extreme Summarization and Domain Adaptation with Limited Supervisioncited by 15
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generationcited by 14
- 2022Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awarenesscited by 13
- 2022X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documentscited by 12
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
- 2024LitLLMs, LLMs for Literature Review: Are we there yet?cited by 12
- 2022Multi-Document Scientific Summarization from a Knowledge Graph-Centric Viewcited by 11
- 2023Do Multi-Document Summarization Models Synthesize?cited by 11
- 2023Hierarchical Catalogue Generation for Literature Review: A Benchmarkcited by 11
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Followingcited by 10
- 2023Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarizationcited by 9
- 2021HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articlescited by 8
- 2023What are the Desired Characteristics of Calibration Sets? Identifying Correlates on Long Form Scientific Summarizationcited by 8
- 2024Systematic Task Exploration with LLMs: A Study in Citation Text Generationcited by 8
- 2024ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language Modelscited by 8
- 2021Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Researchcited by 7
- 2024MedINST: Meta Dataset of Biomedical Instructionscited by 7
- 2025SurveyGen: Quality-Aware Scientific Survey Generation with Large Language Modelscited by 7
- 2022WikiDes: A Wikipedia-Based Dataset for Generating Short Descriptions from Paragraphscited by 6
- 2022DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarizationcited by 6
- 2024From Paper to Card: Transforming Design Implications with Generative AIcited by 6
- 2024OARelatedWork: A Large-Scale Dataset of Related Work Sections with Full-texts from Open Access Sourcescited by 6
- 2025arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generationcited by 6
- 2025Expert Preference-based Evaluation of Automated Related Work Generationcited by 6
- 2022NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarizationcited by 5
50 most cited of 96 All 96 (JSON)
- 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalist6 Sep 2026
- 2026SciLENS: RL-Driven Autonomous Agents for Scientific Localized Evidence Navigation and Synthesis3 Sep 2026
- 2026SAGE: A Unified Algebra and Self-Adaptive Execution for AI Functions in SQL21 Aug 2026
- 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation18 Aug 2026
- 2026Ideas Have Genomes: Benchmarking Scientific Lineage Reasoning and Lineage-Grounded Idea Generation9 Jul 2026
- 2026On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain1 Jul 2026
- 2026Detect, Unlearn, Restore: Defending Text Summarization Models Against Data Poisoning24 Jun 2026
- 2026MetaSyn: A Benchmark for LLM Agents on Meta-Analysis Articles from Nature Portfolio15 Jun 2026
- 2026CalBrief: A Pilot Diagnostic Benchmark for Evidence-Calibrated Scientific Briefing with Large Language Models11 Jun 2026
- 2026A Training-Free Mixture-of-Agents Framework for Multi-Document Summarization using LLMs and Knowledge Graphs2 Jun 2026
- 2026How Much Structure Do LLMs Need? Evaluating LLMs for Bibliometric Cluster Description23 May 2026
- 2026SciZoom: A Large-scale Benchmark for Hierarchical Scientific Summarization across the LLM Era17 Mar 2026
38 more
- 2025Not too long do read: Evaluating LLM-generated extreme scientific summaries29 Dec 2025
- 2025InforME: Improving Informativeness of Abstractive Text Summarization With Informative Attention Guided by Named Entity Salience7 Oct 2025
- 2025Paper2Video: Automatic Video Generation from Scientific Papers6 Oct 2025
- 2025Topic-Guided Reinforcement Learning with LLMs for Enhancing Multi-Document Summarization11 Sep 2025
- 2025MSRS: Evaluating Multi-Source Retrieval-Augmented Generation28 Aug 2025
- 2025SurveyGen: Quality-Aware Scientific Survey Generation with Large Language Models25 Aug 2025
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation21 Aug 2025
- 2025Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation19 Aug 2025
- 2025Expert Preference-based Evaluation of Automated Related Work Generation11 Aug 2025
- 2025SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded Tasks1 Jul 2025
- 2025Principled Content Selection to Generate Diverse and Personalized Multi-Document Summaries28 May 2025
- 2025Select, Read, and Write: A Multi-Agent Framework of Full-Text-based Related Work Generation26 May 2025
- 2025Ask, Retrieve, Summarize: A Modular Pipeline for Scientific Literature Summarization22 May 2025
- 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysis20 May 2025
- 2025A Unified Retrieval Framework with Document Ranking and EDU Filtering for Multi-document Summarization23 Apr 2025
- 2025arXiv2Table: Toward Realistic Benchmarking and Evaluation for LLM-Based Literature-Review Table Generation14 Apr 2025
- 2025Can one size fit all?: Measuring Failure in Multi-Document Summarization Domain Transfer20 Mar 2025
- 2024EventSum: A Large-Scale Event-Centric Summarization Dataset for Chinese Multi-News Documents16 Dec 2024
- 2024LitLLMs, LLMs for Literature Review: Are we there yet?15 Dec 2024
- 2024The State and Fate of Summarization Datasets: A Survey7 Nov 2024
- 2024On Positional Bias of Faithfulness for Long-form Summarization31 Oct 2024
- 2024MDCure: A Scalable Pipeline for Multi-Document Instruction-Following30 Oct 2024
- 2024Attacks against Abstractive Text Summarization Models through Lead Bias and Influence Functions26 Oct 2024
- 2024ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language Models25 Oct 2024
- 2024From Single to Multi: How LLMs Hallucinate in Multi-Document Summarization17 Oct 2024
- 2024MedINST: Meta Dataset of Biomedical Instructions17 Oct 2024
- 2024SurveySum: A Dataset for Summarizing Multiple Scientific Articles into a Survey Section29 Aug 2024
- 2024GLIMMER: Incorporating Graph and Lexical Features in Unsupervised Multi-Document Summarization19 Aug 2024
- 2024M2DS: Multilingual Dataset for Multi-document Summarisation17 Jul 2024
- 2024Rethinking Transformer-based Multi-document Summarization: An Empirical Investigation16 Jul 2024
- 2024Systematic Task Exploration with LLMs: A Study in Citation Text Generation4 Jul 2024
- 2024LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization18 Jun 2024
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Models17 Jun 2024
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literature10 Jun 2024
- 2024Disentangling Specificity for Abstractive Multi-document Summarization12 May 2024
- 2024OARelatedWork: A Large-Scale Dataset of Related Work Sections with Full-texts from Open Access Sources3 May 2024
- 2024Disentangling Instructive Information from Ranked Multiple Candidates for Multi-Document Scientific Summarization16 Apr 2024
- 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generation26 Mar 2024
50 newest of 96 All 96 (JSON)
- 2026A Training-Free Mixture-of-Agents Framework for Multi-Document Summarization using LLMs and Knowledge Graphscited by 0
- 2026MetaSyn: A Benchmark for LLM Agents on Meta-Analysis Articles from Nature Portfoliocited by 0
- 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automationcited by 0
- 2026SciLENS: RL-Driven Autonomous Agents for Scientific Localized Evidence Navigation and Synthesiscited by 0
- 2026SciLENS: RL-Driven Autonomous Agents for Scientific Localized Evidence Navigation and Synthesis3 Sep 2026
- 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation18 Aug 2026
- 2026MetaSyn: A Benchmark for LLM Agents on Meta-Analysis Articles from Nature Portfolio15 Jun 2026
- 2026A Training-Free Mixture-of-Agents Framework for Multi-Document Summarization using LLMs and Knowledge Graphs2 Jun 2026
- 2025MSRS: Evaluating Multi-Source Retrieval-Augmented Generation28 Aug 2025
- 2024A Comprehensive Survey on Process-Oriented Automatic Text Summarization with Exploration of LLM-Based Methodscited by 101
- 2021PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarizationcited by 62
- 2024LitLLM: A Toolkit for Scientific Literature Reviewcited by 61
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2022Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularitiescited by 47
- 2023Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articlescited by 45
- 2024SciRIFF: A Resource to Enhance Language Model Instruction-Following over Scientific Literaturecited by 37
- 2022BigBIO: A Framework for Data-Centric Biomedical Natural Language Processingcited by 36
- 2021Bringing Structure into Summaries: a Faceted Summarization Dataset for Long Scientific Documentscited by 33
- 2023On Context Utilization in Summarization with Large Language Modelscited by 30
- 2023Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answeringcited by 28
- 2023Summarizing Multiple Documents with Conversational Structure for Meta-Review Generationcited by 27
12 most cited of 86 All 86 (JSON)
- 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalist6 Sep 2026
- 2026SAGE: A Unified Algebra and Self-Adaptive Execution for AI Functions in SQL21 Aug 2026
- 2026CalBrief: A Pilot Diagnostic Benchmark for Evidence-Calibrated Scientific Briefing with Large Language Models11 Jun 2026
- 2026How Much Structure Do LLMs Need? Evaluating LLMs for Bibliometric Cluster Description23 May 2026
- 2026SciZoom: A Large-scale Benchmark for Hierarchical Scientific Summarization across the LLM Era17 Mar 2026
- 2025Not too long do read: Evaluating LLM-generated extreme scientific summaries29 Dec 2025
- 2025InforME: Improving Informativeness of Abstractive Text Summarization With Informative Attention Guided by Named Entity Salience7 Oct 2025
- 2025Paper2Video: Automatic Video Generation from Scientific Papers6 Oct 2025
- 2025Topic-Guided Reinforcement Learning with LLMs for Enhancing Multi-Document Summarization11 Sep 2025
- 2025SurveyGen: Quality-Aware Scientific Survey Generation with Large Language Models25 Aug 2025
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation21 Aug 2025
- 2025Towards AI-Assisted Research Writing: Benchmarking LLMs for AI/ML Introduction Generation19 Aug 2025
12 newest of 86 All 86 (JSON)