Automatic Related Work Generation: A Meta Study
Not on the map. Why?
Abstract (arXiv)
Academic research is an exploration activity to solve problems that have never been resolved before. By this nature, each academic research work is required to perform a literature review to distinguish its novelties that have not been addressed by prior works. In natural language processing, this literature review is usually conducted under the "Related Work" section. The task of automatic related work generation aims to automatically generate the "Related Work" section given the rest of the research paper and a list of cited papers. Although this task was proposed over 10 years ago, it received little attention until very recently, when it was cast as a variant of the scientific multi-document summarization problem. However, even today, the problems of automatic related work and citation text generation are not yet standardized. In this survey, we conduct a meta-study to compare the existing literature on related work generation from the perspectives of problem formulation, dataset collection, methodological approach, performance evaluation, and future prospects to provide the reader insight into the progress of the state-of-the-art studies, as well as and how future studies can be conducted. We also survey relevant fields of study that we suggest future work to consider integrating.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 35 of its 124 references that are in the map. First posted on arXiv 6 Jan 2022.
Builds on
35 of 124 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2017Graph Attention Networkscited by 8,854
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2018Deep contextualized word representationscited by 2,285
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
- 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
- 2019Text Summarization with Pretrained Encoderscited by 553
23 more
- 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 476
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
- 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
- 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 129
- 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 123
- 2018Construction of the Literature Graph in Semantic Scholarcited by 118
- 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
- 2020Leveraging Graph to Improve Abstractive Multi-Document Summarizationcited by 67
- 2017Graph-based Neural Multi-Document Summarizationcited by 54
- 2018A Web-scale system for scientific knowledge explorationcited by 39
- 2020Explaining Relationships Between Scientific Documentscited by 35
- 2021MultiCite: Modeling realistic citations requires moving beyond the single-sentence single-label settingcited by 30
- 2019SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sentence Compressioncited by 27
- 2016Neural Sentence Orderingcited by 18
- 2019A Summarization System for Scientific Documentscited by 17
- 2017Scientific document summarization via citation contextualization and scientific discoursecited by 12
- 2019Scientific Discourse Tagging for Evidence Extractioncited by 11
- 2019The CL-SciSumm Shared Task 2018: Results and Key Insightscited by 9
- 2020MELINDA: A Multimodal Dataset for Biomedical Experiment Method Classificationcited by 9
- 2014Generating Extractive Summaries of Scientific Paradigmscited by 7
- 2017Experiment Segmentation in Scientific Discourse as Clause-level Structured Prediction using Recurrent Neural Networkscited by 7
- 2020CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Datasetcited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 2; 2025: 2.
8 papers.
- 2024Artificial Intelligence for Literature Reviews: Opportunities and Challengescited by 30
- 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
- 2022CORWA: A Citation-Oriented Related Work Annotation Datasetcited by 17
- 2024Shallow Synthesis of Knowledge in GPT-Generated Texts: A Case Study in Automatic Related Work Compositioncited by 12
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systemscited by 8
- 2023Causal Intervention for Abstractive Related Work Generationcited by 5
- 2025Modelling and Classifying the Components of a Literature Reviewcited by 2
- 2023Cited Text Spans for Citation Text Generationcited by 1
- 2025Modelling and Classifying the Components of a Literature Review6 Aug 2025
- 2025From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems3 Mar 2025
- 2024Shallow Synthesis of Knowledge in GPT-Generated Texts: A Case Study in Automatic Related Work Composition19 Feb 2024
- 2024Artificial Intelligence for Literature Reviews: Opportunities and Challenges13 Feb 2024
- 2023Cited Text Spans for Citation Text Generation12 Sep 2023
- 2023Causal Intervention for Abstractive Related Work Generation23 May 2023
- 2022CiteBench: A benchmark for Scientific Citation Text Generation19 Dec 2022
- 2022CORWA: A Citation-Oriented Related Work Annotation Dataset7 May 2022