mlsanityData to 7 Oct 2026

Automatic Related Work Generation: A Meta Study

arXiv 2201.01880 ↗First posted 6 Jan 2022cs.CLcited by 8

Not on the map. Why?

Abstract (arXiv)

Academic research is an exploration activity to solve problems that have never been resolved before. By this nature, each academic research work is required to perform a literature review to distinguish its novelties that have not been addressed by prior works. In natural language processing, this literature review is usually conducted under the "Related Work" section. The task of automatic related work generation aims to automatically generate the "Related Work" section given the rest of the research paper and a list of cited papers. Although this task was proposed over 10 years ago, it received little attention until very recently, when it was cast as a variant of the scientific multi-document summarization problem. However, even today, the problems of automatic related work and citation text generation are not yet standardized. In this survey, we conduct a meta-study to compare the existing literature on related work generation from the perspectives of problem formulation, dataset collection, methodological approach, performance evaluation, and future prospects to provide the reader insight into the progress of the state-of-the-art studies, as well as and how future studies can be conducted. We also survey relevant fields of study that we suggest future work to consider integrating.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 35 of its 124 references that are in the map. First posted on arXiv 6 Jan 2022.

Builds on

35 of 124 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2017Graph Attention Networkscited by 8,854
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2018Deep contextualized word representationscited by 2,285
  9. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  10. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  11. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  12. 2019Text Summarization with Pretrained Encoderscited by 553
23 more
  1. 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 476
  2. 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
  3. 2016SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documentscited by 245
  4. 2019Hierarchical Transformers for Multi-Document Summarizationcited by 132
  5. 2019Structural Scaffolds for Citation Intent Classification in Scientific Publicationscited by 129
  6. 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 123
  7. 2018Construction of the Literature Graph in Semantic Scholarcited by 118
  8. 2019ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networkscited by 73
  9. 2020Leveraging Graph to Improve Abstractive Multi-Document Summarizationcited by 67
  10. 2017Graph-based Neural Multi-Document Summarizationcited by 54
  11. 2018A Web-scale system for scientific knowledge explorationcited by 39
  12. 2020Explaining Relationships Between Scientific Documentscited by 35
  13. 2021MultiCite: Modeling realistic citations requires moving beyond the single-sentence single-label settingcited by 30
  14. 2019SEQ^3: Differentiable Sequence-to-Sequence-to-Sequence Autoencoder for Unsupervised Abstractive Sentence Compressioncited by 27
  15. 2016Neural Sentence Orderingcited by 18
  16. 2019A Summarization System for Scientific Documentscited by 17
  17. 2017Scientific document summarization via citation contextualization and scientific discoursecited by 12
  18. 2019Scientific Discourse Tagging for Evidence Extractioncited by 11
  19. 2019The CL-SciSumm Shared Task 2018: Results and Key Insightscited by 9
  20. 2020MELINDA: A Multimodal Dataset for Biomedical Experiment Method Classificationcited by 9
  21. 2014Generating Extractive Summaries of Scientific Paradigmscited by 7
  22. 2017Experiment Segmentation in Scientific Discourse as Clause-level Structured Prediction using Recurrent Neural Networkscited by 7
  23. 2020CODA-19: Using a Non-Expert Crowd to Annotate Research Aspects on 10,000+ Abstracts in the COVID-19 Open Research Datasetcited by 4

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 2; 2024: 2; 2025: 2.

8 papers.