mlsanityData to 14 Oct 2026

SciXGen: A Scientific Paper Dataset for Context-Aware Text Generation

arXiv 2110.10774 ↗First posted 20 Oct 2021cs.CLcited by 22

Not on the map. Why?

Abstract (arXiv)

Generating texts in scientific papers requires not only capturing the content contained within the given input but also frequently acquiring the external information called textitcontext. We push forward the scientific text generation by proposing a new task, namely context-aware text generation in the scientific domain, aiming at exploiting the contributions of context in generated texts. To this end, we present a novel challenging large-scale Scientific Paper Dataset for ConteXt-Aware Text Generation (SciXGen), consisting of well-annotated 205,304 papers with full references to widely-used objects (e.g., tables, figures, algorithms) in a paper. We comprehensively benchmark, using state-of-the-arts, the efficacy of our newly constructed SciXGen dataset in generating description and paragraph. Our dataset and benchmarks will be made publicly available to hopefully facilitate the scientific text generation research.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 20 Oct 2021.

Builds on

17 of 25 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2020Longformer: The Long-Document Transformercited by 3,413
  6. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  7. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  8. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 430
  9. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 418
  10. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  11. 2019On the Use of ArXiv as a Datasetcited by 103
  12. 2020Multi-XScience: A Large-scale Dataset for Extreme Multi-document Summarization of Scientific Articlescited by 97
5 more
  1. 2019PaperRobot: Incremental Draft Generation of Scientific Ideascited by 37
  2. 2021ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generationcited by 28
  3. 2021Enhancing Scientific Papers Summarization with Citation Graphcited by 14
  4. 2021Learning to Reason for Text Generation from Scientific Tablescited by 14
  5. 2019Neural Academic Paper Generationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 3; 2024: 10; 2025: 7; 2026: 1.

22 papers.

Sort:

By area:

  1. 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
  2. 2024DeTeCtive: Detecting AI-generated Text via Multi-Level Contrastive Learningcited by 53
  3. 2024ExeGPT: Constraint-Aware Resource Scheduling for LLM Inferencecited by 45
  4. 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 42
  5. 2023unarXive 2022: All arXiv Publications Pre-Processed for NLP, Including Structured Full-Text and Citation Networkcited by 24
  6. 2024LitLLMs, LLMs for Literature Review: Are we there yet?cited by 14
  7. 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
  8. 2025MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholdscited by 9
  9. 2025Diversity Boosts AI-Generated Text Detectioncited by 6
  10. 2022Synthesis and Evaluation of a Domain-specific Large Data Set for Dungeons & Dragonscited by 5
  11. 2024Context-Enhanced Language Models for Generating Multi-Paper Citationscited by 5
  12. 2024KG-CTG: Citation Generation through Knowledge Graph-guided Large Language Modelscited by 4
10 more
  1. 2024Synthetic Lyrics Detection Across Languages and Genrescited by 4
  2. 2024PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detectioncited by 3
  3. 2025Not all tokens are created equal: Perplexity Attention Weighted Networks for AI generated text detectioncited by 3
  4. 2024SciEvo: A 2 Million, 30-Year Cross-disciplinary Dataset for Temporal Scientometric Analysiscited by 2
  5. 2025RefuteBench 2.0 -- Agentic Benchmark for Dynamic Evaluation of LLM Responses to Refutation Instructioncited by 2
  6. 2025LLMTrace: A Corpus for Classification and Fine-Grained Localization of AI-Written Textcited by 2
  7. 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approachcited by 0
  8. 2024SHADE: Semantic Hypernym Annotator for Domain-specific Entities -- DnD Domain Use Casecited by 0
  9. 2025AINL-Eval 2025 Shared Task: Detection of AI-Generated Scientific Abstracts in Russiancited by 0
  10. 2026READER: Reasoning-Enhanced AI-Generated Text Detectioncited by 0