mlsanityData to 14 Oct 2026

ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generation

arXiv 2101.08382 ↗First posted 21 Jan 2021cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

We propose ParaSCI, the first large-scale paraphrase dataset in the scientific field, including 33,981 paraphrase pairs from ACL (ParaSCI-ACL) and 316,063 pairs from arXiv (ParaSCI-arXiv). Digging into characteristics and common patterns of scientific papers, we construct this dataset though intra-paper and inter-paper methods, such as collecting citations to the same paper or aggregating definitions by scientific terms. To take advantage of sentences paraphrased partially, we put up PDBERT as a general paraphrase discovering method. The major advantages of paraphrases in ParaSCI lie in the prominent length and textual diversity, which is complementary to existing paraphrase datasets. ParaSCI obtains satisfactory results on human evaluation and downstream tasks, especially long paraphrase generation.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 11 of its 25 references that are in the map. First posted on arXiv 21 Jan 2021.

Builds on

11 of 25 references.

References · 11

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  6. 2017A Continuously Growing Dataset of Sentential Paraphrasescited by 72
  7. 2017A Deep Generative Framework for Paraphrase Generationcited by 54
  8. 2017Learning to Paraphrase for Question Answeringcited by 46
  9. 2020Paraphrase Generation with Latent Bag of Wordscited by 27
  10. 2017Stochastic Answer Networks for Machine Reading Comprehensioncited by 22
  11. 2017Cross-domain Semantic Parsing via Paraphrasingcited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 5; 2022: 7; 2023: 7; 2024: 3; 2025: 4; 2026: 2.

28 papers.

Sort:

By area:

  1. 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
  2. 2022EditEval: An Instruction-Based Benchmark for Text Improvementscited by 30
  3. 2022arXivEdits: Understanding the Human Revision Process in Scientific Writingcited by 26
  4. 2022Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuningcited by 25
  5. 2023A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Textscited by 23
  6. 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
  7. 2022Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational Needscited by 19
  8. 2023The ACL OCL Corpus: Advancing Open Science in Computational Linguisticscited by 17
  9. 2021Neural semi-Markov CRF for Monolingual Word Alignmentcited by 16
  10. 2022SsciBERT: A Pre-trained Language Model for Social Science Textscited by 12
  11. 2023Paraphrase Detection: Human vs. Machine Contentcited by 12
  12. 2024SciNews: From Scholarly Complexities to Public Narratives -- A Dataset for Scientific News Report Generationcited by 12
16 more
  1. 2021Finnish Paraphrase Corpuscited by 10
  2. 2021Graphine: A Dataset for Graph-aware Terminology Definition Generationcited by 10
  3. 2022Improving Large-scale Paraphrase Acquisition and Generationcited by 8
  4. 2021Generative Pretraining for Paraphrase Evaluationcited by 4
  5. 2024Evaluation of pretrained language models on music understandingcited by 4
  6. 2025Fake News Detection After LLM Laundering: Measurement and Explanationcited by 4
  7. 2022Evade the Trap of Mediocrity: Promoting Diversity and Novelty in Text Generation via Concentrating Attentioncited by 3
  8. 2023Active Learning for Natural Language Generationcited by 3
  9. 2025ARC-Encoder: learning compressed text representations for large language modelscited by 3
  10. 2026Beyond LLM-as-a-Judge: Deterministic Metrics for Multilingual Generative Text Evaluationcited by 3
  11. 2024What's Mine becomes Yours: Defining, Annotating and Detecting Context-Dependent Paraphrases in News Interview Dialogscited by 1
  12. 2025A Large-Scale Benchmark for Vietnamese Sentence Paraphrasescited by 1
  13. 2023What Makes a Good Paraphrase: Do Automated Evaluations Work?cited by 0
  14. 2023G-SPEED: General SParse Efficient Editing MoDelcited by 0
  15. 2025The power of text similarity in identifying AI-LLM paraphrased documents: The case of BBC news articles and ChatGPTcited by 0
  16. 2026Hierarchical Wasserstein Merging for Multi-Domain Multi-Task Learning: From Specialists to a Generalistcited by 0