A Continuously Growing Dataset of Sentential Paraphrases
Not on the map. Why?
Abstract (arXiv)
A major challenge in paraphrase research is the lack of parallel corpora. In this paper, we present a new method to collect large-scale sentential paraphrases from Twitter by linking tweets through shared URLs. The main advantage of our method is its simplicity, as it gets rid of the classifier or human in the loop needed to select data before annotation and subsequent application of paraphrase identification algorithms in the previous work. We present the largest human-labeled paraphrase corpus to date of 51,524 sentence pairs and the first cross-domain benchmarking for automatic paraphrase identification. In addition, we show that more than 30,000 new sentential paraphrases can be easily and continuously captured every month at ~70% precision, and demonstrate their utility for downstream NLP tasks through phrasal paraphrase extraction. We make our code and data freely available.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 22; 2022: 20; 2023: 6; 2024: 14; 2025: 2; 2026: 7.
72 papers.
Sort:
By area:
- 2022MTEB: Massive Text Embedding Benchmarkcited by 623
- 2021Active Learning by Acquiring Contrastive Examplescited by 154
- 2021TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learningcited by 116
- 2022Describing Differences between Text Distributions with Natural Languagecited by 54
- 2021Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Levelcited by 34
- 2022On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliencycited by 31
- 2023Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Modelscited by 29
- 2021ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generationcited by 28
- 2021Bayesian Attention Belief Networkscited by 25
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
- 2021Improving Paraphrase Detection with the Adversarial Paraphrasing Taskcited by 19
38 more
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusioncited by 18
- 2022Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Frameworkcited by 18
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challengescited by 18
- 2021Identifying Machine-Paraphrased Plagiarismcited by 16
- 2021Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixingcited by 16
- 2022Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue Systemcited by 16
- 2021Neural semi-Markov CRF for Monolingual Word Alignmentcited by 15
- 2021Alignment Attention by Matching Key and Query Distributionscited by 14
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizercited by 13
- 2022Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priorscited by 13
- 2023Paraphrase Detection: Human vs. Machine Contentcited by 12
- 2019An Empirical Comparison on Imitation Learning and Reinforcement Learning for Paraphrase Generationcited by 11
- 2021Finnish Paraphrase Corpuscited by 10
- 2022Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learningcited by 10
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matchingcited by 9
- 2022Improving Large-scale Paraphrase Acquisition and Generationcited by 8
- 2024ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversitycited by 8
- 2022Calibration Meets Explanation: A Simple and Effective Approach for Model Confidence Estimatescited by 7
- 2021Semi-supervised Interactive Intent Labelingcited by 5
- 2021Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuningcited by 5
- 2021Simulated annealing for optimization of graphs and sequencescited by 5
- 2022A Data Cartography based MixUp for Pre-trained Language Modelscited by 5
- 2022Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLUcited by 5
- 2026CSRv2: Unlocking Ultra-Sparse Embeddingscited by 5
- 2022Revision for Concision: A Constrained Paraphrase Generation Taskcited by 4
- 2022Relational Sentence Embedding for Flexible Semantic Matchingcited by 4
- 2023Paraphrase Types for Generation and Detectioncited by 4
- 2026The Embedder's Dilemma: LLMs Are Better, but at What Cost?cited by 4
- 2021On Length Divergence Bias in Textual Matching Modelscited by 3
- 2021Learning to Selectively Learn for Weakly-supervised Paraphrase Generationcited by 3
- 2021Exploiting Twitter as Source of Large Corpora of Weakly Similar Pairs for Semantic Sentence Embeddingscited by 3
- 2022Decay No More: A Persistent Twitter Dataset for Learning Social Meaningcited by 3
- 2022Pathologies of Pre-trained Language Models in Few-shot Fine-tuningcited by 3
- 2024Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortioncited by 3
- 2024Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillationcited by 3
- 2024VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Modelscited by 3
- 2021LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matchingcited by 2
- 2021Extracting and filtering paraphrases by bridging natural language inference and paraphrasingcited by 2
50 most cited of 72 All 72 (JSON)
- 2026Not All Duplicates Are Coordination: Generic vs. Non-Generic Duplicate Campaigns in Information Operations12 Sep 2026
- 2026The Embedder's Dilemma: LLMs Are Better, but at What Cost?13 Aug 2026
- 2026CaliDist: Calibrating Large Language Models via Behavioral Robustness to Distraction4 Jun 2026
- 2026The Harder Text Embedding Benchmark (HTEB): Beyond One-dimensional Static Robustness27 May 2026
- 2026Layer-wise Representation Dynamics: An Empirical Investigation Across Embedders and Base LLMs12 May 2026
- 2026Learning Concepts, Not Tokens: Self-Supervised Semantic Alignment for Language Models31 Mar 2026
- 2026CSRv2: Unlocking Ultra-Sparse Embeddings5 Feb 2026
- 2025AdParaphrase v2.0: Generating Attractive Ad Texts Using a Preference-Annotated Paraphrase Dataset27 May 2025
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoning10 May 2025
- 2024Learning to Adapt to Low-Resource Paraphrase Generation22 Dec 2024
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2024GASE: Generatively Augmented Sentence Encoding7 Nov 2024
38 more
- 2024VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models7 Nov 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Action Controlled Paraphrasing18 May 2024
- 2024Parameter Efficient Diverse Paraphrase Generation Using Sequence-Level Knowledge Distillation19 Apr 2024
- 2024ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversity18 Apr 2024
- 2024What's Mine becomes Yours: Defining, Annotating and Detecting Context-Dependent Paraphrases in News Interview Dialogs10 Apr 2024
- 2024Task-Oriented Paraphrase Analytics26 Mar 2024
- 2024EvoGrad: A Dynamic Take on the Winograd Schema Challenge with Human Adversaries20 Feb 2024
- 2024Finding a Needle in the Adversarial Haystack: A Targeted Paraphrasing Approach For Uncovering Edge Cases with Minimal Distribution Distortion21 Jan 2024
- 2024Data-CUBE: Data Curriculum for Instruction-based Sentence Representation Learning7 Jan 2024
- 2023IEKM: A Model Incorporating External Keyword Matrices21 Nov 2023
- 2023Non-contrastive sentence representations via self-supervision26 Oct 2023
- 2023Paraphrase Types for Generation and Detection23 Oct 2023
- 2023Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models30 May 2023
- 2023Paraphrase Detection: Human vs. Machine Content24 Mar 2023
- 2023Paraphrase Acquisition from Image Captions26 Jan 2023
- 2022Relational Sentence Embedding for Flexible Semantic Matching17 Dec 2022
- 2022Calibration Meets Explanation: A Simple and Effective Approach for Model Confidence Estimates6 Nov 2022
- 2022Fine-Grained Emotional Paraphrasing along Emotion Gradients30 Oct 2022
- 2022Generate, Discriminate and Contrast: A Semi-Supervised Sentence Representation Learning Framework30 Oct 2022
- 2022Revision for Concision: A Constrained Paraphrase Generation Task25 Oct 2022
- 2022Training Dynamics for Curriculum Learning: A Study on Monolingual and Cross-lingual NLU22 Oct 2022
- 2022Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion16 Oct 2022
- 2022MTEB: Massive Text Embedding Benchmark13 Oct 2022
- 2022Towards Structure-aware Paraphrase Identification with Phrase Alignment Using Sentence Encoders11 Oct 2022
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matching7 Oct 2022
- 2022Improving Large-scale Paraphrase Acquisition and Generation6 Oct 2022
- 2022Data Augmentation with Paraphrase Generation and Entity Extraction for Multimodal Dialogue System9 May 2022
- 2022Odor Descriptor Understanding through Prompting7 May 2022
- 2022A Data Cartography based MixUp for Pre-trained Language Models6 May 2022
- 2022Pathologies of Pre-trained Language Models in Few-shot Fine-tuning17 Apr 2022
- 2022Decay No More: A Persistent Twitter Dataset for Learning Social Meaning10 Apr 2022
- 2022Match-Prompt: Improving Multi-task Generalization Ability for Neural Text Matching via Prompt Learning6 Apr 2022
- 2022Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priors4 Apr 2022
- 2022On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliency14 Mar 2022
- 2022Describing Differences between Text Distributions with Natural Language28 Jan 2022
- 2021Extracting and filtering paraphrases by bridging natural language inference and paraphrasing13 Nov 2021
50 newest of 72 All 72 (JSON)
- 2026The Embedder's Dilemma: LLMs Are Better, but at What Cost?13 Aug 2026
- 2025Boosting Neural Language Inference via Cascaded Interactive Reasoning10 May 2025
- 2024GASE: Generatively Augmented Sentence Encoding7 Nov 2024
- 2022MTEB: Massive Text Embedding Benchmarkcited by 623
- 2021Active Learning by Acquiring Contrastive Examplescited by 154
- 2021TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learningcited by 116
- 2022Describing Differences between Text Distributions with Natural Languagecited by 54
- 2021Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Levelcited by 34
- 2022On the Calibration of Pre-trained Language Models using Mixup Guided by Area Under the Margin and Saliencycited by 31
- 2023Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Modelscited by 29
- 2021ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generationcited by 28
- 2021Bayesian Attention Belief Networkscited by 25
- 2021Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Taskscited by 22
- 2022DABERT: Dual Attention Enhanced BERT for Semantic Matchingcited by 21
- 2021Improving Paraphrase Detection with the Adversarial Paraphrasing Taskcited by 19
12 most cited of 67 All 67 (JSON)
- 2026Not All Duplicates Are Coordination: Generic vs. Non-Generic Duplicate Campaigns in Information Operations12 Sep 2026
- 2026CaliDist: Calibrating Large Language Models via Behavioral Robustness to Distraction4 Jun 2026
- 2026The Harder Text Embedding Benchmark (HTEB): Beyond One-dimensional Static Robustness27 May 2026
- 2026Layer-wise Representation Dynamics: An Empirical Investigation Across Embedders and Base LLMs12 May 2026
- 2026CSRv2: Unlocking Ultra-Sparse Embeddings5 Feb 2026
- 2025AdParaphrase v2.0: Generating Attractive Ad Texts Using a Preference-Annotated Paraphrase Dataset27 May 2025
- 2024Learning to Adapt to Low-Resource Paraphrase Generation22 Dec 2024
- 2024Comateformer: Combined Attention Transformer for Semantic Sentence Matching10 Dec 2024
- 2024VTechAGP: An Academic-to-General-Audience Text Paraphrase Dataset and Benchmark Models7 Nov 2024
- 2024ALVIN: Active Learning Via INterpolation11 Oct 2024
- 2024Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges24 May 2024
- 2024Action Controlled Paraphrasing18 May 2024
12 newest of 67 All 67 (JSON)