ParaBank: Monolingual Bitext Generation and Sentential Paraphrasing via Lexically-constrained Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
We present ParaBank, a large-scale English paraphrase dataset that surpasses prior work in both quantity and quality. Following the approach of ParaNMT, we train a Czech-English neural machine translation (NMT) system to generate novel paraphrases of English reference sentences. By adding lexical constraints to the NMT decoding procedure, however, we are able to produce multiple high-quality sentential paraphrases per source sentence, yielding an English paraphrase resource with more than 4 billion generated tokens and exhibiting greater lexical diversity. Using human judgments, we also demonstrate that ParaBank's paraphrases improve over ParaNMT on both semantic similarity and fluency. Finally, we use ParaBank to train a monolingual NMT model with the same support for lexically-constrained decoding for sentence rewriting tasks.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 8; 2023: 10; 2024: 4; 2025: 1; 2026: 1.
38 papers.
Sort:
By area:
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defensecited by 401
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2021Guided Generation of Cause and Effectcited by 33
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
- 2021Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translationcited by 27
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasingcited by 22
- 2023Nugget: Neural Agglomerative Embeddings of Textcited by 19
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretabilitycited by 19
- 2021BiSECT: Learning to Split and Rephrase Sentences with Bitextscited by 18
- 2021Text AutoAugment: Learning Compositional Augmentation Policy for Text Classificationcited by 15
- 2021An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languagescited by 14
26 more
- 2021Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Qualitycited by 13
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizercited by 13
- 2023ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translationcited by 11
- 2023Learning to Paraphrase Sentences to Different Complexity Levelscited by 11
- 2022Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisonscited by 10
- 2024ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversitycited by 8
- 2022GRS: Combining Generation and Revision in Unsupervised Sentence Simplificationcited by 6
- 2022ParaCotta: Synthetic Multilingual Paraphrase Corpora from the Most Diverse Translation Sample Paircited by 6
- 2022Principled Paraphrase Generation with Parallel Corporacited by 5
- 2022Exploring Diversity in Back Translation for Low-Resource Machine Translationcited by 5
- 2024Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrievalcited by 5
- 2024Better than Random: Reliable NLG Human Evaluation with Constrained Active Samplingcited by 4
- 2022Entailment Relation Aware Paraphrase Generationcited by 3
- 2023Active Learning for Natural Language Generationcited by 3
- 2021InFillmore: Frame-Guided Language Generation with Bidirectional Contextcited by 2
- 2021On Neurons Invariant to Sentence Structural Changes in Neural Machine Translationcited by 2
- 2021Improving the Diversity of Unsupervised Paraphrasing with Embedding Outputscited by 2
- 2025A Survey of Pun Generation: Datasets, Evaluations and Methodologiescited by 2
- 2023Language as a Latent Sequence: deep latent variable models for semi-supervised paraphrase generationcited by 1
- 2023Multilingual Lexical Simplification via Paraphrase Generationcited by 1
- 2023Negative Lexical Constraints in Neural Machine Translationcited by 1
- 2021Paraphrase Generation as Unsupervised Machine Translationcited by 0
- 2022Machine Translation Robustness to Natural Asemantic Variationcited by 0
- 2022The BLue Amazon Brain (BLAB): A Modular Architecture of Services about the Brazilian Maritime Territorycited by 0
- 2023Sentence Simplification Using Paraphrase Corpus for Initializationcited by 0
- 2026CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Modelcited by 0
- 2026CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model28 Jul 2026
- 2025A Survey of Pun Generation: Datasets, Evaluations and Methodologies7 Jul 2025
- 2024Quantifying the Gaps Between Translation and Native Perception in Training for Multimodal, Multilingual Retrieval2 Oct 2024
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability26 Jun 2024
- 2024Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling12 Jun 2024
- 2024ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversity18 Apr 2024
- 2023Nugget: Neural Agglomerative Embeddings of Text3 Oct 2023
- 2023Negative Lexical Constraints in Neural Machine Translation7 Aug 2023
- 2023Learning to Paraphrase Sentences to Different Complexity Levels4 Aug 2023
- 2023Multilingual Lexical Simplification via Paraphrase Generation28 Jul 2023
- 2023Sentence Simplification Using Paraphrase Corpus for Initialization31 May 2023
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing26 May 2023
26 more
- 2023ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation26 May 2023
- 2023Active Learning for Natural Language Generation24 May 2023
- 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar 2023
- 2023Language as a Latent Sequence: deep latent variable models for semi-supervised paraphrase generation5 Jan 2023
- 2022The BLue Amazon Brain (BLAB): A Modular Architecture of Services about the Brazilian Maritime Territory6 Sep 2022
- 2022Exploring Diversity in Back Translation for Low-Resource Machine Translation1 Jun 2022
- 2022Machine Translation Robustness to Natural Asemantic Variation25 May 2022
- 2022Principled Paraphrase Generation with Parallel Corpora24 May 2022
- 2022ParaCotta: Synthetic Multilingual Paraphrase Corpora from the Most Diverse Translation Sample Pair10 May 2022
- 2022Entailment Relation Aware Paraphrase Generation20 Mar 2022
- 2022GRS: Combining Generation and Revision in Unsupervised Sentence Simplification18 Mar 2022
- 2022Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons11 Mar 2022
- 2021Improving the Diversity of Unsupervised Paraphrasing with Embedding Outputs25 Oct 2021
- 2021On Neurons Invariant to Sentence Structural Changes in Neural Machine Translation6 Oct 2021
- 2021BiSECT: Learning to Split and Rephrase Sentences with Bitexts10 Sep 2021
- 2021Paraphrase Generation as Unsupervised Machine Translation7 Sep 2021
- 2021Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification1 Sep 2021
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizer1 Sep 2021
- 2021An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languages1 Sep 2021
- 2021Guided Generation of Cause and Effect21 Jul 2021
- 2021Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality8 Jun 2021
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasing31 May 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Survey10 May 2021
- 2021Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translation13 Apr 2021
- 2021InFillmore: Frame-Guided Language Generation with Bidirectional Context8 Mar 2021
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairs26 Jan 2021
- 2021Recent Advances in Deep Learning Based Dialogue Systems: A Systematic Surveycited by 130
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2021Guided Generation of Cause and Effectcited by 33
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasingcited by 31
- 2021Source and Target Bidirectional Knowledge Distillation for End-to-end Speech Translationcited by 27
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasingcited by 22
- 2023Nugget: Neural Agglomerative Embeddings of Textcited by 19
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretabilitycited by 19
- 2021BiSECT: Learning to Split and Rephrase Sentences with Bitextscited by 18
- 2021Text AutoAugment: Learning Compositional Augmentation Policy for Text Classificationcited by 15
- 2021An Unsupervised Method for Building Sentence Simplification Corpora in Multiple Languagescited by 14
- 2021Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Qualitycited by 13
12 most cited of 35 All 35 (JSON)
- 2025A Survey of Pun Generation: Datasets, Evaluations and Methodologies7 Jul 2025
- 2024Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability26 Jun 2024
- 2024Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling12 Jun 2024
- 2024ParaFusion: A Large-Scale LLM-Driven English Paraphrase Dataset Infused with High-Quality Lexical and Syntactic Diversity18 Apr 2024
- 2023Nugget: Neural Agglomerative Embeddings of Text3 Oct 2023
- 2023Negative Lexical Constraints in Neural Machine Translation7 Aug 2023
- 2023Learning to Paraphrase Sentences to Different Complexity Levels4 Aug 2023
- 2023Multilingual Lexical Simplification via Paraphrase Generation28 Jul 2023
- 2023Sentence Simplification Using Paraphrase Corpus for Initialization31 May 2023
- 2023Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing26 May 2023
- 2023ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation26 May 2023
- 2023Active Learning for Natural Language Generation24 May 2023
12 newest of 35 All 35 (JSON)