Neural Paraphrase Generation with Stacked Residual LSTM Networks
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel neural approach for paraphrase generation. Conventional para- phrase generation methods either leverage hand-written rules and thesauri-based alignments, or use statistical machine learning principles. To the best of our knowledge, this work is the first to explore deep learning models for paraphrase generation. Our primary contribution is a stacked residual LSTM network, where we add residual connections between LSTM layers. This allows for efficient training of deep LSTMs. We evaluate our model and other state-of-the-art deep learning models on three different datasets: PPDB, WikiAnswers and MSCOCO. Evaluation results demonstrate that our model outperforms sequence to sequence, attention-based and bi- directional LSTM models on BLEU, METEOR, TER and an embedding-based sentence similarity metric.
Key facts. Cited by 52 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Oct 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2019: 1; 2020: 0; 2021: 16; 2022: 16; 2023: 11; 2024: 5; 2025: 2; 2026: 1.
52 papers.
Sort:
By area:
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2023DINOISER: Diffused Conditional Sequence Learning by Manipulating Noisescited by 50
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarismcited by 38
- 2024A Comprehensive Survey on Data Augmentationcited by 38
- 2022LINGUIST: Language Model Instruction Tuning to Generate Annotated Utterances for Intent Classification and Slot Taggingcited by 29
- 2022Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuningcited by 25
- 2022Hierarchical Sketch Induction for Paraphrase Generationcited by 21
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizercited by 13
- 2022Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priorscited by 13
38 more
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methodscited by 13
- 2021ParaQA: A Question Answering Dataset with Paraphrase Responses for Single-Turn Conversationcited by 12
- 2019An Empirical Comparison on Imitation Learning and Reinforcement Learning for Paraphrase Generationcited by 11
- 2023ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translationcited by 11
- 2021Unsupervised Contextual Paraphrase Generation using Lexical Control and Reinforcement Learningcited by 10
- 2021Towards Document-Level Paraphrase Generation with Sentence Rewriting and Reorderingcited by 10
- 2022Prophet Attention: Predicting Attention with Future Attention for Image Captioningcited by 10
- 2022ExtraPhrase: Efficient Data Augmentation for Abstractive Summarizationcited by 8
- 2021Pushing Paraphrase Away from Original Sentence: A Multi-Round Paraphrase Generation Approachcited by 7
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statementscited by 7
- 2021Contrastive Representation Learning for Exemplar-Guided Paraphrase Generationcited by 6
- 2021From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generationcited by 5
- 2021Simulated annealing for optimization of graphs and sequencescited by 5
- 2023AskIt: Unified Programming Interface for Programming with Large Language Modelscited by 5
- 2025Fake News Detection After LLM Laundering: Measurement and Explanationcited by 4
- 2021Learning to Selectively Learn for Weakly-supervised Paraphrase Generationcited by 3
- 2022Entailment Relation Aware Paraphrase Generationcited by 3
- 2022N-gram Is Back: Residual Learning of Neural Text Generation with n-gram Language Modelcited by 3
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approachescited by 3
- 2021Improving the Diversity of Unsupervised Paraphrasing with Embedding Outputscited by 2
- 2022Multi-Figurative Language Generationcited by 2
- 2023Emotion and Sentiment Guided Paraphrasingcited by 2
- 2023Fine-Tuning Language Models for Scientific Writing Supportcited by 2
- 2024Learning to Adapt to Low-Resource Paraphrase Generationcited by 2
- 2021MAPGN: MAsked Pointer-Generator Network for sequence-to-sequence pre-trainingcited by 1
- 2022Understanding Metrics for Paraphrasingcited by 1
- 2022Continuous Decomposition of Granularity for Neural Paraphrase Generationcited by 1
- 2023Language as a Latent Sequence: deep latent variable models for semi-supervised paraphrase generationcited by 1
- 2023Paraphrase Acquisition from Image Captionscited by 1
- 2023Coherence and Diversity through Noise: Self-Supervised Paraphrase Generation via Structure-Aware Denoisingcited by 1
- 2024Task-Oriented Paraphrase Analyticscited by 1
- 2024Effective Unsupervised Constrained Text Generation based on Perturbed Maskingcited by 1
- 2021Paraphrase Generation as Unsupervised Machine Translationcited by 0
- 2022Visual Information Guided Zero-Shot Paraphrase Generationcited by 0
- 2022Fine-Grained Emotional Paraphrasing along Emotion Gradientscited by 0
- 2022On-the-fly Denoising for Data Augmentation in Natural Language Understandingcited by 0
- 2023IdEALS: Idiomatic Expressions for Advancement of Language Skillscited by 0
- 2024Action Controlled Paraphrasingcited by 0
50 most cited of 52 All 52 (JSON)
- 2026Paraphrase-Induced Output-Mode Collapse: When LLMs Break Character Under Semantically Equivalent Inputs6 May 2026
- 2025SMCLM: Semantically Meaningful Causal Language Modeling for Autoregressive Paraphrase Generation4 Jul 2025
- 2025Fake News Detection After LLM Laundering: Measurement and Explanation29 Jan 2025
- 2024Learning to Adapt to Low-Resource Paraphrase Generation22 Dec 2024
- 2024Action Controlled Paraphrasing18 May 2024
- 2024A Comprehensive Survey on Data Augmentation15 May 2024
- 2024Effective Unsupervised Constrained Text Generation based on Perturbed Masking24 Apr 2024
- 2024Task-Oriented Paraphrase Analytics26 Mar 2024
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approaches19 Sep 2023
- 2023AskIt: Unified Programming Interface for Programming with Large Language Models29 Aug 2023
- 2023Math Word Problem Solving by Generating Linguistic Variants of Problem Statements24 Jun 2023
- 2023Fine-Tuning Language Models for Scientific Writing Support19 Jun 2023
38 more
- 2023Emotion and Sentiment Guided Paraphrasing8 Jun 2023
- 2023ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-Translation26 May 2023
- 2023IdEALS: Idiomatic Expressions for Advancement of Language Skills23 May 2023
- 2023DINOISER: Diffused Conditional Sequence Learning by Manipulating Noises20 Feb 2023
- 2023Coherence and Diversity through Noise: Self-Supervised Paraphrase Generation via Structure-Aware Denoising6 Feb 2023
- 2023Paraphrase Acquisition from Image Captions26 Jan 2023
- 2023Language as a Latent Sequence: deep latent variable models for semi-supervised paraphrase generation5 Jan 2023
- 2022On-the-fly Denoising for Data Augmentation in Natural Language Understanding20 Dec 2022
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methods13 Dec 2022
- 2022Fine-Grained Emotional Paraphrasing along Emotion Gradients30 Oct 2022
- 2022N-gram Is Back: Residual Learning of Neural Text Generation with n-gram Language Model26 Oct 2022
- 2022Prophet Attention: Predicting Attention with Future Attention for Image Captioning19 Oct 2022
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarism7 Oct 2022
- 2022LINGUIST: Language Model Instruction Tuning to Generate Annotated Utterances for Intent Classification and Slot Tagging20 Sep 2022
- 2022Multi-Figurative Language Generation5 Sep 2022
- 2022Continuous Decomposition of Granularity for Neural Paraphrase Generation5 Sep 2022
- 2022Understanding Metrics for Paraphrasing26 May 2022
- 2022Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priors4 Apr 2022
- 2022Entailment Relation Aware Paraphrase Generation20 Mar 2022
- 2022Hierarchical Sketch Induction for Paraphrase Generation7 Mar 2022
- 2022Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning1 Feb 2022
- 2022Visual Information Guided Zero-Shot Paraphrase Generation22 Jan 2022
- 2022ExtraPhrase: Efficient Data Augmentation for Abstractive Summarization14 Jan 2022
- 2021Improving the Diversity of Unsupervised Paraphrasing with Embedding Outputs25 Oct 2021
- 2021Simulated annealing for optimization of graphs and sequences1 Oct 2021
- 2021A Review of Text Style Transfer using Deep Learning30 Sep 2021
- 2021Learning to Selectively Learn for Weakly-supervised Paraphrase Generation25 Sep 2021
- 2021Towards Document-Level Paraphrase Generation with Sentence Rewriting and Reordering15 Sep 2021
- 2021Paraphrase Generation as Unsupervised Machine Translation7 Sep 2021
- 2021Pushing Paraphrase Away from Original Sentence: A Multi-Round Paraphrase Generation Approach4 Sep 2021
- 2021Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation3 Sep 2021
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizer1 Sep 2021
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLP14 Jun 2021
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions30 Apr 2021
- 2021From Solving a Problem Boldly to Cutting the Gordian Knot: Idiomatic Text Generation13 Apr 2021
- 2021Unsupervised Contextual Paraphrase Generation using Lexical Control and Reinforcement Learning23 Mar 2021
- 2021ParaQA: A Question Answering Dataset with Paraphrase Responses for Single-Turn Conversation13 Mar 2021
- 2021MAPGN: MAsked Pointer-Generator Network for sequence-to-sequence pre-training15 Feb 2021
50 newest of 52 All 52 (JSON)
- 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2022How Large Language Models are Transforming Machine-Paraphrased Plagiarismcited by 38
- 2024A Comprehensive Survey on Data Augmentationcited by 38
- 2022LINGUIST: Language Model Instruction Tuning to Generate Annotated Utterances for Intent Classification and Slot Taggingcited by 29
- 2022Hierarchical Sketch Induction for Paraphrase Generationcited by 21
- 2021A Review of Text Style Transfer using Deep Learningcited by 18
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizercited by 13
- 2022Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priorscited by 13
- 2022Paraphrase Identification with Deep Learning: A Review of Datasets and Methodscited by 13
- 2021ParaQA: A Question Answering Dataset with Paraphrase Responses for Single-Turn Conversationcited by 12
12 most cited of 48 All 48 (JSON)
- 2026Paraphrase-Induced Output-Mode Collapse: When LLMs Break Character Under Semantically Equivalent Inputs6 May 2026
- 2025SMCLM: Semantically Meaningful Causal Language Modeling for Autoregressive Paraphrase Generation4 Jul 2025
- 2025Fake News Detection After LLM Laundering: Measurement and Explanation29 Jan 2025
- 2024Learning to Adapt to Low-Resource Paraphrase Generation22 Dec 2024
- 2024Action Controlled Paraphrasing18 May 2024
- 2024A Comprehensive Survey on Data Augmentation15 May 2024
- 2024Effective Unsupervised Constrained Text Generation based on Perturbed Masking24 Apr 2024
- 2024Task-Oriented Paraphrase Analytics26 Mar 2024
- 2023Weakly Supervised Reasoning by Neuro-Symbolic Approaches19 Sep 2023
- 2023AskIt: Unified Programming Interface for Programming with Large Language Models29 Aug 2023
- 2023Fine-Tuning Language Models for Scientific Writing Support19 Jun 2023
- 2023Emotion and Sentiment Guided Paraphrasing8 Jun 2023
12 newest of 48 All 48 (JSON)