Generating Sentences from Disentangled Syntactic and Semantic Spaces
Not on the map. Why?
Abstract (arXiv)
Variational auto-encoders (VAEs) are widely used in natural language generation due to the regularization of the latent space. However, generating sentences from the continuous latent space does not explicitly model the syntactic information. In this paper, we propose to generate sentences from disentangled syntactic and semantic spaces. Our proposed method explicitly models syntactic information in the VAE's latent space by using the linearized tree sequence, leading to better performance of language generation. Additionally, the advantage of sampling in the disentangled syntactic and semantic latent spaces enables us to perform novel applications, such as the unsupervised paraphrase generation and syntax-transfer generation. Experimental results show that our proposed model achieves similar or better performance in various tasks, compared with state-of-the-art related work.
Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 16; 2023: 10; 2024: 6; 2025: 8; 2026: 3.
59 papers.
Sort:
By area:
- 2022Disentangled Representation Learningcited by 111
- 2021Continual Learning for Text Classification with Information Disentanglement Based Regularizationcited by 86
- 2021Tailor: Generating and Perturbing Text with Semantic Controlscited by 67
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
- 2021A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representationscited by 37
- 2022Quality Controlled Paraphrase Generationcited by 31
- 2021Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Modelscited by 22
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasingcited by 22
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2022Hierarchical Sketch Induction for Paraphrase Generationcited by 21
- 2022Why is constrained neural language generation particularly challenging?cited by 19
38 more
- 2023Prompt-Based Editing for Text Style Transfercited by 16
- 2021Improving Formality Style Transfer with Context-Aware Rule Injectioncited by 13
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizercited by 13
- 2022Learning Disentangled Representations of Negation and Uncertaintycited by 13
- 2023Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoningcited by 13
- 2022Learning Disentangled Representations for Natural Language Definitionscited by 12
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Editscited by 10
- 2022Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfercited by 7
- 2023Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networkscited by 6
- 2023Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoderscited by 6
- 2024Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoderscited by 6
- 2024Are there identifiable structural parts in the sentence embedding whole?cited by 6
- 2025Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Textcited by 6
- 2021StyleKQC: A Style-Variant Paraphrase Corpus for Korean Questions and Commandscited by 5
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Surveycited by 5
- 2022Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Rolescited by 5
- 2022Quasi-symbolic Semantic Geometry over Transformer-based Variational AutoEncodercited by 5
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversationscited by 5
- 2022Unsupervised Syntactically Controlled Paraphrase Generation with Abstract Meaning Representationscited by 4
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfercited by 4
- 2024Enhanced Coherence-Aware Network with Hierarchical Disentanglement for Aspect-Category Sentiment Analysiscited by 4
- 2024P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Modelscited by 4
- 2021Learning to Selectively Learn for Weakly-supervised Paraphrase Generationcited by 3
- 2021VIRT: Improving Representation-based Models for Text Matching through Virtual Interactioncited by 3
- 2022Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEscited by 3
- 2023LlaMaVAE: Guiding Large Language Model Generation via Continuous Latent Sentence Spacescited by 3
- 2024Dual-disentangled Deep Multiple Clusteringcited by 3
- 2025Disentangling Feature Structure: A Mathematically Provable Two-Stage Training Dynamics in Transformerscited by 3
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEscited by 3
- 2022Unsupervised Opinion Summarisation in the Wasserstein Spacecited by 2
- 2025Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not applycited by 2
- 2021Unsupervised Representation Disentanglement of Text: An Evaluation on Synthetic Datasetscited by 1
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoderscited by 1
- 2022Accelerating Antimicrobial Peptide Discovery with Latent Structurecited by 1
- 2023Towards Controllable Natural Language Inference through Lexical Inference Typescited by 1
- 2025Robust Drone-View Geo-Localization via Content-Viewpoint Disentanglementcited by 1
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusioncited by 1
- 2022Noun2Verb: Probabilistic frame semantics for word class conversioncited by 0
50 most cited of 59 All 59 (JSON)
- 2026Uncovering Latent Reasoning Strategies in Language Models20 Jul 2026
- 2026Triospect: A Three-Dimensional Framework for Robust Statistical AI-Generated Text Detection Against Diverse Attacks30 Jun 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2025Syntax-Guided Diffusion Language Models with User-Integrated Personalization1 Oct 2025
- 2025Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription28 Sep 2025
- 2025Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply1 Sep 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2025Robust Drone-View Geo-Localization via Content-Viewpoint Disentanglement17 May 2025
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEs29 Mar 2025
- 2025Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Text1 Mar 2025
- 2025Disentangling Feature Structure: A Mathematically Provable Two-Stage Training Dynamics in Transformers28 Feb 2025
- 2024Are there identifiable structural parts in the sentence embedding whole?24 Jun 2024
38 more
- 2024P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models17 Jun 2024
- 2024Action Controlled Paraphrasing18 May 2024
- 2024Enhanced Coherence-Aware Network with Hierarchical Disentanglement for Aspect-Category Sentiment Analysis15 Mar 2024
- 2024Dual-disentangled Deep Multiple Clustering7 Feb 2024
- 2024Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders1 Feb 2024
- 2023LlaMaVAE: Guiding Large Language Model Generation via Continuous Latent Sentence Spaces20 Dec 2023
- 2023Disentangling continuous and discrete linguistic signals in transformer-based sentence embeddings18 Dec 2023
- 2023Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders14 Nov 2023
- 2023Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoning30 Oct 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Towards Controllable Natural Language Inference through Lexical Inference Types7 Aug 2023
- 2023Disentangled Variational Autoencoder for Emotion Recognition in Conversations23 May 2023
- 2023Interpretable Sentence Representation with Variational Autoencoders and Attention4 May 2023
- 2023Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networks2 May 2023
- 2023Prompt-Based Editing for Text Style Transfer27 Jan 2023
- 2022StyleFlow: Disentangle Latent Representations via Normalizing Flow for Unsupervised Text Style Transfer19 Dec 2022
- 2022Accelerating Antimicrobial Peptide Discovery with Latent Structure28 Nov 2022
- 2022Unsupervised Opinion Summarisation in the Wasserstein Space27 Nov 2022
- 2022Disentangled Representation Learning21 Nov 2022
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoders15 Nov 2022
- 2022Unsupervised Syntactically Controlled Paraphrase Generation with Abstract Meaning Representations2 Nov 2022
- 2022Quasi-symbolic Semantic Geometry over Transformer-based Variational AutoEncoder12 Oct 2022
- 2022Learning Disentangled Representations for Natural Language Definitions22 Sep 2022
- 2022Towards Unsupervised Content Disentanglement in Sentence Representations via Syntactic Roles22 Jun 2022
- 2022Why is constrained neural language generation particularly challenging?11 Jun 2022
- 2022Noun2Verb: Probabilistic frame semantics for word class conversion12 May 2022
- 2022Exploiting Inductive Bias in Transformers for Unsupervised Disentanglement of Syntax and Semantics with VAEs12 May 2022
- 2022Towards Robust and Semantically Organised Latent Representations for Unsupervised Text Style Transfer4 May 2022
- 2022Learning Disentangled Representations of Negation and Uncertainty1 Apr 2022
- 2022Quality Controlled Paraphrase Generation21 Mar 2022
- 2022Hierarchical Sketch Induction for Paraphrase Generation7 Mar 2022
- 2021VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction8 Dec 2021
- 2021From Theories on Styles to their Transfer in Text: Bridging the Gap with a Hierarchical Survey29 Oct 2021
- 2021Learning to Selectively Learn for Weakly-supervised Paraphrase Generation25 Sep 2021
- 2021Transferable Persona-Grounded Dialogues via Grounded Minimal Edits16 Sep 2021
- 2021ConRPG: Paraphrase Generation using Contexts as Regularizer1 Sep 2021
- 2021Tailor: Generating and Perturbing Text with Semantic Controls15 Jul 2021
- 2021Unsupervised Representation Disentanglement of Text: An Evaluation on Synthetic Datasets7 Jun 2021
50 newest of 59 All 59 (JSON)
- 2022Disentangled Representation Learningcited by 111
- 2021Continual Learning for Text Classification with Information Disentanglement Based Regularizationcited by 86
- 2021Tailor: Generating and Perturbing Text with Semantic Controlscited by 67
- 2021Generating Syntactically Controlled Paraphrases without Using Annotated Parallel Pairscited by 45
- 2021Transformer-based Conditional Variational Autoencoder for Controllable Story Generationcited by 44
- 2021A Novel Estimator of Mutual Information for Learning to Disentangle Textual Representationscited by 37
- 2022Quality Controlled Paraphrase Generationcited by 31
- 2021Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Modelscited by 22
- 2021Factorising Meaning and Form for Intent-Preserving Paraphrasingcited by 22
- 2021Convex Aggregation for Opinion Summarizationcited by 21
- 2022Hierarchical Sketch Induction for Paraphrase Generationcited by 21
- 2022Why is constrained neural language generation particularly challenging?cited by 19
12 most cited of 56 All 56 (JSON)
- 2026Triospect: A Three-Dimensional Framework for Robust Statistical AI-Generated Text Detection Against Diverse Attacks30 Jun 2026
- 2026Enhancing Visual In-Context Learning by Multi-Faceted Fusion15 Jan 2026
- 2025Disentangling Score Content and Performance Style for Joint Piano Rendering and Transcription28 Sep 2025
- 2025Testing the assumptions about the geometry of sentence embedding spaces: the cosine measure need not apply1 Sep 2025
- 2025Bridging Compositional and Distributional Semantics: A Survey on Latent Semantic Geometry via AutoEncoder25 Jun 2025
- 2025Robust Drone-View Geo-Localization via Content-Viewpoint Disentanglement17 May 2025
- 2025LangVAE and LangSpace: Building and Probing for Language Model VAEs29 Mar 2025
- 2025Decoupling Content and Expression: Two-Dimensional Detection of AI-Generated Text1 Mar 2025
- 2025Disentangling Feature Structure: A Mathematically Provable Two-Stage Training Dynamics in Transformers28 Feb 2025
- 2024Are there identifiable structural parts in the sentence embedding whole?24 Jun 2024
- 2024P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models17 Jun 2024
- 2024Action Controlled Paraphrasing18 May 2024
12 newest of 56 All 56 (JSON)