Topic-Guided Variational Autoencoders for Text Generation
Not on the map. Why?
Abstract (arXiv)
We propose a topic-guided variational autoencoder (TGVAE) model for text generation. Distinct from existing variational autoencoder (VAE) based approaches, which assume a simple Gaussian prior for the latent code, our model specifies the prior as a Gaussian mixture model (GMM) parametrized by a neural topic module. Each mixture component corresponds to a latent topic, which provides guidance to generate sentences under the topic. The neural topic module and the VAE-based neural sequence module in our model are learned jointly. In particular, a sequence of invertible Householder transformations is applied to endow the approximate posterior of the latent code with high flexibility during model inference. Experimental results show that our TGVAE outperforms alternative approaches on both unconditional and conditional text generation, which can generate semantically-meaningful sentences with various topics.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 13; 2022: 9; 2023: 11; 2024: 6; 2025: 3; 2026: 1.
44 papers.
Sort:
By area:
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modelingcited by 67
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2023Controllable Mixed-Initiative Dialogue Generation through Promptingcited by 32
- 2023BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inferencecited by 30
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Modelscited by 27
- 2021Math Word Problem Generation with Mathematical Consistency and Problem Context Constraintscited by 27
- 2023Mixture of Soft Prompts for Controllable Data Generationcited by 23
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Variational Topic Inference for Chest X-Ray Report Generationcited by 16
- 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLMcited by 16
- 2024LLM-based multi-agent poetry generation in non-cooperative environmentscited by 15
32 more
- 2021Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidancecited by 14
- 2021Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classificationcited by 14
- 2021Controllable and Diverse Text Generation in E-commercecited by 13
- 2024Learning to Plan for Language Modeling from Unlabeled Datacited by 12
- 2022Are Neural Topic Models Broken?cited by 11
- 2021Constrained Text Generation with Global Guidance -- Case Study on CommonGencited by 10
- 2022AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modelingcited by 10
- 2023Distributional Learning of Variational AutoEncoder: Application to Synthetic Data Generationcited by 9
- 2021Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priorscited by 8
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commentingcited by 7
- 2022Plug-and-Play Recipe Generation with Content Planningcited by 5
- 2023Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Controlcited by 5
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Modelscited by 5
- 2021EXoN: EXplainable encoder Networkcited by 4
- 2021Learning Graphon Autoencoders for Generative Graph Modelingcited by 4
- 2021CCGG: A Deep Autoregressive Model for Class-Conditional Graph Generationcited by 4
- 2022PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text Generationcited by 4
- 2020Nested-Wasserstein Self-Imitation Learning for Sequence Generationcited by 3
- 2022RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generatorscited by 3
- 2023Revisiting Topic-Guided Language Modelscited by 3
- 2026Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Reviewcited by 3
- 2021TopNet: Learning from Neural Topic Model to Generate Long Storiescited by 2
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoderscited by 1
- 2023Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledgecited by 1
- 2024Membership Inference Attacks and Privacy in Topic Modelingcited by 1
- 2023HICL: Hashtag-Driven In-Context Learning for Social Media Natural Language Understandingcited by 0
- 2023Boosting Summarization with Normalizing Flows and Aggressive Trainingcited by 0
- 2024CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generationscited by 0
- 2024VRDSynth: Synthesizing Programs for Multilingual Visually Rich Document Information Extractioncited by 0
- 2025Learning Extrapolative Sequence Transformations from Markov Chainscited by 0
- 2025Vec2Summ: Text Summarization via Probabilistic Sentence Embeddingscited by 0
- 2025Extrapolated Markov Chain Oversampling Method for Imbalanced Text Classificationcited by 0
- 2026Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Review19 Jan 2026
- 2025Extrapolated Markov Chain Oversampling Method for Imbalanced Text Classification2 Sep 2025
- 2025Vec2Summ: Text Summarization via Probabilistic Sentence Embeddings9 Aug 2025
- 2025Learning Extrapolative Sequence Transformations from Markov Chains26 May 2025
- 2024LLM-based multi-agent poetry generation in non-cooperative environments5 Sep 2024
- 2024VRDSynth: Synthesizing Programs for Multilingual Visually Rich Document Information Extraction9 Jul 2024
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting19 Apr 2024
- 2024Learning to Plan for Language Modeling from Unlabeled Data31 Mar 2024
- 2024Membership Inference Attacks and Privacy in Topic Modeling7 Mar 2024
- 2024CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generations22 Feb 2024
- 2023Revisiting Topic-Guided Language Models4 Dec 2023
- 2023Boosting Summarization with Normalizing Flows and Aggressive Training1 Nov 2023
32 more
- 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM23 Oct 2023
- 2023BayesDiff: Estimating Pixel-wise Uncertainty in Diffusion via Bayesian Inference17 Oct 2023
- 2023HICL: Hashtag-Driven In-Context Learning for Social Media Natural Language Understanding19 Aug 2023
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Models25 May 2023
- 2023Advancing Precise Outline-Conditioned Text Generation with Task Duality and Explicit Outline Control23 May 2023
- 2023Semantic Similarity Measure of Natural Language Text through Machine Learning and a Keyword-Aware Cross-Encoder-Ranking Summarizer -- A Case Study Using UCGIS GIS&T Body of Knowledge17 May 2023
- 2023Controllable Mixed-Initiative Dialogue Generation through Prompting6 May 2023
- 2023Mixture of Soft Prompts for Controllable Data Generation2 Mar 2023
- 2023Distributional Learning of Variational AutoEncoder: Application to Synthetic Data Generation22 Feb 2023
- 2022Plug-and-Play Recipe Generation with Content Planning9 Dec 2022
- 2022An Overview on Controllable Text Generation via Variational Auto-Encoders15 Nov 2022
- 2022Are Neural Topic Models Broken?28 Oct 2022
- 2022PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text Generation7 Oct 2022
- 2022Latent Diffusion Energy-Based Model for Interpretable Text Modeling13 Jun 2022
- 2022Why is constrained neural language generation particularly challenging?11 Jun 2022
- 2022RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generators25 May 2022
- 2022AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling12 May 2022
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models14 Jan 2022
- 2021TopNet: Learning from Neural Topic Model to Generate Long Stories14 Dec 2021
- 2021CCGG: A Deep Autoregressive Model for Class-Conditional Graph Generation7 Oct 2021
- 2021Math Word Problem Generation with Mathematical Consistency and Problem Context Constraints9 Sep 2021
- 2021Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classification26 Aug 2021
- 2021Variational Topic Inference for Chest X-Ray Report Generation15 Jul 2021
- 2021Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidance15 Jun 2021
- 2021Learning Graphon Autoencoders for Generative Graph Modeling29 May 2021
- 2021EXoN: EXplainable encoder Network23 May 2021
- 2021Distantly Supervised Relation Extraction with Sentence Reconstruction and Knowledge Base Priors16 Apr 2021
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Models20 Mar 2021
- 2021Constrained Text Generation with Global Guidance -- Case Study on CommonGen12 Mar 2021
- 2021Topic Modelling Meets Deep Neural Networks: A Survey28 Feb 2021
- 2021Controllable and Diverse Text Generation in E-commerce23 Feb 2021
- 2020Nested-Wasserstein Self-Imitation Learning for Sequence Generation20 Jan 2020
- 2022A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Modelscited by 128
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2023Controllable Mixed-Initiative Dialogue Generation through Promptingcited by 32
- 2021Attribute Alignment: Controlling Text Generation from Pre-trained Language Modelscited by 27
- 2021Math Word Problem Generation with Mathematical Consistency and Problem Context Constraintscited by 27
- 2023Mixture of Soft Prompts for Controllable Data Generationcited by 23
- 2022Why is constrained neural language generation particularly challenging?cited by 19
- 2021Variational Topic Inference for Chest X-Ray Report Generationcited by 16
- 2021Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidancecited by 14
- 2021Latent Space Energy-Based Model of Symbol-Vector Coupling for Text Generation and Classificationcited by 14
- 2021Controllable and Diverse Text Generation in E-commercecited by 13
- 2024Learning to Plan for Language Modeling from Unlabeled Datacited by 12
12 most cited of 38 All 38 (JSON)
- 2026Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Review19 Jan 2026
- 2025Extrapolated Markov Chain Oversampling Method for Imbalanced Text Classification2 Sep 2025
- 2025Vec2Summ: Text Summarization via Probabilistic Sentence Embeddings9 Aug 2025
- 2025Learning Extrapolative Sequence Transformations from Markov Chains26 May 2025
- 2024VRDSynth: Synthesizing Programs for Multilingual Visually Rich Document Information Extraction9 Jul 2024
- 2024Sentiment-oriented Transformer-based Variational Autoencoder Network for Live Video Commenting19 Apr 2024
- 2024Learning to Plan for Language Modeling from Unlabeled Data31 Mar 2024
- 2024CEV-LM: Controlled Edit Vector Language Model for Shaping Natural Language Generations22 Feb 2024
- 2023Revisiting Topic-Guided Language Models4 Dec 2023
- 2023Boosting Summarization with Normalizing Flows and Aggressive Training1 Nov 2023
- 2023HICL: Hashtag-Driven In-Context Learning for Social Media Natural Language Understanding19 Aug 2023
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Models25 May 2023
12 newest of 38 All 38 (JSON)