Improving Topic Models with Latent Feature Word Representations
Not on the map. Why?
Abstract (arXiv)
Probabilistic topic models are widely used to discover latent topics in document collections, while latent feature vector representations of words have been used to obtain high performance in many NLP tasks. In this paper, we extend two different Dirichlet multinomial topic models by incorporating latent feature vector representations of words trained on very large corpora to improve the word-topic mapping learnt on a smaller corpus. Experimental results show that by using information from the external corpora, our new models produce significant improvements on topic coherence, document clustering and document classification tasks, especially on datasets with few or short documents.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 10; 2023: 6; 2024: 2; 2025: 3.
28 papers.
Sort:
By area:
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherencecited by 74
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2022Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddingscited by 36
- 2022Topic Discovery via Latent Space Clustering of Pretrained Language Model Representationscited by 34
- 2023vONTSS: vMF based semi-supervised neural topic modeling with optimal transportcited by 16
- 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLMcited by 16
- 2022HyperMiner: Topic Taxonomy Mining with Hyperbolic Embeddingcited by 15
- 2022Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contextscited by 12
- 2022Seed-Guided Topic Discovery with Out-of-Vocabulary Seedscited by 7
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modelingcited by 7
- 2021Multi-source Neural Topic Modeling in Multi-view Embedding Spacescited by 4
16 more
- 2022DGNet: Distribution Guided Efficient Learning for Oil Spill Image Segmentationcited by 4
- 2021Short Text Clustering with Transformerscited by 3
- 2021Evaluation of Thematic Coherence in Microblogscited by 3
- 2024Neural-Bayesian Program Learning for Few-shot Dialogue Intent Parsingcited by 2
- 2022Enhance Topics Analysis based on Keywords Propertiescited by 1
- 2022Revealing Patient-Reported Experiences in Healthcare from Social Media using the DAPMAV Frameworkcited by 1
- 2022Chronic pain patient narratives allow for the estimation of current pain intensitycited by 1
- 2023Efficient and Flexible Topic Modeling using Pretrained Embeddings and Bag of Sentencescited by 1
- 2023Towards Generalising Neural Topical Representationscited by 1
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Modelscited by 1
- 2021Chronic Pain and Language: A Topic Modelling Approach to Personal Pain Descriptionscited by 0
- 2021Bilingual Topic Models for Comparable Corporacited by 0
- 2023How People Respond to the COVID-19 Pandemic on Twitter: A Comparative Analysis of Emotional Expressions from US and Indiacited by 0
- 2024A Novel Method for News Article Event-Based Embeddingcited by 0
- 2025Fine-Tuning Topics through Weighting Aspect Keywordscited by 0
- 2025Interpretable Topic Extraction and Word Embedding Learning using row-stochastic DEDICOMcited by 0
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models8 Sep 2025
- 2025Interpretable Topic Extraction and Word Embedding Learning using row-stochastic DEDICOM22 Jul 2025
- 2025Fine-Tuning Topics through Weighting Aspect Keywords12 Feb 2025
- 2024Neural-Bayesian Program Learning for Few-shot Dialogue Intent Parsing8 Oct 2024
- 2024A Novel Method for News Article Event-Based Embedding20 May 2024
- 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM23 Oct 2023
- 2023Towards Generalising Neural Topical Representations24 Jul 2023
- 2023vONTSS: vMF based semi-supervised neural topic modeling with optimal transport3 Jul 2023
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling16 May 2023
- 2023How People Respond to the COVID-19 Pandemic on Twitter: A Comparative Analysis of Emotional Expressions from US and India19 Mar 2023
- 2023Efficient and Flexible Topic Modeling using Pretrained Embeddings and Bag of Sentences6 Feb 2023
- 2022DGNet: Distribution Guided Efficient Learning for Oil Spill Image Segmentation19 Dec 2022
16 more
- 2022Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contexts12 Dec 2022
- 2022Chronic pain patient narratives allow for the estimation of current pain intensity31 Oct 2022
- 2022HyperMiner: Topic Taxonomy Mining with Hyperbolic Embedding16 Oct 2022
- 2022Revealing Patient-Reported Experiences in Healthcare from Social Media using the DAPMAV Framework9 Oct 2022
- 2022Seed-Guided Topic Discovery with Out-of-Vocabulary Seeds4 May 2022
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedure11 Mar 2022
- 2022Enhance Topics Analysis based on Keywords Properties9 Mar 2022
- 2022Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings3 Mar 2022
- 2022Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations9 Feb 2022
- 2021Bilingual Topic Models for Comparable Corpora30 Nov 2021
- 2021Chronic Pain and Language: A Topic Modelling Approach to Personal Pain Descriptions1 Sep 2021
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherence5 Jul 2021
- 2021Evaluation of Thematic Coherence in Microblogs30 Jun 2021
- 2021Multi-source Neural Topic Modeling in Multi-view Embedding Spaces17 Apr 2021
- 2021Topic Modelling Meets Deep Neural Networks: A Survey28 Feb 2021
- 2021Short Text Clustering with Transformers31 Jan 2021
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherencecited by 74
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2022Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddingscited by 36
- 2022Topic Discovery via Latent Space Clustering of Pretrained Language Model Representationscited by 34
- 2023vONTSS: vMF based semi-supervised neural topic modeling with optimal transportcited by 16
- 2022HyperMiner: Topic Taxonomy Mining with Hyperbolic Embeddingcited by 15
- 2022Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contextscited by 12
- 2022Seed-Guided Topic Discovery with Out-of-Vocabulary Seedscited by 7
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modelingcited by 7
- 2021Multi-source Neural Topic Modeling in Multi-view Embedding Spacescited by 4
- 2022DGNet: Distribution Guided Efficient Learning for Oil Spill Image Segmentationcited by 4
12 most cited of 27 All 27 (JSON)
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models8 Sep 2025
- 2025Interpretable Topic Extraction and Word Embedding Learning using row-stochastic DEDICOM22 Jul 2025
- 2025Fine-Tuning Topics through Weighting Aspect Keywords12 Feb 2025
- 2024Neural-Bayesian Program Learning for Few-shot Dialogue Intent Parsing8 Oct 2024
- 2024A Novel Method for News Article Event-Based Embedding20 May 2024
- 2023Towards Generalising Neural Topical Representations24 Jul 2023
- 2023vONTSS: vMF based semi-supervised neural topic modeling with optimal transport3 Jul 2023
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling16 May 2023
- 2023How People Respond to the COVID-19 Pandemic on Twitter: A Comparative Analysis of Emotional Expressions from US and India19 Mar 2023
- 2023Efficient and Flexible Topic Modeling using Pretrained Embeddings and Bag of Sentences6 Feb 2023
- 2022DGNet: Distribution Guided Efficient Learning for Oil Spill Image Segmentation19 Dec 2022
- 2022Effective Seed-Guided Topic Discovery by Integrating Multiple Types of Contexts12 Dec 2022
12 newest of 27 All 27 (JSON)