Coherence-Aware Neural Topic Modeling
Not on the map. Why?
Abstract (arXiv)
Topic models are evaluated based on their ability to describe documents well (i.e. low perplexity) and to produce topics that carry coherent semantic meaning. In topic modeling so far, perplexity is a direct optimization target. However, topic coherence, owing to its challenging computation, is not optimized for and is only evaluated after training. In this work, under a neural variational inference framework, we propose methods to incorporate a topic coherence objective into the training process. We demonstrate that such a coherence-aware topic model exhibits a similar level of perplexity as baseline models but achieves substantially higher topic coherence.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 6; 2024: 2; 2025: 3; 2026: 2.
26 papers.
Sort:
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherencecited by 74
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2021Contrastive Learning for Neural Topic Modelcited by 48
- 2021Enriching and Controlling Global Semantics for Text Summarizationcited by 20
- 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modelingcited by 8
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modelingcited by 7
- 2021Neural Attention-Aware Hierarchical Topic Modelcited by 6
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Modelscited by 5
- 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluationcited by 5
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluationcited by 4
- 2021SocialVisTUM: An Interactive Visualization Toolkit for Correlated Neural Topic Models on Social Media Opinion Miningcited by 1
- 2022Enhance Topics Analysis based on Keywords Propertiescited by 1
14 more
- 2022Neural Topic Modeling with Deep Mutual Information Estimationcited by 1
- 2022Towards Better Understanding with Uniformity and Explicit Regularization of Embeddings in Embedding-based Neural Topic Modelscited by 1
- 2022ProSiT! Latent Variable Discovery with PROgressive SImilarity Thresholdscited by 1
- 2023You Are What You Talk About: Inducing Evaluative Topics for Personality Analysiscited by 1
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognitioncited by 1
- 2024Enhancing Topic Interpretability for Neural Topic Modeling through Topic-wise Contrastive Learningcited by 1
- 2025DiffETM: Diffusion Process Enhanced Embedded Topic Modelcited by 1
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Modelscited by 1
- 2022One Configuration to Rule Them All? Towards Hyperparameter Transfer in Topic Models using Multi-Objective Bayesian Optimizationcited by 0
- 2022Anchor Prediction: A Topic Modeling Approachcited by 0
- 2023Explainable Topic-Enhanced Argument Mining from Heterogeneous Sourcescited by 0
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classificationcited by 0
- 2026Meta-probabilistic Modelingcited by 0
- 2026Hybrid Classical-Quantum Variational Autoencoder for Neural Topic Modelingcited by 0
- 2026Hybrid Classical-Quantum Variational Autoencoder for Neural Topic Modeling11 Jun 2026
- 2026Meta-probabilistic Modeling8 Jan 2026
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models8 Sep 2025
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluation11 Feb 2025
- 2025DiffETM: Diffusion Process Enhanced Embedded Topic Model1 Jan 2025
- 2024Enhancing Topic Interpretability for Neural Topic Modeling through Topic-wise Contrastive Learning23 Dec 2024
- 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluation26 Mar 2024
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classification29 Aug 2023
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognition23 Jul 2023
- 2023Explainable Topic-Enhanced Argument Mining from Heterogeneous Sources22 Jul 2023
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Models25 May 2023
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling16 May 2023
14 more
- 2023You Are What You Talk About: Inducing Evaluative Topics for Personality Analysis1 Feb 2023
- 2022ProSiT! Latent Variable Discovery with PROgressive SImilarity Thresholds26 Oct 2022
- 2022Towards Better Understanding with Uniformity and Explicit Regularization of Embeddings in Embedding-based Neural Topic Models16 Jun 2022
- 2022Anchor Prediction: A Topic Modeling Approach29 May 2022
- 2022Neural Topic Modeling with Deep Mutual Information Estimation12 Mar 2022
- 2022Enhance Topics Analysis based on Keywords Properties9 Mar 2022
- 2022One Configuration to Rule Them All? Towards Hyperparameter Transfer in Topic Models using Multi-Objective Bayesian Optimization15 Feb 2022
- 2021Contrastive Learning for Neural Topic Model25 Oct 2021
- 2021SocialVisTUM: An Interactive Visualization Toolkit for Correlated Neural Topic Models on Social Media Opinion Mining20 Oct 2021
- 2021Neural Attention-Aware Hierarchical Topic Model14 Oct 2021
- 2021Enriching and Controlling Global Semantics for Text Summarization22 Sep 2021
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherence5 Jul 2021
- 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modeling11 Apr 2021
- 2021Topic Modelling Meets Deep Neural Networks: A Survey28 Feb 2021
- 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherencecited by 74
- 2021Topic Modelling Meets Deep Neural Networks: A Surveycited by 51
- 2021Contrastive Learning for Neural Topic Modelcited by 48
- 2021Enriching and Controlling Global Semantics for Text Summarizationcited by 20
- 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modelingcited by 8
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modelingcited by 7
- 2021Neural Attention-Aware Hierarchical Topic Modelcited by 6
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Modelscited by 5
- 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluationcited by 5
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluationcited by 4
- 2021SocialVisTUM: An Interactive Visualization Toolkit for Correlated Neural Topic Models on Social Media Opinion Miningcited by 1
- 2022Enhance Topics Analysis based on Keywords Propertiescited by 1
12 most cited of 26 All 26 (JSON)
- 2026Hybrid Classical-Quantum Variational Autoencoder for Neural Topic Modeling11 Jun 2026
- 2026Meta-probabilistic Modeling8 Jan 2026
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models8 Sep 2025
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluation11 Feb 2025
- 2025DiffETM: Diffusion Process Enhanced Embedded Topic Model1 Jan 2025
- 2024Enhancing Topic Interpretability for Neural Topic Modeling through Topic-wise Contrastive Learning23 Dec 2024
- 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluation26 Mar 2024
- 2023Classification-Aware Neural Topic Model Combined With Interpretable Analysis -- For Conflict Classification29 Aug 2023
- 2023FATRER: Full-Attention Topic Regularizer for Accurate and Robust Conversational Emotion Recognition23 Jul 2023
- 2023Explainable Topic-Enhanced Argument Mining from Heterogeneous Sources22 Jul 2023
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Models25 May 2023
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling16 May 2023
12 newest of 26 All 26 (JSON)