mlsanityData to 7 Oct 2026

Tethering Broken Themes: Aligning Neural Topic Models with Labels and Authors

arXiv 2410.18140 ↗First posted 22 Oct 2024cs.IR cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Topic models are a popular approach for extracting semantic information from large document collections. However, recent studies suggest that the topics generated by these models often do not align well with human intentions. Although metadata such as labels and authorship information are available, it has not yet been effectively incorporated into neural topic models. To address this gap, we introduce FANToM, a novel method to align neural topic models with both labels and authorship information. FANToM allows for the inclusion of this metadata when available, producing interpretable topics and author distributions for each topic. Our approach demonstrates greater expressiveness than conventional topic models by learning the alignment between labels, topics, and authors. Experimental results show that FANToM improves existing models in terms of both topic quality and alignment. Additionally, it identifies author interests and similarities.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 74 references that are in the map. First posted on arXiv 22 Oct 2024.

Builds on

25 of 74 references.

References · 25

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2016Pointer Sentinel Mixture Modelscited by 2,992
  4. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  5. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  6. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  7. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  8. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
  9. 2019Topic Modeling in Embedding Spacescited by 224
  10. 2017Autoencoding Variational Inference For Topic Modelscited by 168
  11. 2015Neural Variational Inference for Text Processingcited by 111
  12. 2021Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherencecited by 74
13 more
  1. 2020Tired of Topic Models? Clusters of Pretrained Word Embeddings Make for Fast and Good Topics too!cited by 73
  2. 2020Cross-lingual Contextualized Topic Models with Zero-shot Learningcited by 66
  3. 2017Neural Models for Documents with Metadatacited by 46
  4. 2023Effective Neural Topic Modeling with Embedding Clustering Regularizationcited by 46
  5. 2024On the Challenges and Opportunities in Generative AIcited by 31
  6. 2020Neural Topic Modeling with Bidirectional Adversarial Trainingcited by 29
  7. 2024HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Predictioncited by 17
  8. 2023A Call for Standardization and Validation of Text Style Transfer Evaluationcited by 13
  9. 2023Text Style Transfer Evaluation Using Large Language Modelscited by 11
  10. 2017MetaLDA: a Topic Model that Efficiently Incorporates Meta informationcited by 6
  11. 2023ANTM: An Aligned Neural Topic Model for Exploring Evolving Topicscited by 6
  12. 2019Discriminative Topic Modeling with Logistic LDAcited by 3
  13. 2021Focusing Knowledge-based Graph Argument Mining via Topic Modelingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.