mlsanityData to 7 Oct 2026

Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling

arXiv 2403.16248 ↗First posted 24 Mar 2024cs.CLcited by 35

Not on the map. Why?

Abstract (arXiv)

Topic modelling, as a well-established unsupervised technique, has found extensive use in automatically detecting significant topics within a corpus of documents. However, classic topic modelling approaches (e.g., LDA) have certain drawbacks, such as the lack of semantic understanding and the presence of overlapping topics. In this work, we investigate the untapped potential of large language models (LLMs) as an alternative for uncovering the underlying topics within extensive text corpora. To this end, we introduce a framework that prompts LLMs to generate topics from a given set of documents and establish evaluation protocols to assess the clustering efficacy of LLMs. Our findings indicate that LLMs with appropriate prompts can stand out as a viable alternative, capable of generating relevant topic titles and adhering to human guidelines to refine and merge topics. Through in-depth experiments and evaluation, we summarise the advantages and constraints of employing LLMs in topic extraction.

Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). Builds on 14 of its 47 references that are in the map. First posted on arXiv 24 Mar 2024.

Builds on

14 of 47 references.

References · 14

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  7. 2019Fine-Tuning Language Models from Human Preferencescited by 2,124
  8. 2021An Explanation of In-context Learning as Implicit Bayesian Inferencecited by 915
  9. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  10. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  11. 2023Benchmarking Large Language Models for News Summarizationcited by 444
  12. 2023Large Language Models are Diverse Role-Players for Summarization Evaluationcited by 62
2 more
  1. 2016Anchored Correlation Explanation: Topic Modeling with Minimal Domain Knowledgecited by 23
  2. 2023VaxxHesitancy: A Dataset for Studying Hesitancy towards COVID-19 Vaccination on Twittercited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 16; 2026: 11.

35 papers.

Sort:

By area:

  1. 2024Neural Topic Modeling with Large Language Models in the Loopcited by 10
  2. 2024Addressing Topic Granularity and Hallucination in Large Language Models for Topic Modellingcited by 7
  3. 2025LLMTaxo: Leveraging Large Language Models for Constructing Taxonomy of Factual Claims from Social Mediacited by 5
  4. 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluationcited by 4
  5. 2025Topic Over Source: The Key to Effective Data Mixing for Language Models Pre-trainingcited by 4
  6. 2025CEMTM: Contextual Embedding-based Multimodal Topic Modelingcited by 4
  7. 2024Topic Classification of Case Law Using a Large Language Model and a New Taxonomy for UK Law: AI Insights into Summary Judgmentcited by 3
  8. 2024Comprehensive Evaluation of Large Language Models for Topic Modelingcited by 3
  9. 2024CAST: Corpus-Aware Self-similarity Enhanced Topic modellingcited by 3
  10. 2025Facts are Harder Than Opinions -- A Multilingual, Comparative Analysis of LLM-Based Fact-Checking Reliabilitycited by 3
  11. 2025AMAQA: A Metadata-based QA Dataset for RAG Systemscited by 2
  12. 2024Capturing research literature attitude towards Sustainable Development Goals: an LLM-based topic modeling approachcited by 1
23 more
  1. 2026MALTopic: Multi-Agent LLM Topic Modeling Frameworkcited by 1
  2. 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Modelscited by 1
  3. 2024fLSA: Learning Semantic Structures in Document Collections Using Foundation Modelscited by 0
  4. 2024Investigating the Impact of Text Summarization on Topic Modelingcited by 0
  5. 2025Contextual Embedding-based Clustering to Identify Topics for Healthcare Service Improvementcited by 0
  6. 2025HAMLET: Healthcare-focused Adaptive Multilingual Learning Embedding-based Topic Modelingcited by 0
  7. 2025Enhancing and Scaling Search Query Datasets for Recommendation Systemscited by 0
  8. 2025Unpacking Generative AI in Education: Computational Modeling of Teacher and Student Perspectives in Social Media Discoursecited by 0
  9. 2025Semantic-Augmented Latent Topic Modeling with LLM-in-the-Loopcited by 0
  10. 2025LLM as Attention-Informed NTM and Topic Modeling as long-input Generation: Interpretability and long-Context Capabilitycited by 0
  11. 2025Populism Meets AI: Advancing Populism Research with LLMscited by 0
  12. 2025Topic-aware Large Language Models for Summarizing the Lived Healthcare Experiences Described in Health Storiescited by 0
  13. 2025Efficient Topic Extraction via Graph-Based Labeling: A Lightweight Alternative to Deep Modelscited by 0
  14. 2025TopicProphet: Prophesies on Temporal Topic Trends and Stockscited by 0
  15. 2026Large Language Model and Formal Concept Analysis: a comparative study for Topic Modelingcited by 0
  16. 2026Improving Topic Modeling by Distilling Soft Labels from Language Modelscited by 0
  17. 2026Disentangling Similarity and Relatedness in Topic Modelscited by 0
  18. 2026Human-Centric Topic Modeling with Goal-Prompted Contrastive Learning and Optimal Transportcited by 0
  19. 2026Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Questcited by 0
  20. 2026Advanced Topic Modeling Techniques for Categorizing Software Vulnerabilitiescited by 0
  21. 2026AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Neutralisation for LLM-Generated News in Automated Journalismcited by 0
  22. 2026Principal Trait Analysis: Towards Deriving "Skills" in Human-AI Collaborationcited by 0
  23. 2026Segment-Level Agentic Topic Modeling for Improved Data Exploration and Resource Efficiencycited by 0