Large Language Model and Formal Concept Analysis: a comparative study for Topic Modeling
Not on the map. Why?
Abstract (arXiv)
Topic modeling is a research field finding increasing applications: historically from document retrieving, to sentiment analysis and text summarization. Large Language Models (LLM) are currently a major trend in text processing, but few works study their usefulness for this task. Formal Concept Analysis (FCA) has recently been presented as a candidate for topic modeling, but no real applied case study has been conducted. In this work, we compare LLM and FCA to better understand their strengths and weakneses in the topic modeling field. FCA is evaluated through the CREA pipeline used in past experiments on topic modeling and visualization, whereas GPT-5 is used for the LLM. A strategy based on three prompts is applied with GPT-5 in a zero-shot setup: topic generation from document batches, merging of batch results into final topics, and topic labeling. A first experiment reuses the teaching materials previously used to evaluate CREA, while a second experiment analyzes 40 research articles in information systems to compare the extracted topics with the underling subfields.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 48 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
12 of 48 references.
References · 12
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2023A Survey of Large Language Modelscited by 2,537
- 2019Topic Modeling in Embedding Spacescited by 224
- 2023Large Language Models Enable Few-Shot Clusteringcited by 72
- 2023ClusterLLM: Large Language Models as a Guide for Text Clusteringcited by 69
- 2024Large Language Models Offer an Alternative to the Traditional Approach of Topic Modellingcited by 35
- 2023Prompting Large Language Models for Topic Modelingcited by 24
- 2024What Should We Engineer in Prompts? Training Humans in Requirement-Driven LLM Usecited by 24
- 2023Natural Language Decompositions of Implicit Content Enable Better Text Representationscited by 18
- 2023Abstractive Summarization of Large Document Collections Using GPTcited by 6
- 2026CNC-TP: Classifier Nominal Concept Based on Top-Pertinent Attributescited by 1
Built on by
Not cited yet.