Cross-lingual Contextualized Topic Models with Zero-shot Learning
Not on the map. Why?
Abstract (arXiv)
Many data sets (e.g., reviews, forums, news, etc.) exist parallelly in multiple languages. They all cover the same content, but the linguistic differences make it impossible to use traditional, bag-of-word-based topic models. Models have to be either single-language or suffer from a huge, but extremely sparse vocabulary. Both issues can be addressed by transfer learning. In this paper, we introduce a zero-shot cross-lingual topic model. Our model learns topics on one language (here, English), and predicts them for unseen documents in different languages (here, Italian, French, German, and Portuguese). We evaluate the quality of the topic predictions for the same document in different languages. Our results show that the transferred topics are coherent and stable across languages, which suggests exciting future research directions.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 13; 2023: 16; 2024: 12; 2025: 19; 2026: 5.
66 papers.
Sort:
By area:
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2022Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topicscited by 35
- 2023InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modelingcited by 24
- 2023Prompting Large Language Models for Topic Modelingcited by 24
- 2024A Survey on Neural Topic Models: Methods, Applications, and Challengescited by 18
- 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modelingcited by 16
- 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLMcited by 16
- 2022Are Neural Topic Models Broken?cited by 11
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2024NeuroMax: Enhancing Neural Topic Modeling via Maximizing Mutual Information and Group Topic Regularizationcited by 9
- 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modelingcited by 8
- 2024Semantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithmscited by 8
38 more
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modelingcited by 7
- 2025Model Directions, Not Words: Mechanistic Topic Models Using Sparse Autoencoderscited by 7
- 2022Multilingual and Multimodal Topic Modelling with Pretrained Embeddingscited by 6
- 2022Unsupervised Opinion Summarization Using Approximate Geodesicscited by 5
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Modelscited by 5
- 2023PromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Modelscited by 5
- 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluationcited by 5
- 2025Labeling Free-text Data using Language Model Ensemblescited by 5
- 2024GINopic: Topic Modeling with Graph Isomorphism Networkcited by 4
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluationcited by 4
- 2025CEMTM: Contextual Embedding-based Multimodal Topic Modelingcited by 4
- 2022Human in the loop: How to effectively create coherent topics by manually labeling only a few documents per classcited by 3
- 2024Refining Dimensions for Improving Clustering-based Cross-lingual Topic Modelscited by 3
- 2025XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignmentscited by 3
- 2025Sparse Autoencoders are Topic Modelscited by 3
- 2023MMT: A Multilingual and Multi-Topic Indian Social Media Datasetcited by 2
- 2023Bridging Nations: Quantifying the Role of Multilinguals in Communication on Social Mediacited by 2
- 2024Context is Key(NMF): Modelling Topical Information Dynamics in Chinese Diaspora Mediacited by 2
- 2025Semantic-Driven Topic Modeling for Analyzing Creativity in Virtual Brainstormingcited by 2
- 2022Twitter-Demographer: A Flow-based Tool to Enrich Twitter Datacited by 1
- 2022TSM: Measuring the Enticement of Honeyfiles with Natural Language Processingcited by 1
- 2022ProSiT! Latent Variable Discovery with PROgressive SImilarity Thresholdscited by 1
- 2023Characterizing Financial Market Coverage using Artificial Intelligencecited by 1
- 2023Improving Neural Topic Models with Wasserstein Knowledge Distillationcited by 1
- 2023Topics in the Haystack: Extracting and Evaluating Topics beyond Coherencecited by 1
- 2023Reinforcement Learning for Topic Modelscited by 1
- 2023Towards Generalising Neural Topical Representationscited by 1
- 2024Probabilistic Topic Modelling with Transformer Representationscited by 1
- 2024GLIMMER: Incorporating Graph and Lexical Features in Unsupervised Multi-Document Summarizationcited by 1
- 2024Multilingual Topic Classification in X: Dataset and Analysiscited by 1
- 2024Tethering Broken Themes: Aligning Neural Topic Models with Labels and Authorscited by 1
- 2025Recommending the right academic programs: An interest mining approach using BERTopiccited by 1
- 2025S2WTM: Spherical Sliced-Wasserstein Autoencoder for Topic Modelingcited by 1
- 2025Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Mediacited by 1
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Modelscited by 1
- 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Modelscited by 1
- 2022One Configuration to Rule Them All? Towards Hyperparameter Transfer in Topic Models using Multi-Objective Bayesian Optimizationcited by 0
- 2022Automatic Scene-based Topic Channel Construction System for E-Commercecited by 0
50 most cited of 66 All 66 (JSON)
- 2026Beyond Top Words: MonoTM for Topic Modeling with Interpretable Monosemantic Features9 Sep 2026
- 2026Domain-Agnostic Neural Topic Modeling with Contextual Token-Level Semantic Graph Representation17 Aug 2026
- 2026Trilingual Topic Modeling of Sri Lankan Parliamentary Debates18 Jun 2026
- 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Models5 May 2026
- 2026Improving Topic Modeling by Distilling Soft Labels from Language Models20 Feb 2026
- 2025TopiCLEAR: Adaptive embedding clustering for interpretable topic discovery from short texts7 Dec 2025
- 2025Sparse Autoencoders are Topic Models20 Nov 2025
- 2025XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments3 Oct 2025
- 2025Semantic-Driven Topic Modeling for Analyzing Creativity in Virtual Brainstorming20 Sep 2025
- 2025CEMTM: Contextual Embedding-based Multimodal Topic Modeling14 Sep 2025
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models8 Sep 2025
- 2025Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Media5 Sep 2025
38 more
- 2025TMT: A Simple Way to Translate Topic Models Using Dictionaries31 Aug 2025
- 2025Continual Neural Topic Model21 Aug 2025
- 2025Model Directions, Not Words: Mechanistic Topic Models Using Sparse Autoencoders31 Jul 2025
- 2025S2WTM: Spherical Sliced-Wasserstein Autoencoder for Topic Modeling16 Jul 2025
- 2025Understanding Cross-Domain Adaptation in Low-Resource Topic Modeling9 Jun 2025
- 2025Constrained Non-negative Matrix Factorization for Guided Topic Modeling of Minority Topics22 May 2025
- 2025topicwizard -- a Modern, Model-agnostic Framework for Topic Model Visualization and Interpretation19 May 2025
- 2025Evaluating Negative Sampling Approaches for Neural Topic Models23 Mar 2025
- 2025Poisson-Process Topic Model for Integrating Knowledge from Pre-trained Language Models22 Mar 2025
- 2025Bridging the Evaluation Gap: Leveraging Large Language Models for Topic Model Evaluation11 Feb 2025
- 2025Labeling Free-text Data using Language Model Ensembles14 Jan 2025
- 2025Recommending the right academic programs: An interest mining approach using BERTopic11 Jan 2025
- 2024Refining Dimensions for Improving Clustering-based Cross-lingual Topic Models17 Dec 2024
- 2024Tethering Broken Themes: Aligning Neural Topic Models with Labels and Authors22 Oct 2024
- 2024Context is Key(NMF): Modelling Topical Information Dynamics in Chinese Diaspora Media16 Oct 2024
- 2024Multilingual Topic Classification in X: Dataset and Analysis4 Oct 2024
- 2024Semantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithms30 Sep 2024
- 2024NeuroMax: Enhancing Neural Topic Modeling via Maximizing Mutual Information and Group Topic Regularization29 Sep 2024
- 2024GLIMMER: Incorporating Graph and Lexical Features in Unsupervised Multi-Document Summarization19 Aug 2024
- 2024S3 -- Semantic Signal Separation13 Jun 2024
- 2024GINopic: Topic Modeling with Graph Isomorphism Network2 Apr 2024
- 2024Neural Multimodal Topic Modeling: A Comprehensive Evaluation26 Mar 2024
- 2024Probabilistic Topic Modelling with Transformer Representations6 Mar 2024
- 2024A Survey on Neural Topic Models: Methods, Applications, and Challenges27 Jan 2024
- 2023Prompting Large Language Models for Topic Modeling15 Dec 2023
- 2023PromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Models11 Dec 2023
- 2023Labeled Interactive Topic Models15 Nov 2023
- 2023DeTiME: Diffusion-Enhanced Topic Modeling using Encoder-decoder based LLM23 Oct 2023
- 2023Beyond original Research Articles Categorization via NLP13 Sep 2023
- 2023Towards Generalising Neural Topical Representations24 Jul 2023
- 2023Diversity-Aware Coherence Loss for Improving Neural Topic Models25 May 2023
- 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modeling19 May 2023
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modeling16 May 2023
- 2023Reinforcement Learning for Topic Models8 May 2023
- 2023Bridging Nations: Quantifying the Role of Multilinguals in Communication on Social Media7 Apr 2023
- 2023InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modeling7 Apr 2023
- 2023MMT: A Multilingual and Multi-Topic Indian Social Media Dataset2 Apr 2023
- 2023Topics in the Haystack: Extracting and Evaluating Topics beyond Coherence30 Mar 2023
50 newest of 66 All 66 (JSON)
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2022Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topicscited by 35
- 2023InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modelingcited by 24
- 2023Prompting Large Language Models for Topic Modelingcited by 24
- 2024A Survey on Neural Topic Models: Methods, Applications, and Challengescited by 18
- 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modelingcited by 16
- 2022Are Neural Topic Models Broken?cited by 11
- 2022Challenges and Opportunities in Information Manipulation Detection: An Examination of Wartime Russian Mediacited by 10
- 2024NeuroMax: Enhancing Neural Topic Modeling via Maximizing Mutual Information and Group Topic Regularizationcited by 9
- 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modelingcited by 8
- 2024Semantic-Driven Topic Modeling Using Transformer-Based Embeddings and Clustering Algorithmscited by 8
- 2023CWTM: Leveraging Contextualized Word Embeddings from BERT for Neural Topic Modelingcited by 7
12 most cited of 65 All 65 (JSON)
- 2026Beyond Top Words: MonoTM for Topic Modeling with Interpretable Monosemantic Features9 Sep 2026
- 2026Domain-Agnostic Neural Topic Modeling with Contextual Token-Level Semantic Graph Representation17 Aug 2026
- 2026Trilingual Topic Modeling of Sri Lankan Parliamentary Debates18 Jun 2026
- 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Models5 May 2026
- 2026Improving Topic Modeling by Distilling Soft Labels from Language Models20 Feb 2026
- 2025TopiCLEAR: Adaptive embedding clustering for interpretable topic discovery from short texts7 Dec 2025
- 2025Sparse Autoencoders are Topic Models20 Nov 2025
- 2025XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments3 Oct 2025
- 2025Semantic-Driven Topic Modeling for Analyzing Creativity in Virtual Brainstorming20 Sep 2025
- 2025CEMTM: Contextual Embedding-based Multimodal Topic Modeling14 Sep 2025
- 2025Toward Purpose-oriented Topic Model Evaluation enabled by Large Language Models8 Sep 2025
- 2025Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Media5 Sep 2025
12 newest of 65 All 65 (JSON)