XTRA: Cross-Lingual Topic Modeling with Topic and Representation Alignments
Not on the map. Why?
Abstract (arXiv)
Cross-lingual topic modeling aims to uncover shared semantic themes across languages. Several methods have been proposed to address this problem, leveraging both traditional and neural approaches. While previous methods have achieved some improvements in topic diversity, they often struggle to ensure high topic coherence and consistent alignment across languages. We propose XTRA (Cross-Lingual Topic Modeling with Topic and Representation Alignments), a novel framework that unifies Bag-of-Words modeling with multilingual embeddings. XTRA introduces two core components: (1) representation alignment, aligning document-topic distributions via contrastive learning in a shared semantic space; and (2) topic alignment, projecting topic-word distributions into the same space to enforce crosslingual consistency. This dual mechanism enables XTRA to learn topics that are interpretable (coherent and diverse) and well-aligned across languages. Experiments on multilingual corpora confirm that XTRA significantly outperforms strong baselines in topic coherence, diversity, and alignment quality. Code and reproducible scripts are available at https: //github.com/tienphat140205/XTRA.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 55 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
25 of 55 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2020InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Trainingcited by 237
- 2019Topic Modeling in Embedding Spacescited by 224
- 2017Autoencoding Variational Inference For Topic Modelscited by 168
- 2020Top2Vec: Distributed Representations of Topicscited by 124
- 2020Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherencecited by 121
- 2020Cross-lingual Contextualized Topic Models with Zero-shot Learningcited by 66
- 2019Topic Modeling with Wasserstein Autoencoderscited by 53
13 more
- 2020Neural Topic Model via Optimal Transportcited by 50
- 2021Contrastive Learning for Neural Topic Modelcited by 48
- 2023Effective Neural Topic Modeling with Embedding Clustering Regularizationcited by 46
- 2019Dirichlet Variational Autoencodercited by 43
- 2020Improving Neural Topic Models using Knowledge Distillationcited by 25
- 2023InfoCTM: A Mutual Information Maximization Perspective of Cross-Lingual Topic Modelingcited by 24
- 2024Topic Modeling as Multi-Objective Contrastive Optimizationcited by 12
- 2024NeuroMax: Enhancing Neural Topic Modeling via Maximizing Mutual Information and Group Topic Regularizationcited by 9
- 2021Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modelingcited by 8
- 2020Bag of biterms modeling for short textscited by 4
- 2024GloCOM: A Short Text Neural Topic Model via Global Clustering Contextcited by 4
- 2024Refining Dimensions for Improving Clustering-based Cross-lingual Topic Modelscited by 3
- 2018Lessons from the Bible on Modern Topics: Low-Resource Multilingual Topic Model Evaluationcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MIPIC: Matryoshka Representation Learning via Self-Distilled Intra-Relational and Progressive Information Chainingcited by 2
- 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Modelscited by 1
- 2026TokenRatio: Principled Token-Level Preference Optimization via Ratio Matchingcited by 0
- 2026TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching12 May 2026
- 2026LLM-XTM: Enhancing Cross-Lingual Topic Models with Large Language Models5 May 2026
- 2026MIPIC: Matryoshka Representation Learning via Self-Distilled Intra-Relational and Progressive Information Chaining27 Apr 2026