mlsanityData to 14 Oct 2026

Dynamic Topic Modeling for Cross-Corpus Temporal Analysis

arXiv 2608.23284 ↗First posted 24 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Dynamic Embedded Topic Models (D-ETM) provide an interpretable framework for modeling temporal semantic evolution, but cross-corpus comparison remains difficult because topics are often learned independently and aligned only after training, a process that does not guarantee stable topic correspondence across corpora and time. To address this problem, we propose a D-ETM framework that first learns a common dynamic topic space over a merged multi-corpus collection, which we call the shared backbone, then introduces corpus-specific residual adaptation around the frozen backbone without creating separate latent topic spaces. This design preserves a shared topic index for cross-corpus comparison while allowing each corpus to specialize lexically. We evaluate the framework on three temporally structured corpora spanning 97 years: the Corpus of Historical American English, Harvard Business Review, and International Labour Review. Residual adaptation improves corpus-specific fit relative to the shared backbone while preserving the same-index cross-corpus topic trajectories, achieving substantially stronger alignment than full fine-tuning from the same backbone, with 97.5 ± 0.7% versus 17.9 ± 1.1% trajectory Retrieval@1, as well as stronger alignment than independent training with post-hoc Hungarian matching. These results suggest that incorporating topic alignment into the model can support more stable over-time cross-corpus comparisons while retaining corpus-specific lexical variation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 49 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

8 of 49 references.

References · 8

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  3. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  4. 2019Topic Modeling in Embedding Spacescited by 224
  5. 2020Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherencecited by 121
  6. 2018The Geometry of Culture: Analyzing Meaning through Word Embeddingscited by 87
  7. 2019The Dynamic Embedded Topic Modelcited by 41
  8. 2023Evaluating Dynamic Topic Modelscited by 4

Built on by

Not cited yet.