HistLens: Mapping Idea Change across Concepts and Corpora
Not on the map. Why?
Abstract (arXiv)
Language change both reflects and shapes social processes, and the semantic evolution of foundational concepts provides a measurable trace of historical and social transformation. Despite recent advances in diachronic semantics and discourse analysis, existing computational approaches often (i) concentrate on a single concept or a single corpus, making findings difficult to compare across heterogeneous sources, and (ii) remain confined to surface lexical evidence, offering insufficient computational and interpretive granularity when concepts are expressed implicitly. We propose HistLens, a unified, SAE-based framework for multi-concept, multi-corpus conceptual-history analysis. The framework decomposes concept representations into interpretable features and tracks their activation dynamics over time and across sources, yielding comparable conceptual trajectories within a shared coordinate system. Experiments on long-span press corpora show that HistLens supports cross-concept, cross-corpus computation of patterns of idea evolution and enables implicit concept computation. By bridging conceptual modeling with interpretive needs, HistLens broadens the analytical perspectives and methodological repertoire available to social science and the humanities for diachronic text analysis.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
19 of 39 references.
References · 19
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Modelscited by 1,359
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 770
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 219
- 2013k-Sparse Autoencoderscited by 209
- 2020Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biasescited by 167
- 2021All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Qualitycited by 150
- 2019The Dynamic Embedded Topic Modelcited by 41
- 2024Disentangling Dense Embeddings with Sparse Autoencoderscited by 19
- 2025LinguaLens: Towards Interpreting Linguistic Mechanisms of Large Language Models via Sparse Auto-Encodercited by 13
- 2023Evolving linguistic divergence on polarizing social mediacited by 6
7 more
- 2023textitSwap and Predict -- Predicting the Semantic Changes in Words across Corpora by Context Swappingcited by 6
- 2024A Discourse Analysis Framework for Legislative and Social Media Debatescited by 3
- 2025Word Embeddings Track Social Group Changes Across 70 Years in Chinacited by 3
- 2025CHRONOBERG: Capturing Language Evolution and Temporal Awareness in Foundation Modelscited by 3
- 2024Dynamic embedded topic models and change-point detection for exploring literary-historical hypothesescited by 2
- 2024News Deja Vu: Connecting Past and Present with Semantic Searchcited by 2
- 2025Identifying Emerging Concepts in Large Corporacited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.