mlsanityData to 7 Oct 2026

Locating the Leading Edge of Cultural Change

arXiv 2411.15068 ↗First posted 22 Nov 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Measures of textual similarity and divergence are increasingly used to study cultural change. But which measures align, in practice, with social evidence about change? We apply three different representations of text (topic models, document embeddings, and word-level perplexity) to three different corpora (literary studies, economics, and fiction). In every case, works by highly-cited authors and younger authors are textually ahead of the curve. We don't find clear evidence that one representation of text is to be preferred over the others. But alignment with social evidence is strongest when texts are represented through the top quartile of passages, suggesting that a text's impact may depend more on its most forward-looking moments than on sustaining a high level of innovation throughout.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 9 of its 22 references that are in the map. First posted on arXiv 22 Nov 2024.

Builds on

9 of 22 references.

References · 9

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 705
  5. 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
  6. 2023The Semantic Scholar Open Data Platformcited by 109
  7. 2017Individuals, Institutions, and Innovation in the Debates of the French Revolutioncited by 10
  8. 2019Do we measure novelty when we analyze unusual combinations of cited references? A validation study of bibliometric novelty indicators based on F1000Prime datacited by 7
  9. 2023Computational thematics: Comparing algorithms for clustering the genres of literary fictioncited by 5

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.