mlsanityData to 14 Oct 2026

Computational conceptual history of scientific concepts: From early digital methods to LLMs

arXiv 2606.04118 ↗First posted 2 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This article situates large language models (LLMs) within the longer history of computational approaches to concept analysis in the history, philosophy, and sociology of science (HPSS). We examine what LLMs add to existing methods, how they inherit longstanding problems, and review recent case studies that employ them. In the first part, we reconstruct computational conceptual history before LLMs by bringing together three strands of work: early digital methods in HPSS, distributional approaches from digital history and related research, and lexical semantic change detection. We provide an overview of the main challenges and opportunities, focusing on corpus construction, operationalization and modelling choices, and evaluation and interpretation. In the second part, we turn to the era of LLMs, starting with a short introduction to LLMs before reviewing LLM-based work on lexical semantic change detection and relevant case studies in HPSS. We then revisit the earlier methodological questions, showing how issues of corpus construction, model choice and training data, operationalization trade-offs, and evaluation and interpretation play out in LLM-based workflows.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 76 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

16 of 76 references.

References · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  4. 2023A Survey on Multimodal Large Language Modelscited by 909
  5. 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
  6. 2018Diachronic word embeddings and semantic shifts: a surveycited by 92
  7. 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
  8. 2019Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shiftcited by 37
  9. 2023A Survey on Contextualised Semantic Shift Detectioncited by 22
  10. 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
  11. 2025Can Language Models Represent the Past without Anachronism?cited by 14
  12. 2014That's sick dude!: Automatic identification of word sense change across different timescalescited by 11
4 more
  1. 2015Co-word Maps and Topic Modeling: A Comparison Using Small and Medium-Sized Corpora (n < 1000)cited by 5
  2. 2024Meaning at the Planck scale? Contextualized word embeddings for doing history, philosophy, and sociology of sciencecited by 3
  3. 2023A comparison of citation-based clustering and topic modeling for science mappingcited by 2
  4. 2024Astro-HEP-BERT: A bidirectional language model for studying the meanings of concepts in astrophysics and high energy physicscited by 2

Built on by

Not cited yet.