mlsanityData to 14 Oct 2026

Large Language Models for History, Philosophy, and Sociology of Science: Interpretive Uses, Methodological Challenges, and Critical Perspectives

arXiv 2506.12242 ↗First posted 13 Jun 2025cs.CL cs.AI cs.CYcited by 2

Not on the map. Why?

Abstract (arXiv)

This paper explores the use of large language models (LLMs) as research tools in the history, philosophy, and sociology of science (HPSS). LLMs are remarkably effective at processing unstructured text and inferring meaning from context, offering new affordances that challenge long-standing divides between computational and interpretive methods. This raises both opportunities and challenges for HPSS, which emphasizes interpretive methodologies and understands meaning as context-dependent, ambiguous, and historically situated. We argue that HPSS is uniquely positioned not only to benefit from LLMs' capabilities but also to interrogate their epistemic assumptions and infrastructural implications. To this end, we first offer a concise primer on LLM architectures and training paradigms tailored to non-technical readers. We frame LLMs not as neutral tools but as epistemic infrastructures that encode assumptions about meaning, context, and similarity, conditioned by their training data, architecture, and patterns of use. We then examine how computational techniques enhanced by LLMs, such as structuring data, detecting patterns, and modeling dynamic processes, can be applied to support interpretive research in HPSS. Our analysis compares full-context and generative models, outlines strategies for domain and task adaptation (e.g., continued pretraining, fine-tuning, and retrieval-augmented generation), and evaluates their respective strengths and limitations for interpretive inquiry in HPSS. We conclude with four lessons for integrating LLMs into HPSS: (1) model selection involves interpretive trade-offs; (2) LLM literacy is foundational; (3) HPSS must define its own benchmarks and corpora; and (4) LLMs should enhance, not replace, interpretive methods.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 113 references that are in the map. First posted on arXiv 13 Jun 2025.

Builds on

40 of 113 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
  6. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  7. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  8. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  9. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
  10. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  11. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
  12. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
28 more
  1. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  2. 2023Can Large Language Models Transform Computational Social Science?cited by 250
  3. 2023Multimodal Large Language Models: A Surveycited by 195
  4. 2020Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic Coherencecited by 121
  5. 2019Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddingscited by 56
  6. 2022Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topicscited by 35
  7. 2024FASTopic: Pretrained Transformer is a Fast, Adaptive, Stable, and Transferable Topic Modelcited by 35
  8. 2024Probing the limitations of multimodal language models for chemistry and materials researchcited by 32
  9. 2019BERT-based Ranking for Biomedical Entity Normalizationcited by 30
  10. 2025Do Large Language Models Solve the Problems of Agent-Based Modeling? A Critical Review of Generative Social Simulationscited by 28
  11. 2022arXivEdits: Understanding the Human Revision Process in Scientific Writingcited by 26
  12. 2023Prompting Large Language Models for Topic Modelingcited by 25
  13. 2023A Survey on Contextualised Semantic Shift Detectioncited by 22
  14. 2022Temporal Attention for Language Modelscited by 21
  15. 2022Contextualized language models for semantic change detection: lessons learnedcited by 20
  16. 2019Towards better substitution-based word sense inductioncited by 18
  17. 2021Statistically significant detection of semantic shifts using contextual word embeddingscited by 14
  18. 2022Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publicationscited by 14
  19. 2025A review on the novelty measurements of academic paperscited by 12
  20. 2024(Chat)GPT v BERT: Dawn of Justice for Semantic Change Detectioncited by 8
  21. 2024Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Typescited by 8
  22. 2021Enhancing Identification of Structure Function of Academic Articles Using Contextual Informationcited by 7
  23. 2024A Survey of Pre-trained Language Models for Processing Scientific Textcited by 7
  24. 2022LitMC-BERT: transformer-based multi-label classification of biomedical literature with an application on COVID-19 literature curationcited by 6
  25. 2023How many preprints have actually been printed and why: a case study of computer science preprints on arXivcited by 6
  26. 2024Meaning at the Planck scale? Contextualized word embeddings for doing history, philosophy, and sociology of sciencecited by 3
  27. 2025In-depth Research Impact Summarization through Fine-Grained Temporal Citation Analysiscited by 2
  28. 2025Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers
  2. 2025A Survey of Large Language Models in Discipline-specific Research: Challenges, Methods and Opportunities
  3. 2026Toward Responsible and Epistemically Grounded Multilingual LLMs for Computational Social Science and Humanities
  4. 2026Mapping the Emerging Social Science of Large Language Models
  5. 2026On Epistemic Diversity in Large Language Models
  6. 2023If the Sources Could Talk: Evaluating Large Language Models for Research Assistance in History
  7. 2025Mechanistic Indicators of Understanding in Large Language Models
  8. 2025What and Whose Knowledge? Measuring Epistemic Diversity in Large Language Models