Geometric Signatures of Conceptual Reorganization: A Counterfactual Embedding Framework for Detecting Scientific Revolutions
Not on the map. Why?
Abstract (arXiv)
We introduce document embedding geometry as a quantitative observable of conceptual reorganization and develop a counterfactual ablation framework for measuring how individual concepts influence the organization of scientific knowledge, providing a quantitative framework for detecting scientific revolutions. The observable is defined by the geometric perturbation induced when removing documents associated with a candidate concept from the embedding space before and after its historical emergence. Statistical validation is performed using five historical case studies spanning physics, mathematics, and machine learning: special relativity, G"odel's incompleteness theorems, the Higgs mechanism, deep learning, and the attention mechanism underlying transformer architectures. Across the historical case studies, the framework identifies measurable geometric signatures associated with conceptual reorganization, while the validation studies expose important limitations arising from document assignment and sparse historical data. These results establish embedding geometry as a medium for quantifying conceptual reorganization, providing a new approach for studying how scientific fields restructure over time.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 36 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
10 of 36 references.
References · 10
- 2017Attention Is All You Needcited by 60,361
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 372
- 2016Diachronic Word Embeddings Reveal Statistical Laws of Semantic Changecited by 221
- 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
- 2018Diachronic word embeddings and semantic shifts: a surveycited by 92
- 2020Analysing Lexical Semantic Change with Contextualised Word Representationscited by 92
Built on by
Not cited yet.