mlsanityData to 14 Oct 2026

Concept Representations in Vector Space: Quantifying Sharedness and Idiosyncrasy of Meaning

arXiv 2610.15496 ↗First posted 11 Oct 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Concepts are the basic units through which we navigate the world and communicate meaning. But do you and I really mean the same thing when we think or speak about a concept? The present study develops a measurement framework for modeling and analyzing interindividual variation in concept representations through sentence embeddings, dense vector representations mapping entire utterances into a shared geometric space. The framework is developed in a theoretical argument and validated, demonstrated, and subjected to robustness checks in a pre-registered study. Short personal definitions, elicited from N = 125 participants, are encoded as sentence embeddings and submitted pairwise to a crossed random effects model yielding two concept-level quantities: sharedness (Sb), the expected dissimilarity between two randomly drawn individuals, and idiosyncrasy (Ib), the person-specific share of total dyadic variance. Two validity tests support the approach: the embedding space fully recovers concept and domain organization from participant definitions even with the target word excluded, and a parameter-free classifier achieves 0.630 accuracy in a within-participant extensional prediction task against a chance baseline of 0.500 and a consistency ceiling of 0.893. The framework finds theoretically interpretable variation in Sb and establishes Ib as a reliable source of dyadic variance across concepts. Results replicate across three encoders varying in architecture and capacity, providing a reproducible and scalable instrument for the empirical study of meaning variation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 88 references that are in the map. First posted on arXiv 11 Oct 2026.

Builds on

15 of 88 references.

References · 15

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  5. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,463
  6. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  7. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  8. 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
  9. 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
  10. 2020Artificial Intelligence, Values and Alignmentcited by 448
  11. 2023Improving Text Embeddings with Large Language Modelscited by 303
  12. 2025MMTEB: Massive Multilingual Text Embedding Benchmarkcited by 125
3 more
  1. 2025Revealing emergent human-like conceptual representations from language predictioncited by 6
  2. 2023Unsupervised Sentence Representation Learning with Frequency-induced Adversarial Tuning and Incomplete Sentence Filteringcited by 3
  3. 2024Making Sentence Embeddings Robust to User-Generated Contentcited by 1

Built on by

Not cited yet.