Displacement Geometry Captures Platonic Shared Reality Across Models and Modalities
Not on the map. Why?
Abstract (arXiv)
The Platonic Representation Hypothesis (PRH) claims that independently trained models converge on a shared statistical model of reality, yet recent work finds only weak pointwise similarity between models. In this paper, we show that what models share is not the location of samples in representation space, but the directions (displacement vectors) between them. Under a single orthogonal alignment--rotation and reflection only--these displacement vectors are substantially preserved across 44 independently trained vision and language encoders spanning modalities and asymmetric capability pairs, consistent with the PRH evidence. The samples' absolute positions are not, consistent with recent counter-evidence. Both arise from a single decomposition: representations split into a shared semantic component that is linearly aligned across models, and a private capability component that is not. We trace this geometry to concept-level structure: within a model, parent concepts are orthogonal to their child variation vectors; across models, concept displacements are parallel. Our theory falsifiably predicts (and experiments confirm) that fine-tuning preserves pointwise similarity but collapses displacement, and that relational distillation does the opposite. A major implication is that, because semantics align linearly but capabilities do not, capabilities can be imported from one model to another using a single cached forward pass through the source. We call this Shadow Casting. As a proof of concept, our SHADOWCLIP instantiation outperforms strong fine-tuned baselines at orders of magnitude less compute. A cache can be released alongside open model weights, letting one model's capabilities be downloaded and imported into any number of other models without fine-tuning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 33 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
27 of 33 references.
References · 27
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020GLU Variants Improve Transformercited by 1,804
- 2022Toy Models of Superpositioncited by 971
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2019Similarity-Preserving Knowledge Distillationcited by 516
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
- 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
- 2022Relative representations enable zero-shot latent space communicationcited by 191
- 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
- 2023Getting aligned on representational alignmentcited by 143
15 more
- 2024DreamLIP: Language-Image Pre-training with Long Captionscited by 72
- 2023Latent Space Translation via Semantic Alignmentcited by 52
- 2022ASIF: Coupled Data Turns Unimodal Models to Multimodal Without Trainingcited by 47
- 2026Revisiting the Platonic Representation Hypothesis: An Aristotelian Viewcited by 44
- 2024Assessing and Learning Alignment of Unimodal Vision and Language Modelscited by 32
- 2025Understanding the Emergence of Multimodal Representation Alignmentcited by 31
- 2023Do Vision and Language Models Share Concepts? A Vector Space Alignment Studycited by 27
- 2025The Universal Weight Subspace Hypothesiscited by 24
- 2023Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Modelcited by 19
- 2026Back into Plato's Cave: Examining Cross-modal Representational Convergence at Scalecited by 16
- 2025Words That Make Language Models Perceivecited by 7
- 2024Better Language Models Exhibit Higher Visual Alignmentcited by 2
- 2026Compositional Generalization Requires Linear, Orthogonal Representations in Vision Embedding Modelscited by 2
- 2026LLM2Vec-Gen: Generative Embeddings from Large Language Modelscited by 2
- 2026Modulating Cross-Modal Convergence with Single-Stimulus, Intra-Modal Dispersioncited by 1
Built on by
Not cited yet.