Portable Semantics, Private Dialects: Reuse and Negative Transfer in Latent Communication Between Language-Model Cells
Not on the map. Why?
Abstract (arXiv)
In shared-genome language-model societies, restricted evidence visibility favors reusable, value-indexed latent packet interfaces, whereas the sole high-performing globally visible model in the parent study learned an episode-entangled code. This companion study asks whether independently trained societies share one packet language, where strict zero-shot transfer fails, and whether inherited interface state helps or harms later learning. First, a leakage-controlled causal interoperability audit over all 30 ordered pairs of six independently trained restricted societies -- under sealed held-out structure and a preregistered raw/orthogonal/linear/nonlinear alignment ladder -- shows the six semantically similar interfaces do not form one raw language: one same-initialization pair is exactly interoperable in both directions, a second shows asymmetric partial compatibility, and all 26 cross-initialization directions fail every frozen alignment rung. Second, within the tested decomposition and a single sealed source formulation, a source-span control localizes strict zero-shot failure to interpretation and execution of the new operator instructions. Third, in a matched adaptation factorial, the globally trained communication interface acts as a severe negative-transfer prior: reinitializing only the packet reader, writer, and mouth raises final depth-three accuracy from 0.169 to 0.857. Fourth, across two restricted checkpoints and two independently frozen target streams each, inherited interfaces never exceeded fresh-interface controls by the preregistered 0.10 margin. All primary conclusions are bounded to a near-transfer 17-state setting; the negative-transfer factorial concerns one globally visible parent-cohort checkpoint, while an appendix adds a post hoc tagged-global twin case study.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
34 of 42 references.
References · 34
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2019Linear Mode Connectivity and the Lottery Ticket Hypothesiscited by 637
- 2022Git Re-Basin: Merging Models modulo Permutation Symmetriescited by 471
- 2021Causal Abstractions of Neural Networkscited by 422
- 2020Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stoppingcited by 384
- 2022The Primacy Bias in Deep Reinforcement Learningcited by 247
- 2014Understanding image representations by measuring their equivariance and equivalencecited by 243
- 2018Characterizing and Avoiding Negative Transfercited by 229
- 2021Revisiting Model Stitching to Compare Neural Representationscited by 209
- 2020"Other-Play" for Zero-Shot Coordinationcited by 198
- 2022Relative representations enable zero-shot latent space communicationcited by 191
- 2017Critical Learning Periods in Deep Neural Networkscited by 79
22 more
- 2021A study on the plasticity of neural networkscited by 44
- 2023Maintaining Plasticity in Deep Continual Learningcited by 43
- 2020Investigating Transferability in Pretrained Language Modelscited by 28
- 2022On the role of population heterogeneity in emergent communicationcited by 24
- 2021Quasi-Equivalence Discovery for Zero-Shot Emergent Communicationcited by 19
- 2025Natural Fingerprints of Large Language Modelscited by 6
- 2026Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLMcited by 5
- 2026StateBridge: Training-free Hidden-state Alignment for Latent Communication in LLM Multi-Agent Systemscited by 5
- 2026A Negative Result on Cross-Model Activation Transfer in a Pythia Multi-Hop Settingcited by 4
- 2025Model Alignment Searchcited by 3
- 2025Unsupervised Translation of Emergent Communicationcited by 3
- 2026When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMscited by 3
- 2026XBridge: Entity-Grounded Latent Bridge for Heterogeneous LLM Communicationcited by 3
- 2026Architecture-Dependent Causal Transfer of Activation States Across Large Language Modelscited by 3
- 2026Frozen Memory Is Not Enough: Rethinking External Memory as Extractioncited by 3
- 2023Context-dependent communication under environmental constraintscited by 2
- 2026Bridging Functional and Representational Similarity via Usable Informationcited by 2
- 2026Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futurescited by 2
- 2026One Adapter Pair per Model: A Universal Activation Interface for Language Modelscited by 2
- 2025Keys in the Weights: Transformer Authentication Using Model-Bound Latent Representationscited by 1
- 2026Beyond Coordinate Gauge: An Audited Protocol for Detecting Donor-Specific Functional Fingerprints after Neural Collapsecited by 1
- 2026Is Inter-Seed Cross-Play Enough? Evaluating the Robustness of Zero-Shot Coordination Algorithms to Implementation Detailscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.