Keys in the Weights: Transformer Authentication Using Model-Bound Latent Representations
Not on the map. Why?
Abstract (arXiv)
We introduce Model-Bound Latent Exchange (MoBLE), a decoder-binding property in Transformer autoencoders formalized as Zero-Shot Decoder Non-Transferability (ZSDN). In identity tasks using iso-architectural models trained on identical data but differing in seeds, self-decoding achieves more than 0.91 exact match and 0.98 token accuracy, while zero-shot cross-decoding collapses to chance without exact matches. This separation arises without injected secrets or adversarial training, and is corroborated by weight-space distances and attention-divergence diagnostics. We interpret ZSDN as model binding, a latent-based authentication and access-control mechanism, even when the architecture and training recipe are public: encoder's hidden state representation deterministically reveals the plaintext, yet only the correctly keyed decoder reproduces it in zero-shot. We formally define ZSDN, a decoder-binding advantage metric, and outline deployment considerations for secure artificial intelligence (AI) pipelines. Finally, we discuss learnability risks (e.g., adapter alignment) and outline mitigations. MoBLE offers a lightweight, accelerator-friendly approach to secure AI deployment in safety-critical domains, including aviation and cyber-physical systems.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 2 Nov 2025.
Builds on
25 of 42 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2016Layer Normalizationcited by 5,579
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2019Similarity of Neural Network Representations Revisitedcited by 1,695
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2023A Watermark for Large Language Modelscited by 667
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2018Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNscited by 585
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
13 more
- 2021The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networkscited by 285
- 2017Embedding Watermarks into Deep Neural Networkscited by 227
- 2017An Introduction to Deep Learning for the Physical Layercited by 227
- 2015Convergent Learning: Do different neural networks learn the same representations?cited by 215
- 2021Revisiting Model Stitching to Compare Neural Representationscited by 203
- 2023On the Reliability of Watermarks for Large Language Modelscited by 170
- 2023Stitchable Neural Networkscited by 26
- 2023Primer: Fast Private Transformer Inference on Encrypted Datacited by 19
- 2022Image and Model Transformation with Secret Key for Vision Transformercited by 12
- 2016Learning to Protect Communications with Adversarial Neural Cryptographycited by 11
- 2023Model Stitching: Looking For Functional Similarity Between Representationscited by 10
- 2023Block-Wise Encryption for Reliable Vision Transformer modelscited by 3
- 2025Private Transformer Inference in MLaaS: A Surveycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.