Tokenized Key-Gated Adapter Routing: A Secure Access Control Mechanism Against Private Data Leakage in LLMs
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) are increasingly deployed in privacy-critical domains (e.g., healthcare, finance, and government), but their propensity to memorize and disclose personally identifiable information (PII) poses serious security and compliance risks. Existing defenses typically force a trade-off between model utility, privacy protection, and access to fine-tuned private knowledge. We propose LoRA-Oriented Control via Keyed Entry Tokens (Locket), a practical framework that embeds fine-grained, policy-driven access control directly into LLM generation. Locket trains a set of lightweight LoRA (Low-Rank Adaptation) adapters, each encoding a distinct access policy (e.g., full reveal, partial redaction via PII masking, or reveal under a specified differential privacy level). A compact gating module is trained to associate a learned keyed entry token with exactly one LoRA adapter via sequence-level hard routing; the presence of a valid token acts as an authorization key that unlocks corresponding private knowledge, while an invalid or absent token triggers a privacy-preserving adapter that redacts or sanitizes sensitive content. This design ensures Locket remains fully compatible with off-the-shelf LLMs, supporting scalable deployment while satisfying regulatory and privacy requirements. We evaluate Locket across multiple datasets (Enron, ECHR, Yelp) and a diverse set of state-of-the-art LLMs, including Qwen3 (1.7B and 8B), Meta's Llama-3.2 (1B and 3B), and Google's Gemma-2-2B. Our extensive experiments demonstrate that, when the correct token is provided, Locket preserves perplexity comparable to fine-tuning on raw data (without any defense). Conversely, when the token is missing or invalid, it substantially reduces PII leakage while maintaining utility and perplexity on par with strong baseline defenses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 53 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
35 of 53 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023GPT-4 Technical Reportcited by 18,132
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2016Deep Learning with Differential Privacycited by 2,682
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
- 2020Extracting Training Data from Large Language Modelscited by 2,144
23 more
- 2023PaLM 2 Technical Reportcited by 1,154
- 2023BloombergGPT: A Large Language Model for Financecited by 923
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2021Membership Inference Attacks From First Principlescited by 839
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
- 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
- 2023Pretraining Language Models with Human Preferencescited by 245
- 2019Neural Legal Judgment Prediction in Englishcited by 208
- 2023ProPILE: Probing Privacy Leakage in Large Language Modelscited by 127
- 2023Aligning Language Models with Preferences through f-divergence Minimizationcited by 118
- 2022The Text Anonymization Benchmark (TAB): A Dedicated Corpus and Evaluation Framework for Text Anonymizationcited by 94
- 2023Training Data Extraction From Pre-trained Language Models: A Surveycited by 43
- 2024LLM-PBE: Assessing Data Privacy in Large Language Modelscited by 38
- 2020Investigating Membership Inference Attacks under Data Dependenciescited by 27
- 2024Data Extraction Attacks in Retrieval-Augmented Generation via Backdoorscited by 23
- 2025Tokens for Learning, Tokens for Unlearning: Mitigating Membership Inference Attacks in Large Language Models via Dual-Purpose Trainingcited by 14
- 2025R.R.: Unveiling LLM Training Privacy through Recollection and Rankingcited by 10
- 2025Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utilitycited by 9
- 2024PII-Scope: A Comprehensive Study on Training Data PII Extraction Attacks in LLMscited by 6
- 2025Merger-as-a-Stealer: Stealing Targeted PII from Aligned LLMs with Model Mergingcited by 5
- 2024The Impact of LoRA Adapters on LLMs for Clinical Text Classification Under Computational and Data Constraintscited by 4
- 2024Multi-objective Representation for Numbers in Clinical Narratives: A CamemBERT-Bio-Based Alternative to Large-Scale LLMscited by 1
Built on by
Not cited yet.