What the Model Cannot See: Covert and Provable Text Invisibility in LLMs
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Text wrapped in a trigger can be made behaviorally invisible to a language model: omitted from summaries and quotations, ignored in question answering, and left unflagged by downstream filtering. We study this selective blindness as a dual-use information-flow primitive, a supply-chain backdoor, and a white-box auditing problem. We first implement it exactly as a serving-time span veto: blocking information flow out of a marked span makes every outside activation bit-identical under same-length substitution of the span's content, a noninterference property we verify across ten models, seven mixer families, and 0.5B-120B parameters. The veto serves as a deployable quarantine, an exact reference for calibrating leakage, and a teacher. Distilled into weights, it yields a backdoor: checkpoints trained on six model families from 4B to 120B ignore marked context at little benchmark cost, and their outputs show no measurable semantic trace of the suppressed content above the veto reference on our held-out suite; an in-domain variant suppresses planted vulnerabilities during AI code review. Detection is therefore a white-box problem. Simpler backdoors remain internally transparent -- linear probes recover suppressed content at 0.57-0.79 accuracy versus 0.025 chance -- but hardening the attack until probes reach chance collapses attention from outside the span into it below the range of base models. Across the attacks we evaluate, probe visibility trades off against routing visibility; we do not establish that this tradeoff is fundamental.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 28 of its 48 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
28 of 48 references.
Closest ancestors · 1
Same direction, newest first
- 2024Certifying Counterfactual Bias in LLMs29 May
Other references · 27
- 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
- 2023Dissecting Recall of Factual Associations in Auto-Regressive Language Modelscited by 528
- 2023Learning to Compress Prompts with Gist Tokenscited by 390
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 375
- 2025Defeating Prompt Injections by Designcited by 297
- 2024Defending Against Indirect Prompt Injection Attacks With Spotlightingcited by 267
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 210
- 2025Securing AI Agents with Information-Flow Controlcited by 121
- 2022Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacycited by 100
- 2023On Provable Copyright Protection for Generative Modelscited by 98
- 2024ContextCite: Attributing Model Generation to Contextcited by 98
- 2024Attention Tracker: Detecting Prompt Injection Attacks in LLMscited by 95
15 more
- 2023Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMscited by 91
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 73
- 2024Obfuscated Activations Bypass LLM Latent-Space Defensescited by 45
- 2025RL-Obfuscation: Can Language Models Learn to Evade Latent-Space Monitors?cited by 24
- 2025TokenShapley: Token Level Context Attribution with Shapley Valuecited by 15
- 2025May I have your Attention? Breaking Fine-Tuning based Prompt Injection Defenses using Architecture-Aware Attackscited by 15
- 2024Do LLMs Know to Respect Copyright Notice?cited by 13
- 2025TracLLM: A Generic Framework for Attributing Long Context LLMscited by 13
- 2024Copyright-Protected Language Generation via Adaptive Model Fusioncited by 7
- 2025AttnTrace: Contextual Attribution of Prompt Injection and Knowledge Corruptioncited by 7
- 2026Attention Smoothing Is All You Need For Unlearningcited by 7
- 2025Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention Shiftingcited by 6
- 2025Certified Mitigation of Worst-Case LLM Copyright Infringementcited by 1
- 2025Can AI Keep a Secret? Contextual Integrity Verification: A Provable Security Architecture for LLMscited by 1
- 2026Anchored Decoding: Provably Reducing Copyright Risk for Any Language Modelcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Steering the CensorShip: Uncovering Representation Vectors for LLM "Thought" Control
- 2026Can You Keep a Secret? Involuntary Information Leakage in Language Model Writing
- 2025Keep Security! Benchmarking Security Policy Preservation in Large Language Model Contexts Against Indirect Attacks in Question Answering
- 2026Knowing What Not to Answer: Selective Non-Compliance in Vision-Language Models
- 2026Understanding Content Moderation in Large Language Models through Restricted Books: From Refusal to Warning ↗
- 2026PrivDrift: Auditing User-Secret Leakage Under Topic Drift in Active LLM Conversations
- 2023Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections
- 2026CopyShield: A Cross-Level Benchmark of Copyright Defenses in LLMs