mlsanityData to 14 Oct 2026

Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfer

arXiv 2608.20442 ↗First posted 20 Aug 2026cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Subliminal trait transfer allows a student model to acquire behavioral dispositions from teacher-generated data in which the trait is not semantically expressed. Recent work explains how such signals enter gradients, but not how they survive source removal or acquire different signs under later training. We treat parameters and optimizer moments as a single trainer state and derive an exact transport-valuation identity separating observer-independent propagation of the source perturbation from the value assigned by a future continuation and behavioral readout. State surgery identifies the first moment as a causal carrier. Transplanting it alone leaves parameters, hidden states, and outputs unchanged at the cut, yet source-free updates generate growing parameter and hidden-state differences; transplanting parameters with the first moment recovers the terminal behavioral response. Sending the same source-induced difference through matched futures produces negative, near-zero, and positive Qwen effects (-0.658, +0.008, and +0.658 seed means). This ordering recurs in all 12 Llama-3.2-1B seeds after eight updates, while state-difference norms remain nearly equal across routes. Both contrasts grow in every paired seed when the continuation extends to sixteen updates. A full-horizon costate predicts all 42 Qwen route-mean signs and all 21 resolved Llama ordinary-route signs. Observer-independent transport also replicates across Qwen, SmolLM2, and Llama, while the complete-state recurrence predicts physical, hidden, and fixed-head responses in non-LoRA MNIST systems, including CNNs trained with AdamW and momentum SGD. Together, these results identify a two-stage mechanism for subliminal trait transfer: optimizer state transports the source perturbation, and later training determines its behavioral value.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 20 Aug 2026.

Builds on

38 of 52 references.

References · 38

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  2. 2024Qwen2.5 Technical Reportcited by 4,942
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  5. 2022Editing Models with Task Arithmeticcited by 1,120
  6. 2024TinyLlama: An Open-Source Small Language Modelcited by 618
  7. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  8. 2024Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingcited by 529
  9. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
  10. 2015Gradient-based Hyperparameter Optimization through Reversible Learningcited by 360
  11. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  12. 2025Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMscited by 172
26 more
  1. 2024Flora: Low-Rank Adapters Are Secretly Gradient Compressorscited by 108
  2. 2024Asymmetry in Low-Rank Adapters of Foundation Modelscited by 86
  3. 2024Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearningcited by 84
  4. 2019Conservative set valued fields, automatic differentiation, stochastic gradient method and deep learningcited by 72
  5. 2025Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMscited by 42
  6. 2025Towards Understanding Subliminal Learning: When and How Hidden Biases Transfercited by 34
  7. 2021On the Transferability of Pre-trained Language Models: A Study from Artificial Datasetscited by 25
  8. 2025Personality Vector: Modulating Personality of Large Language Models by Model Mergingcited by 17
  9. 2026Subliminal Steering: Stronger Encoding of Hidden Signalscited by 14
  10. 2026Subliminal Learning Is Steering Vector Distillationcited by 13
  11. 2026The Geometry of Sequential Learning: Lie-Bracket Prediction of Transfer Ordercited by 9
  12. 2026Emergent and Subliminal Misalignment Through the Lens of Data-Mediated Transfercited by 8
  13. 2025Persistent Backdoor Attacks under Continual Fine-Tuning of LLMscited by 7
  14. 2026Learning Through Noise: Why Subliminal Learning Works and When It Failscited by 7
  15. 2026Channel Location Constrains the Auditability of Subliminal Learningcited by 7
  16. 2026Optimizer Memory Makes Shuffle Order a First-Order Source of Fine-Tuning Noisecited by 7
  17. 2025How Memory in Optimization Algorithms Implicitly Modifies the Losscited by 6
  18. 2026Subliminal Learning is a LoRA Artifactcited by 6
  19. 2021How and When Random Feedback Works: A Case Study of Low-Rank Matrix Factorizationcited by 5
  20. 2025Seed-Induced Uniqueness in Transformer Models: Subspace Alignment Governs Subliminal Transfercited by 5
  21. 2026Subliminal Transfer of Unsafe Behaviors in AI Agent Distillationcited by 5
  22. 2026How Faithful Is Trajectory-Based Data Attribution? Error Sources, Remedies, and Practical Guidelinescited by 4
  23. 2026In-Run Data Shapley for Adam Optimizercited by 3
  24. 2026Quantifying Subliminal Behavioral Transfer Ratios in Language Model Distillationcited by 3
  25. 2026Process-Tensor Tomography of SGD: Measuring Non-Markovian Memory via Back-Flow of Distinguishabilitycited by 2
  26. 2026Covert Trait Propagation Is Representation Alignment: Mechanistic Evidence from Hidden-Channel Distillationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.