Engram Injection: A Study of Temporal Validity in Parametric Language-Model Memory
Not on the map. Why?
Abstract (arXiv)
A stored fact may stop being valid when a user changes a preference or an event replaces an earlier one. We study whether a language model can learn these changes in its parameters and answer correctly from only a question and the current time. Engram Injection stores facts in LoRA adapters and supplies the clock through FiLM conditioning on a frozen Qwen2.5-3B-Instruct model. We compare it with additive clock conditioning, prompting with the full dated history, and retrieving four dated records. We train six matched adapters across three seeds after fixing a sampler that could admit test-age examples into training. The training audit reports no such examples among 127,760 evaluated training inputs. On 62 pairs of questions asked before and after an update, at an elapsed age of seven days excluded from training, both adapter methods answer zero pairs correctly under the primary blinded assistant review with order code 1 held fixed. Full-history prompting answers 59/62 pairs correctly, and retrieval answers 62/62. Separate experiments show that adapters can store facts and that removable memory units can support local deletion. Combining fact selection with time-based version selection remains unsuccessful. These results separate learning a fact from learning when to use it.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 19 references that are in the map. First posted on arXiv 11 Oct 2026.
Builds on
15 of 19 references.
References · 15
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2024TOFU: A Task of Fictitious Unlearning for LLMscited by 533
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
- 2024Titans: Learning to Memorize at Test Timecited by 328
- 2019Time2Vec: Learning a Vector Representation of Timecited by 213
- 2016Using Fast Weights to Attend to the Recent Pastcited by 170
- 2025Cartridges: Lightweight and general-purpose long context representations via self-studycited by 86
Built on by
Not cited yet.