Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs
Not on the map. Why?
Abstract (arXiv)
A game character should not have to reread its entire life before every conversation. For locally deployed language-model characters, however, revising a few memories can invalidate a long reusable prefix. The resulting preparation cost competes with both foreground dialogue and the maintenance of other characters. This matters especially when dialogue feeds game-defined actions and value judgments: a fluent but incorrect account of who owns an item, or whether a transfer has already happened, can corrupt the input to otherwise deterministic rules. We study incremental memory maintenance for long-lived game NPCs in a quantized Qwen hybrid recurrent-attention model. Our runtime removes superseded attention KV entries, computes replacement records at the true sequence tail, and preserves the continuing recurrent state and unchanged KV. Existing local experiments combine multi-update dialogue replays, fixed-input placement ablations, and attention diagnostics. Independent block composition weakens query-conditioned memory selection without a uniform chunk-initial attention collapse. True-tail updates preserve important current-state and historical bindings across eight scripted maintenance rounds; a placement case recovers the full-refill quantity in three reconstructions, while slot-preserving alternatives repeat a double-subtraction error. Attention-distribution proximity alone does not explain these semantic differences. The results motivate treating a character's inference state as a maintained, history-dependent resource, rather than only a disposable encoding of its latest memory text.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
15 of 29 references.
References · 15
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
- 2019Attention is not Explanationcited by 929
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2019Attention is not not Explanationcited by 636
3 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents
- 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games
- 2026Can Agents Forget When Asked? A Benchmark for Memory Unlearning in LLM Agents
- 2026When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents
- 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
- 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics