mlsanityData to 14 Oct 2026

Long-Lived Characters, Local Inference: Incremental Memory Maintenance for Game NPCs

arXiv 2609.18935 ↗First posted 16 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

A game character should not have to reread its entire life before every conversation. For locally deployed language-model characters, however, revising a few memories can invalidate a long reusable prefix. The resulting preparation cost competes with both foreground dialogue and the maintenance of other characters. This matters especially when dialogue feeds game-defined actions and value judgments: a fluent but incorrect account of who owns an item, or whether a transfer has already happened, can corrupt the input to otherwise deterministic rules. We study incremental memory maintenance for long-lived game NPCs in a quantized Qwen hybrid recurrent-attention model. Our runtime removes superseded attention KV entries, computes replacement records at the true sequence tail, and preserves the continuing recurrent state and unchanged KV. Existing local experiments combine multi-update dialogue replays, fixed-input placement ablations, and attention diagnostics. Independent block composition weakens query-conditioned memory selection without a uniform chunk-initial attention collapse. True-tail updates preserve important current-state and historical bindings across eight scripted maintenance rounds; a placement case recovers the full-refill quantity in three reconstructions, while slot-preserving alternatives repeat a double-subtraction error. Attention-distribution proximity alone does not explain these semantic differences. The results motivate treating a character's inference state as a maintained, history-dependent resource, rather than only a disposable encoding of its latest memory text.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 16 Sep 2026.

Builds on

15 of 29 references.

References · 15

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
  6. 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
  7. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  8. 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,141
  9. 2019Attention is not Explanationcited by 929
  10. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  11. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  12. 2019Attention is not not Explanationcited by 636
3 more
  1. 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
  2. 2023Prompt Cache: Modular Attention Reuse for Low-Latency Inferencecited by 268
  3. 2026HYPIC: Accelerating Hybrid-Attention LLM Serving with Position-Independent Cachingcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Supersede: Diagnosing and Training the Memory-Update Gap in LLM Agents
  2. 2026Memory in the LLM Era: Modular Architectures and Strategies in a Unified Framework
  3. 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games
  4. 2026Can Agents Forget When Asked? A Benchmark for Memory Unlearning in LLM Agents
  5. 2026When Does Memory Help? A Cost-Aware Evaluation of Long-Term Memory in Tool-Using LLM Agents
  6. 2026Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
  7. 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
  8. 2025Rethinking Memory in LLM based Agents: Representations, Operations, and Emerging Topics