mlsanityData to 7 Oct 2026

ThinkFlow: Self-Evolving Probabilistic Latent Memory for Lifelong Conversational Agents

arXiv 2609.17010 ↗First posted 15 Sep 2026cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Lifelong conversational agents rely on memory systems to maintain deep, context-aware interactions with users. However, existing explicit textual memory pipelines suffer from a severe information bottleneck, often losing subtle behavioral patterns and emotional shifts. Furthermore, being typically static post-deployment, they cannot autonomously adapt to personal habits and preferences without manual feedback. Cognitive science, however, suggests that humans maintain mental models purely in a latent space and continuously refine them through predictive coding. Inspired by this, we propose ThinkFlow, a novel end-to-end latent memory framework for lifelong conversational agents. ThinkFlow bypasses the text bottleneck by dynamically compressing conversational flows into probabilistic latent memory skills, autonomously consolidating complex user states into disentangled, continuous vectors without semantic interference. To break this barrier, we introduce a test-time evolution paradigm. By coupling teacher-guided latent alignment to bootstrap the initial state with a self-supervised next-user-utterance prediction task for continuous refinement, the framework successfully overcomes cold-start challenges and achieves label-free lifelong personalization. Extensive experiments on long-term conversation benchmarks demonstrate that ThinkFlow significantly outperforms prevailing memory systems, providing highly personalized and contextually accurate responses over extended multi-session interactions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

36 of 52 references.

References · 36

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  5. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  6. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  7. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
  8. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
  9. 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
  10. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  11. 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
  12. 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
24 more
  1. 2025Memory in the Age of AI Agentscited by 285
  2. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
  3. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
  4. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
  5. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
  6. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
  7. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 99
  8. 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
  9. 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 82
  10. 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
  11. 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 74
  12. 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
  13. 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
  14. 2024Towards Lifelong Dialogue Agents via Timeline-based Memory Managementcited by 50
  15. 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
  16. 2025Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Spacecited by 40
  17. 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 40
  18. 2024Compress to Impress: Unleashing the Potential of Compressive Memory in Real-World Long-Term Conversationscited by 36
  19. 2025O-Mem: Omni Memory System for Personalized, Long Horizon, Self-Evolving Agentscited by 30
  20. 2025PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Datacited by 26
  21. 2024Deliberation in Latent Space via Differentiable Cache Augmentationcited by 25
  22. 2023Mind the Gap Between Conversations for Improved Long-Term Dialogue Generationcited by 13
  23. 2026Evoking User Memory: Personalizing LLM via Recollection-Familiarity Adaptive Retrievalcited by 8
  24. 2024Mixed-Session Conversation with Egocentric Memorycited by 7

Built on by

Not cited yet.