ThinkFlow: Self-Evolving Probabilistic Latent Memory for Lifelong Conversational Agents
Not on the map. Why?
Abstract (arXiv)
Lifelong conversational agents rely on memory systems to maintain deep, context-aware interactions with users. However, existing explicit textual memory pipelines suffer from a severe information bottleneck, often losing subtle behavioral patterns and emotional shifts. Furthermore, being typically static post-deployment, they cannot autonomously adapt to personal habits and preferences without manual feedback. Cognitive science, however, suggests that humans maintain mental models purely in a latent space and continuously refine them through predictive coding. Inspired by this, we propose ThinkFlow, a novel end-to-end latent memory framework for lifelong conversational agents. ThinkFlow bypasses the text bottleneck by dynamically compressing conversational flows into probabilistic latent memory skills, autonomously consolidating complex user states into disentangled, continuous vectors without semantic interference. To break this barrier, we introduce a test-time evolution paradigm. By coupling teacher-guided latent alignment to bootstrap the initial state with a self-supervised next-user-utterance prediction task for continuous refinement, the framework successfully overcomes cold-start challenges and achieves label-free lifelong personalization. Extensive experiments on long-term conversation benchmarks demonstrate that ThinkFlow significantly outperforms prevailing memory systems, providing highly personalized and contextually accurate responses over extended multi-session interactions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
36 of 52 references.
References · 36
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2025Qwen3 Technical Reportcited by 8,195
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2024A Survey on the Memory Mechanism of Large Language Model based Agentscited by 622
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
- 2021MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence Frontierscited by 466
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 400
24 more
- 2025Memory in the Age of AI Agentscited by 285
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 266
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 163
- 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 163
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 121
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
- 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 99
- 2023MemoChat: Tuning LLMs to Use Memos for Consistent Long-Range Open-Domain Conversationcited by 94
- 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memorycited by 82
- 2024From Isolated Conversations to Hierarchical Schemas: Dynamic Tree Memory Representation for LLMscited by 77
- 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 74
- 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 62
- 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
- 2024Towards Lifelong Dialogue Agents via Timeline-based Memory Managementcited by 50
- 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
- 2025Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Spacecited by 40
- 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 40
- 2024Compress to Impress: Unleashing the Potential of Compressive Memory in Real-World Long-Term Conversationscited by 36
- 2025O-Mem: Omni Memory System for Personalized, Long Horizon, Self-Evolving Agentscited by 30
- 2025PersonaBench: Evaluating AI Models on Understanding Personal Information through Accessing (Synthetic) Private User Datacited by 26
- 2024Deliberation in Latent Space via Differentiable Cache Augmentationcited by 25
- 2023Mind the Gap Between Conversations for Improved Long-Term Dialogue Generationcited by 13
- 2026Evoking User Memory: Personalizing LLM via Recollection-Familiarity Adaptive Retrievalcited by 8
- 2024Mixed-Session Conversation with Egocentric Memorycited by 7
Built on by
Not cited yet.