Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
Abstract (arXiv)
There has been a surge in the use of large language models (LLM) conversational agents to generate responses based on long-term history from multiple sessions. However, existing long-term open-domain dialogue datasets lack complex, real-world personalization and fail to capture implicit reasoning-where relevant information is embedded in subtle, syntactic, or semantically distant connections rather than explicit statements. In such cases, traditional retrieval methods fail to capture relevant context, and long-context modeling also becomes inefficient due to numerous complicated persona-related details. To address this gap, we introduce ImplexConv, a large-scale long-term dataset with 2,500 examples, each containing approximately 100 conversation sessions, designed to study implicit reasoning in personalized dialogues. Additionally, we propose TaciTree, a novel hierarchical tree framework that structures conversation history into multiple levels of summarization. Instead of brute-force searching all data, TaciTree enables an efficient, level-based retrieval process where models refine their search by progressively selecting relevant details. Our experiments demonstrate that TaciTree significantly improves the ability of LLMs to reason over long-term conversations with implicit contextual dependencies.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 27 references that are in the map. First posted on arXiv 10 Mar 2025.
Builds on
20 of 27 references.
References · 20
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
- 2023Effective Long-Context Scaling of Foundation Modelscited by 303
8 more
- 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
- 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 123
- 2023Retrieval meets Long Context Large Language Modelscited by 115
- 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
- 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
- 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agentscited by 20
Built on by
Citing papers per year: 2025: 3; 2026: 18.
21 papers.
Sort:
By area:
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?cited by 50
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2026HorizonBench: Long-Horizon Personalization with Evolving Preferencescited by 17
- 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interactioncited by 11
- 2026How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistantscited by 9
- 2026LLMs Corrupt Your Documents When You Delegatecited by 9
- 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
- 2026LMEB: Long-horizon Memory Embedding Benchmarkcited by 7
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agentscited by 7
- 2026PGMem: Tightly Coupled Persona-Memory Graph for Lifelong Personalized Agentscited by 2
- 2026DMT-CBT: Longitudinal Therapeutic State Modeling for CBT Counselingcited by 1
9 more
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMscited by 1
- 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialoguecited by 1
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributionscited by 0
- 2026Know It, Act on It: Investigating Memory Utilization in LLM Personalizationcited by 0
- 2026hoBIT: A Profile-Aware Retrieval-Augmented Chatbot for University Academic Advisingcited by 0
- 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferencescited by 0
- 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversationscited by 0
- 2026To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archivescited by 0
- 2026Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Livescited by 0
- 2026Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives1 Oct 2026
- 2026To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives11 Sep 2026
- 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversations9 Sep 2026
- 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferences1 Sep 2026
- 2026hoBIT: A Profile-Aware Retrieval-Augmented Chatbot for University Academic Advising27 Aug 2026
- 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue7 Aug 2026
- 2026PGMem: Tightly Coupled Persona-Memory Graph for Lifelong Personalized Agents3 Aug 2026
- 2026Know It, Act on It: Investigating Memory Utilization in LLM Personalization31 Jul 2026
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agents14 Jul 2026
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs22 Jun 2026
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributions5 Jun 2026
- 2026DMT-CBT: Longitudinal Therapeutic State Modeling for CBT Counseling2 Jun 2026
9 more
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?7 May 2026
- 2026HorizonBench: Long-Horizon Personalization with Evolving Preferences19 Apr 2026
- 2026LLMs Corrupt Your Documents When You Delegate17 Apr 2026
- 2026LMEB: Long-horizon Memory Embedding Benchmark13 Mar 2026
- 2026How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistants23 Jan 2026
- 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interaction17 Nov 2025
- 2025SteerX: Disentangled Steering for LLM Personalization25 Oct 2025
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scale19 Apr 2025
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?cited by 50
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
- 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interactioncited by 11
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agentscited by 7
- 2026PGMem: Tightly Coupled Persona-Memory Graph for Lifelong Personalized Agentscited by 2
- 2026PGMem: Tightly Coupled Persona-Memory Graph for Lifelong Personalized Agents3 Aug 2026
- 2026PM-Bench: Evaluating Prospective Memory in LLM Agents14 Jul 2026
- 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms7 May 2026
- 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?7 May 2026
- 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interaction17 Nov 2025
- 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
- 2025SteerX: Disentangled Steering for LLM Personalization25 Oct 2025
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
- 2026HorizonBench: Long-Horizon Personalization with Evolving Preferencescited by 17
- 2026How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistantscited by 9
- 2026LLMs Corrupt Your Documents When You Delegatecited by 9
- 2026LMEB: Long-horizon Memory Embedding Benchmarkcited by 7
- 2026DMT-CBT: Longitudinal Therapeutic State Modeling for CBT Counselingcited by 1
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMscited by 1
- 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialoguecited by 1
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributionscited by 0
- 2026Know It, Act on It: Investigating Memory Utilization in LLM Personalizationcited by 0
- 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversationscited by 0
- 2026To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archivescited by 0
12 most cited of 13 All 13 (JSON)
- 2026Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Lives1 Oct 2026
- 2026To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archives11 Sep 2026
- 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversations9 Sep 2026
- 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialogue7 Aug 2026
- 2026Know It, Act on It: Investigating Memory Utilization in LLM Personalization31 Jul 2026
- 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs22 Jun 2026
- 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributions5 Jun 2026
- 2026DMT-CBT: Longitudinal Therapeutic State Modeling for CBT Counseling2 Jun 2026
- 2026HorizonBench: Long-Horizon Personalization with Evolving Preferences19 Apr 2026
- 2026LLMs Corrupt Your Documents When You Delegate17 Apr 2026
- 2026LMEB: Long-horizon Memory Embedding Benchmark13 Mar 2026
- 2026How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistants23 Jan 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning
- 2026ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional Support
- 2025A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agents
- 2026AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs
- 2026Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue
- 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agents
- 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents
- 2025D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree