mlsanityData to 14 Oct 2026

Toward Multi-Session Personalized Conversation: A Large-Scale Dataset and Hierarchical Tree Framework for Implicit Reasoning

arXiv 2503.07018 ↗First posted 10 Mar 2025cs.CLcited by 21

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

There has been a surge in the use of large language models (LLM) conversational agents to generate responses based on long-term history from multiple sessions. However, existing long-term open-domain dialogue datasets lack complex, real-world personalization and fail to capture implicit reasoning-where relevant information is embedded in subtle, syntactic, or semantically distant connections rather than explicit statements. In such cases, traditional retrieval methods fail to capture relevant context, and long-context modeling also becomes inefficient due to numerous complicated persona-related details. To address this gap, we introduce ImplexConv, a large-scale long-term dataset with 2,500 examples, each containing approximately 100 conversation sessions, designed to study implicit reasoning in personalized dialogues. Additionally, we propose TaciTree, a novel hierarchical tree framework that structures conversation history into multiple levels of summarization. Instead of brute-force searching all data, TaciTree enables an efficient, level-based retrieval process where models refine their search by progressively selecting relevant details. Our experiments demonstrate that TaciTree significantly improves the ability of LLMs to reason over long-term conversations with implicit contextual dependencies.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 20 of its 27 references that are in the map. First posted on arXiv 10 Mar 2025.

Builds on

20 of 27 references.

References · 20

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  4. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
  5. 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 839
  6. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  7. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  8. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  9. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  10. 2017DailyDialog: A Manually Labelled Multi-turn Dialogue Datasetcited by 652
  11. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  12. 2023Effective Long-Context Scaling of Foundation Modelscited by 303
8 more
  1. 2021Beyond Goldfish Memory: Long-Term Open-Domain Conversationcited by 267
  2. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 123
  3. 2023Retrieval meets Long Context Large Language Modelscited by 115
  4. 2024Jasper and Stella: distillation of SOTA embedding modelscited by 112
  5. 2023SCM: Enhancing Large Language Model with Self-Controlled Memory Frameworkcited by 98
  6. 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
  7. 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
  8. 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agentscited by 20

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 18.

21 papers.

Sort:

By area:

  1. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
  2. 2026STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?cited by 50
  3. 2026From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanismscited by 21
  4. 2026HorizonBench: Long-Horizon Personalization with Evolving Preferencescited by 17
  5. 2025Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interactioncited by 11
  6. 2026How Does Personalized Memory Shape LLM Behavior? Benchmarking Rational Preference Utilization in Personalized Assistantscited by 9
  7. 2026LLMs Corrupt Your Documents When You Delegatecited by 9
  8. 2025SteerX: Disentangled Steering for LLM Personalizationcited by 7
  9. 2026LMEB: Long-horizon Memory Embedding Benchmarkcited by 7
  10. 2026PM-Bench: Evaluating Prospective Memory in LLM Agentscited by 7
  11. 2026PGMem: Tightly Coupled Persona-Memory Graph for Lifelong Personalized Agentscited by 2
  12. 2026DMT-CBT: Longitudinal Therapeutic State Modeling for CBT Counselingcited by 1
9 more
  1. 2026Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMscited by 1
  2. 2026PHASE-Tree: Modeling Character-State Evolution in Long-Horizon Role-Playing Dialoguecited by 1
  3. 2026Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributionscited by 0
  4. 2026Know It, Act on It: Investigating Memory Utilization in LLM Personalizationcited by 0
  5. 2026hoBIT: A Profile-Aware Retrieval-Augmented Chatbot for University Academic Advisingcited by 0
  6. 2026VIBE-Bench: Evaluating Personalized Large Language Models When Profiles Don't Mean Preferencescited by 0
  7. 2026PRAGMA: Evaluating Personalized Guidance with Memory Alignment in Lifelong Conversationscited by 0
  8. 2026To Memories and Beyond: From Remembering to Knowing You across Long-Term Multimodal Personal Archivescited by 0
  9. 2026Madeleine: Learning Involuntary Recall for Conversational Memory from Simulated Livescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026StateTree: Enhancing Long-Term Dialogue Reasoning via Reinforcement Learning
  2. 2026ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional Support
  3. 2025A Simple Yet Strong Baseline for Long-Term Conversational Memory of LLM Agents
  4. 2026AgenticAI-DialogGen: Topic-Guided Conversation Generation for Fine-Tuning and Evaluating Short- and Long-Term Memories of LLMs
  5. 2026Context-Agent: Dynamic Discourse Trees for Non-Linear Dialogue
  6. 2026AdaMem: Adaptive User-Centric Memory for Long-Horizon Dialogue Agents
  7. 2026TiMem: Temporal-Hierarchical Memory Consolidation for Long-Horizon Conversational Agents
  8. 2025D-SMART: Enhancing LLM Dialogue Consistency via Dynamic Structured Memory And Reasoning Tree