mlsanityData to 14 Oct 2026

Connecting the Dots: Benchmarking Reflective Memory in Long-Horizon Dialogue

arXiv 2606.01223 ↗First posted 31 May 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite substantial progress in long-context modeling, existing benchmarks remain confined to factual memory for explicit recall, failing to measure the reflective memory required to synthesize fragmented, multimodal cues into high-level interpretations. To address this gap, we introduce RefMem-Bench, a benchmark for reflective memory in long-horizon dialogue. RefMem-Bench contains 26K annotated QA instances with eight reflective-memory dimensions and three task formats, requiring models to move beyond surface-level retrieval and infer latent meanings from evidence distributed across interaction histories. To enhance reflective memory capability, we propose REflective Memory INDuction (REMIND), a hierarchical framework that treats reflective memory as progressive meaning construction. REMIND couples question-conditioned evidence retrieval, salience-aware grounding, and abstraction-level supervision, and uses Progressive Reflective Alignment to distill high-level reflective reasoning into the factual inference pathway. Experiments show RefMem-Bench poses a substantial challenge to current models, while REMIND consistently improves both answer accuracy and memory recall through progressive evidence perception, grounding, and abstraction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 50 references that are in the map. First posted on arXiv 31 May 2026.

Builds on

27 of 50 references.

References · 27

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  4. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  5. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  6. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  7. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  8. 2024Scaling and evaluating sparse autoencoderscited by 553
  9. 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
  10. 2025MemAgent: Reshaping Long-Context LLM with Multi-Conv RL-based Memory Agentcited by 246
  11. 2025MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agentscited by 238
  12. 2025Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learningcited by 237
15 more
  1. 2025LightMem: Lightweight and Efficient Memory-Augmented Generationcited by 180
  2. 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
  3. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 136
  4. 2023Scaling Transformer to 1M tokens and beyond with RMTcited by 98
  5. 2024MEMORYLLM: Towards Self-Updatable Large Language Modelscited by 93
  6. 2025MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systemscited by 61
  7. 2025M+: Extending MemoryLLM with Scalable Long-Term Memorycited by 54
  8. 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 54
  9. 2025General Agentic Memory Via Deep Researchcited by 47
  10. 2025REALTALK: A 21-Day Real-World Dataset for Long-Term Conversationcited by 35
  11. 2024DialSim: A Dialogue Simulator for Evaluating Long-Term Multi-Party Dialogue Understanding of Conversational Agentscited by 20
  12. 2026KnowMe-Bench: Benchmarking Person Understanding for Lifelong Digital Companionscited by 11
  13. 2026LifeBench: A Benchmark for Long-Horizon Multi-Source Memorycited by 10
  14. 2026EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agentscited by 9
  15. 2026S3-Attention:Attention-Aligned Endogenous Retrieval for Memory-Bounded Long-Context Inferencecited by 1

Built on by

Not cited yet.