FinLifeBench: Exhaustive Life-Event History and Financial-State Reconstruction from Longitudinal Banking Dialogue
Not on the map. Why?
Abstract (arXiv)
Repeated banking interactions require assistants to maintain complete, current, and traceable customer records as life changes emerge incidentally in routine requests. Existing benchmarks emphasize question answering, bounded episodes, or targeted recall rather than exhaustive longitudinal reconstruction. We introduce FinLifeBench, which evaluates two tasks over the same cumulative dialogue: reconstructing every life-event instance with its first-establishing session and reconstructing a complete 34-path financial state at consecutive checkpoints. The benchmark contains 6,000 eight-turn Korean banking sessions from 20 independent synthetic trajectories, with deterministic, exhaustive gold for 24 event types and 34 state paths and consensus quality assurance. Across eleven LLMs under a full-context condition, event-anchor recall falls from 0.591 at 15 sessions to 0.445 at 300. Errors are driven primarily by omitted events rather than poor anchor localization, while financial-state reconstruction frequently treats superseded or potentially outdated information as current; the best GCA@15 reaches 0.470. Performance on the two reconstruction tasks is only weakly associated. These results show that models can localize evidence for recovered events while still failing to maintain complete and temporally valid longitudinal records.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 36 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
26 of 36 references.
References · 26
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2024RULER: What's the Real Context Size of Your Long-Context Language Models?cited by 1,346
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 254
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196
14 more
- 2025Know Me, Respond to Me: Benchmarking LLMs for Dynamic User Profiling and Personalized Responses at Scalecited by 178
- 2022Keep Me Updated! Memory Management in Long-term Conversationscited by 63
- 2024Towards Lifelong Dialogue Agents via Timeline-based Memory Managementcited by 51
- 2026From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agentscited by 36
- 2026AMemGym: Interactive Memory Benchmarking for Assistants in Long-Horizon Conversationscited by 20
- 2019Getting To Know You: User Attribute Extraction from Dialoguescited by 19
- 2026Locomo-Plus: Beyond-Factual Cognitive Memory Evaluation Framework for LLM Agentscited by 19
- 2026MemConflict: Evaluating Long-Term Memory Systems Under Memory Conflictscited by 12
- 2026ES-MemEval: Benchmarking Conversational Agents on Personalized Long-Term Emotional Supportcited by 11
- 2026MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversationscited by 7
- 2026CloneMem: Benchmarking Long-Term Memory for AI Clonescited by 6
- 2026MemAudit: Auditing Long-Term Agent Memory via Hidden User-State Recoverycited by 6
- 2025Comprehensive Framework for Evaluating Conversational AI Chatbotscited by 2
- 2025Banking Done Right: Redefining Retail Banking with Language-Centric AIcited by 1
Built on by
Not cited yet.