Life-Bench: A Benchmark and Knowledge Graph Framework for Multimodal Personalization Beyond Concept Recognition
Not on the map. Why?
Abstract (arXiv)
As large language models increasingly power personal assistants, users expect them to reason over multimodal life histories, from recognizing people to understanding events to aggregating patterns, yet existing benchmarks primarily target concept-level recognition. We introduce Life-Bench, a fully synthetic, human-verified multimodal benchmark of over 11,800 question-answer pairs across 10 tasks, organized by required evidence scope: concept identification, event understanding, and aggregated reasoning. The benchmark's photo-centric personal histories are distributionally aligned with real user accounts under embedding statistic. The interconnected structure of personal data invites graph-based solutions; we propose LifeGraph, a personal knowledge graph framework providing structured retrieval with on-demand access to source visual evidence, showing particular promise on event and aggregated tasks. Systematic evaluation of four retrieval paradigms on Life-Bench demonstrates that accuracy degrades sharply with evidence scope, falling below 0.40 on aggregated tasks, and that no single paradigm dominates across categories. Performance beyond concept recognition remains modest for all evaluated methods, establishing personalization over multimodal histories as an open challenge and Life-Bench as a testbed for future progress.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 66 references that are in the map. First posted on arXiv 22 Feb 2026.
Builds on
43 of 66 references.
References · 43
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
- 2023LaMP: When Large Language Models Meet Personalizationcited by 437
- 2025Memory in the Age of AI Agentscited by 303
31 more
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
- 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
- 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
- 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
- 2024Personalization of Large Language Models: A Surveycited by 104
- 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 97
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 73
- 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
- 2024Yo'LLaVA: Your Personalized Language and Vision Assistantcited by 62
- 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 60
- 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 60
- 2025Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMscited by 60
- 2024MyVLM: Personalizing VLMs for User-Specific Queriescited by 58
- 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 54
- 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 54
- 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 40
- 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
- 2021Link Prediction on N-ary Relational Facts: A Graph-based Approachcited by 29
- 2024RAP: Retrieval-Augmented Personalization for Multimodal Large Language Modelscited by 24
- 2025MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphscited by 16
- 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
- 2025MMPB: It's Time for Multi-Modal Personalizationcited by 14
- 2023Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Constructioncited by 11
- 2023TimelineQA: A Benchmark for Question Answering over Timelinescited by 10
- 2024OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answeringcited by 10
- 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprintscited by 10
- 2025Memory-QA: Answering Recall Questions Based on Multimodal Memoriescited by 10
- 2017MemexQA: Visual Memex Question Answeringcited by 3
- 2024PKG API: A Tool for Personal Knowledge Graph Managementcited by 1
Built on by
Not cited yet.