mlsanityData to 14 Oct 2026

Life-Bench: A Benchmark and Knowledge Graph Framework for Multimodal Personalization Beyond Concept Recognition

arXiv 2602.19001 ↗First posted 22 Feb 2026cs.CV cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

As large language models increasingly power personal assistants, users expect them to reason over multimodal life histories, from recognizing people to understanding events to aggregating patterns, yet existing benchmarks primarily target concept-level recognition. We introduce Life-Bench, a fully synthetic, human-verified multimodal benchmark of over 11,800 question-answer pairs across 10 tasks, organized by required evidence scope: concept identification, event understanding, and aggregated reasoning. The benchmark's photo-centric personal histories are distributionally aligned with real user accounts under embedding statistic. The interconnected structure of personal data invites graph-based solutions; we propose LifeGraph, a personal knowledge graph framework providing structured retrieval with on-demand access to source visual evidence, showing particular promise on event and aggregated tasks. Systematic evaluation of four retrieval paradigms on Life-Bench demonstrates that accuracy degrades sharply with evidence scope, falling below 0.40 on aggregated tasks, and that no single paradigm dominates across categories. Performance beyond concept recognition remains modest for all evaluated methods, establishing personalization over multimodal histories as an open challenge and Life-Bench as a testbed for future progress.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 66 references that are in the map. First posted on arXiv 22 Feb 2026.

Builds on

43 of 66 references.

References · 43

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  6. 2025Gemma 3 Technical Reportcited by 1,824
  7. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  8. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  9. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  10. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  11. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  12. 2025Memory in the Age of AI Agentscited by 303
31 more
  1. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
  2. 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 231
  3. 2025MIRIX: Multi-Agent Memory System for LLM-Based Agentscited by 173
  4. 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 172
  5. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
  6. 2024The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Modelscited by 144
  7. 2024Personalization of Large Language Models: A Surveycited by 104
  8. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 97
  9. 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 73
  10. 2024Think-on-Graph 2.0: Deep and Faithful Large Language Model Reasoning with Knowledge-guided Retrieval Augmented Generationcited by 64
  11. 2024Yo'LLaVA: Your Personalized Language and Vision Assistantcited by 62
  12. 2024HYDRA: Model Factorization Framework for Black-Box LLM Personalizationcited by 60
  13. 2024PersonalLLM: Tailoring LLMs to Individual Preferencescited by 60
  14. 2025Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMscited by 60
  15. 2024MyVLM: Personalizing VLMs for User-Specific Queriescited by 58
  16. 2024MC-LLaVA: Multi-Concept Personalized Vision-Language Modelcited by 54
  17. 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 54
  18. 2025Oolong: Evaluating Long Context Reasoning and Aggregation Capabilitiescited by 40
  19. 2024PerLTQA: A Personal Long-Term Memory Dataset for Memory Classification, Retrieval, and Synthesis in Question Answeringcited by 34
  20. 2021Link Prediction on N-ary Relational Facts: A Graph-based Approachcited by 29
  21. 2024RAP: Retrieval-Augmented Personalization for Multimodal Large Language Modelscited by 24
  22. 2025MMGraphRAG: Bridging Vision and Language with Interpretable Multimodal Knowledge Graphscited by 16
  23. 2023UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Trainingcited by 14
  24. 2025MMPB: It's Time for Multi-Modal Personalizationcited by 14
  25. 2023Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Constructioncited by 11
  26. 2023TimelineQA: A Benchmark for Question Answering over Timelinescited by 10
  27. 2024OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answeringcited by 10
  28. 2025Training-Free Personalization via Retrieval and Reasoning on Fingerprintscited by 10
  29. 2025Memory-QA: Answering Recall Questions Based on Multimodal Memoriescited by 10
  30. 2017MemexQA: Visual Memex Question Answeringcited by 3
  31. 2024PKG API: A Tool for Personal Knowledge Graph Managementcited by 1

Built on by

Not cited yet.