# OpenLifelogQA: An Open-Ended Multi-Modal Lifelog Question-Answering Dataset

arXiv: https://arxiv.org/abs/2508.03583 · HTML: https://mlsanity.com/paper/2508.03583/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 5 Aug 2025.

## Built on by (most cited first, 3 of 3)

- [LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning](https://mlsanity.com/paper/2601.13880/) (2026)
- [BehaviorBench: Modeling Real-World User Decisions from Behavioral Traces](https://mlsanity.com/paper/2606.02798/) (2026)
- [PAL-Bench: Evidence-Grounded Profile Reconstruction from Longitudinal Personal Albums](https://mlsanity.com/paper/2606.16175/) (2026)

## Abstract (arXiv)

We introduce OpenLifelogQA, a large-scale open-ended lifelog QA dataset constructed from 18 months of multimodal lifelog data. Lifelogging is the passive collection and analysis of personal daily activities using wearable devices, producing rich multimodal data such as images, locations, and biometrics. Question answering (QA) over lifelog data enables users to interactively query their own experiences, supporting applications in memory support, lifestyle analysis, and personal assistance. OpenLifelogQA contains 14,187 Q&A pairs spanning multiple question types and difficulty levels, designed to support robust evaluation in realistic settings. Compared with prior resources, OpenLifelogQA offers greater diversity and practicality for real-world applications. To establish baselines, we evaluate the LLaVA-NeXT-Interleave 7B model, achieving 89.7% BERTScore, 25.87% ROUGE-L, and an average LLM Score of 3.97. By releasing OpenLifelogQA, we aim to promote future research on lifelog technologies, paving the way for personal lifelog assistants capable of memory augmentation, healthcare support, and lifestyle coaching.
