mlsanityData to 7 Oct 2026

Memento: Towards Proactive Visualization of Everyday Memories with Personal Wearable AR Assistant

arXiv 2601.17622 ↗First posted 24 Jan 2026cs.HC cs.CL cs.IRcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce Memento, a conversational AR assistant that permanently captures and memorizes user's verbal queries alongside their spatiotemporal and activity contexts. By storing these "memories," Memento discovers connections between users' recurring interests and the contexts that trigger them. Upon detection of similar or identical spatiotemporal activity, Memento proactively recalls user interests and delivers up-to-date responses through AR, seamlessly integrating AR experience into their daily routine. Unlike prior work, each interaction in Memento is not a transient event, but a connected series of interactions with coherent long--term perspective, tailored to the user's broader multimodal (visual, spatial, temporal, and embodied) context. We conduct a preliminary evaluation through user feedbacks with participants of diverse expertise in immersive apps, and explore the value of proactive context-aware AR assistant in everyday settings. We share our findings and challenges in designing a proactive, context-aware AR system.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 80 references that are in the map. First posted on arXiv 24 Jan 2026.

Builds on

40 of 80 references.

References · 40

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  4. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  5. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  6. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 853
  7. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
  8. 2022MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Textcited by 216
  9. 2025EgoLife: Towards Egocentric Life Assistantcited by 86
  10. 2024User-LLM: Efficient LLM Contextualization with User Embeddingscited by 74
  11. 2024Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generationcited by 44
  12. 2023LLMR: Real-time Prompting of Interactive Worlds using Large Language Modelscited by 39
28 more
  1. 2024GazePointAR: A Context-Aware Multimodal Voice Assistant for Pronoun Disambiguation in Wearable Augmented Realitycited by 35
  2. 2024Proactive Conversational Agents with Inner Thoughtscited by 35
  3. 2019Text-to-Viz: Automatic Generation of Infographics from Proportion-Related Natural Language Statementscited by 31
  4. 2024WorldScribe: Towards Context-Aware Live Visual Descriptionscited by 26
  5. 2024Satori: Towards Proactive AR Assistant with Belief-Desire-Intention User Modelingcited by 24
  6. 2024Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentationcited by 20
  7. 2023CAESURA: Language Models as Multi-Modal Query Plannerscited by 19
  8. 2024Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Modelcited by 19
  9. 2024From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systemscited by 16
  10. 2025Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agentscited by 14
  11. 2023SUQL: Conversational Search over Structured and Unstructured Data with Large Language Modelscited by 13
  12. 2024Augmented Object Intelligence with XR-Objectscited by 12
  13. 2025AiGet: Transforming Everyday Moments into Hidden Knowledge Discovery with AI Assistance on Smart Glassescited by 11
  14. 2024OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMscited by 10
  15. 2024OmniQuery: Contextually Augmenting Captured Multimodal Memory to Enable Personal Question Answeringcited by 10
  16. 2023Encode-Store-Retrieve: Augmenting Human Memory through Language-Encoded Egocentric Perceptioncited by 9
  17. 2023Design Patterns for Situated Visualization in Augmented Realitycited by 6
  18. 2025Explainable XR: Understanding User Behaviors of XR Environments using LLM-assisted Analytics Frameworkcited by 6
  19. 2025Mirai: A Wearable Proactive AI "Inner-Voice" for Contextual Nudgingcited by 6
  20. 2024A Deixis-Centered Approach for Documenting Remote Synchronous Communication around Data Visualizationscited by 5
  21. 2025Wearable AR in Everyday Contexts: Insights from a Digital Ethnography of YouTube Videoscited by 4
  22. 2025Leveraging Vision-Language Models for Open-Vocabulary Instance Segmentation and Trackingcited by 4
  23. 2023Context-Dependent Memory in Situated Visualizationcited by 3
  24. 2024SituationalLLM: Proactive language models with scene awareness for dynamic, contextual task guidancecited by 3
  25. 2025MaRginalia: Enabling In-person Lecture Capturing and Note-taking Through Mixed Realitycited by 2
  26. 2025Towards spatial computing: recent advances in multimodal natural interaction for XR headsetscited by 2
  27. 2019AppsPred: Predicting Context-Aware Smartphone Apps using Random Forest Learningcited by 1
  28. 2019Real World Longitudinal iOS App Usage Study at Scalecited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026VisionClaw: Always-On AI Agents through Smart Glassescited by 4