ScrapMem: A Bio-inspired Framework for On-device Personalized Agent Memory via Optical Forgetting
On the map: LLM agents and tool use → Agent memory systems
Abstract (arXiv)
Long-term personalized memory for LLM agents is challenging on resource-limited edge devices due to high storage costs and multimodal complexity. To address this, we propose ScrapMem, a framework that integrates multimodal data into "Scrapbook Page." ScrapMem introduces Optical Forgetting, an optical compression mechanism that progressively reduces the resolution of older memories, lowering storage cost while suppressing low-value details. To maintain semantic consistency, we construct an Episodic Memory Graph (EM-Graph) that organizes key events into a causal-temporal structure. Extensive experiments on the multimodal ATM-Bench showcase that ScrapMem provides three main benefits: (1) strong performance, achieving a new state-of-the-art with a 51.0% Joint@10 score; (2) high storage efficiency, reducing memory usage by up to 93% via optical forgetting; and (3) improved recall, increasing Recall@10 to 70.3% through structured aggregation. ScrapMem offers an effective and storage-efficient solution for on-device long-term memory in multimodal LLM agents.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Agent memory systems, one of 16 directions in LLM agents and tool use. Builds on 19 of its 43 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
19 of 43 references.
Closest ancestors · 5
Same direction, newest first
- 2026NextMem: Towards Latent Factual Memory for LLM-based Agents26 Feb
- 2026Agentic Unlearning: When LLM Agent Meets Machine Unlearning6 Feb
- 2026MemOCR: Layout-Aware Visual Memory for Efficient Long-Horizon Reasoning29 Jan
- 2026AgentOCR: Reimagining Agent History via Optical Self-Compression8 Jan
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory28 Apr
Other references · 14
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2025From RAG to Memory: Non-Parametric Continual Learning for Large Language Modelscited by 223
- 2025DeepSeek-OCR: Contexts Optical Compressioncited by 174
- 2024On-Device Language Models: A Comprehensive Reviewcited by 101
- 2025Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Managementcited by 51
- 2024Foundations and Recent Trends in Multimodal Mobile Agents: A Surveycited by 31
- 2024Retrieval Meets Reasoning: Even High-school Textbook Knowledge Benefits Multimodal Reasoningcited by 13
- 2026According to Me: Long-Term Personalized Referential Memory QAcited by 12
- 2026OCR-Memory: Optical Context Retrieval for Long-Horizon Agent Memorycited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidationcited by 3
- 2026Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluationcited by 0
- 2026HGP:An on-device personalized agent memory via hybrid graph storagecited by 0
- 2026HGP:An on-device personalized agent memory via hybrid graph storage7 Oct 2026
- 2026Graph-Based Personalized Memory for LLM Agents: Representation, Evolution, Retrieval, and Evaluation8 Sep 2026
- 2026LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation13 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Caching for the Future: Scrub Jay Episodic Memory Principles for Agent Memory Systems
- 2026CreaMem: A Scene-Aware Memory Architecture for Personalized Agents
- 2026Human-Inspired Memory Architecture for LLM Agents
- 2026PLACEMEM: Toward a Compute-Aware Memory Plane for Lifelong Agents
- 2026Towards Autonomous Memory Agents
- 2026SF-AMS: Strategic Forgetting for Structured Memory in LLM Agent
- 2026All-Mem: Agentic Lifelong Memory via Dynamic Topology Evolution
- 2026FSFM: A Biologically-Inspired Framework for Selective Forgetting of Agent Memory