ViSAGE: Constructing Self-Correcting Memories for Long-Form Video Understanding
Not on the map. Why?
Abstract (arXiv)
Multimodal agents operating in long-horizon environments must build and continually update multimedia memories to support entity-consistent, temporally grounded reasoning. However, existing agentic memory approaches often discard fine-grained dentity cues under aggressive compression and segment-wise processing. They also rely heavily on vector similarity retrieval, which can surface semantically related yet identity-mismatched evidence, leading to entity confusion, error propagation, and hallucinated answers. We propose ViSAGE, a multimodal agentic memory framework that constructs self-correcting, entity-centric memories. Specifically, ViSAGE anchors entity identity via cross-modal binding over long temporal ranges. It then applies bidirectional memory refinement to propagate delayed identity evidence, retroactively unifying historical records and improving future reasoning. We also introduce multi-agent cross-verification to assess retrieved evidence under an identity-evidence alignment onstraint, enabling abstention instead of unsupported answers when evidence is missing. Extensive results demonstrate that ViSAGE consistently outperforms the strongest baseline, achieving 5.9% higher accuracy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
16 of 37 references.
References · 16
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
- 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
- 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 83
4 more
- 2025Embodied AI Agents: Modeling the Worldcited by 57
- 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
- 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
- 2024Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understandingcited by 24
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval
- 2026Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memory
- 2026PyraVid: Hierarchical Multimodal Memory for Long-Horizon Video Reasoning
- 2026Homer: Understanding Long-form Videos with Hierarchical Memory and Agentic Reasoning
- 2026VideoTapestry: Query-Adaptive Memory Refinement for Multi-Agent Long-Video Understanding
- 2026RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning
- 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents
- 2026Bridging Modalities, Spanning Time: Structured Memory for Ultra-Long Agentic Video Reasoning