mlsanityData to 7 Oct 2026

ViSAGE: Constructing Self-Correcting Memories for Long-Form Video Understanding

arXiv 2607.28678 ↗First posted 29 Jul 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal agents operating in long-horizon environments must build and continually update multimedia memories to support entity-consistent, temporally grounded reasoning. However, existing agentic memory approaches often discard fine-grained dentity cues under aggressive compression and segment-wise processing. They also rely heavily on vector similarity retrieval, which can surface semantically related yet identity-mismatched evidence, leading to entity confusion, error propagation, and hallucinated answers. We propose ViSAGE, a multimodal agentic memory framework that constructs self-correcting, entity-centric memories. Specifically, ViSAGE anchors entity identity via cross-modal binding over long temporal ranges. It then applies bidirectional memory refinement to propagate delayed identity evidence, retroactively unifying historical records and improving future reasoning. We also introduce multi-agent cross-verification to assess retrieved evidence under an identity-evidence alignment onstraint, enabling abstention instead of unsupported answers when evidence is missing. Extensive results demonstrate that ViSAGE consistently outperforms the strongest baseline, achieving 5.9% higher accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 37 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

16 of 37 references.

References · 16

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  2. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  3. 2023VILA: On Pre-training for Visual Language Modelscited by 686
  4. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 666
  5. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
  6. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  7. 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 341
  8. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  9. 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
  10. 2024MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understandingcited by 223
  11. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  12. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 83
4 more
  1. 2025Embodied AI Agents: Modeling the Worldcited by 57
  2. 2024AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent Systemcited by 53
  3. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  4. 2024Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understandingcited by 24

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Visual Agentic Memory: Enabling Online Long Video Understanding via Online Indexing, Hierarchical Memory, and Agentic Retrieval
  2. 2026Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memory
  3. 2026PyraVid: Hierarchical Multimodal Memory for Long-Horizon Video Reasoning
  4. 2026Homer: Understanding Long-form Videos with Hierarchical Memory and Agentic Reasoning
  5. 2026VideoTapestry: Query-Adaptive Memory Refinement for Multi-Agent Long-Video Understanding
  6. 2026RRM: Experience-Driven Reflective Retrieval Memory for Long-Horizon Multimodal Reasoning
  7. 2026VideoLoop: Looped Working Memory Against Semantic Thrashing in Long-Form Video Agents
  8. 2026Bridging Modalities, Spanning Time: Structured Memory for Ultra-Long Agentic Video Reasoning