mlsanityData to 14 Oct 2026

Uncertainty-Weighted Fusion of Image and Synthetic Event for Video Anomaly Detection

arXiv 2505.02393 ↗First posted 5 May 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Most existing video anomaly detectors rely on RGB frames alone, which limit their ability to capture abrupt or transient motion cues that are critical for identifying anomalous events. We propose Uncertainty Weighted Image Event Fusion (IEF-VAD), a framework that integrates complementary RGB and synthetic motion information through a principled weighting mechanism. The method models the high variance and heavy tailed characteristics of synthetic motion cues with a Student's t likelihood, computes value level inverse variance weights using a Laplace approximation to prevent the image modality from overshadowing motion information, and performs iterative refinement to suppress residual cross modal noise. This formulation provides a more balanced and reliable fusion process compared to cross attention or gating based approaches that often suffer from modality dominance. Without requiring an event camera or frame level annotations, IEF-VAD achieves new state of the art performance on multiple real world anomaly detection benchmarks and remains stable under degradation applied to individual modalities. The results indicate that extracting and integrating complementary motion cues is an effective direction for robust video understanding across diverse environments.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 64 of its 76 references that are in the map. First posted on arXiv 5 May 2025.

Builds on

64 of 76 references.

References · 64

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  5. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  6. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  7. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
  8. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  9. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
  10. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  11. 2019Event-based Vision: A Surveycited by 1,016
  12. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
38 more
  1. 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
  2. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  3. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
  4. 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 429
  5. 2022Multimodal Learning with Transformers: A Surveycited by 400
  6. 2017Future Frame Prediction for Anomaly Detection -- A New Baselinecited by 391
  7. 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 365
  8. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  9. 2023Multimodal Deep Learningcited by 258
  10. 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
  11. 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
  12. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
  13. 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
  14. 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
  15. 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 193
  16. 2020Anomaly Detection in Video via Self-Supervised and Multi-Task Learningcited by 148
  17. 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 138
  18. 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 123
  19. 2022Secrets of Event-Based Optical Flowcited by 92
  20. 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 90
  21. 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
  22. 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 89
  23. 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 85
  24. 2021The Promises and Pitfalls of Deep Kernel Learningcited by 81
  25. 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
  26. 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 70
  27. 2024Recent Event Camera Innovations: A Surveycited by 68
  28. 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
  29. 2023Self-Supervised Multimodal Learning: A Surveycited by 58
  30. 2023Open-Vocabulary Video Anomaly Detectioncited by 57
  31. 2023Event Camera Data Pre-trainingcited by 50
  32. 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
  33. 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 49
  34. 2016Backprop KF: Learning Discriminative Deterministic State Estimatorscited by 47
  35. 2023Multimodal Motion Conditioned Diffusion Model for Skeleton-based Video Anomaly Detectioncited by 42
  36. 2024Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Promptscited by 40
  37. 2023EventCLIP: Adapting CLIP for Event-based Object Recognitioncited by 36
  38. 2023EventBind: Learning a Unified Representation to Bind Them All for Event-based Open-world Understandingcited by 34

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.