Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervision
Not on the map. Why?
Cited by 20 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Violence detection has been studied in computer vision for years. However, previous work are either superficial, e.g., classification of short-clips, and the single scenario, or undersupplied, e.g., the single modality, and hand-crafted features based multimodality. To address this problem, in this work we first release a large-scale and multi-scene dataset named XD-Violence with a total duration of 217 hours, containing 4754 untrimmed videos with audio signals and weak labels. Then we propose a neural network containing three parallel branches to capture different relations among video snippets and integrate features, where holistic branch captures long-range dependencies using similarity prior, localized branch captures local positional relation using proximity prior, and score branch dynamically captures the closeness of predicted score. Besides, our method also includes an approximator to meet the needs of online detection. Our method outperforms other state-of-the-art methods on our released dataset and other existing benchmark. Moreover, extensive experimental results also show the positive effect of multimodal (audio-visual) input and modeling relationships. The code and dataset will be released in https://roc-ng.github.io/XD-Violence/.
Key facts. Cited by 235 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 21; 2023: 35; 2024: 48; 2025: 63; 2026: 58.
235 papers.
Sort:
By area:
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2022CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detectioncited by 67
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectioncited by 64
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
38 more
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024A Closer Look at AUROC and AUPRC under Class Imbalancecited by 56
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 48
- 2022Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detectioncited by 47
- 2024Hawk: Learning to Understand Open-World Video Anomaliescited by 47
- 2024Video Anomaly Detection and Explanation via Large Language Modelscited by 45
- 2023Learning Prompt-Enhanced Context Features for Weakly-Supervised Video Anomaly Detectioncited by 43
- 2023A New Comprehensive Benchmark for Semi-supervised Video Anomaly Detection and Anticipationcited by 42
- 2024Weakly Supervised Video Anomaly Detection and Localization with Spatio-Temporal Promptscited by 40
- 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 37
- 2021HANet: Hierarchical Alignment Networks for Video-Text Retrievalcited by 31
- 2022Dynamic Local Aggregation Network with Adaptive Clusterer for Anomaly Detectioncited by 27
- 2023Delving into CLIP latent space for Video Anomaly Recognitioncited by 27
- 2024Deep Learning for Video Anomaly Detection: A Reviewcited by 27
- 2022Modality-Aware Contrastive Instance Learning with Self-Distillation for Weakly-Supervised Audio-Visual Violence Detectioncited by 26
- 2022Towards Open Set Video Anomaly Detectioncited by 26
- 2022DyAnNet: A Scene Dynamicity Guided Self-Trained Video Anomaly Detection Networkcited by 26
- 2023Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and Modelcited by 25
- 2023Anomaly Heterogeneity Learning for Open-set Supervised Anomaly Detectioncited by 25
- 2024Large Language Models for Anomaly and Out-of-Distribution Detection: A Surveycited by 24
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Modelscited by 24
- 2023TeD-SPAD: Temporal Distinctiveness for Self-supervised Privacy-preservation for video Anomaly Detectioncited by 23
- 2023BatchNorm-based Weakly Supervised Video Anomaly Detectioncited by 22
- 2024Learnable Expansion of Graph Operators for Multi-Modal Feature Fusioncited by 22
- 2024Networking Systems for Video Anomaly Detection: A Tutorial and Surveycited by 21
- 2022Contrastive Transformer-based Multiple Instance Learning for Weakly Supervised Polyp Frame Detectioncited by 20
- 2023Hyperbolic Audio-visual Zero-shot Learningcited by 19
- 2022CHAD: Charlotte Anomaly Datasetcited by 18
- 2023Graph Anomaly Detection in Time Series: A Surveycited by 18
- 2024Video Anomaly Detection in 10 Years: A Survey and Outlookcited by 18
- 2025UCF-Crime-DVS: A Novel Event-Based Dataset for Video Anomaly Detection with Spiking Neural Networkscited by 18
- 2024Collaborative Learning of Anomalies with Privacy (CLAP) for Unsupervised Video Anomaly Detection: A New Baselinecited by 17
- 2023Weakly-Supervised Video Anomaly Detection with Snippet Anomalous Attentioncited by 15
- 2024A Survey on Safe Multi-Modal Learning Systemcited by 15
- 2025PANDA: Towards Generalist Video Anomaly Detection via Agentic AI Engineercited by 15
50 most cited of 235 All 235 (JSON)
- 2026Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization1 Oct 2026
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding1 Oct 2026
- 2026Can We Anticipate Violence? Multimodal Learning from Pre-Incident Behavioral Cues30 Sep 2026
- 2026Decision Readouts for Text-Mediated Video Anomaly Detection: An Exploratory Evaluation of Jev and Qwen28 Sep 2026
- 2026VidOmni-Bench: A Benchmark for Fine-Grained Video Understanding via Spatio-Temporal Event Verification across Complexity and Duration18 Sep 2026
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection15 Sep 2026
- 2026Do Input-Level Defenses Transfer to Observation-Level Attacks on VideoLLMs?8 Sep 2026
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding7 Sep 2026
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understanding7 Sep 2026
- 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understanding6 Sep 2026
- 2026NOVA: Normal-Side Modeling for Training-Free Zero-Shot Video Anomaly Detection6 Sep 2026
- 2026Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection4 Sep 2026
38 more
- 2026Post-Training VLMs for Video Mistake Detection28 Aug 2026
- 2026What Do Interaction Representations Actually Measure? Pre-Event Separability in Weakly-Supervised Violence Detection28 Aug 2026
- 2026Multi-Modal Anomaly Detection: A Survey24 Aug 2026
- 2026Look Inside Each Video: Rethinking How Video Anomaly Detection Is Evaluated22 Aug 2026
- 2026A VLM Answer Is Not an Anomaly Score: Rank Compression Across Image and Video Anomaly Detection21 Aug 2026
- 2026TD-VAD: Breaking Visual Dependence in Video Anomaly Detection with Text-Driven Learning12 Aug 2026
- 2026Beyond Hazard Resemblance: Contrastive Event Adjudication for Training-Free Video Anomaly Detection10 Aug 2026
- 2026FedVAR: Prototype-Aligned Federated Framework for Video Anomaly Recognition7 Aug 2026
- 2026TAU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding6 Aug 2026
- 2026EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding29 Jul 2026
- 2026Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness22 Jul 2026
- 2026Event Stream based Multi-Modal Video Anomaly Detection: A Benchmark Dataset and Algorithms10 Jul 2026
- 2026Learning to Watch: Active Video Anomaly Understanding via Interleaved Policy Optimization1 Jul 2026
- 2026SENSE-VAD: Sentient and Semantic Video Anomaly Detection for Autonomous Driving30 Jun 2026
- 2026Learning Where and When: Patch-Based Spatiotemporal Localization in Weakly Supervised Video Anomaly Detection28 Jun 2026
- 2026Robust Zero-Shot Generalization for Open-Vocabulary Action Recognition via Task Arithmetic17 Jun 2026
- 2026MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios4 Jun 2026
- 2026PaSBench-Video: A Streaming Video Benchmark for Proactive Safety Warning1 Jun 2026
- 2026Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration29 May 2026
- 2026Rethinking Weak Supervision in Anomaly Detection: A Comprehensive Benchmark25 May 2026
- 2026An Analysis Focused on Womens Safety: Can VAD Models Be Enhanced by a Multi-modal Dataset?25 May 2026
- 2026FoodMonitor: Benchmarking MLLMs for Explainable Compliance Analysis23 May 2026
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection22 May 2026
- 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detection14 May 2026
- 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection14 May 2026
- 2026NAACA: Training-Free NeuroAuditory Attentive Cognitive Architecture with Oscillatory Working Memory for Salience-Driven Attention Gating13 May 2026
- 2026SphereVAD: Training-Free Video Anomaly Detection via Geodesic Inference on the Unit Hypersphere8 May 2026
- 2026Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding9 Apr 2026
- 2026ESOM: Efficiently Understanding Streaming Video Anomalies with Open-world Dynamic Definitions9 Apr 2026
- 2026CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inference7 Apr 2026
- 2026QVAD: A Question-Centric Agentic Framework for Efficient and Training-Free Video Anomaly Detection3 Apr 2026
- 2026AViS-Mamba: Adaptive Visual Steering of Audio State-Space Dynamics for Violence Detection2 Apr 2026
- 2026VADMamba++: Efficient Video Anomaly Detection via Hybrid Modeling in Grayscale Space1 Apr 2026
- 2026Towards Video Anomaly Detection from Event Streams: A Baseline and Benchmark Datasets26 Mar 2026
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understanding19 Mar 2026
- 2026Shot-Aware Frame Sampling for Video Understanding18 Mar 2026
- 2026Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection10 Mar 2026
- 2026Benchmarking Compact VLMs for Clip-Level Surveillance Anomaly Detection Under Weak Supervision3 Mar 2026
50 newest of 235 All 235 (JSON)
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 121
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularitycited by 66
- 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 63
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Modelscited by 24
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Promptingcited by 8
- 2024Vision-Language Models Assisted Unsupervised Video Anomaly Detectioncited by 6
- 2023Multimodal Guidance Network for Missing-Modality Inference in Content Moderationcited by 5
- 2025iSafetyBench: A video-language benchmark for safety in industrial environmentcited by 5
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understandingcited by 3
- 2026CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inferencecited by 3
- 2026Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detectioncited by 2
- 2025Cerberus: Real-Time Video Anomaly Detection via Cascaded Vision-Language Modelscited by 1
12 most cited of 16 All 16 (JSON)
- 2026NOVA: Normal-Side Modeling for Training-Free Zero-Shot Video Anomaly Detection6 Sep 2026
- 2026Probing Collision Grounding in Vision-Language Models for Safe Human-Robot Collaboration29 May 2026
- 2026COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detection14 May 2026
- 2026CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inference7 Apr 2026
- 2026TAU-R1: Visual Language Model for Traffic Anomaly Understanding19 Mar 2026
- 2026Shot-Aware Frame Sampling for Video Understanding18 Mar 2026
- 2026Steering and Rectifying Latent Representation Manifolds in Frozen Multi-modal LLMs for Video Anomaly Detection27 Feb 2026
- 2025Cerberus: Real-Time Video Anomaly Detection via Cascaded Vision-Language Models18 Oct 2025
- 2025Unlocking Vision-Language Models for Video Anomaly Detection via Fine-Grained Prompting2 Oct 2025
- 2025iSafetyBench: A video-language benchmark for safety in industrial environment1 Aug 2025
- 2024Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularity9 Dec 2024
- 2024VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Models2 Dec 2024
12 newest of 16 All 16 (JSON)
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selectioncited by 64
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understandingcited by 5
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localizationcited by 1
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detectioncited by 1
- 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understandingcited by 1
- 2025MissionHD: Hyperdimensional Refinement of Distribution-Deficient Reasoning Graphs for Video Anomaly Detectioncited by 0
- 2025Live-E2T: Real-time Threat Monitoring in Video via Deduplicated Event Reasoning and Chain-of-Thoughtcited by 0
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learningcited by 0
- 2026Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detectioncited by 0
- 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detectioncited by 0
- 2026EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understandingcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understandingcited by 0
- 2026Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding1 Oct 2026
- 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understanding6 Sep 2026
- 2026EgoSafe: A First-Person Mobile-Captured Benchmark for Visual Safety Understanding29 Jul 2026
- 2026CoReVAD: A Contextual Reasoning Framework for Training-Free Video Anomaly Detection22 May 2026
- 2026LATERN: Test-Time Context-Aware Explainable Video Anomaly Detection14 May 2026
- 2026Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection10 Mar 2026
- 2026SRVAU-R1: Enhancing Video Anomaly Understanding via Reflection-Aware Learning1 Feb 2026
- 2025Live-E2T: Real-time Threat Monitoring in Video via Deduplicated Event Reasoning and Chain-of-Thought23 Sep 2025
- 2025MissionHD: Hyperdimensional Refinement of Distribution-Deficient Reasoning Graphs for Video Anomaly Detection20 Aug 2025
- 2025A2Seek: Towards Reasoning-Centric Benchmark for Aerial Anomaly Understanding28 May 2025
- 2025Chain-of-Evidence Multimodal Reasoning for Few-shot Temporal Action Localization18 Apr 2025
- 2024VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection22 Nov 2024
- 2025PANDA: Towards Generalist Video Anomaly Detection via Agentic AI Engineercited by 15
- 2026Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Groundingcited by 3
- 2026QVAD: A Question-Centric Agentic Framework for Efficient and Training-Free Video Anomaly Detectioncited by 1
- 2025MA-CBP: A Criminal Behavior Prediction Framework Based on Multi-Agent Asynchronous Collaborationcited by 0
- 2026Open-Ended Video Game Glitch Detection with Agentic Reasoning and Temporal Grounding9 Apr 2026
- 2026QVAD: A Question-Centric Agentic Framework for Efficient and Training-Free Video Anomaly Detection3 Apr 2026
- 2025PANDA: Towards Generalist Video Anomaly Detection via Agentic AI Engineer30 Sep 2025
- 2025MA-CBP: A Criminal Behavior Prediction Framework Based on Multi-Agent Asynchronous Collaboration8 Aug 2025
- 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanationscited by 37
- 2025Failures to Surface Harmful Contents in Video Large Language Modelscited by 4
- 2025SafeVision: Efficient Image Guardrail with Robust Policy Adherence and Explainabilitycited by 4
- 2025Customize Multi-modal RAI Guardrails with Precedent-based predictionscited by 1
- 2025SafeVision: Efficient Image Guardrail with Robust Policy Adherence and Explainability28 Oct 2025
- 2025Failures to Surface Harmful Contents in Video Large Language Models14 Aug 2025
- 2025Customize Multi-modal RAI Guardrails with Precedent-based predictions28 Jul 2025
- 2024SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanations9 Dec 2024
- 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 226
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
- 2022Generative Cooperative Learning for Unsupervised Video Anomaly Detectioncited by 102
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 88
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2022CLIP-TSA: CLIP-Assisted Temporal Self-Attention for Weakly-Supervised Video Anomaly Detectioncited by 67
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2023Open-Vocabulary Video Anomaly Detectioncited by 57
- 2024A Closer Look at AUROC and AUPRC under Class Imbalancecited by 56
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
12 most cited of 193 All 193 (JSON)
- 2026Controllable Multi-label Video Safety Detection via Adaptive Tversky Policy Optimization1 Oct 2026
- 2026Can We Anticipate Violence? Multimodal Learning from Pre-Incident Behavioral Cues30 Sep 2026
- 2026Decision Readouts for Text-Mediated Video Anomaly Detection: An Exploratory Evaluation of Jev and Qwen28 Sep 2026
- 2026VidOmni-Bench: A Benchmark for Fine-Grained Video Understanding via Spatio-Temporal Event Verification across Complexity and Duration18 Sep 2026
- 2026Probe-VAD: Ordinal Likelihood Probing for Training-Free Video Anomaly Detection15 Sep 2026
- 2026ReactVAU: A Slow-Fast Decoupled Framework for Streaming Video Anomaly Understanding7 Sep 2026
- 2026AnomalyCraft-700K: Component-Level Controllable and Verifiable Synthetic Anomalies for Fine-Grained Video Anomaly Understanding7 Sep 2026
- 2026Adaptive Multi-Granularity Temporal Modeling for Weakly Supervised Video Anomaly Detection4 Sep 2026
- 2026Post-Training VLMs for Video Mistake Detection28 Aug 2026
- 2026What Do Interaction Representations Actually Measure? Pre-Event Separability in Weakly-Supervised Violence Detection28 Aug 2026
- 2026Multi-Modal Anomaly Detection: A Survey24 Aug 2026
- 2026Look Inside Each Video: Rethinking How Video Anomaly Detection Is Evaluated22 Aug 2026
12 newest of 193 All 193 (JSON)