mlsanityData to 14 Oct 2026

Hoi2Threat: An Interpretable Threat Detection Method for Human Violence Scenarios Guided by Human-Object Interaction

arXiv 2503.10508 ↗First posted 13 Mar 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In light of the mounting imperative for public security, the necessity for automated threat detection in high-risk scenarios is becoming increasingly pressing. However, existing methods generally suffer from the problems of uninterpretable inference and biased semantic understanding, which severely limits their reliability in practical deployment. In order to address the aforementioned challenges, this article proposes a threat detection method based on human-object interaction pairs (HOI-pairs), Hoi2Threat. This method is based on the fine-grained multimodal TD-Hoi dataset, enhancing the model's semantic modeling ability for key entities and their behavioral interactions by using structured HOI tags to guide language generation. Furthermore, a set of metrics is designed for the evaluation of text response quality, with the objective of systematically measuring the model's representation accuracy and comprehensibility during threat interpretation. The experimental results have demonstrated that Hoi2Threat attains substantial enhancement in several threat detection tasks, particularly in the core metrics of Correctness of Information (CoI), Behavioral Mapping Accuracy (BMA), and Threat Detailed Orientation (TDO), which are 5.08, 5.04, and 4.76, and 7.10%, 6.80%, and 2.63%, respectively, in comparison with the Gemma3 (4B). The aforementioned results provide comprehensive validation of the merits of this approach in the domains of semantic understanding, entity behavior mapping, and interpretability.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 39 references that are in the map. First posted on arXiv 13 Mar 2025.

Builds on

14 of 39 references.

References · 14

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  6. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  7. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  8. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  9. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  10. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
  11. 2021HOTR: End-to-End Human-Object Interaction Detection with Transformerscited by 183
  12. 2024Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLMcited by 64
2 more
  1. 2021Anomaly Detection in Video Sequences: A Benchmark and Computational Modelcited by 10
  2. 2024A Lightweight Dual-Branch System for Weakly-Supervised Video Anomaly Detection on Consumer Edge Devicescited by 2

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.