HOD: A Benchmark Dataset for Harmful Object Detection
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Recent multi-media data such as images and videos have been rapidly spread out on various online services such as social network services (SNS). With the explosive growth of online media services, the number of image content that may harm users is also growing exponentially. Thus, most recent online platforms such as Facebook and Instagram have adopted content filtering systems to prevent the prevalence of harmful content and reduce the possible risk of adverse effects on users. Unfortunately, computer vision research on detecting harmful content has not yet attracted attention enough. Users of each platform still manually click the report button to recognize patterns of harmful content they dislike when exposed to harmful content. However, the problem with manual reporting is that users are already exposed to harmful content. To address these issues, our research goal in this work is to develop automatic harmful object detection systems for online services. We present a new benchmark dataset for harmful object detection. Unlike most related studies focusing on a small subset of object categories, our dataset addresses various categories. Specifically, our proposed dataset contains more than 10,000 images across 6 categories that might be harmful, consisting of not only normal cases but also hard cases that are difficult to detect. Moreover, we have conducted extensive experiments to evaluate the effectiveness of our proposed dataset. We have utilized the recently proposed state-of-the-art (SOTA) object detection architectures and demonstrated our proposed dataset can be greatly useful for the real-time harmful object detection task. The whole source codes and datasets are publicly accessible at https://github.com/poori-nuna/HOD-Benchmark-Dataset.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 20 of its 48 references that are in the map. First posted on arXiv 8 Oct 2023.
Builds on
20 of 48 references.
References · 20
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2015Fast R-CNNcited by 2,933
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
8 more
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
- 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,020
- 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
- 2016Speed/accuracy trade-offs for modern convolutional object detectorscited by 198
- 2021Lite-HRNet: A Lightweight High-Resolution Networkcited by 91
- 2020Real-Time Sign Language Detection using Human Pose Estimationcited by 29
- 2017Automatic Handgun Detection Alarm in Videos Using Deep Learningcited by 15
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 1.
10 papers.
- 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Modelscited by 167
- 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoningcited by 42
- 2024Assessment of Multimodal Large Language Models in Alignment with Human Valuescited by 36
- 2024Cross-Modal Safety Mechanism Transfer in Large Vision-Language Modelscited by 19
- 2024FlexiFilm: Long Video Generation with Flexible Conditionscited by 13
- 2025HoliSafe: Holistic Safety Benchmarking and Modeling for Vision-Language Modelcited by 9
- 2025VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safetycited by 8
- 2025Zero-Shot Defense Against Toxic Images via Inherent Multimodal Alignment in LVLMscited by 6
- 2025Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Securitycited by 2
- 2026Architectural Backdoors in Vision-Language Model Supply Chains via Representation Steeringcited by 0
- 2026Architectural Backdoors in Vision-Language Model Supply Chains via Representation Steering28 Jul 2026
- 2025Q-MLLM: Vector Quantization for Robust Multimodal Large Language Model Security20 Nov 2025
- 2025VLSU: Mapping the Limits of Joint Multimodal Understanding for AI Safety21 Oct 2025
- 2025HoliSafe: Holistic Safety Benchmarking and Modeling for Vision-Language Model5 Jun 2025
- 2025GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning16 May 2025
- 2025Zero-Shot Defense Against Toxic Images via Inherent Multimodal Alignment in LVLMs25 Feb 2025
- 2024Cross-Modal Safety Mechanism Transfer in Large Vision-Language Models16 Oct 2024
- 2024FlexiFilm: Long Video Generation with Flexible Conditions29 Apr 2024
- 2024Assessment of Multimodal Large Language Models in Alignment with Human Values26 Mar 2024
- 2024Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models3 Feb 2024
Similar, not cited
Close in wording, no citation either way
- 2024Harmful YouTube Video Detection: A Taxonomy of Online Harm and MLLMs as Alternative Annotators
- 2026Safe Alone, Unsafe Together: Safeguarding Against Implicit Toxicity When Benign Images Combine
- 2025Towards Safer Social Media Platforms: Scalable and Performant Few-Shot Harmful Content Moderation Using Large Language Models
- 2026HarmVideoBench: Benchmarking Harmful Video Understanding in Large Multimodal Models
- 2026Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed
- 2024T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognition
- 2024UnsafeBench: Benchmarking Image Safety Classifiers on Real-World and AI-Generated Images
- 2025Understanding and Mitigating Toxicity in Image-Text Pretraining Datasets: A Case Study on LLaVA