mlsanityData to 14 Oct 2026

SSL-OTA: Unveiling Backdoor Threats in Self-Supervised Learning for Object Detection

arXiv 2401.00137 ↗First posted 30 Dec 2023cs.CR cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The extensive adoption of Self-supervised learning(SSL) has led to an increased security threat from backdoor attacks. While existing research has mainly focused on backdoor attacks in image classification, there has been limited exploration of their implications for object detection. Object detection plays a critical role in security-sensitive applications, such as autonomous driving, where backdoor attacks seriously threaten human life and property. In this work, we propose the first backdoor attack designed for object detection tasks in SSL scenarios, called Object Transform Attack (SSL-OTA). SSL-OTA employs a trigger capable of altering predictions of the target object to the desired category, encompassing two attacks: Naive Attack(NA) and Dual-Source Blending Attack (DSBA). NA conducts data poisoning during downstream fine-tuning of the object detector, while DSBA additionally injects backdoors into the pre-trained encoder. We establish appropriate metrics and conduct extensive experiments on benchmark datasets, demonstrating the effectiveness of our proposed attack and its resistance to potential defenses. Notably, both NA and DSBA achieve high attack success rates (ASR) at extremely low poisoning rates (0.5%). The results underscore the importance of considering backdoor threats in SSL-based object detection and contribute a novel perspective to the field.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 30 Dec 2023.

Builds on

26 of 40 references.

References · 26

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  6. 2017Mask R-CNNcited by 7,277
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  8. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
  9. 2018Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networkscited by 580
  10. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  11. 2019Hidden Trigger Backdoor Attackscited by 371
  12. 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 353
14 more
  1. 2021Adversarial Neuron Pruning Purifies Backdoored Deep Modelscited by 235
  2. 2021Rethinking the Backdoor Attacks' Triggers: A Frequency Perspectivecited by 161
  3. 2021BadEncoder: Backdoor Attacks to Pre-trained Encoders in Self-Supervised Learningcited by 123
  4. 2021Instance Localization for Self-supervised Detection Pretrainingcited by 99
  5. 2021Backdoor Scanning for Deep Neural Networks through K-Arm Optimizationcited by 98
  6. 2021Backdoor Attacks on Self-Supervised Learningcited by 90
  7. 2021Poison Ink: Robust and Invisible Backdoor Attackcited by 50
  8. 2022BadDet: Backdoor Attacks on Object Detectioncited by 45
  9. 2022An Embarrassingly Simple Backdoor Attack on Self-supervised Learningcited by 31
  10. 2020Backdooring and Poisoning Neural Networks with Image-Scaling Attackscited by 28
  11. 2022Untargeted Backdoor Attack against Object Detectioncited by 28
  12. 2022Just Rotate it: Deploying Backdoor Attacks via Rotation Transformationcited by 20
  13. 2022ESTAS: Effective and Stable Trojan Attacks in Self-supervised Encoders with One Target Unlabelled Samplecited by 9
  14. 2023GhostEncoder: Stealthy Backdoor Attacks with Dynamic Triggers to Pre-trained Encoders in Self-supervised Learningcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Invisible Backdoor Attack against Self-supervised Learning
  2. 2024DeDe: Detecting Backdoor Samples for SSL Encoders via Decoders
  3. 2024On the Credibility of Backdoor Attacks Against Object Detectors in the Physical World
  4. 2023Attacking by Aligning: Clean-Label Backdoor Attacks on Object Detection
  5. 2022Dangerous Cloaking: Natural Trigger based Backdoor Attacks on Object Detectors in the Physical World
  6. 2024Towards Adversarial Robustness And Backdoor Mitigation in SSL
  7. 2023SSL-Cleanse: Trojan Detection and Mitigation in Self-Supervised Learning
  8. 2024Mask-based Invisible Backdoor Attacks on Object Detection