mlsanityData to 7 Oct 2026

Get a Model! Model Hijacking Attack Against Machine Learning Models

arXiv 2111.04394 ↗First posted 8 Nov 2021cs.CR cs.AI cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning models, multiple attacks have emerged. One class of such attacks is training time attack, whereby an adversary executes their attack before or during the machine learning model training. In this work, we propose a new training time attack against computer vision based machine learning models, namely model hijacking attack. The adversary aims to hijack a target model to execute a different task than its original one without the model owner noticing. Model hijacking can cause accountability and security risks since a hijacked model owner can be framed for having their model offering illegal or unethical services. Model hijacking attacks are launched in the same way as existing data poisoning attacks. However, one requirement of the model hijacking attack is to be stealthy, i.e., the data samples used to hijack the target model should look similar to the model's original training dataset. To this end, we propose two different model hijacking attacks, namely Chameleon and Adverse Chameleon, based on a novel encoder-decoder style ML model, namely the Camouflager. Our evaluation shows that both of our model hijacking attacks achieve a high attack success rate, with a negligible drop in model utility.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 42 of its 54 references that are in the map. First posted on arXiv 8 Nov 2021.

Builds on

42 of 54 references.

References · 42

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  4. 2014Going Deeper with Convolutionscited by 4,231
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  6. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
  7. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  8. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  9. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
  10. 2016Practical Black-Box Attacks against Machine Learningcited by 893
  11. 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
  12. 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
30 more
  1. 2019Towards Federated Learning at Scale: System Designcited by 826
  2. 2015The Limitations of Deep Learning in Adversarial Settingscited by 784
  3. 2016Stealing Machine Learning Models via Prediction APIscited by 602
  4. 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
  5. 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
  6. 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 475
  7. 2019Hidden Trigger Backdoor Attackscited by 359
  8. 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
  9. 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 307
  10. 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
  11. 2020Data Poisoning Attacks Against Federated Learning Systemscited by 266
  12. 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
  13. 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 219
  14. 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
  15. 2019MemGuard: Defending against Black-Box Membership Inference Attacks via Adversarial Examplescited by 183
  16. 2020Clean-Label Backdoor Attacks on Video Recognition Modelscited by 162
  17. 2020Dynamic Backdoor Attacks Against Machine Learning Modelscited by 147
  18. 2019Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learningcited by 117
  19. 2018Stealing Hyperparameters in Machine Learningcited by 115
  20. 2018Adversarial Reprogramming of Neural Networkscited by 115
  21. 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
  22. 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 112
  23. 2018Adversarial Attacks on Node Embeddings via Graph Poisoningcited by 109
  24. 2020An Embarrassingly Simple Approach for Trojan Attack in Deep Neural Networkscited by 92
  25. 2018Technical Report: When Does Machine Learning FAIL? Generalized Transferability for Evasion and Poisoning Attackscited by 78
  26. 2018AttriGuard: A Practical Defense Against Attribute Inference Attacks via Adversarial Machine Learningcited by 58
  27. 2017Adversarial Image Perturbation for Privacy Protection -- A Game Theory Perspectivecited by 38
  28. 2020Practical Data Poisoning Attack against Next-Item Recommendationcited by 27
  29. 2018Data Poisoning Attack against Unsupervised Node Embedding Methodscited by 19
  30. 2018Tagvisor: A Privacy Advisor for Sharing Hashtagscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 5; 2024: 5; 2025: 1; 2026: 1.

13 papers.

Sort:

By area: