Get a Model! Model Hijacking Attack Against Machine Learning Models
Not on the map. Why?
Abstract (arXiv)
Machine learning (ML) has established itself as a cornerstone for various critical applications ranging from autonomous driving to authentication systems. However, with this increasing adoption rate of machine learning models, multiple attacks have emerged. One class of such attacks is training time attack, whereby an adversary executes their attack before or during the machine learning model training. In this work, we propose a new training time attack against computer vision based machine learning models, namely model hijacking attack. The adversary aims to hijack a target model to execute a different task than its original one without the model owner noticing. Model hijacking can cause accountability and security risks since a hijacked model owner can be framed for having their model offering illegal or unethical services. Model hijacking attacks are launched in the same way as existing data poisoning attacks. However, one requirement of the model hijacking attack is to be stealthy, i.e., the data samples used to hijack the target model should look similar to the model's original training dataset. To this end, we propose two different model hijacking attacks, namely Chameleon and Adverse Chameleon, based on a novel encoder-decoder style ML model, namely the Camouflager. Our evaluation shows that both of our model hijacking attacks achieve a high attack success rate, with a negligible drop in model utility.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 42 of its 54 references that are in the map. First posted on arXiv 8 Nov 2021.
Builds on
42 of 54 references.
References · 42
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2014Going Deeper with Convolutionscited by 4,231
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
- 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 937
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2018The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networkscited by 847
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
30 more
- 2019Towards Federated Learning at Scale: System Designcited by 826
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 784
- 2016Stealing Machine Learning Models via Prediction APIscited by 602
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
- 2017Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networkscited by 484
- 2018ML-Leaks: Model and Data Independent Membership Inference Attacks and Defenses on Machine Learning Modelscited by 475
- 2019Hidden Trigger Backdoor Attackscited by 359
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
- 2020Attack of the Tails: Yes, You Really Can Backdoor Federated Learningcited by 307
- 2018Knockoff Nets: Stealing Functionality of Black-Box Modelscited by 285
- 2020Data Poisoning Attacks Against Federated Learning Systemscited by 266
- 2019The Secret Revealer: Generative Model-Inversion Attacks Against Deep Neural Networkscited by 241
- 2018Manipulating Machine Learning: Poisoning Attacks and Countermeasures for Regression Learningcited by 219
- 2020BadNL: Backdoor Attacks against NLP Models with Semantic-preserving Improvementscited by 191
- 2019MemGuard: Defending against Black-Box Membership Inference Attacks via Adversarial Examplescited by 183
- 2020Clean-Label Backdoor Attacks on Video Recognition Modelscited by 162
- 2020Dynamic Backdoor Attacks Against Machine Learning Modelscited by 147
- 2019Updates-Leak: Data Set Inference and Reconstruction Attacks in Online Learningcited by 117
- 2018Stealing Hyperparameters in Machine Learningcited by 115
- 2018Adversarial Reprogramming of Neural Networkscited by 115
- 2019TBT: Targeted Neural Network Attack with Bit Trojancited by 112
- 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 112
- 2018Adversarial Attacks on Node Embeddings via Graph Poisoningcited by 109
- 2020An Embarrassingly Simple Approach for Trojan Attack in Deep Neural Networkscited by 92
- 2018Technical Report: When Does Machine Learning FAIL? Generalized Transferability for Evasion and Poisoning Attackscited by 78
- 2018AttriGuard: A Practical Defense Against Attribute Inference Attacks via Adversarial Machine Learningcited by 58
- 2017Adversarial Image Perturbation for Privacy Protection -- A Game Theory Perspectivecited by 38
- 2020Practical Data Poisoning Attack against Next-Item Recommendationcited by 27
- 2018Data Poisoning Attack against Unsupervised Node Embedding Methodscited by 19
- 2018Tagvisor: A Privacy Advisor for Sharing Hashtagscited by 8
Built on by
Citing papers per year: 2022: 1; 2023: 5; 2024: 5; 2025: 1; 2026: 1.
13 papers.
Sort:
By area:
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,339
- 2023Prompt Injection attack against LLM-integrated Applicationscited by 568
- 2023Two-in-One: A Model Hijacking Attack Against Text Generation Modelscited by 11
- 2024Purified and Unified Steganographic Networkcited by 10
- 2023STDLens: Model Hijacking-Resilient Federated Learning for Object Detectioncited by 4
- 2023Mondrian: Prompt Abstraction Attack Against Large Language Models for Cheaper API Pricingcited by 4
- 2024On the Efficiency of Privacy Attacks in Federated Learningcited by 3
- 2025BADTV: Unveiling Backdoor Threats in Third-Party Task Vectorscited by 3
- 2022SeqNet: An Efficient Neural Network for Automatic Malware Detectioncited by 1
- 2024Vera Verto: Multimodal Hijacking Attackcited by 1
- 2026Osmosis Distillation: Model Hijacking with the Fewest Samplescited by 1
- 2024SnatchML: Hijacking ML models without Training Accesscited by 0
1 more
- 2024Model Hijacking Attack in Federated Learningcited by 0
- 2026Osmosis Distillation: Model Hijacking with the Fewest Samples5 Mar 2026
- 2025BADTV: Unveiling Backdoor Threats in Third-Party Task Vectors4 Jan 2025
- 2024Model Hijacking Attack in Federated Learning4 Aug 2024
- 2024Vera Verto: Multimodal Hijacking Attack31 Jul 2024
- 2024SnatchML: Hijacking ML models without Training Access3 Jun 2024
- 2024On the Efficiency of Privacy Attacks in Federated Learning15 Apr 2024
- 2024Purified and Unified Steganographic Network27 Feb 2024
- 2023Mondrian: Prompt Abstraction Attack Against Large Language Models for Cheaper API Pricing7 Aug 2023
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun 2023
- 2023Two-in-One: A Model Hijacking Attack Against Text Generation Models12 May 2023
- 2023STDLens: Model Hijacking-Resilient Federated Learning for Object Detection21 Mar 2023
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection23 Feb 2023
1 more
- 2023Two-in-One: A Model Hijacking Attack Against Text Generation Modelscited by 11
- 2024Purified and Unified Steganographic Networkcited by 10
- 2023STDLens: Model Hijacking-Resilient Federated Learning for Object Detectioncited by 4
- 2023Mondrian: Prompt Abstraction Attack Against Large Language Models for Cheaper API Pricingcited by 4
- 2024On the Efficiency of Privacy Attacks in Federated Learningcited by 3
- 2022SeqNet: An Efficient Neural Network for Automatic Malware Detectioncited by 1
- 2024Vera Verto: Multimodal Hijacking Attackcited by 1
- 2026Osmosis Distillation: Model Hijacking with the Fewest Samplescited by 1
- 2024SnatchML: Hijacking ML models without Training Accesscited by 0
- 2024Model Hijacking Attack in Federated Learningcited by 0
- 2026Osmosis Distillation: Model Hijacking with the Fewest Samples5 Mar 2026
- 2024Model Hijacking Attack in Federated Learning4 Aug 2024
- 2024Vera Verto: Multimodal Hijacking Attack31 Jul 2024
- 2024SnatchML: Hijacking ML models without Training Access3 Jun 2024
- 2024On the Efficiency of Privacy Attacks in Federated Learning15 Apr 2024
- 2024Purified and Unified Steganographic Network27 Feb 2024
- 2023Mondrian: Prompt Abstraction Attack Against Large Language Models for Cheaper API Pricing7 Aug 2023
- 2023Two-in-One: A Model Hijacking Attack Against Text Generation Models12 May 2023
- 2023STDLens: Model Hijacking-Resilient Federated Learning for Object Detection21 Mar 2023
- 2022SeqNet: An Efficient Neural Network for Automatic Malware Detection8 May 2022