On the (In)Security of Loading Machine Learning Models
Not on the map. Why?
Abstract (arXiv)
The rise of model sharing through frameworks and dedicated hubs makes Machine Learning significantly more accessible. Despite its benefits, loading shared models exposes users to underexplored security risks, while security awareness remains limited among both practitioners and developers. To enable a more security-conscious approach in Machine Learning model sharing, in this paper, we evaluate the security posture of frameworks and hubs, assess whether security-oriented mechanisms offer real protection, and survey how users perceive the security narratives surrounding model sharing. Our evaluation shows that most frameworks and hubs address security risks partially at best, often by shifting responsibility to the user. More concerningly, our analysis of frameworks advertising security-oriented settings and complete model sharing uncovered multiple 0-day vulnerabilities enabling arbitrary code execution. Through this analysis, we show that, despite the recent narrative, securely loading Machine Learning models is far from being a solved problem and cannot be guaranteed by the file format used for sharing. Our survey shows that the security narrative leads users to consider security-oriented settings as trustworthy, despite the weaknesses shown in this work. From this, we derive suggestions to strengthen the security of model-sharing ecosystems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 63 references that are in the map. First posted on arXiv 8 Sep 2025.
Builds on
12 of 63 references.
References · 12
- 2020Backstabber's Knife Collection: A Review of Open Source Software Supply Chain Attackscited by 61
- 2022Taxonomy of Attacks on Open-Source Software Supply Chainscited by 58
- 2023An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registrycited by 47
- 2024Models Are Codes: Towards Measuring Malicious Code Poisoning Attacks on Pre-trained Model Hubscited by 18
- 2021EvilModel: Hiding Malware Inside of Neural Network Modelscited by 16
- 2024A Large-Scale Exploit Instrumentation Study of AI/ML Supply Chain Attacks in Hugging Face Modelscited by 14
- 2021EvilModel 2.0: Bringing Neural Network Models into Malware Attackscited by 13
- 2024What do we know about Hugging Face? A systematic literature review and quantitative validation of qualitative claimscited by 9
- 2025Demystifying LLM Supply Chain Vulnerabilities in the Wild: Distribution, Root Cause, and Real-World Impactcited by 8
- 2023"I see models being a whole other thing": An Empirical Study of Pre-Trained Model Naming Conventions and A Tool for Enhancing Naming Consistencycited by 7
- 2024MalModel: Hiding Malicious Payload in Mobile Deep Learning Models with Black-box Backdoor Attackcited by 4
- 2025Machine Learning Models Have a Supply Chain Problemcited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.