Malware Detection at the Edge with Lightweight LLMs: A Performance Evaluation
Not on the map. Why?
Abstract (arXiv)
The rapid evolution of malware attacks calls for the development of innovative detection methods, especially in resource-constrained edge computing. Traditional detection techniques struggle to keep up with modern malware's sophistication and adaptability, prompting a shift towards advanced methodologies like those leveraging Large Language Models (LLMs) for enhanced malware detection. However, deploying LLMs for malware detection directly at edge devices raises several challenges, including ensuring accuracy in constrained environments and addressing edge devices' energy and computational limits. To tackle these challenges, this paper proposes an architecture leveraging lightweight LLMs' strengths while addressing limitations like reduced accuracy and insufficient computational power. To evaluate the effectiveness of the proposed lightweight LLM-based approach for edge computing, we perform an extensive experimental evaluation using several state-of-the-art lightweight LLMs. We test them with several publicly available datasets specifically designed for edge and IoT scenarios and different edge nodes with varying computational power and characteristics.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
23 of 50 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2023A Survey of Large Language Modelscited by 2,576
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
- 2020Efficient Transformers: A Surveycited by 790
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
11 more
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
- 2018An introduction to domain adaptation and transfer learningcited by 112
- 2021Scale Efficiently: Insights from Pre-training and Fine-tuning Transformerscited by 106
- 2022SecureBERT: A Domain-Specific Language Model for Cybersecuritycited by 60
- 2022Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networkscited by 55
- 2023Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devicescited by 39
- 2019The Theory Behind Overfitting, Cross Validation, Regularization, Bagging, and Boosting: Tutorialcited by 22
- 2024AppPoet: Large Language Model based Android malware detection via multi-view prompt engineeringcited by 16
- 2024Adaptive Layer Splitting for Wireless LLM Inference in Edge Computing: A Model-Based Reinforcement Learning Approachcited by 12
- 2024Transfer Learning in Pre-Trained Large Language Models for Malware Detection Based on System Callscited by 8
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skillscited by 20
- 2026A Decompilation-Driven Framework for Malware Detection with Large Language Modelscited by 2
- 2026LoRA-based Parameter-Efficient LLMs for Continuous Learning in Edge-based Malware Detectioncited by 1
- 2026CESBench: Benchmarking Large Language Models on Cryptographic Engineering Security for IoT Devicescited by 0
- 2026CESBench: Benchmarking Large Language Models on Cryptographic Engineering Security for IoT Devices18 Sep 2026
- 2026SkillSieve: A Hierarchical Triage Framework for Detecting Malicious AI Agent Skills8 Apr 2026
- 2026LoRA-based Parameter-Efficient LLMs for Continuous Learning in Edge-based Malware Detection12 Feb 2026
- 2026A Decompilation-Driven Framework for Malware Detection with Large Language Models14 Jan 2026