mlsanityData to 14 Oct 2026

Malware Detection at the Edge with Lightweight LLMs: A Performance Evaluation

arXiv 2503.04302 ↗First posted 6 Mar 2025cs.CR cs.AI cs.DCcited by 4

Not on the map. Why?

Abstract (arXiv)

The rapid evolution of malware attacks calls for the development of innovative detection methods, especially in resource-constrained edge computing. Traditional detection techniques struggle to keep up with modern malware's sophistication and adaptability, prompting a shift towards advanced methodologies like those leveraging Large Language Models (LLMs) for enhanced malware detection. However, deploying LLMs for malware detection directly at edge devices raises several challenges, including ensuring accuracy in constrained environments and addressing edge devices' energy and computational limits. To tackle these challenges, this paper proposes an architecture leveraging lightweight LLMs' strengths while addressing limitations like reduced accuracy and insufficient computational power. To evaluate the effectiveness of the proposed lightweight LLM-based approach for edge computing, we perform an extensive experimental evaluation using several state-of-the-art lightweight LLMs. We test them with several publicly available datasets specifically designed for edge and IoT scenarios and different edge nodes with varying computational power and characteristics.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 6 Mar 2025.

Builds on

23 of 50 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  10. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  11. 2020Efficient Transformers: A Surveycited by 790
  12. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
11 more
  1. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  2. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 284
  3. 2018An introduction to domain adaptation and transfer learningcited by 112
  4. 2021Scale Efficiently: Insights from Pre-training and Fine-tuning Transformerscited by 106
  5. 2022SecureBERT: A Domain-Specific Language Model for Cybersecuritycited by 60
  6. 2022Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networkscited by 55
  7. 2023Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devicescited by 39
  8. 2019The Theory Behind Overfitting, Cross Validation, Regularization, Bagging, and Boosting: Tutorialcited by 22
  9. 2024AppPoet: Large Language Model based Android malware detection via multi-view prompt engineeringcited by 16
  10. 2024Adaptive Layer Splitting for Wireless LLM Inference in Edge Computing: A Model-Based Reinforcement Learning Approachcited by 12
  11. 2024Transfer Learning in Pre-Trained Large Language Models for Malware Detection Based on System Callscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.