SecureBERT and LLAMA 2 Empowered Control Area Network Intrusion Detection and Classification
Not on the map. Why?
Abstract (arXiv)
Numerous studies have proved their effective strength in detecting Control Area Network (CAN) attacks. In the realm of understanding the human semantic space, transformer-based models have demonstrated remarkable effectiveness. Leveraging pre-trained transformers has become a common strategy in various language-related tasks, enabling these models to grasp human semantics more comprehensively. To delve into the adaptability evaluation on pre-trained models for CAN intrusion detection, we have developed two distinct models: CAN-SecureBERT and CAN-LLAMA2. Notably, our CAN-LLAMA2 model surpasses the state-of-the-art models by achieving an exceptional performance 0.999993 in terms of balanced accuracy, precision detection rate, F1 score, and a remarkably low false alarm rate of 3.10e-6. Impressively, the false alarm rate is 52 times smaller than that of the leading model, MTH-IDS (Multitiered Hybrid Intrusion Detection System). Our study underscores the promise of employing a Large Language Model as the foundational model, while incorporating adapters for other cybersecurity-related tasks and maintaining the model's inherent language-related capabilities.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 15 of its 38 references that are in the map. First posted on arXiv 19 Nov 2023.
Builds on
15 of 38 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 762
- 2022SecureBERT: A Domain-Specific Language Model for Cybersecuritycited by 60
- 2019GIDS: GAN based Intrusion Detection System for In-Vehicle Networkcited by 42
- 2021MTH-IDS: A Multi-Tiered Hybrid Intrusion Detection System for Internet of Vehiclescited by 36
- 2022CAN-BERT do it? Controller Area Network Intrusion Detection System based on BERT Language Modelcited by 17
Built on by
Citing papers per year: 2024: 2.
2 papers.