mlsanityData to 7 Oct 2026

CAN-BERT do it? Controller Area Network Intrusion Detection System based on BERT Language Model

arXiv 2210.09439 ↗First posted 17 Oct 2022cs.LG cs.CR cs.NIcited by 17

Not on the map. Why?

Abstract (arXiv)

Due to the rising number of sophisticated customer functionalities, electronic control units (ECUs) are increasingly integrated into modern automotive systems. However, the high connectivity between the in-vehicle and the external networks paves the way for hackers who could exploit in-vehicle network protocols' vulnerabilities. Among these protocols, the Controller Area Network (CAN), known as the most widely used in-vehicle networking technology, lacks encryption and authentication mechanisms, making the communications delivered by distributed ECUs insecure. Inspired by the outstanding performance of bidirectional encoder representations from transformers (BERT) for improving many natural language processing tasks, we propose in this paper ``CAN-BERT", a deep learning based network intrusion detection system, to detect cyber attacks on CAN bus protocol. We show that the BERT model can learn the sequence of arbitration identifiers (IDs) in the CAN bus for anomaly detection using the ``masked language model" unsupervised training objective. The experimental results on the ``Car Hacking: Attack & Defense Challenge 2020" dataset show that ``CAN-BERT" outperforms state-of-the-art approaches. In addition to being able to identify in-vehicle intrusions in real-time within 0.8 ms to 3 ms w.r.t CAN ID sequence length, it can also detect a wide variety of cyberattacks with an F1-score of between 0.81 and 0.99.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 9 of its 21 references that are in the map. First posted on arXiv 17 Oct 2022.

Builds on

9 of 21 references.

References · 9

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2016Layer Normalizationcited by 5,579
  5. 2021LogBERT: Log Anomaly Detection via BERTcited by 114
  6. 2021Log-based Anomaly Detection Without Log Parsingcited by 59
  7. 2021LAnoBERT: System Log Anomaly Detection based on BERT Masked Language Modelcited by 30
  8. 2019CANet: An Unsupervised Intrusion Detection System for High Dimensional CAN Bus Datacited by 28
  9. 2021How is BERT surprised? Layerwise detection of linguistic anomaliescited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 8; 2025: 4; 2026: 2.

17 papers.

Sort:

  1. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 65
  2. 2023Revolutionizing Cyber Threat Detection with Large Language Models: A privacy-preserving BERT-based Lightweight Model for IoT/IIoT Devicescited by 38
  3. 2024A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directionscited by 25
  4. 2024Transformers and Large Language Models for Efficient Intrusion Detection Systems: A Comprehensive Surveycited by 21
  5. 2024Towards Explainable Network Intrusion Detection using Large Language Modelscited by 12
  6. 2025eX-NIDS: A Framework for Explainable Network Intrusion Detection Leveraging Large Language Modelscited by 5
  7. 2024MistralBSM: Leveraging Mistral-7B for Vehicular Networks Misbehavior Detectioncited by 3
  8. 2023SecureBERT and LLAMA 2 Empowered Control Area Network Intrusion Detection and Classificationcited by 2
  9. 2024A Unified Framework for Context-Aware IoT Management and State-of-the-Art IoT Traffic Anomaly Detectioncited by 2
  10. 2023LogShield: A Transformer-based APT Detection System Leveraging Self-Attentioncited by 0
  11. 2024Empirical and Experimental Insights into Data Mining Techniques for Crime Prediction: A Comprehensive Surveycited by 0
  12. 2024MKF-ADS: Multi-Knowledge Fusion Based Self-supervised Anomaly Detection System for Control Area Networkcited by 0
5 more
  1. 2025Good Enough to Learn: LLM-based Anomaly Detection in ECU Logs without Reliable Labelscited by 0
  2. 2025Alleviating Attack Data Scarcity: SCANIA's Experience Towards Enhancing In-Vehicle Cyber Security Measurescited by 0
  3. 2025FedLiTeCAN : A Federated Lightweight Transformer for Fast and Robust CAN Bus Intrusion Detectioncited by 0
  4. 2026DAIRE: A lightweight AI model for real-time detection of Controller Area Network attacks in the Internet of Vehiclescited by 0
  5. 2026GenTI: Benchmarking LLMs for Autonomous IDPS Rule Generation for Unseen Attackscited by 0