Next-generation cyberattack detection with large language models: anomaly analysis across heterogeneous logs
Not on the map. Why?
Abstract (arXiv)
This project explores large language models (LLMs) for anomaly detection across heterogeneous log sources. Traditional intrusion detection systems suffer from high false positive rates, semantic blindness, and data scarcity, as logs are inherently sensitive, making clean datasets rare. We address these challenges through three contributions: (1) LogAtlas-Foundation-Sessions and LogAtlas-Defense-Set, balanced and heterogeneous log datasets with explicit attack annotations and privacy preservation; (2) empirical benchmarking revealing why standard metrics such as F1 and accuracy are misleading for security applications; and (3) a two phase training framework combining log understanding (Base-AMAN, 3B parameters) with real time detection (AMAN, 0.5B parameters via knowledge distillation). Results demonstrate practical feasibility, with inference times of 0.3-0.5 seconds per session and operational costs below 50 USD per day.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 18 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
10 of 18 references.
References · 10
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2021LogBERT: Log Anomaly Detection via BERTcited by 114
- 2023LogGPT: Log Anomaly Detection via GPTcited by 26
- 2024Audit-LLM: Multi-Agent Collaboration for Log-based Insider Threat Detectioncited by 18
Built on by
Not cited yet.