LogGPT: Log Anomaly Detection via GPT
Not on the map. Why?
Abstract (arXiv)
Detecting system anomalies based on log data is important for ensuring the security and reliability of computer systems. Recently, deep learning models have been widely used for log anomaly detection. The core idea is to model the log sequences as natural language and adopt deep sequential models, such as LSTM or Transformer, to encode the normal patterns in log sequences via language modeling. However, there is a gap between language modeling and anomaly detection as the objective of training a sequential model via a language modeling loss is not directly related to anomaly detection. To fill up the gap, we propose LogGPT, a novel framework that employs GPT for log anomaly detection. LogGPT is first trained to predict the next log entry based on the preceding sequence. To further enhance the performance of LogGPT, we propose a novel reinforcement learning strategy to finetune the model specifically for the log anomaly detection task. The experimental results on three datasets show that LogGPT significantly outperforms existing state-of-the-art approaches.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 10 of its 26 references that are in the map. First posted on arXiv 25 Sep 2023.
Builds on
10 of 26 references.
References · 10
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Deep Learning for Anomaly Detection: A Surveycited by 358
- 2020Deep Learning for Anomaly Detection: A Reviewcited by 159
- 2021LogBERT: Log Anomaly Detection via BERTcited by 118
- 2022Log-based Anomaly Detection with Deep Learning: How Far Are We?cited by 57
- 2021Experience Report: Deep Learning-based System Log Analysis for Anomaly Detectioncited by 37
- 2022Deep Learning for Anomaly Detection in Log Data: A Surveycited by 28
- 2020Multi-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detectioncited by 19
Built on by
Citing papers per year: 2024: 5; 2025: 11; 2026: 10.
26 papers.
Sort:
By area:
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 71
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2025Time Series Language Model for Descriptive Caption Generationcited by 11
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2024Beyond Detection: Leveraging Large Language Models for Cyber Attack Prediction in IoT Networkscited by 7
- 2025Mapping the Landscape of Generative AI in Network Monitoring and Managementcited by 4
- 2025Evaluating Language Models For Threat Detection in IoT Security Logscited by 4
- 2025LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Modelscited by 3
- 2024Oddballness: universal anomaly detection with language modelscited by 2
- 2024LogBabylon: A Unified Framework for Cross-Log File Integration and Analysiscited by 1
- 2025From Flows to Words: Can Zero-/Few-Shot LLMs Detect Network Intrusions? A Grammar-Constrained, Calibrated Evaluation on UNSW-NB15cited by 1
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunicationscited by 1
14 more
- 2025Large Language Models in Cybersecurity: Applications, Vulnerabilities, and Defense Techniquescited by 0
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learningcited by 0
- 2025Architecting software monitors for control-flow anomaly detection through large language models and conformance checkingcited by 0
- 2025JT-DA: Enhancing Data Analysis with Tool-Integrated Table Reasoning Large Language Modelscited by 0
- 2025Automated Fault Detection in 5G Core Networks Using Large Language Modelscited by 0
- 2026Next-generation cyberattack detection with large language models: anomaly analysis across heterogeneous logscited by 0
- 2026KRONE: Scalable LLM-Augmented Log Anomaly Detection via Hierarchical Abstractioncited by 0
- 2026DP-FlogTinyLLM: Differentially private federated log anomaly detection using Tiny LLMscited by 0
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyondcited by 0
- 2026NLLog: Lightweight, Explainable SOC Anomaly Detection via Log-to-Language Rewritingcited by 0
- 2026LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detectioncited by 0
- 2026Multi-Source Cybersecurity Logs: An ATT&CK-Labeled Dataset and SLM Evaluationcited by 0
- 2026Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Modelscited by 0
- 2026ASTRA - Agentic System for Ticket Resolution and Analysiscited by 0
- 2026ASTRA - Agentic System for Ticket Resolution and Analysis28 Aug 2026
- 2026Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Models23 Jul 2026
- 2026Multi-Source Cybersecurity Logs: An ATT&CK-Labeled Dataset and SLM Evaluation16 Jun 2026
- 2026LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detection6 Jun 2026
- 2026NLLog: Lightweight, Explainable SOC Anomaly Detection via Log-to-Language Rewriting3 Jun 2026
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond7 May 2026
- 2026DP-FlogTinyLLM: Differentially private federated log anomaly detection using Tiny LLMs21 Apr 2026
- 2026KRONE: Scalable LLM-Augmented Log Anomaly Detection via Hierarchical Abstraction7 Feb 2026
- 2026Next-generation cyberattack detection with large language models: anomaly analysis across heterogeneous logs6 Feb 2026
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunications2 Jan 2026
- 2025JT-DA: Enhancing Data Analysis with Tool-Integrated Table Reasoning Large Language Models7 Dec 2025
- 2025Automated Fault Detection in 5G Core Networks Using Large Language Models24 Nov 2025
14 more
- 2025Architecting software monitors for control-flow anomaly detection through large language models and conformance checking14 Nov 2025
- 2025LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models28 Oct 2025
- 2025From Flows to Words: Can Zero-/Few-Shot LLMs Detect Network Intrusions? A Grammar-Constrained, Calibrated Evaluation on UNSW-NB1518 Oct 2025
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learning18 Sep 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025Large Language Models in Cybersecurity: Applications, Vulnerabilities, and Defense Techniques18 Jul 2025
- 2025Evaluating Language Models For Threat Detection in IoT Security Logs3 Jul 2025
- 2025Mapping the Landscape of Generative AI in Network Monitoring and Management12 Feb 2025
- 2025Time Series Language Model for Descriptive Caption Generation3 Jan 2025
- 2024LogBabylon: A Unified Framework for Cross-Log File Integration and Analysis16 Dec 2024
- 2024Oddballness: universal anomaly detection with language models4 Sep 2024
- 2024Beyond Detection: Leveraging Large Language Models for Cyber Attack Prediction in IoT Networks26 Aug 2024
- 2024Large Language Models for Cyber Security: A Systematic Literature Review8 May 2024
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Review6 May 2024
- 2026TraXion: Rethinking Pre-training Frameworks for Mobility and Beyond7 May 2026
- 2025JT-DA: Enhancing Data Analysis with Tool-Integrated Table Reasoning Large Language Models7 Dec 2025
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learning18 Sep 2025
- 2026ASTRA - Agentic System for Ticket Resolution and Analysis28 Aug 2026
- 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 71
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2025Time Series Language Model for Descriptive Caption Generationcited by 11
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2024Beyond Detection: Leveraging Large Language Models for Cyber Attack Prediction in IoT Networkscited by 7
- 2025Mapping the Landscape of Generative AI in Network Monitoring and Managementcited by 4
- 2025Evaluating Language Models For Threat Detection in IoT Security Logscited by 4
- 2025LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Modelscited by 3
- 2024Oddballness: universal anomaly detection with language modelscited by 2
- 2024LogBabylon: A Unified Framework for Cross-Log File Integration and Analysiscited by 1
- 2025From Flows to Words: Can Zero-/Few-Shot LLMs Detect Network Intrusions? A Grammar-Constrained, Calibrated Evaluation on UNSW-NB15cited by 1
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunicationscited by 1
12 most cited of 22 All 22 (JSON)
- 2026Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Models23 Jul 2026
- 2026Multi-Source Cybersecurity Logs: An ATT&CK-Labeled Dataset and SLM Evaluation16 Jun 2026
- 2026LogNEO: A GPT-Neo Reinforcement Learning Framework for Accurate Real-Time Log Anomaly Detection6 Jun 2026
- 2026NLLog: Lightweight, Explainable SOC Anomaly Detection via Log-to-Language Rewriting3 Jun 2026
- 2026DP-FlogTinyLLM: Differentially private federated log anomaly detection using Tiny LLMs21 Apr 2026
- 2026KRONE: Scalable LLM-Augmented Log Anomaly Detection via Hierarchical Abstraction7 Feb 2026
- 2026Next-generation cyberattack detection with large language models: anomaly analysis across heterogeneous logs6 Feb 2026
- 2026TeleDoCTR: Domain-Specific and Contextual Troubleshooting for Telecommunications2 Jan 2026
- 2025Automated Fault Detection in 5G Core Networks Using Large Language Models24 Nov 2025
- 2025Architecting software monitors for control-flow anomaly detection through large language models and conformance checking14 Nov 2025
- 2025LLMLogAnalyzer: A Clustering-Based Log Analysis Chatbot using Large Language Models28 Oct 2025
- 2025From Flows to Words: Can Zero-/Few-Shot LLMs Detect Network Intrusions? A Grammar-Constrained, Calibrated Evaluation on UNSW-NB1518 Oct 2025
12 newest of 22 All 22 (JSON)