LogLM: From Task-based to Instruction-based Automated Log Analysis
Not on the map. Why?
Abstract (arXiv)
Automatic log analysis is essential for the efficient Operation and Maintenance (O&M) of software systems, providing critical insights into system behaviors. However, existing approaches mostly treat log analysis as training a model to perform an isolated task ( e.g., anomaly detection, log parsing, etc.) using task-specific log-label pairs. These task-based approaches are inflexible in generalizing to complex scenarios, depend on task-specific training data, and cost significantly when deploying multiple models. In this paper, we propose an instruction-based training approach that transforms log-label pairs from multiple tasks and domains into a unified format of instruction-response pairs. Our trained model, LogLM, can follow complex user instructions and generalize better across different tasks, thereby increasing flexibility and reducing the dependence on task-specific training data. By integrating major log analysis tasks into a single model, our approach also relieves model deployment burden. Experimentally, LogLM outperforms existing approaches across five log analysis capabilities, and exhibits strong generalization abilities on complex instructions and unseen tasks.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 12 Oct 2024.
Builds on
32 of 65 references.
References · 32
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
20 more
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2023Automatic Root Cause Analysis via Large Language Models for Cloud Incidentscited by 82
- 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
- 2021Log-based Anomaly Detection Without Log Parsingcited by 59
- 2018Tools and Benchmarks for Automated Log Parsingcited by 56
- 2022Log-based Anomaly Detection with Deep Learning: How Far Are We?cited by 56
- 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
- 2023OWL: A Large Language Model for IT Operationscited by 43
- 2023Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Modelscited by 38
- 2023Interpretable Online Log Analysis Using Large Language Models with Prompt Strategiescited by 34
- 2023LILAC: Log Parsing using LLMs with Adaptive Parsing Cachecited by 30
- 2023Log Parsing with Prompt-based Few-shot Learningcited by 28
- 2024LogParser-LLM: Advancing Efficient Log Parsing with Large Language Modelscited by 20
- 2023Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstractioncited by 19
- 2023RAGLog: Log Anomaly Detection using Retrieval Augmented Generationcited by 19
- 2023CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuningcited by 19
- 2021SemParser: A Semantic Parser for Log Analysiscited by 15
- 2021UniLog: Deploy One Model and Specialize it for All Log Analysis Taskscited by 11
- 2024LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysiscited by 10
- 2022LogStamp: Automatic Online Log Parsing Based on Sequence Labellingcited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 7; 2026: 5.
13 papers.
Sort:
By area:
- 2025A Survey of AIOps in the Era of Large Language Modelscited by 18
- 2025Adaptive Root Cause Localization for Microservice Systems with Multi-Agent Recursion-of-Thoughtcited by 11
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2024Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledgecited by 6
- 2026Graph of States: Solving Abductive Tasks with Large Language Modelscited by 4
- 2026E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuningcited by 3
- 2026TriCalRAG: A Three-Strategy, Retrieval-Augmented Benchmark for On-Premise LLM-Based Root Cause Analysis in AIOpscited by 1
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learningcited by 0
- 2025LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysiscited by 0
- 2025LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filteringcited by 0
- 2025Scalable and Efficient Large-Scale Log Analysis with LLMs: An IT Software Support Case Studycited by 0
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thoughtcited by 0
1 more
- 2026TriFleetRCA: On-Premise LLM Root Cause Analysis for Kubernetes20 Sep 2026
- 2026TriCalRAG: A Three-Strategy, Retrieval-Augmented Benchmark for On-Premise LLM-Based Root Cause Analysis in AIOps13 Sep 2026
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thought14 May 2026
- 2026E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuning13 Apr 2026
- 2026Graph of States: Solving Abductive Tasks with Large Language Models22 Mar 2026
- 2025LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filtering18 Nov 2025
- 2025Scalable and Efficient Large-Scale Log Analysis with LLMs: An IT Software Support Case Study17 Nov 2025
- 2025LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysis25 Sep 2025
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learning18 Sep 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025Adaptive Root Cause Localization for Microservice Systems with Multi-Agent Recursion-of-Thought28 Aug 2025
- 2025A Survey of AIOps in the Era of Large Language Models23 Jun 2025
- 2025Adaptive Root Cause Localization for Microservice Systems with Multi-Agent Recursion-of-Thoughtcited by 11
- 2026Graph of States: Solving Abductive Tasks with Large Language Modelscited by 4
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learningcited by 0
- 2025LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysiscited by 0
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thoughtcited by 0
- 2026Towards In-Depth Root Cause Localization for Microservices with Multi-Agent Recursion-of-Thought14 May 2026
- 2026Graph of States: Solving Abductive Tasks with Large Language Models22 Mar 2026
- 2025LogReasoner: Empowering LLMs with Expert-like Coarse-to-Fine Reasoning for Automated Log Analysis25 Sep 2025
- 2025RationAnomaly: Log Anomaly Detection with Rationality via Chain-of-Thought and Reinforcement Learning18 Sep 2025
- 2025Adaptive Root Cause Localization for Microservice Systems with Multi-Agent Recursion-of-Thought28 Aug 2025
- 2025A Survey of AIOps in the Era of Large Language Modelscited by 18
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2024Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledgecited by 6
- 2026E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuningcited by 3
- 2025LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filteringcited by 0
- 2025Scalable and Efficient Large-Scale Log Analysis with LLMs: An IT Software Support Case Studycited by 0
- 2026TriFleetRCA: On-Premise LLM Root Cause Analysis for Kubernetescited by 0
- 2026TriFleetRCA: On-Premise LLM Root Cause Analysis for Kubernetes20 Sep 2026
- 2026E2E-REME: Towards End-to-End Microservices Auto-Remediation via Experience-Simulation Reinforcement Fine-Tuning13 Apr 2026
- 2025LogPurge: Log Data Purification for Anomaly Detection via Rule-Enhanced Filtering18 Nov 2025
- 2025Scalable and Efficient Large-Scale Log Analysis with LLMs: An IT Software Support Case Study17 Nov 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025A Survey of AIOps in the Era of Large Language Models23 Jun 2025
- 2024Adapting Large Language Models to Log Analysis with Interpretable Domain Knowledge2 Dec 2024