mlsanityData to 7 Oct 2026

LogLM: From Task-based to Instruction-based Automated Log Analysis

arXiv 2410.09352 ↗First posted 12 Oct 2024cs.SE cs.CLcited by 13

Not on the map. Why?

Abstract (arXiv)

Automatic log analysis is essential for the efficient Operation and Maintenance (O&M) of software systems, providing critical insights into system behaviors. However, existing approaches mostly treat log analysis as training a model to perform an isolated task ( e.g., anomaly detection, log parsing, etc.) using task-specific log-label pairs. These task-based approaches are inflexible in generalizing to complex scenarios, depend on task-specific training data, and cost significantly when deploying multiple models. In this paper, we propose an instruction-based training approach that transforms log-label pairs from multiple tasks and domains into a unified format of instruction-response pairs. Our trained model, LogLM, can follow complex user instructions and generalize better across different tasks, thereby increasing flexibility and reducing the dependence on task-specific training data. By integrating major log analysis tasks into a single model, our approach also relieves model deployment burden. Experimentally, LogLM outperforms existing approaches across five log analysis capabilities, and exhibits strong generalization abilities on complex instructions and unseen tasks.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 32 of its 65 references that are in the map. First posted on arXiv 12 Oct 2024.

Builds on

32 of 65 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  9. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  10. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  11. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  12. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
20 more
  1. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  2. 2023Automatic Root Cause Analysis via Large Language Models for Cloud Incidentscited by 82
  3. 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
  4. 2021Log-based Anomaly Detection Without Log Parsingcited by 59
  5. 2018Tools and Benchmarks for Automated Log Parsingcited by 56
  6. 2022Log-based Anomaly Detection with Deep Learning: How Far Are We?cited by 56
  7. 2023PanGu-Sigma: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computingcited by 55
  8. 2023OWL: A Large Language Model for IT Operationscited by 43
  9. 2023Recommending Root-Cause and Mitigation Steps for Cloud Incidents using Large Language Modelscited by 38
  10. 2023Interpretable Online Log Analysis Using Large Language Models with Prompt Strategiescited by 34
  11. 2023LILAC: Log Parsing using LLMs with Adaptive Parsing Cachecited by 30
  12. 2023Log Parsing with Prompt-based Few-shot Learningcited by 28
  13. 2024LogParser-LLM: Advancing Efficient Log Parsing with Large Language Modelscited by 20
  14. 2023Did We Miss Something Important? Studying and Exploring Variable-Aware Log Abstractioncited by 19
  15. 2023RAGLog: Log Anomaly Detection using Retrieval Augmented Generationcited by 19
  16. 2023CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuningcited by 19
  17. 2021SemParser: A Semantic Parser for Log Analysiscited by 15
  18. 2021UniLog: Deploy One Model and Specialize it for All Log Analysis Taskscited by 11
  19. 2024LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysiscited by 10
  20. 2022LogStamp: Automatic Online Log Parsing Based on Sequence Labellingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 7; 2026: 5.

13 papers.

Sort:

By area: