mlsanityData to 14 Oct 2026

SpikeLogBERT: Energy-Efficient Log Parsing Using Spiking Transformer Networks

arXiv 2606.31781 ↗First posted 30 Jun 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Log parsing is a fundamental step in automated log analysis, transforming raw system logs into structured event templates for downstream tasks such as anomaly detection and system monitoring. Existing log parsing methods range from rule-based and clustering-based approaches to neural models that learn semantic representations from log messages. However, neural approaches typically rely on dense matrix multiplications, which can result in high computational cost and energy consumption. This paper presents SpikeLogBERT, a spiking neural network framework for energy-efficient log parsing. The proposed model integrates a spiking transformer architecture with knowledge distillation from a BERT teacher model, enabling spike-driven computation while preserving semantic representation capability. By leveraging sparse spike activations and event-driven processing, the number of active operations during inference can be significantly reduced. As an initial benchmark study, experiments on the HDFS dataset demonstrate that SpikeLogBERT outperforms ANN-based neural log parsing models with a parsing accuracy of 0.99997, while reducing estimated theoretical energy consumption by up to 62.6% under standard 45nm CMOS assumptions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 18 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

10 of 18 references.

References · 10

  1. 2023Spike-driven Transformercited by 146
  2. 2022Attention Spiking Neural Networkscited by 107
  3. 2023SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networkscited by 88
  4. 2020Loghub: A Large Collection of System Log Datasets for AI-driven Log Analyticscited by 70
  5. 2023SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiationcited by 48
  6. 2023Log Parsing with Prompt-based Few-shot Learningcited by 29
  7. 2022UniParser: A Unified Log Parser for Heterogeneous Log Datacited by 26
  8. 2020Self-Supervised Log Parsingcited by 23
  9. 2023SpikeBERT: A Language Spikformer Learned from BERT with Knowledge Distillationcited by 17
  10. 2025STAR: A Privacy-Preserving, Energy-Efficient Edge AI Framework for Human Activity Recognition via Wi-Fi CSI in Mobile and Pervasive Computing Environmentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Lemur: Log Parsing with Entropy Sampling and Chain-of-Thought Merging
  2. 2024On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks
  3. 2025STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
  4. 2025S2NN: Sub-bit Spiking Neural Networks
  5. 2024Exploring Extreme Quantization in Spiking Language Models
  6. 2025A Word is Worth 4-bit: Efficient Log Parsing with Binary Coded Decimal Recognition
  7. 2024Efficient Speech Command Recognition Leveraging Spiking Neural Network and Curriculum Learning-based Knowledge Distillation
  8. 2024P-SpikeSSM: Harnessing Probabilistic Spiking State Space Models for Long-Range Dependency Tasks