Radial Spike and Slab Bayesian Neural Networks for Sparse Data in Ransomware Attacks
Not on the map. Why?
Abstract (arXiv)
Ransomware attacks are increasing at an alarming rate, leading to large financial losses, unrecoverable encrypted data, data leakage, and privacy concerns. The prompt detection of ransomware attacks is required to minimize further damage, particularly during the encryption stage. However, the frequency and structure of the observed ransomware attack data makes this task difficult to accomplish in practice. The data corresponding to ransomware attacks represents temporal, high-dimensional sparse signals, with limited records and very imbalanced classes. While traditional deep learning models have been able to achieve state-of-the-art results in a wide variety of domains, Bayesian Neural Networks, which are a class of probabilistic models, are better suited to the issues of the ransomware data. These models combine ideas from Bayesian statistics with the rich expressive power of neural networks. In this paper, we propose the Radial Spike and Slab Bayesian Neural Network, which is a new type of Bayesian Neural network that includes a new form of the approximate posterior distribution. The model scales well to large architectures and recovers the sparse structure of target functions. We provide a theoretical justification for using this type of distribution, as well as a computationally efficient method to perform variational inference. We demonstrate the performance of our model on a real dataset of ransomware attacks and show improvement over a large number of baselines, including state-of-the-art models such as Neural ODEs (ordinary differential equations). In addition, we propose to represent low-level events as MITRE ATT&CK tactics, techniques, and procedures (TTPs) which allows the model to better generalize to unseen ransomware attacks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 51 references that are in the map. First posted on arXiv 29 May 2022.
Builds on
22 of 51 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
- 2015Weight Uncertainty in Neural Networkscited by 554
- 2015Variational Dropout and the Local Reparameterization Trickcited by 490
- 2013Black Box Variational Inferencecited by 319
- 2021Bayesian Neural Network Priors Revisitedcited by 121
10 more
- 2017Model Selection in Bayesian Neural Networks via Horseshoe Priorscited by 52
- 2018Processing of missing data by neural networkscited by 37
- 2019Radial Bayesian Neural Networks: Beyond Discrete Support In Large-Scale Bayesian Deep Learningcited by 37
- 2017Reducing Reparameterization Gradient Variancecited by 27
- 2021A Survey on Ransomware: Evolution, Taxonomy, and Defense Solutionscited by 9
- 2022Graph Reparameterizations for Enabling 1000+ Monte Carlo Iterations in Bayesian Deep Neural Networkscited by 3
- 2018Leveraging Machine Learning Techniques for Windows Ransomware Network Traffic Detectioncited by 2
- 2019Stabilising priors for robust Bayesian deep learningcited by 2
- 2020Bayesian Models Applied to Cyber Security Anomaly Detection Problemscited by 2
- 2021A Survey of Machine Learning Algorithms for Detecting Ransomware Encryption Activitycited by 1
Built on by
Not cited yet.