mlsanityData to 14 Oct 2026

Convolutional Neural Networks and Mixture of Experts for Intrusion Detection in 5G Networks and beyond

arXiv 2412.03483 ↗First posted 4 Dec 2024cs.LGcited by 0

On the map: Mixture-of-experts → Vision mixture-of-experts

Abstract (arXiv)

The advent of 6G/NextG networks comes along with a series of benefits, including extreme capacity, reliability, and efficiency. However, these networks may become vulnerable to new security threats. Therefore, 6G/NextG networks must be equipped with advanced Artificial Intelligence algorithms, in order to evade these attacks. Existing studies on the intrusion detection task rely on the train of shallow machine learning classifiers, including Logistic Regression, Decision Trees, and so on, yielding suboptimal performance. Others are based on deep neural networks consisting of static components, which are not conditional on the input. This limits their representation power and efficiency. To resolve these issues, we present the first study integrating Mixture of Experts (MoE) for identifying malicious traffic. Specifically, we use network traffic data and convert the 1D array of features into a 2D matrix. Next, we pass this matrix through convolutional neural network (CNN) layers followed by batch normalization and max pooling layers. After obtaining the representation vector via the CNN layers, a sparsely gated MoE layer is used. This layer consists of a set of experts (dense layers) and a router, where the router assigns weights to the output of each expert. Sparsity is achieved by choosing the most relevant experts of the total ones. Finally, we perform a series of ablation experiments to prove the effectiveness of our proposed model. Experiments are conducted on the 5G-NIDD dataset, a network intrusion detection dataset generated from a real 5G test network. Results show that our introduced approach reaches weighted F1-score up to 99.95% achieving comparable performance to existing approaches. Findings also show that our proposed model achieves multiple advantages over state-of-the-art approaches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 11 of its 39 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

11 of 39 references.

References · 11

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2021Dynamic Neural Networks: A Surveycited by 408
  4. 2016Expert Gate: Lifelong Learning with a Network of Expertscited by 372
  5. 2018GAIN: Missing Data Imputation using Generative Adversarial Netscited by 352
  6. 2019A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problemscited by 160
  7. 2018Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detectioncited by 121
  8. 2021The Road Towards 6G: A Comprehensive Surveycited by 40
  9. 20225G-NIDD: A Comprehensive Network Intrusion Detection Dataset Generated over 5G Wireless Networkcited by 16
  10. 2020DDoSNet: A Deep-Learning Model for Detecting Network Attackscited by 8
  11. 2024Security, Trust and Privacy challenges in AI-driven 6G Networkscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Towards Understanding Mixture of Experts in Deep Learning
  2. 2024Graph Mixture of Experts and Memory-augmented Routers for Multivariate Time Series Anomaly Detection
  3. 2023Deep Neural Networks based Meta-Learning for Network Intrusion Detection
  4. 2026ExAI5G: A Logic-Based Explainable AI Framework for Intrusion Detection in 5G Networks
  5. 2024Enhancing the "Immunity" of Mixture-of-Experts Networks for Adversarial Defense
  6. 2024Efficient Federated Intrusion Detection in 5G ecosystem using optimized BERT-based model
  7. 2025Load Balancing Mixture of Experts with Similarity Preserving Routers
  8. 2023Robust Mixture-of-Expert Training for Convolutional Neural Networks