A Survey of Network-based Intrusion Detection Data Sets
Not on the map. Why?
Abstract (arXiv)
Labeled data sets are necessary to train and evaluate anomaly-based network intrusion detection systems. This work provides a focused literature survey of data sets for network-based intrusion detection and describes the underlying packet- and flow-based network data in detail. The paper identifies 15 different properties to assess the suitability of individual data sets for specific evaluation scenarios. These properties cover a wide range of criteria and are grouped into five categories such as data volume or recording environment for offering a structured search. Based on these properties, a comprehensive overview of existing data sets is given. This overview also highlights the peculiarities of each data set. Furthermore, this work briefly touches upon other sources for network-based data such as traffic generators and traffic repositories. Finally, we discuss our observations and provide some recommendations for the use and creation of network-based data sets.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 8; 2023: 4; 2024: 3; 2025: 6; 2026: 17.
46 papers.
Sort:
By area:
- 2024TimeSeriesBench: An Industrial-Grade Benchmark for Time Series Anomaly Detection Modelscited by 22
- 2022The Role of Machine Learning in Cybersecuritycited by 21
- 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detectioncited by 13
- 2021MemStream: Memory-Based Streaming Anomaly Detectioncited by 12
- 2022AnoShift: A Distribution Shift Benchmark for Unsupervised Anomaly Detectioncited by 11
- 2021Sketch-Based Anomaly Detection in Streaming Graphscited by 9
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2022The Cross-evaluation of Machine Learning-based Network Intrusion Detection Systemscited by 8
- 2021Benchmarking the Benchmark -- Analysis of Synthetic NIDS Datasetscited by 5
- 2021Active Learning for Network Traffic Classification: A Technical Studycited by 5
- 2021An Adaptable Deep Learning-Based Intrusion Detection System to Zero-Day Attackscited by 5
- 2024Federated Learning Under Attack: Exposing Vulnerabilities through Data Poisoning Attacks in Computer Networkscited by 5
34 more
- 2026OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detectioncited by 4
- 2021Bridging the gap to real-world for network intrusion detection systems with data-centric approachcited by 2
- 2022Investigation and rectification of NIDS datasets and standardized feature set derivation for network attack detection with graph neural networkscited by 2
- 2025Temporal Analysis of NetFlow Datasets for Network Intrusion Detection Systemscited by 2
- 2021Improving the Reliability of Network Intrusion Detection Systems through Dataset Integrationcited by 1
- 2022Prepare for Trouble and Make it Double. Supervised and Unsupervised Stacking for AnomalyBased Intrusion Detectioncited by 1
- 2023Leveraging a Probabilistic PCA Model to Understand the Multivariate Statistical Network Monitoring Framework for Network Security Anomaly Detectioncited by 1
- 2024Diffusion-based Adversarial Purification for Intrusion Detectioncited by 1
- 2025From Flows to Words: Can Zero-/Few-Shot LLMs Detect Network Intrusions? A Grammar-Constrained, Calibrated Evaluation on UNSW-NB15cited by 1
- 2025An Evaluation Framework for Network IDS/IPS Datasets: Leveraging MITRE ATT&CK and Industry Relevance Metricscited by 1
- 2026BRIDGE and TCH-Net: Heterogeneous Benchmark and Multi-Branch Baseline for Cross-Domain IoT Botnet Detectioncited by 1
- 2026Spectral Geometry and Bosonic-Bloch Probes: Explorations in Quantum Learningcited by 1
- 2021Data Curation and Quality Assurance for Machine Learning-based Cyber Intrusion Detectioncited by 0
- 2022DDoSDet: An approach to Detect DDoS attacks using Neural Networkscited by 0
- 2022Open ERP System Data For Occupational Fraud Detectioncited by 0
- 2022Improving Multilayer-Perceptron(MLP)-based Network Anomaly Detection with Birch Clustering on CICIDS-2017 Datasetcited by 0
- 2023Anomaly Detection Dataset for Industrial Control Systemscited by 0
- 2023Ensembling Uncertainty Measures to Improve Safety of Black-Box Classifierscited by 0
- 2025Packet-Level DDoS Data Augmentation Using Dual-Stream Temporal-Field Diffusioncited by 0
- 2025Revisiting Network Traffic Analysis: Compatible network flows for ML modelscited by 0
- 2026AMDS: Attack-Aware Multi-Stage Defense System for Network Intrusion Detection with Two-Stage Adaptive Weight Learningcited by 0
- 2026Explainable Threat Attribution for IoT Networks Using Conditional SHAP and Flow Behavior Modellingcited by 0
- 2026Robust Semi-Supervised Temporal Intrusion Detection for Adversarial Cloud Networkscited by 0
- 2026GESR: Graph-Based Edge Semantic Reconstruction for Stealthy Communication Detection with Benign-Only Trainingcited by 0
- 2026Context-Aware Web Attack Detection in Open-Source SIEM Systems via MITRE ATT&CK-Enriched Behavioral Profilingcited by 0
- 2026Stream Assembly Is an Uncontrolled Treatment in Streaming Intrusion-Detection Benchmarkscited by 0
- 2026An Improved CNN-LSTM Based Intrusion Detection System for IoT Networkscited by 0
- 2026nCMD: Benign-Anchored Feature Selection for Imbalanced Network Intrusion Detectioncited by 0
- 2026Do Transformers Actually Help Intrusion Detection? A Temporal Sequence Evaluation on CIC-IDS2017cited by 0
- 2026Multi-Level Distributional Entropy from Flow Summary Statistics for Explainable Network Intrusion Detectioncited by 0
- 2026Generative AI and Federated Learning for Intrusion Detection Systems: A Surveycited by 0
- 2026BARS: Benign-Anchored Ranking and Selection for False Alarm Reduction in Network Intrusion Detectioncited by 0
- 2026Defending Retrieval-Augmented Intrusion Detection Against Knowledge Poisoning and Prompt Injectioncited by 0
- 2026VQC-ZTI: Variational Quantum Control for Zero Trust Protection of the Tactile Internetcited by 0
- 2026VQC-ZTI: Variational Quantum Control for Zero Trust Protection of the Tactile Internet19 Aug 2026
- 2026Defending Retrieval-Augmented Intrusion Detection Against Knowledge Poisoning and Prompt Injection8 Aug 2026
- 2026BARS: Benign-Anchored Ranking and Selection for False Alarm Reduction in Network Intrusion Detection14 Jul 2026
- 2026Generative AI and Federated Learning for Intrusion Detection Systems: A Survey1 Jul 2026
- 2026Spectral Geometry and Bosonic-Bloch Probes: Explorations in Quantum Learning30 Jun 2026
- 2026Multi-Level Distributional Entropy from Flow Summary Statistics for Explainable Network Intrusion Detection29 Jun 2026
- 2026Do Transformers Actually Help Intrusion Detection? A Temporal Sequence Evaluation on CIC-IDS20179 Jun 2026
- 2026nCMD: Benign-Anchored Feature Selection for Imbalanced Network Intrusion Detection7 Jun 2026
- 2026An Improved CNN-LSTM Based Intrusion Detection System for IoT Networks4 Jun 2026
- 2026Stream Assembly Is an Uncontrolled Treatment in Streaming Intrusion-Detection Benchmarks23 May 2026
- 2026Context-Aware Web Attack Detection in Open-Source SIEM Systems via MITRE ATT&CK-Enriched Behavioral Profiling13 May 2026
- 2026GESR: Graph-Based Edge Semantic Reconstruction for Stealthy Communication Detection with Benign-Only Training8 May 2026
34 more
- 2026Robust Semi-Supervised Temporal Intrusion Detection for Adversarial Cloud Networks14 Apr 2026
- 2026BRIDGE and TCH-Net: Heterogeneous Benchmark and Multi-Branch Baseline for Cross-Domain IoT Botnet Detection13 Apr 2026
- 2026Explainable Threat Attribution for IoT Networks Using Conditional SHAP and Flow Behavior Modelling24 Mar 2026
- 2026OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detection23 Mar 2026
- 2026AMDS: Attack-Aware Multi-Stage Defense System for Network Intrusion Detection with Two-Stage Adaptive Weight Learning1 Mar 2026
- 2025An Evaluation Framework for Network IDS/IPS Datasets: Leveraging MITRE ATT&CK and Industry Relevance Metrics16 Nov 2025
- 2025Revisiting Network Traffic Analysis: Compatible network flows for ML models11 Nov 2025
- 2025From Flows to Words: Can Zero-/Few-Shot LLMs Detect Network Intrusions? A Grammar-Constrained, Calibrated Evaluation on UNSW-NB1518 Oct 2025
- 2025Large Language Models for Security Operations Centers: A Comprehensive Survey13 Sep 2025
- 2025Packet-Level DDoS Data Augmentation Using Dual-Stream Temporal-Field Diffusion27 Jul 2025
- 2025Temporal Analysis of NetFlow Datasets for Network Intrusion Detection Systems6 Mar 2025
- 2024Diffusion-based Adversarial Purification for Intrusion Detection25 Jun 2024
- 2024Federated Learning Under Attack: Exposing Vulnerabilities through Data Poisoning Attacks in Computer Networks5 Mar 2024
- 2024TimeSeriesBench: An Industrial-Grade Benchmark for Time Series Anomaly Detection Models16 Feb 2024
- 2023Ensembling Uncertainty Measures to Improve Safety of Black-Box Classifiers23 Aug 2023
- 2023Anomaly Detection Dataset for Industrial Control Systems11 May 2023
- 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detection30 Apr 2023
- 2023Leveraging a Probabilistic PCA Model to Understand the Multivariate Statistical Network Monitoring Framework for Network Security Anomaly Detection2 Feb 2023
- 2022Investigation and rectification of NIDS datasets and standardized feature set derivation for network attack detection with graph neural networks26 Dec 2022
- 2022Improving Multilayer-Perceptron(MLP)-based Network Anomaly Detection with Birch Clustering on CICIDS-2017 Dataset20 Aug 2022
- 2022AnoShift: A Distribution Shift Benchmark for Unsupervised Anomaly Detection30 Jun 2022
- 2022The Role of Machine Learning in Cybersecurity20 Jun 2022
- 2022Open ERP System Data For Occupational Fraud Detection9 Jun 2022
- 2022The Cross-evaluation of Machine Learning-based Network Intrusion Detection Systems9 Mar 2022
- 2022Prepare for Trouble and Make it Double. Supervised and Unsupervised Stacking for AnomalyBased Intrusion Detection28 Feb 2022
- 2022DDoSDet: An approach to Detect DDoS attacks using Neural Networks24 Jan 2022
- 2021Improving the Reliability of Network Intrusion Detection Systems through Dataset Integration2 Dec 2021
- 2021Bridging the gap to real-world for network intrusion detection systems with data-centric approach25 Oct 2021
- 2021An Adaptable Deep Learning-Based Intrusion Detection System to Zero-Day Attacks20 Aug 2021
- 2021Active Learning for Network Traffic Classification: A Technical Study13 Jun 2021
- 2021Sketch-Based Anomaly Detection in Streaming Graphs8 Jun 2021
- 2021MemStream: Memory-Based Streaming Anomaly Detection7 Jun 2021
- 2021Data Curation and Quality Assurance for Machine Learning-based Cyber Intrusion Detection20 May 2021
- 2021Benchmarking the Benchmark -- Analysis of Synthetic NIDS Datasets19 Apr 2021
- 2024TimeSeriesBench: An Industrial-Grade Benchmark for Time Series Anomaly Detection Modelscited by 22
- 2022The Role of Machine Learning in Cybersecuritycited by 21
- 2023SoK: Pragmatic Assessment of Machine Learning for Network Intrusion Detectioncited by 13
- 2021MemStream: Memory-Based Streaming Anomaly Detectioncited by 12
- 2022AnoShift: A Distribution Shift Benchmark for Unsupervised Anomaly Detectioncited by 11
- 2021Sketch-Based Anomaly Detection in Streaming Graphscited by 9
- 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
- 2022The Cross-evaluation of Machine Learning-based Network Intrusion Detection Systemscited by 8
- 2021Benchmarking the Benchmark -- Analysis of Synthetic NIDS Datasetscited by 5
- 2021Active Learning for Network Traffic Classification: A Technical Studycited by 5
- 2021An Adaptable Deep Learning-Based Intrusion Detection System to Zero-Day Attackscited by 5
- 2026OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detectioncited by 4
12 most cited of 42 All 42 (JSON)
- 2026VQC-ZTI: Variational Quantum Control for Zero Trust Protection of the Tactile Internet19 Aug 2026
- 2026BARS: Benign-Anchored Ranking and Selection for False Alarm Reduction in Network Intrusion Detection14 Jul 2026
- 2026Generative AI and Federated Learning for Intrusion Detection Systems: A Survey1 Jul 2026
- 2026Spectral Geometry and Bosonic-Bloch Probes: Explorations in Quantum Learning30 Jun 2026
- 2026Multi-Level Distributional Entropy from Flow Summary Statistics for Explainable Network Intrusion Detection29 Jun 2026
- 2026Do Transformers Actually Help Intrusion Detection? A Temporal Sequence Evaluation on CIC-IDS20179 Jun 2026
- 2026nCMD: Benign-Anchored Feature Selection for Imbalanced Network Intrusion Detection7 Jun 2026
- 2026An Improved CNN-LSTM Based Intrusion Detection System for IoT Networks4 Jun 2026
- 2026Stream Assembly Is an Uncontrolled Treatment in Streaming Intrusion-Detection Benchmarks23 May 2026
- 2026Context-Aware Web Attack Detection in Open-Source SIEM Systems via MITRE ATT&CK-Enriched Behavioral Profiling13 May 2026
- 2026GESR: Graph-Based Edge Semantic Reconstruction for Stealthy Communication Detection with Benign-Only Training8 May 2026
- 2026Robust Semi-Supervised Temporal Intrusion Detection for Adversarial Cloud Networks14 Apr 2026
12 newest of 42 All 42 (JSON)