SOREL-20M: A Large Scale Benchmark Dataset for Malicious PE Detection
Not on the map. Why?
Abstract (arXiv)
In this paper we describe the SOREL-20M (Sophos/ReversingLabs-20 Million) dataset: a large-scale dataset consisting of nearly 20 million files with pre-extracted features and metadata, high-quality labels derived from multiple sources, information about vendor detections of the malware samples at the time of collection, and additional ``tags'' related to each malware sample to serve as additional targets. In addition to features and metadata, we also provide approximately 10 million ``disarmed'' malware samples -- samples with both the optionalheaders.subsystem and fileheader.machine flags set to zero -- that may be used for further exploration of features and detection strategies. We also provide Python code to interact with the data and features, as well as baseline neural network and gradient boosted decision tree models and their results, with full training and evaluation code, to serve as a starting point for further experimentation.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 5; 2024: 5; 2025: 15; 2026: 10.
49 papers.
Sort:
By area:
- 2021Unsolved Problems in ML Safetycited by 291
- 2022The Role of Machine Learning in Cybersecuritycited by 21
- 2025EMBER2024 -- A Benchmark Dataset for Holistic Evaluation of Malware Classifierscited by 18
- 2021MOTIF: A Large Malware Reference Dataset with Ground Truth Family Labelscited by 17
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2022Jigsaw Puzzle: Selective Backdoor Attack to Subvert Malware Classifierscited by 14
- 2024Assemblage: Automatic Binary Dataset Construction for Machine Learningcited by 12
- 2021Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraintscited by 11
- 2022MERLIN -- Malware Evasion with Reinforcement LearnINgcited by 10
- 2021Mate! Are You Really Aware? An Explainability-Guided Testing Framework for Robustness of Malware Detectorscited by 7
- 2022Efficient Malware Analysis Using Metric Embeddingscited by 6
- 2024Is Function Similarity Over-Engineered? Building a Benchmarkcited by 6
37 more
- 2025Recent Advances in Malware Detection: Graph Learning and Explainabilitycited by 6
- 2025LAMDA: A Longitudinal Android Malware Benchmark for Concept Drift Analysiscited by 6
- 2023AVScan2Vec: Feature Learning on Antivirus Scan Data for Production-Scale Malware Corporacited by 5
- 2022Class-wise and reduced calibration methodscited by 4
- 2023Small Effect Sizes in Malware Detection? Make Harder Train/Test Splits!cited by 4
- 2024Stabilizing Linear Passive-Aggressive Online Learning with Weighted Reservoir Samplingcited by 4
- 2023The Power of MEME: Adversarial Malware Creation with Model-Based Reinforcement Learningcited by 3
- 2025Semantic Preprocessing for LLM-based Malware Analysiscited by 3
- 2022Avast-CTU Public CAPE Datasetcited by 2
- 2023A Survey on Cross-Architectural IoT Malware Threat Huntingcited by 2
- 2025Binary BPE: A Family of Cross-Platform Tokenizers for Binary Analysiscited by 2
- 2026Cybersecurity is the True Frontier for Generative AI Success or Failurecited by 2
- 2022Stealing and Evading Malware Classifiers and Antivirus at Low False Positive Conditionscited by 1
- 2022Marvolo: Programmatic Data Augmentation for Practical ML-Driven Malware Detectioncited by 1
- 2024Machine Learning for Windows Malware Detection and Classification: Methods, Challenges and Ongoing Researchcited by 1
- 2025On the Security Risks of ML-based Malware Detection Systems: A Surveycited by 1
- 2025Efficient Malware Detection with Optimized Learning on High-Dimensional Featurescited by 1
- 2025Adaptive Malware Detection using Sequential Feature Selection: A Dueling Double Deep Q-Network (D3QN) Framework for Intelligent Classificationcited by 1
- 2025Demystifying the Role of Rule-based Detection in AI Systems for Windows Malware Detectioncited by 1
- 2025Binary-30K: A Heterogeneous Dataset for Deep Learning in Binary Analysis and Malware Detectioncited by 1
- 2025Clustering Malware at Scale: A First Full-Benchmark Studycited by 1
- 2026Automated Malware Family Classification using Weighted Hierarchical Ensembles of Large Language Modelscited by 1
- 2026Trident: Improving Malware Detection with LLMs and Behavioral Featurescited by 1
- 2021A Comparison of State-of-the-Art Techniques for Generating Adversarial Malware Binariescited by 0
- 2022On the impact of dataset size and class imbalance in evaluating machine-learning-based windows malware detection techniquescited by 0
- 2023Enhancing Enterprise Network Security: Comparing Machine-Level and Process-Level Analysis for Dynamic Malware Detectioncited by 0
- 2024On the Robustness of Malware Detectors to Adversarial Samplescited by 0
- 2025Evaluating Out-of-Distribution Robustness in Graph-Based Android Malware Classification: A New Principled Benchmarkcited by 0
- 2025Certifiably robust malware detectors by designcited by 0
- 2025Efficient Adversarial Malware Defense via Trust-Based Raw Override and Confidence-Adaptive Bit-Depth Reductioncited by 0
- 2026FARM: Few-shot Adaptive Malware Family Classification under Concept Driftcited by 0
- 2026Machine Learning Transferability for Malware Detectioncited by 0
- 2026LCC-LLM: Leveraging Code-Centric Large Language Models for Malware Attributioncited by 0
- 2026Quantifiable Uncertainty: A Stochastic Consensus Multi-Agent RAG Framework for Robust Malware Detectioncited by 0
- 2026EXE-Bench: Ranking the Tradeoffs of AI-based Windows Malware Detectors for Real-World Usabilitycited by 0
- 2026Simpler Methods Work Better for L1 Penalized Logistic Models and Large Datasetscited by 0
- 2026Temporal Generalization and Explanation Stability of Control Flow Graph Neural Networks for Malware Detectioncited by 0
- 2026Temporal Generalization and Explanation Stability of Control Flow Graph Neural Networks for Malware Detection21 Sep 2026
- 2026Simpler Methods Work Better for L1 Penalized Logistic Models and Large Datasets21 Sep 2026
- 2026EXE-Bench: Ranking the Tradeoffs of AI-based Windows Malware Detectors for Real-World Usability27 Jul 2026
- 2026Cybersecurity is the True Frontier for Generative AI Success or Failure27 Jun 2026
- 2026Quantifiable Uncertainty: A Stochastic Consensus Multi-Agent RAG Framework for Robust Malware Detection8 May 2026
- 2026LCC-LLM: Leveraging Code-Centric Large Language Models for Malware Attribution7 May 2026
- 2026Trident: Improving Malware Detection with LLMs and Behavioral Features30 Apr 2026
- 2026Automated Malware Family Classification using Weighted Hierarchical Ensembles of Large Language Models2 Apr 2026
- 2026Machine Learning Transferability for Malware Detection27 Mar 2026
- 2026FARM: Few-shot Adaptive Malware Family Classification under Concept Drift25 Jan 2026
- 2025Clustering Malware at Scale: A First Full-Benchmark Study28 Nov 2025
- 2025Binary-30K: A Heterogeneous Dataset for Deep Learning in Binary Analysis and Malware Detection27 Nov 2025
37 more
- 2025Efficient Adversarial Malware Defense via Trust-Based Raw Override and Confidence-Adaptive Bit-Depth Reduction16 Nov 2025
- 2025Binary BPE: A Family of Cross-Platform Tokenizers for Binary Analysis14 Nov 2025
- 2025Demystifying the Role of Rule-based Detection in AI Systems for Windows Malware Detection13 Aug 2025
- 2025Certifiably robust malware detectors by design10 Aug 2025
- 2025Evaluating Out-of-Distribution Robustness in Graph-Based Android Malware Classification: A New Principled Benchmark8 Aug 2025
- 2025Adaptive Malware Detection using Sequential Feature Selection: A Dueling Double Deep Q-Network (D3QN) Framework for Intelligent Classification6 Jul 2025
- 2025Efficient Malware Detection with Optimized Learning on High-Dimensional Features18 Jun 2025
- 2025Semantic Preprocessing for LLM-based Malware Analysis13 Jun 2025
- 2025EMBER2024 -- A Benchmark Dataset for Holistic Evaluation of Malware Classifiers5 Jun 2025
- 2025LAMDA: A Longitudinal Android Malware Benchmark for Concept Drift Analysis24 May 2025
- 2025On the Security Risks of ML-based Malware Detection Systems: A Survey16 May 2025
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineering7 Apr 2025
- 2025Recent Advances in Malware Detection: Graph Learning and Explainability14 Feb 2025
- 2024Stabilizing Linear Passive-Aggressive Online Learning with Weighted Reservoir Sampling31 Oct 2024
- 2024Is Function Similarity Over-Engineered? Building a Benchmark30 Oct 2024
- 2024On the Robustness of Malware Detectors to Adversarial Samples5 Aug 2024
- 2024Assemblage: Automatic Binary Dataset Construction for Machine Learning7 May 2024
- 2024Machine Learning for Windows Malware Detection and Classification: Methods, Challenges and Ongoing Research29 Apr 2024
- 2023Small Effect Sizes in Malware Detection? Make Harder Train/Test Splits!25 Dec 2023
- 2023Enhancing Enterprise Network Security: Comparing Machine-Level and Process-Level Analysis for Dynamic Malware Detection27 Oct 2023
- 2023The Power of MEME: Adversarial Malware Creation with Model-Based Reinforcement Learning31 Aug 2023
- 2023A Survey on Cross-Architectural IoT Malware Threat Hunting9 Jun 2023
- 2023AVScan2Vec: Feature Learning on Antivirus Scan Data for Production-Scale Malware Corpora9 Jun 2023
- 2022Efficient Malware Analysis Using Metric Embeddings5 Dec 2022
- 2022Class-wise and reduced calibration methods7 Oct 2022
- 2022Avast-CTU Public CAPE Dataset6 Sep 2022
- 2022The Role of Machine Learning in Cybersecurity20 Jun 2022
- 2022On the impact of dataset size and class imbalance in evaluating machine-learning-based windows malware detection techniques13 Jun 2022
- 2022Marvolo: Programmatic Data Augmentation for Practical ML-Driven Malware Detection7 Jun 2022
- 2022Stealing and Evading Malware Classifiers and Antivirus at Low False Positive Conditions13 Apr 2022
- 2022MERLIN -- Malware Evasion with Reinforcement LearnINg24 Mar 2022
- 2022Jigsaw Puzzle: Selective Backdoor Attack to Subvert Malware Classifiers11 Feb 2022
- 2021MOTIF: A Large Malware Reference Dataset with Ground Truth Family Labels29 Nov 2021
- 2021A Comparison of State-of-the-Art Techniques for Generating Adversarial Malware Binaries22 Nov 2021
- 2021Mate! Are You Really Aware? An Explainability-Guided Testing Framework for Robustness of Malware Detectors19 Nov 2021
- 2021Unsolved Problems in ML Safety28 Sep 2021
- 2021Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraints9 Aug 2021
- 2021Unsolved Problems in ML Safetycited by 291
- 2022The Role of Machine Learning in Cybersecuritycited by 21
- 2025EMBER2024 -- A Benchmark Dataset for Holistic Evaluation of Malware Classifierscited by 18
- 2021MOTIF: A Large Malware Reference Dataset with Ground Truth Family Labelscited by 17
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2022Jigsaw Puzzle: Selective Backdoor Attack to Subvert Malware Classifierscited by 14
- 2024Assemblage: Automatic Binary Dataset Construction for Machine Learningcited by 12
- 2021Leveraging Uncertainty for Improved Static Malware Detection Under Extreme False Positive Constraintscited by 11
- 2022MERLIN -- Malware Evasion with Reinforcement LearnINgcited by 10
- 2021Mate! Are You Really Aware? An Explainability-Guided Testing Framework for Robustness of Malware Detectorscited by 7
- 2022Efficient Malware Analysis Using Metric Embeddingscited by 6
- 2024Is Function Similarity Over-Engineered? Building a Benchmarkcited by 6
12 most cited of 48 All 48 (JSON)
- 2026Temporal Generalization and Explanation Stability of Control Flow Graph Neural Networks for Malware Detection21 Sep 2026
- 2026Simpler Methods Work Better for L1 Penalized Logistic Models and Large Datasets21 Sep 2026
- 2026EXE-Bench: Ranking the Tradeoffs of AI-based Windows Malware Detectors for Real-World Usability27 Jul 2026
- 2026Cybersecurity is the True Frontier for Generative AI Success or Failure27 Jun 2026
- 2026LCC-LLM: Leveraging Code-Centric Large Language Models for Malware Attribution7 May 2026
- 2026Trident: Improving Malware Detection with LLMs and Behavioral Features30 Apr 2026
- 2026Automated Malware Family Classification using Weighted Hierarchical Ensembles of Large Language Models2 Apr 2026
- 2026Machine Learning Transferability for Malware Detection27 Mar 2026
- 2026FARM: Few-shot Adaptive Malware Family Classification under Concept Drift25 Jan 2026
- 2025Clustering Malware at Scale: A First Full-Benchmark Study28 Nov 2025
- 2025Binary-30K: A Heterogeneous Dataset for Deep Learning in Binary Analysis and Malware Detection27 Nov 2025
- 2025Efficient Adversarial Malware Defense via Trust-Based Raw Override and Confidence-Adaptive Bit-Depth Reduction16 Nov 2025
12 newest of 48 All 48 (JSON)