Adversarial Robustness Toolbox v1.0.0
Not on the map. Why?
Abstract (arXiv)
Adversarial Robustness Toolbox (ART) is a Python library supporting developers and researchers in defending Machine Learning models (Deep Neural Networks, Gradient Boosted Decision Trees, Support Vector Machines, Random Forests, Logistic Regression, Gaussian Processes, Decision Trees, Scikit-learn Pipelines, etc.) against adversarial threats and helps making AI systems more secure and trustworthy. Machine Learning models are vulnerable to adversarial examples, which are inputs (images, texts, tabular data, etc.) deliberately modified to produce a desired response by the Machine Learning model. ART provides the tools to build and deploy defences and test them with adversarial attacks. Defending Machine Learning models involves certifying and verifying model robustness and model hardening with approaches such as pre-processing inputs, augmenting training data with adversarial samples, and leveraging runtime detection methods to flag any inputs that might have been modified by an adversary. The attacks implemented in ART allow creating adversarial attacks against Machine Learning models which is required to test defenses with state-of-the-art threat models. Supported Machine Learning Libraries include TensorFlow (v1 and v2), Keras, PyTorch, MXNet, Scikit-learn, XGBoost, LightGBM, CatBoost, and GPy. The source code of ART is released with MIT license at https://github.com/IBM/adversarial-robustness-toolbox. The release includes code examples, notebooks with tutorials and documentation (http://adversarial-robustness-toolbox.readthedocs.io).
Key facts. Cited by 214 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 44; 2022: 36; 2023: 37; 2024: 38; 2025: 34; 2026: 25.
214 papers.
Sort:
By area:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2022Federated Unlearning: How to Efficiently Erase a Client in FL?cited by 90
- 2023A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinkingcited by 85
- 2021RobustART: Benchmarking Robustness on Architecture Design and Training Techniquescited by 78
- 2021Adversarial Attacks for Tabular Data: Application to Fraud Detection and Imbalanced Datacited by 45
- 2022Evaluating Machine Unlearning via Epistemic Uncertaintycited by 39
- 2021The Threat of Offensive AI to Organizationscited by 37
- 2021Consistent Counterfactuals for Deep Modelscited by 37
- 2023Spatial-frequency channels, shape bias, and adversarial robustnesscited by 28
- 2021A Unified Framework for Adversarial Attack and Defense in Constrained Feature Spacecited by 22
38 more
- 2022Towards Understanding and Mitigating Audio Adversarial Examples for Speaker Recognitioncited by 22
- 2022Membership Inference Attack Using Self Influence Functionscited by 19
- 2021On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attackscited by 17
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 17
- 2022On The Empirical Effectiveness of Unrealistic Adversarial Hardening Against Realistic Adversarial Attackscited by 15
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2023Choosing Public Datasets for Private Machine Learning via Gradient Subspace Distancecited by 14
- 2024AttackBench: Evaluating Gradient-based Attacks for Adversarial Examplescited by 14
- 2023Auditing and Generating Synthetic Data with Controllable Trust Trade-offscited by 13
- 2021Neural Population Geometry Reveals the Role of Stochasticity in Robust Perceptioncited by 12
- 2023Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Surveycited by 12
- 2024Establishing and Evaluating Trustworthy AI: Overview and Research Challengescited by 12
- 2021Spectral Leakage and Rethinking the Kernel Size in CNNscited by 11
- 2022Analysis and Extensions of Adversarial Training for Video Classificationcited by 11
- 2022An Evolutionary, Gradient-Free, Query-Efficient, Black-Box Algorithm for Generating Adversarial Instances in Deep Networkscited by 11
- 2023Marich: A Query-efficient Distributionally Equivalent Model Extraction Attack using Public Datacited by 11
- 2025Robustness and Cybersecurity in the EU Artificial Intelligence Actcited by 10
- 2021Revisiting Model's Uncertainty and Confidences for Adversarial Example Detectioncited by 9
- 2022Tools and Practices for Responsible AI Engineeringcited by 9
- 2022TSFool: Crafting Highly-Imperceptible Adversarial Time Series through Multi-Objective Attackcited by 9
- 2023It Is All About Data: A Survey on the Effects of Data on Adversarial Robustnesscited by 9
- 2025PCAP-Backdoor: Backdoor Poisoning Generator for Network Traffic in CPS/IoT Environmentscited by 9
- 2021PDPGD: Primal-Dual Proximal Gradient Descent Adversarial Attackcited by 8
- 2021Rethinking Image-Scaling Attacks: The Interplay Between Vulnerabilities in Machine Learning Systemscited by 7
- 2021Performance Evaluation of Adversarial Attacks: Discrepancies and Solutionscited by 7
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2023Improved Membership Inference Attacks Against Language Classification Modelscited by 7
- 2024AdvQDet: Detecting Query-Based Adversarial Attacks with Adversarial Contrastive Prompt Tuningcited by 7
- 2021Adversarial Training for Deep Learning-based Intrusion Detection Systemscited by 6
- 2021Evaluating the Cybersecurity Risk of Real World, Machine Learning Production Systemscited by 6
- 2022Robust Federated Learning Against Adversarial Attacks for Speech Emotion Recognitioncited by 6
- 2023New Adversarial Image Detection Based on Sentiment Analysiscited by 6
- 2023Causality-Aided Trade-off Analysis for Machine Learning Fairnesscited by 6
- 2026FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamicscited by 6
- 2021Incompatibility Clustering as a Defense Against Backdoor Poisoning Attackscited by 5
- 2021Stochastic-Shield: A Probabilistic Approach Towards Training-Free Adversarial Defense in Quantized CNNscited by 5
- 2022Certifying Model Accuracy under Distribution Shiftscited by 5
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
50 most cited of 214 All 214 (JSON)
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026Benchmarking Quantum Machine Learning for Power-System Attack Detection: Evaluation Choices Decide the Outcome Before the Models Do16 Aug 2026
- 2026Command-Space Counterfactual Explanations for Pareto-Conditioned Reinforcement Learning15 Aug 2026
- 2026Cross-Domain Generalization Failure in Lightweight Intrusion Detection Models for IIoT Networks1 Jul 2026
- 2026Model Stealing Through the Lens of Model Multiplicity13 Jun 2026
- 2026Neural Variability Enhances Artificial Network Robustness11 Jun 2026
- 2026ERTS: Adversarial Robustness Testing of Ethical AI via Semantic Perturbation in a Bounded Consequence Space11 Jun 2026
- 2026A No-Defense Defense Against Gradient-Based Adversarial Attacks on ML-NIDS: Is Less More?18 May 2026
- 2026FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics17 May 2026
- 2026STRIDE-AI: A Threat Modeling Framework for Generative AI Security Assessment16 May 2026
- 2026Adversarial Fragility and Language Vulnerability in Clinical AI: A Systematic Audit of Diagnostic Collapse Under Imperceptible Perturbations and Cross-Lingual Drift in Low-Resource Healthcare Settings16 May 2026
- 2026SAFE Quantum Machine Learning with Variational Quantum Classifiers15 May 2026
38 more
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026AVISE: Framework for Evaluating the Security of AI Systems22 Apr 2026
- 2026DAIRE: A lightweight AI model for real-time detection of Controller Area Network attacks in the Internet of Vehicles22 Apr 2026
- 2026Auto-ART: Structured Literature Synthesis and Automated Adversarial Robustness Testing22 Apr 2026
- 2026Evaluating Differential Privacy Against Membership Inference in Federated Learning: Insights from the NIST Genomics Red Team Challenge14 Apr 2026
- 2026QShield: Securing Neural Networks Against Adversarial Attacks using Quantum Circuits13 Apr 2026
- 2026Adversarial Robustness of Time-Series Classification for Crystal Collimator Alignment7 Apr 2026
- 2026NERO-Net: A Neuroevolutionary Approach for the Design of Adversarially Robust CNNs26 Mar 2026
- 2026Lipschitz-Based Robustness Certification Under Floating-Point Execution6 Mar 2026
- 2026AMDS: Attack-Aware Multi-Stage Defense System for Network Intrusion Detection with Two-Stage Adaptive Weight Learning1 Mar 2026
- 2026LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings21 Feb 2026
- 2026Evaluating False Alarm and Missing Attacks in CAN IDS2 Feb 2026
- 2026ZK-HybridFL: Zero-Knowledge Proof-Enhanced Hybrid Ledger for Federated Learning29 Jan 2026
- 2025PrivateXR: Defending Privacy Attacks in Extended Reality Through Explainable AI-Guided Differential Privacy18 Dec 2025
- 2025Adversarial Robustness of Traffic Classification under Resource Constraints: Input Structure Matters1 Dec 2025
- 2025ABLE: Using Adversarial Pairs to Construct Local Models for Explaining Model Predictions26 Nov 2025
- 2025Enhancing Adversarial Robustness of IoT Intrusion Detection via SHAP-Based Attribution Fingerprinting9 Nov 2025
- 2025PRBench: A Standardized Probabilistic Robustness Benchmark3 Nov 2025
- 2025RAISE: A Unified Framework for Responsible AI Scoring and Evaluation21 Oct 2025
- 2025UNDREAM: Bridging Differentiable Rendering and Photorealistic Simulation for End-to-end Adversarial Attacks19 Oct 2025
- 2025MS-GAGA: Metric-Selective Guided Adversarial Generation Attack14 Oct 2025
- 2025BlackIce: A Containerized Red Teaming Toolkit for AI Security Testing13 Oct 2025
- 2025FML-bench: Benchmarking Machine Learning Agents for Scientific Research12 Oct 2025
- 2025A Statistical Method for Attack-Agnostic Adversarial Attack Detection with Compressive Sensing Comparison3 Oct 2025
- 2025Learning-Based Testing for Deep Learning: Enhancing Model Robustness with Adversarial Input Prioritization28 Sep 2025
- 2025Amulet: a Python Library for Assessing Interactions Among ML Defenses and Risks15 Sep 2025
- 2025A five-layer framework for AI governance: integrating regulation, standards, and certification14 Sep 2025
- 2025Foe for Fraud: Transferable Adversarial Attacks in Credit Card Fraud Detection20 Aug 2025
- 2025On the Interaction of Compressibility and Adversarial Robustness23 Jul 2025
- 2025Adopting a human developmental visual diet yields robust, shape-based AI vision3 Jul 2025
- 2025Securing AI Systems: A Guide to Known Attacks and Impacts29 Jun 2025
- 2025Bridging Ethical Principles and Algorithmic Methods: An Alternative Approach for Assessing Trustworthiness in AI Systems28 Jun 2025
- 2025An Attack Method for Medical Insurance Claim Fraud Detection based on Generative Adversarial Network22 Jun 2025
- 2025SDN-Based False Data Detection With Its Mitigation and Machine Learning Robustness for In-Vehicle Networks6 Jun 2025
- 2025DURA-CPS: A Multi-Role Orchestrator for Dependability Assurance in LLM-Enabled Cyber-Physical Systems4 Jun 2025
- 2025A Formally Verified Robustness Certifier for Neural Networks (Extended Version)11 May 2025
- 2025Framework GNN-AID: Graph Neural Network Analysis Interpretation and Defense6 May 2025
- 2025Rogue Cell: Adversarial Attack and Defense in Untrusted O-RAN Setup Exploiting the Traffic Steering xApp3 May 2025
50 newest of 214 All 214 (JSON)
- 2022Wild Patterns Reloaded: A Survey of Machine Learning Security against Training Data Poisoningcited by 93
- 2022Federated Unlearning: How to Efficiently Erase a Client in FL?cited by 90
- 2022Evaluating Machine Unlearning via Epistemic Uncertaintycited by 39
- 2022Membership Inference Attack Using Self Influence Functionscited by 19
- 2025PCAP-Backdoor: Backdoor Poisoning Generator for Network Traffic in CPS/IoT Environmentscited by 9
- 2023Improved Membership Inference Attacks Against Language Classification Modelscited by 7
- 20242D-OOB: Attributing Data Contribution Through Joint Valuation Frameworkcited by 4
- 2021Active Learning Under Malicious Mislabeling and Poisoning Attackscited by 3
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearningcited by 2
- 2024Machine Unlearning using Forgetting Neural Networkscited by 2
- 2026STRIDE-AI: A Threat Modeling Framework for Generative AI Security Assessmentcited by 1
- 2022HoneyModels: Machine Learning Honeypotscited by 0
12 most cited of 16 All 16 (JSON)
- 2026STRIDE-AI: A Threat Modeling Framework for Generative AI Security Assessment16 May 2026
- 2026AVISE: Framework for Evaluating the Security of AI Systems22 Apr 2026
- 2026Evaluating Differential Privacy Against Membership Inference in Federated Learning: Insights from the NIST Genomics Red Team Challenge14 Apr 2026
- 2026LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings21 Feb 2026
- 2025BlackIce: A Containerized Red Teaming Toolkit for AI Security Testing13 Oct 2025
- 2025PCAP-Backdoor: Backdoor Poisoning Generator for Network Traffic in CPS/IoT Environments26 Jan 2025
- 2024Machine Unlearning using Forgetting Neural Networks29 Oct 2024
- 20242D-OOB: Attributing Data Contribution Through Joint Valuation Framework7 Aug 2024
- 2024Silver Linings in the Shadows: Harnessing Membership Inference for Machine Unlearning1 Jul 2024
- 2023Improved Membership Inference Attacks Against Language Classification Models11 Oct 2023
- 2022Evaluating Machine Unlearning via Epistemic Uncertainty23 Aug 2022
- 2022Federated Unlearning: How to Efficiently Erase a Client in FL?12 Jul 2022
12 newest of 16 All 16 (JSON)
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2022BackdoorBench: A Comprehensive Benchmark of Backdoor Learningcited by 124
- 2023A Comprehensive Study on Robustness of Image Classification Models: Benchmarking and Rethinkingcited by 85
- 2021RobustART: Benchmarking Robustness on Architecture Design and Training Techniquescited by 78
- 2021Adversarial Attacks for Tabular Data: Application to Fraud Detection and Imbalanced Datacited by 45
- 2021The Threat of Offensive AI to Organizationscited by 37
- 2021Consistent Counterfactuals for Deep Modelscited by 37
- 2023Spatial-frequency channels, shape bias, and adversarial robustnesscited by 28
- 2021A Unified Framework for Adversarial Attack and Defense in Constrained Feature Spacecited by 22
- 2022Towards Understanding and Mitigating Audio Adversarial Examples for Speaker Recognitioncited by 22
- 2021On the Effectiveness of Small Input Noise for Defending Against Query-based Black-Box Attackscited by 17
- 2024BackdoorBench: A Comprehensive Benchmark and Analysis of Backdoor Learningcited by 17
12 most cited of 195 All 195 (JSON)
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026Benchmarking Quantum Machine Learning for Power-System Attack Detection: Evaluation Choices Decide the Outcome Before the Models Do16 Aug 2026
- 2026Command-Space Counterfactual Explanations for Pareto-Conditioned Reinforcement Learning15 Aug 2026
- 2026Cross-Domain Generalization Failure in Lightweight Intrusion Detection Models for IIoT Networks1 Jul 2026
- 2026Model Stealing Through the Lens of Model Multiplicity13 Jun 2026
- 2026Neural Variability Enhances Artificial Network Robustness11 Jun 2026
- 2026ERTS: Adversarial Robustness Testing of Ethical AI via Semantic Perturbation in a Bounded Consequence Space11 Jun 2026
- 2026A No-Defense Defense Against Gradient-Based Adversarial Attacks on ML-NIDS: Is Less More?18 May 2026
- 2026Adversarial Fragility and Language Vulnerability in Clinical AI: A Systematic Audit of Diagnostic Collapse Under Imperceptible Perturbations and Cross-Lingual Drift in Low-Resource Healthcare Settings16 May 2026
- 2026SAFE Quantum Machine Learning with Variational Quantum Classifiers15 May 2026
- 2026Multi-Dimensional Model Integrity and Responsibility Assessment Index and Scoring Framework14 May 2026
- 2026DAIRE: A lightweight AI model for real-time detection of Controller Area Network attacks in the Internet of Vehicles22 Apr 2026
12 newest of 195 All 195 (JSON)