TA3: Testing Against Adversarial Attacks on Machine Learning Models
Not on the map. Why?
Abstract (arXiv)
Adversarial attacks are major threats to the deployment of machine learning (ML) models in many applications. Testing ML models against such attacks is becoming an essential step for evaluating and improving ML models. In this paper, we report the design and development of an interactive system for aiding the workflow of Testing Against Adversarial Attacks (TA3). In particular, with TA3, human-in-the-loop (HITL) enables human-steered attack simulation and visualization-assisted attack impact evaluation. While the current version of TA3 focuses on testing decision tree models against adversarial attacks based on the One Pixel Attack Method, it demonstrates the importance of HITL in ML testing and the potential application of HITL to the ML testing workflows for other types of ML models and other types of adversarial attacks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 35 of its 92 references that are in the map. First posted on arXiv 6 Oct 2024.
Builds on
35 of 92 references.
References · 35
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2016Adversarial Machine Learning at Scalecited by 934
- 2017Ensemble Adversarial Training: Attacks and Defensescited by 833
- 2018Improving Transferability of Adversarial Examples with Input Diversitycited by 591
- 2017One pixel attack for fooling deep neural networkscited by 579
- 2018Poison Frogs! Targeted Clean-Label Poisoning Attacks on Neural Networkscited by 500
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
- 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 276
- 2018Adversarial Attacks and Defences: A Surveycited by 259
23 more
- 2018Dataset Distillationcited by 224
- 2019Human-Centered Tools for Coping with Imperfect Algorithms during Medical Decision-Makingcited by 109
- 2017ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Modelscited by 56
- 2022"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practicecited by 55
- 2016Towards Better Analysis of Deep Convolutional Neural Networkscited by 51
- 2020Universal Adversarial Attack on Attention and the Resulting Dataset DAmageNetcited by 45
- 2019Human-Centered Artificial Intelligence and Machine Learningcited by 37
- 2021VINS: Visual Search for Mobile User Interface Designcited by 37
- 2019A Survey of Black-Box Adversarial Attacks on Computer Vision Modelscited by 36
- 2017A Workflow for Visual Diagnostics of Binary Classifiers using Instance-Level Explanationscited by 20
- 2020A multi-component framework for the analysis and design of explainable artificial intelligencecited by 14
- 2023Evading Black-box Classifiers Without Breaking Eggscited by 13
- 2022Towards Involving End-users in Interactive Human-in-the-loop AI Fairnesscited by 12
- 2020Debiased-CAM to mitigate image perturbations with faithful visual explanations of machine learningcited by 11
- 2021EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendationcited by 8
- 2021Integrated Visualization Editing via Parameterized Declarative Templatescited by 5
- 2022Explainable Global Fairness Verification of Tree-Based Classifierscited by 5
- 2023Segment (Almost) Nothing: Prompt-Agnostic Adversarial Attacks on Segmentation Modelscited by 5
- 2021Visualizing Ensemble Predictions of Music Moodcited by 4
- 2017How the Experts Do It: Assessing and Explaining Agent Behaviors in Real-Time Strategy Gamescited by 3
- 2022Publishing Efficient On-device Models Increases Adversarial Vulnerabilitycited by 3
- 2021Simulation-Based Optimization of User Interfaces for Quality-Assuring Machine Learning Model Predictionscited by 2
- 2023Radial Icicle Tree (RIT): Node Separation and Area Constancycited by 1
Built on by
Not cited yet.