BASAR:Black-box Attack on Skeletal Action Recognition
Not on the map. Why?
Abstract (arXiv)
Skeletal motion plays a vital role in human activity recognition as either an independent data source or a complement. The robustness of skeleton-based activity recognizers has been questioned recently, which shows that they are vulnerable to adversarial attacks when the full-knowledge of the recognizer is accessible to the attacker. However, this white-box requirement is overly restrictive in most scenarios and the attack is not truly threatening. In this paper, we show that such threats do exist under black-box settings too. To this end, we propose the first black-box adversarial attack method BASAR. Through BASAR, we show that adversarial attack is not only truly a threat but also can be extremely deceitful, because on-manifold adversarial samples are rather common in skeletal motions, in contrast to the common belief that adversarial samples only exist off-manifold. Through exhaustive evaluation and comparison, we show that BASAR can deliver successful attacks across models, data, and attack modes. Through harsh perceptual studies, we show that it achieves effective yet imperceptible attacks. By analyzing the attack on different activity recognizers, BASAR helps identify the potential causes of their vulnerability and provides insights on what classifiers are likely to be more robust against attack. Code is available at https://github.com/realcrane/BASAR-Black-box-Attack-on-Skeletal-Action-Recognition.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 42 of its 64 references that are in the map. First posted on arXiv 9 Mar 2021.
Builds on
42 of 64 references.
References · 42
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2017The Kinetics Human Action Video Datasetcited by 1,894
- 2016Adversarial examples in the physical worldcited by 1,762
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
- 2016Practical Black-Box Attacks against Machine Learningcited by 893
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 656
- 2017Decision-Based Adversarial Attacks: Reliable Attacks Against Black-Box Machine Learning Modelscited by 459
- 2018Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Surveycited by 459
30 more
- 2016Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samplescited by 439
- 2020Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognitioncited by 339
- 2019HopSkipJumpAttack: A Query-Efficient Decision-Based Attackcited by 328
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
- 2019Efficient Decision-based Black-box Adversarial Attacks on Face Recognitioncited by 173
- 2018Disentangling Adversarial Robustness and Generalizationcited by 171
- 2018Adversarial Attack and Defense on Graph Data: A Surveycited by 166
- 2017The Space of Transferable Adversarial Examplescited by 156
- 2016Spatio-Temporal LSTM with Trust Gates for 3D Human Action Recognitioncited by 142
- 2018AutoZOOM: Autoencoder-based Zeroth Order Optimization Method for Attacking Black-box Neural Networkscited by 137
- 2019Semantics-Guided Neural Networks for Efficient Skeleton-Based Human Action Recognitioncited by 135
- 2018Query-Efficient Hard-label Black-box Attack:An Optimization-based Approachcited by 130
- 2016An End-to-End Spatio-Temporal Attention Model for Human Action Recognition from Skeleton Datacited by 126
- 2017A New Representation of Skeleton Sequences for 3D Action Recognitioncited by 125
- 2019Sign-OPT: A Query-Efficient Hard-label Adversarial Attackcited by 118
- 2020QEBA: Query-Efficient Boundary-Based Blackbox Attackcited by 103
- 2017Interpretable 3D Human Action Analysis with Temporal Convolutional Networkscited by 88
- 2018View Adaptive Neural Networks for High Performance Skeleton-based Human Action Recognitioncited by 84
- 2017Adversarial Transformation Networks: Learning to Generate Adversarial Examplescited by 60
- 2019Adversarial Attacks on Deep Neural Networks for Time Series Classificationcited by 53
- 2019Adversarial Attacks on Time Seriescited by 40
- 2019Heuristic Black-box Adversarial Attacks on Video Recognition Modelscited by 37
- 2019Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modelingcited by 32
- 2019Adversarial Attack on Skeleton-based Human Action Recognitioncited by 32
- 2018Adversarial Attacks for Optical Flow-Based Action Recognition Classifierscited by 14
- 2020Dynamic Future Net: Diversified Human Motion Generationcited by 14
- 2020Adversarial Attacks on Multivariate Time Seriescited by 13
- 2020Towards Understanding the Adversarial Vulnerability of Skeleton-based Action Recognitioncited by 12
- 2019SMART: Skeletal Motion Action Recognition aTtackcited by 4
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 3; 2024: 9; 2025: 3; 2026: 2.
25 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2021Fusing Higher-order Features in Graph Neural Networks for Skeleton-based Action Recognitioncited by 22
- 2021Adversarial Visual Robustness by Causal Interventioncited by 13
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attackscited by 12
- 2021Adversarial Bone Length Attack on Action Recognitioncited by 10
- 2023Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed Gradientcited by 10
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videoscited by 9
- 2022Defending Black-box Skeleton-based Human Activity Classifierscited by 8
- 2022Understanding the Vulnerability of Skeleton-based Human Activity Recognition via Black-box Attackcited by 7
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognitioncited by 7
- 2024TASAR: Transfer-based Attack on Skeletal Action Recognitioncited by 7
13 more
- 2021Anonymization for Skeleton Action Recognitioncited by 5
- 2024Two-Person Interaction Augmentation with Skeleton Priorscited by 5
- 2024Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systemscited by 3
- 2023Fourier Analysis on Robustness of Graph Convolutional Neural Networks for Skeleton-based Action Recognitioncited by 2
- 2024LocalStyleFool: Regional Video Style Transfer Attack Using Segment Anything Modelcited by 2
- 2023Post-train Black-box Defense via Bayesian Boundary Correctioncited by 1
- 2024Fooling Neural Networks for Motion Forecasting via Adversarial Attackscited by 1
- 2025Unveiling Hidden Vulnerabilities in Digital Human Generation via Adversarial Attackscited by 1
- 2024Emotion Loss Attacking: Adversarial Attack Perception for Skeleton based on Multi-dimensional Featurescited by 0
- 2024Boosting Adversarial Transferability for Skeleton-based Action Recognition via Exploring the Model Posterior Spacecited by 0
- 2025Spoofing-aware Prompt Learning for Unified Physical-Digital Facial Attack Detectioncited by 0
- 2026Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognitioncited by 0
- 2026A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Modelscited by 0
- 2026A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Models7 Sep 2026
- 2026Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognition11 Jun 2026
- 2025Spoofing-aware Prompt Learning for Unified Physical-Digital Facial Attack Detection6 Dec 2025
- 2025Unveiling Hidden Vulnerabilities in Digital Human Generation via Adversarial Attacks24 Apr 2025
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos21 Apr 2025
- 2024Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systems18 Dec 2024
- 2024TASAR: Transfer-based Attack on Skeletal Action Recognition4 Sep 2024
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognition16 Aug 2024
- 2024Vulnerabilities in AI-generated Image Detection: The Challenge of Adversarial Attacks30 Jul 2024
- 2024Boosting Adversarial Transferability for Skeleton-based Action Recognition via Exploring the Model Posterior Space11 Jul 2024
- 2024Emotion Loss Attacking: Adversarial Attack Perception for Skeleton based on Multi-dimensional Features28 Jun 2024
- 2024Two-Person Interaction Augmentation with Skeleton Priors8 Apr 2024
13 more
- 2024LocalStyleFool: Regional Video Style Transfer Attack Using Segment Anything Model18 Mar 2024
- 2024Fooling Neural Networks for Motion Forecasting via Adversarial Attacks7 Mar 2024
- 2023Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed Gradient10 Aug 2023
- 2023Post-train Black-box Defense via Bayesian Boundary Correction29 Jun 2023
- 2023Fourier Analysis on Robustness of Graph Convolutional Neural Networks for Skeleton-based Action Recognition29 May 2023
- 2022Understanding the Vulnerability of Skeleton-based Human Activity Recognition via Black-box Attack21 Nov 2022
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Survey30 Sep 2022
- 2022Defending Black-box Skeleton-based Human Activity Classifiers9 Mar 2022
- 2021Anonymization for Skeleton Action Recognition30 Nov 2021
- 2021Adversarial Bone Length Attack on Action Recognition13 Sep 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A survey1 Aug 2021
- 2021Adversarial Visual Robustness by Causal Intervention17 Jun 2021
- 2021Fusing Higher-order Features in Graph Neural Networks for Skeleton-based Action Recognition4 May 2021
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2022Physical Adversarial Attack meets Computer Vision: A Decade Surveycited by 66
- 2021Fusing Higher-order Features in Graph Neural Networks for Skeleton-based Action Recognitioncited by 22
- 2021Adversarial Visual Robustness by Causal Interventioncited by 13
- 2021Adversarial Bone Length Attack on Action Recognitioncited by 10
- 2023Hard No-Box Adversarial Attack on Skeleton-Based Human Action Recognition with Skeleton-Motion-Informed Gradientcited by 10
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videoscited by 9
- 2022Defending Black-box Skeleton-based Human Activity Classifierscited by 8
- 2022Understanding the Vulnerability of Skeleton-based Human Activity Recognition via Black-box Attackcited by 7
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognitioncited by 7
- 2024TASAR: Transfer-based Attack on Skeletal Action Recognitioncited by 7
- 2021Anonymization for Skeleton Action Recognitioncited by 5
12 most cited of 24 All 24 (JSON)
- 2026A Black-Box Adversarial Attack on Human Pose Estimation and Keypoint-Based Action Recognition Models7 Sep 2026
- 2026Quality-Preserving Imperceptible Adversarial Attack on Skeleton-based Human Action Recognition11 Jun 2026
- 2025Spoofing-aware Prompt Learning for Unified Physical-Digital Facial Attack Detection6 Dec 2025
- 2025Unveiling Hidden Vulnerabilities in Digital Human Generation via Adversarial Attacks24 Apr 2025
- 2025Fast Adversarial Training with Weak-to-Strong Spatial-Temporal Consistency in the Frequency Domain on Videos21 Apr 2025
- 2024Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systems18 Dec 2024
- 2024TASAR: Transfer-based Attack on Skeletal Action Recognition4 Sep 2024
- 2024Towards Physical World Backdoor Attacks against Skeleton Action Recognition16 Aug 2024
- 2024Boosting Adversarial Transferability for Skeleton-based Action Recognition via Exploring the Model Posterior Space11 Jul 2024
- 2024Emotion Loss Attacking: Adversarial Attack Perception for Skeleton based on Multi-dimensional Features28 Jun 2024
- 2024Two-Person Interaction Augmentation with Skeleton Priors8 Apr 2024
- 2024LocalStyleFool: Regional Video Style Transfer Attack Using Segment Anything Model18 Mar 2024
12 newest of 24 All 24 (JSON)