Maximum Mean Discrepancy Test is Aware of Adversarial Attacks
Not on the map. Why?
Abstract (arXiv)
The maximum mean discrepancy (MMD) test could in principle detect any distributional discrepancy between two datasets. However, it has been shown that the MMD test is unaware of adversarial attacks -- the MMD test failed to detect the discrepancy between natural and adversarial data. Given this phenomenon, we raise a question: are natural and adversarial data really from different distributions? The answer is affirmative -- the previous use of the MMD test on the purpose missed three key factors, and accordingly, we propose three components. Firstly, the Gaussian kernel has limited representation power, and we replace it with an effective deep kernel. Secondly, the test power of the MMD test was neglected, and we maximize it following asymptotic statistics. Finally, adversarial data may be non-independent, and we overcome this issue with the wild bootstrap. By taking care of the three factors, we verify that the MMD test is aware of adversarial attacks, which lights up a novel road for adversarial data detection based on two-sample tests.
Key facts. Cited by 44 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 9; 2023: 3; 2024: 10; 2025: 11; 2026: 6.
44 papers.
Sort:
By area:
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 89
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2021CausalAdv: Adversarial Robustness through the Lens of Causalitycited by 37
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
- 2023Detecting Adversarial Data by Probing Multiple Perturbations Using Expected Perturbation Scorecited by 20
- 2024Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancycited by 20
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Sciencecited by 14
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attackcited by 13
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networkscited by 13
- 2022CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learningcited by 11
32 more
- 2022Generalizing Adversarial Explanations with Grad-CAMcited by 9
- 2023The Representation Jensen-Shannon Divergencecited by 9
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2022Evaluating Aleatoric Uncertainty via Conditional Generative Modelscited by 8
- 2024On the Robustness of Kernel Goodness-of-Fit Testscited by 7
- 2022Towards Adversarial Purification using Denoising AutoEncoderscited by 6
- 2024Improving Accuracy-robustness Trade-off via Pixel Reweighted Adversarial Trainingcited by 6
- 2025DUAL: Learning Diverse Kernels for Aggregated Two-sample and Independence Testingcited by 6
- 2024A Unified Data Representation Learning for Non-parametric Two-sample Testingcited by 5
- 2025One Stone, Two Birds: Enhancing Adversarial Defense Through the Lens of Distributional Discrepancycited by 3
- 2022Adversarial Attack and Defense for Non-Parametric Two-Sample Testscited by 2
- 2024Learning Representations for Independence Testingcited by 2
- 2025PAFT: Prompt-Agnostic Fine-Tuningcited by 2
- 2025Sample-Specific Noise Injection For Diffusion-Based Adversarial Purificationcited by 2
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1
- 2025Topological Signatures of Adversaries in Multimodal Alignmentscited by 1
- 2025Temporal Distribution Shift in Real-World Pharmaceutical Data: Implications for Uncertainty Quantification in QSAR Modelscited by 1
- 2025Anchor-based Maximum Discrepancy for Relative Similarity Testingcited by 1
- 2021Detecting Adversaries, yet Faltering to Noise? Leveraging Conditional Variational AutoEncoders for Adversary Detection in the Presence of Noisy Imagescited by 0
- 2022Btech thesis report on adversarial attack detection and purification of adverserially attacked imagescited by 0
- 2024Discerning the Chaos: Detecting Adversarial Perturbations while Disentangling Intentional from Unintentional Noisescited by 0
- 2024Certifiably Robust Model Evaluation in Federated Learning under Meta-Distributional Shiftscited by 0
- 2024Adversarial Purification by Consistency-aware Latent Space Optimization on Data Manifoldscited by 0
- 2025Boosting Statistic Learning with Synthetic Data from Pretrained Large Modelscited by 0
- 2025Continuous Temporal Learning of Probability Distributions via Neural ODEs with Applications in Continuous Glucose Monitoring Datacited by 0
- 2025Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing Approachcited by 0
- 2025CORE-ReID V2: Advancing the Domain Adaptation for Object Re-Identification with Optimized Training and Ensemble Fusioncited by 0
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Modelscited by 0
- 2026LOTTERY: Learning from Reference-Only Samples in Two-Sample Testing under Size Asymmetrycited by 0
- 2026A nonparametric two-sample test using a parametric integral probability metriccited by 0
- 2026USAD: Uncertainty-aware Statistical Adversarial Detectioncited by 0
- 2026ElasticBack: Stealthy Conditional Backdoor in LLM-Agent Skills via Coupled Trigger-Rule Optimizationcited by 0
- 2026ElasticBack: Stealthy Conditional Backdoor in LLM-Agent Skills via Coupled Trigger-Rule Optimization10 Aug 2026
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2026A nonparametric two-sample test using a parametric integral probability metric15 Jun 2026
- 2026LOTTERY: Learning from Reference-Only Samples in Two-Sample Testing under Size Asymmetry7 Jun 2026
- 2026A Unified Perspective on Adversarial Membership Manipulation in Vision Models3 Apr 2026
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2025DUAL: Learning Diverse Kernels for Aggregated Two-sample and Independence Testing13 Oct 2025
- 2025Anchor-based Maximum Discrepancy for Relative Similarity Testing12 Oct 2025
- 2025CORE-ReID V2: Advancing the Domain Adaptation for Object Re-Identification with Optimized Training and Ensemble Fusion6 Aug 2025
- 2025Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing Approach17 Jul 2025
- 2025Sample-Specific Noise Injection For Diffusion-Based Adversarial Purification6 Jun 2025
- 2025Continuous Temporal Learning of Probability Distributions via Neural ODEs with Applications in Continuous Glucose Monitoring Data13 May 2025
32 more
- 2025Boosting Statistic Learning with Synthetic Data from Pretrained Large Models8 May 2025
- 2025One Stone, Two Birds: Enhancing Adversarial Defense Through the Lens of Distributional Discrepancy4 Mar 2025
- 2025PAFT: Prompt-Agnostic Fine-Tuning18 Feb 2025
- 2025Temporal Distribution Shift in Real-World Pharmaceutical Data: Implications for Uncertainty Quantification in QSAR Models6 Feb 2025
- 2025Topological Signatures of Adversaries in Multimodal Alignments29 Jan 2025
- 2024Adversarial Purification by Consistency-aware Latent Space Optimization on Data Manifolds11 Dec 2024
- 2024A Unified Data Representation Learning for Non-parametric Two-sample Testing30 Nov 2024
- 2024Certifiably Robust Model Evaluation in Federated Learning under Meta-Distributional Shifts26 Oct 2024
- 2024Discerning the Chaos: Detecting Adversarial Perturbations while Disentangling Intentional from Unintentional Noises29 Sep 2024
- 2024Learning Representations for Independence Testing10 Sep 2024
- 2024On the Robustness of Kernel Goodness-of-Fit Tests11 Aug 2024
- 2024Improving Accuracy-robustness Trade-off via Pixel Reweighted Adversarial Training2 Jun 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Science19 Mar 2024
- 2024Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancy25 Feb 2024
- 2023Defenses in Adversarial Machine Learning: A Survey13 Dec 2023
- 2023The Representation Jensen-Shannon Divergence25 May 2023
- 2023Detecting Adversarial Data by Probing Multiple Perturbations Using Expected Perturbation Score25 May 2023
- 2022CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learning4 Oct 2022
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networks29 Sep 2022
- 2022Towards Adversarial Purification using Denoising AutoEncoders29 Aug 2022
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack15 Jun 2022
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attacks11 Jun 2022
- 2022Evaluating Aleatoric Uncertainty via Conditional Generative Models9 Jun 2022
- 2022Btech thesis report on adversarial attack detection and purification of adverserially attacked images9 May 2022
- 2022Generalizing Adversarial Explanations with Grad-CAM11 Apr 2022
- 2022Adversarial Attack and Defense for Non-Parametric Two-Sample Tests7 Feb 2022
- 2021Detecting Adversaries, yet Faltering to Noise? Leveraging Conditional Variational AutoEncoders for Adversary Detection in the Presence of Noisy Images28 Nov 2021
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Training26 Oct 2021
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Training15 Jun 2021
- 2021CausalAdv: Adversarial Robustness through the Lens of Causality11 Jun 2021
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Training9 Feb 2021
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2021AugMax: Adversarial Composition of Random Augmentations for Robust Trainingcited by 89
- 2021Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Trainingcited by 58
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2021CausalAdv: Adversarial Robustness through the Lens of Causalitycited by 37
- 2022Bilateral Dependency Optimization: Defending Against Model-inversion Attackscited by 30
- 2023Detecting Adversarial Data by Probing Multiple Perturbations Using Expected Perturbation Scorecited by 20
- 2024Detecting Machine-Generated Texts by Multi-Population Aware Optimization for Maximum Mean Discrepancycited by 20
- 2023Defenses in Adversarial Machine Learning: A Surveycited by 14
- 2024A Practical Guide to Sample-based Statistical Distances for Evaluating Generative Models in Sciencecited by 14
- 2022Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attackcited by 13
- 2022Towards Lightweight Black-Box Attacks against Deep Neural Networkscited by 13
- 2022CADet: Fully Self-Supervised Out-Of-Distribution Detection With Contrastive Learningcited by 11
12 most cited of 39 All 39 (JSON)
- 2026USAD: Uncertainty-aware Statistical Adversarial Detection26 Jun 2026
- 2026A nonparametric two-sample test using a parametric integral probability metric15 Jun 2026
- 2026LOTTERY: Learning from Reference-Only Samples in Two-Sample Testing under Size Asymmetry7 Jun 2026
- 2025DUAL: Learning Diverse Kernels for Aggregated Two-sample and Independence Testing13 Oct 2025
- 2025Anchor-based Maximum Discrepancy for Relative Similarity Testing12 Oct 2025
- 2025CORE-ReID V2: Advancing the Domain Adaptation for Object Re-Identification with Optimized Training and Ensemble Fusion6 Aug 2025
- 2025Are Two Datasets Close Enough With Statistical Significance? A Kernel Distributional Closeness Testing Approach17 Jul 2025
- 2025Sample-Specific Noise Injection For Diffusion-Based Adversarial Purification6 Jun 2025
- 2025Continuous Temporal Learning of Probability Distributions via Neural ODEs with Applications in Continuous Glucose Monitoring Data13 May 2025
- 2025One Stone, Two Birds: Enhancing Adversarial Defense Through the Lens of Distributional Discrepancy4 Mar 2025
- 2025PAFT: Prompt-Agnostic Fine-Tuning18 Feb 2025
- 2025Temporal Distribution Shift in Real-World Pharmaceutical Data: Implications for Uncertainty Quantification in QSAR Models6 Feb 2025
12 newest of 39 All 39 (JSON)