VC Classes are Adversarially Robustly Learnable, but Only Improperly
Not on the map. Why?
Abstract (arXiv)
We study the question of learning an adversarially robust predictor. We show that any hypothesis class H with finite VC dimension is robustly PAC learnable with an improper learning rule. The requirement of being improper is necessary as we exhibit examples of hypothesis classes H with finite VC dimension that are not robustly PAC learnable with any proper learning rule.
Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 20; 2023: 17; 2024: 13; 2025: 7; 2026: 7.
83 papers.
Sort:
By area:
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
- 2021Calibration and Consistency of Adversarial Surrogate Lossescited by 47
- 2021Adversarial Robustness with Semi-Infinite Constrained Learningcited by 39
- 2022Probabilistically Robust Learning: Balancing Average- and Worst-case Performancecited by 36
- 2022Stability Analysis and Generalization Bounds of Adversarial Trainingcited by 30
- 2023WAT: Improve the Worst-class Robustness in Adversarial Trainingcited by 27
- 2021Realizable Learning is All You Needcited by 25
- 2021On the Existence of the Adversarial Bayes Classifier (Extended Version)cited by 25
- 2021Adversarially Robust Learning with Unknown Perturbation Setscited by 24
- 2021Excess Capacity and Backdoor Poisoningcited by 24
38 more
- 2023Strategic Classification under Unknown Personalized Manipulationcited by 23
- 2023Optimal Learners for Realizable Regression: PAC Learning and Online Learningcited by 23
- 2022Learning Losses for Strategic Classificationcited by 22
- 2022Robustly-reliable learners under poisoning attackscited by 19
- 2021Online Learning with Simple Predictors and a Combinatorial Characterization of Minimax in 0/1 Gamescited by 18
- 2022Adversarial Rademacher Complexity of Deep Neural Networkscited by 18
- 2022Adversarially Robust Learning: A Generic Minimax Optimal Learner and Characterizationcited by 17
- 2021Fast Rates for Nonparametric Online Learning: From Realizability to Learning in Gamescited by 16
- 2024Learnability Gaps of Strategic Classificationcited by 16
- 2021Robust learning under clean-label attackcited by 15
- 2024FedImpro: Measuring and Improving Client Update in Federated Learningcited by 15
- 2021A PAC-Bayes Analysis of Adversarial Robustnesscited by 13
- 2021Learning and Certification under Instance-targeted Poisoningcited by 13
- 2022A Characterization of Semi-Supervised Adversarially-Robust PAC Learnabilitycited by 13
- 2023Multiclass Online Learnability under Bandit Feedbackcited by 12
- 2024Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorizationcited by 12
- 2023Adversarial Resilience in Sequential Prediction via Abstentioncited by 11
- 2021Understanding Generalization in Adversarial Training via the Bias-Variance Decompositioncited by 10
- 2021Transductive Robust Learning Guaranteescited by 10
- 2022A Law of Robustness beyond Isoperimetrycited by 9
- 2022Adversarially Robust Learning with Tolerancecited by 9
- 2023Reliable learning in challenging environmentscited by 9
- 2022Formulating Robustness Against Unforeseen Attackscited by 8
- 2022Adversarially Robust PAC Learnability of Real-Valued Functionscited by 8
- 2021Domain Invariant Adversarial Learningcited by 7
- 2022Robust Empirical Risk Minimization with Tolerancecited by 6
- 2023Generalization Bounds for Adversarial Contrastive Learningcited by 6
- 2023Characterizing the Optimal 0-1 Loss for Multi-class Classification with a Test-time Attackercited by 6
- 2023Sup-Norm Convergence of Deep Neural Network Estimator for Nonparametric Regression by Adversarial Trainingcited by 6
- 2024On the Computability of Robust PAC Learningcited by 6
- 2025PAC Learning with Improvementscited by 6
- 2022On Proper Learnability between Average- and Worst-case Robustnesscited by 5
- 2024Coverage-Guaranteed Prediction Sets for Out-of-Distribution Datacited by 5
- 2024Stability and Generalization in Free Adversarial Trainingcited by 5
- 2025Should Decision-Makers Reveal Classifiers in Online Strategic Classification?cited by 5
- 2021Regional Adversarial Training for Better Robust Generalizationcited by 4
- 2022Sample Complexity Bounds for Robustly Learning Decision Lists against Evasion Attackscited by 4
- 2024Transformation-Invariant Learning and Theoretical Guarantees for OOD Generalizationcited by 4
50 most cited of 83 All 83 (JSON)
- 2026Adversarially Robust PAC Learning with Optimal VC Rates21 Sep 2026
- 2026Bagging Robustly Learns VC Classes with Linear Sample Complexity13 Aug 2026
- 2026Factorized AdaBoost.MH Achieves the Same Convergence Rate as AdaBoost.MH2 Aug 2026
- 2026Clipping the Price of Adaptivity at the Tail21 Jun 2026
- 2026Strategic PAC Learnability via Geometric Definability13 May 2026
- 2026Distribution-Free Sequential Prediction with Abstentions20 Feb 2026
- 2026Robust Online Learning6 Feb 2026
- 2025Impact of Positional Encoding: Clean and Adversarial Rademacher Complexity for Transformers under In-Context Regression10 Dec 2025
- 2025PRBench: A Standardized Probabilistic Robustness Benchmark3 Nov 2025
- 2025The Parameterized Complexity of Computing the VC-Dimension20 Oct 2025
- 2025Should Decision-Makers Reveal Classifiers in Online Strategic Classification?2 Jun 2025
- 2025Robust learning of halfspaces under log-concave marginals19 May 2025
38 more
- 2025Beyond Worst-Case Online Classification: VC-Based Regret Bounds for Relaxed Benchmarks14 Apr 2025
- 2025PAC Learning with Improvements5 Mar 2025
- 2024Transformation-Invariant Learning and Theoretical Guarantees for OOD Generalization30 Oct 2024
- 2024Sample Compression Scheme Reductions16 Oct 2024
- 2024Minimax rates of convergence for nonparametric regression under adversarial attacks12 Oct 2024
- 2024Online Epsilon Net and Piercing Set for Geometric Concepts9 Oct 2024
- 2024On the Computability of Robust PAC Learning14 Jun 2024
- 2024Distributional Adversarial Loss5 Jun 2024
- 2024Uniformly Stable Algorithms for Adversarial Training and Beyond3 May 2024
- 2024Stability and Generalization in Free Adversarial Training13 Apr 2024
- 2024Coverage-Guaranteed Prediction Sets for Out-of-Distribution Data29 Mar 2024
- 2024Learnability Gaps of Strategic Classification29 Feb 2024
- 2024Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization14 Feb 2024
- 2024FedImpro: Measuring and Improving Client Update in Federated Learning10 Feb 2024
- 2024Generalization Properties of Adversarial Training for ℓ0-Bounded Adversarial Attacks5 Feb 2024
- 2023On robust overfitting: adversarial training induced distribution matters28 Nov 2023
- 2023Adversarial Attacks to Latent Representations of Distributed Neural Networks in Split Computing29 Sep 2023
- 2023Online Infinite-Dimensional Regression: Learning Linear Operators8 Sep 2023
- 2023Multiclass Online Learnability under Bandit Feedback8 Aug 2023
- 2023Sup-Norm Convergence of Deep Neural Network Estimator for Nonparametric Regression by Adversarial Training8 Jul 2023
- 2023Optimal Learners for Realizable Regression: PAC Learning and Online Learning7 Jul 2023
- 2023Adversarial Resilience in Sequential Prediction via Abstention22 Jun 2023
- 2023Two Heads are Actually Better than One: Towards Better Adversarial Robustness via Transduction and Rejection27 May 2023
- 2023Strategic Classification under Unknown Personalized Manipulation25 May 2023
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applications14 Apr 2023
- 2023Reliable learning in challenging environments6 Apr 2023
- 2023Agnostic Multi-Robust Learning Using ERM15 Mar 2023
- 2023On the Hardness of Robustness Transfer: A Perspective from Rademacher Complexity over Symmetric Difference Hypothesis Space23 Feb 2023
- 2023Characterizing the Optimal 0-1 Loss for Multi-class Classification with a Test-time Attacker21 Feb 2023
- 2023Generalization Bounds for Adversarial Contrastive Learning21 Feb 2023
- 2023WAT: Improve the Worst-class Robustness in Adversarial Training8 Feb 2023
- 2023A Characterization of Multioutput Learnability6 Jan 2023
- 2022Adversarial Rademacher Complexity of Deep Neural Networks27 Nov 2022
- 2022On Proper Learnability between Average- and Worst-case Robustness10 Nov 2022
- 2022When are Local Queries Useful for Robust Learning?12 Oct 2022
- 2022Stability Analysis and Generalization Bounds of Adversarial Training3 Oct 2022
- 2022Robust Empirical Risk Minimization with Tolerance2 Oct 2022
- 2022Adversarially Robust Learning: A Generic Minimax Optimal Learner and Characterization15 Sep 2022
50 newest of 83 All 83 (JSON)
- 2022Robustly-reliable learners under poisoning attackscited by 19
- 2022Robustly-reliable learners under poisoning attacks8 Mar 2022
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 206
- 2021Robust Learning Meets Generative Models: Can Proxy Distributions Improve Adversarial Robustness?cited by 113
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
- 2021Calibration and Consistency of Adversarial Surrogate Lossescited by 47
- 2021Adversarial Robustness with Semi-Infinite Constrained Learningcited by 39
- 2022Probabilistically Robust Learning: Balancing Average- and Worst-case Performancecited by 36
- 2022Stability Analysis and Generalization Bounds of Adversarial Trainingcited by 30
- 2023WAT: Improve the Worst-class Robustness in Adversarial Trainingcited by 27
- 2021Realizable Learning is All You Needcited by 25
- 2021On the Existence of the Adversarial Bayes Classifier (Extended Version)cited by 25
- 2021Adversarially Robust Learning with Unknown Perturbation Setscited by 24
- 2021Excess Capacity and Backdoor Poisoningcited by 24
12 most cited of 82 All 82 (JSON)
- 2026Adversarially Robust PAC Learning with Optimal VC Rates21 Sep 2026
- 2026Bagging Robustly Learns VC Classes with Linear Sample Complexity13 Aug 2026
- 2026Factorized AdaBoost.MH Achieves the Same Convergence Rate as AdaBoost.MH2 Aug 2026
- 2026Clipping the Price of Adaptivity at the Tail21 Jun 2026
- 2026Strategic PAC Learnability via Geometric Definability13 May 2026
- 2026Distribution-Free Sequential Prediction with Abstentions20 Feb 2026
- 2026Robust Online Learning6 Feb 2026
- 2025Impact of Positional Encoding: Clean and Adversarial Rademacher Complexity for Transformers under In-Context Regression10 Dec 2025
- 2025PRBench: A Standardized Probabilistic Robustness Benchmark3 Nov 2025
- 2025The Parameterized Complexity of Computing the VC-Dimension20 Oct 2025
- 2025Should Decision-Makers Reveal Classifiers in Online Strategic Classification?2 Jun 2025
- 2025Robust learning of halfspaces under log-concave marginals19 May 2025
12 newest of 82 All 82 (JSON)