Hypothesis Set Stability and Generalization
Not on the map. Why?
Abstract (arXiv)
We present a study of generalization for data-dependent hypothesis sets. We give a general learning guarantee for data-dependent hypothesis sets based on a notion of transductive Rademacher complexity. Our main result is a generalization bound for data-dependent hypothesis sets expressed in terms of a notion of hypothesis set stability and a notion of Rademacher complexity for data-dependent hypothesis sets that we introduce. This bound admits as special cases both standard Rademacher complexity bounds and algorithm-dependent uniform stability bounds. We also illustrate the use of these learning bounds in the analysis of several scenarios.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 6; 2023: 4; 2024: 4; 2025: 4; 2026: 2.
23 papers.
Sort:
- 2022Topology-aware Generalization of Decentralized SGDcited by 37
- 2021Stability and Generalization of Stochastic Gradient Methods for Minimax Problemscited by 35
- 2021Churn Reduction via Distillationcited by 17
- 2023Generalization Bounds with Data-dependent Fractal Dimensionscited by 15
- 2024Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Setscited by 9
- 2022Exploring the Algorithm-Dependent Generalization of AUPRC Optimization with List Stabilitycited by 8
- 2022Generalization Properties of Retrieval-based Modelscited by 5
- 2022On the Algorithmic Stability and Generalization of Adaptive Optimization Methodscited by 5
- 2023Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Boundscited by 5
- 2023Generalization Guarantees via Algorithm-dependent Rademacher Complexitycited by 4
- 2024The Price of Implicit Bias in Adversarially Robust Generalizationcited by 4
- 2022Boosting the Confidence of Generalization for L2-Stable Randomized Learning Algorithmscited by 3
11 more
- 2023On the Stability and Generalization of Triplet Learningcited by 2
- 2024Stability and Sharper Risk Bounds with Convergence Rate tildeO(1/n2)cited by 2
- 2022Teacher Guided Training: An Efficient Framework for Knowledge Transfercited by 1
- 2025Stability, Complexity and Data-Dependent Worst-Case Generalization Boundscited by 1
- 2025Revisiting Knowledge Distillation: The Hidden Role of Dataset Sizecited by 1
- 2026Logarithmic-Free Moment and Generalization Bounds for Uniformly Stable Algorithmscited by 1
- 2021Improved Learning Rates for Stochastic Optimizationcited by 0
- 2024Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimizationcited by 0
- 2025A Bootstrap Perspective on Stochastic Gradient Descentcited by 0
- 2025Disentangled and Distilled Encoder for Out-of-Distribution Reasoning with Rademacher Guaranteescited by 0
- 2026Generalization at the Edge of Stabilitycited by 0
- 2026Logarithmic-Free Moment and Generalization Bounds for Uniformly Stable Algorithms10 Aug 2026
- 2026Generalization at the Edge of Stability21 Apr 2026
- 2025Disentangled and Distilled Encoder for Out-of-Distribution Reasoning with Rademacher Guarantees11 Dec 2025
- 2025A Bootstrap Perspective on Stochastic Gradient Descent8 Dec 2025
- 2025Revisiting Knowledge Distillation: The Hidden Role of Dataset Size17 Oct 2025
- 2025Stability, Complexity and Data-Dependent Worst-Case Generalization Bounds9 Jul 2025
- 2024Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimization25 Nov 2024
- 2024Stability and Sharper Risk Bounds with Convergence Rate tildeO(1/n2)13 Oct 2024
- 2024The Price of Implicit Bias in Adversarially Robust Generalization7 Jun 2024
- 2024Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets26 Apr 2024
- 2023Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds31 Oct 2023
- 2023Generalization Guarantees via Algorithm-dependent Rademacher Complexity4 Jul 2023
11 more
- 2023On the Stability and Generalization of Triplet Learning20 Feb 2023
- 2023Generalization Bounds with Data-dependent Fractal Dimensions6 Feb 2023
- 2022On the Algorithmic Stability and Generalization of Adaptive Optimization Methods8 Nov 2022
- 2022Generalization Properties of Retrieval-based Models6 Oct 2022
- 2022Exploring the Algorithm-Dependent Generalization of AUPRC Optimization with List Stability27 Sep 2022
- 2022Teacher Guided Training: An Efficient Framework for Knowledge Transfer14 Aug 2022
- 2022Topology-aware Generalization of Decentralized SGD25 Jun 2022
- 2022Boosting the Confidence of Generalization for L2-Stable Randomized Learning Algorithms8 Jun 2022
- 2021Improved Learning Rates for Stochastic Optimization19 Jul 2021
- 2021Churn Reduction via Distillation4 Jun 2021
- 2021Stability and Generalization of Stochastic Gradient Methods for Minimax Problems8 May 2021
- 2022Topology-aware Generalization of Decentralized SGDcited by 37
- 2021Stability and Generalization of Stochastic Gradient Methods for Minimax Problemscited by 35
- 2021Churn Reduction via Distillationcited by 17
- 2023Generalization Bounds with Data-dependent Fractal Dimensionscited by 15
- 2024Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Setscited by 9
- 2022Exploring the Algorithm-Dependent Generalization of AUPRC Optimization with List Stabilitycited by 8
- 2022Generalization Properties of Retrieval-based Modelscited by 5
- 2022On the Algorithmic Stability and Generalization of Adaptive Optimization Methodscited by 5
- 2023Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Boundscited by 5
- 2023Generalization Guarantees via Algorithm-dependent Rademacher Complexitycited by 4
- 2024The Price of Implicit Bias in Adversarially Robust Generalizationcited by 4
- 2022Boosting the Confidence of Generalization for L2-Stable Randomized Learning Algorithmscited by 3
12 most cited of 23 All 23 (JSON)
- 2026Logarithmic-Free Moment and Generalization Bounds for Uniformly Stable Algorithms10 Aug 2026
- 2026Generalization at the Edge of Stability21 Apr 2026
- 2025Disentangled and Distilled Encoder for Out-of-Distribution Reasoning with Rademacher Guarantees11 Dec 2025
- 2025A Bootstrap Perspective on Stochastic Gradient Descent8 Dec 2025
- 2025Revisiting Knowledge Distillation: The Hidden Role of Dataset Size17 Oct 2025
- 2025Stability, Complexity and Data-Dependent Worst-Case Generalization Bounds9 Jul 2025
- 2024Understanding Generalization of Federated Learning: the Trade-off between Model Stability and Optimization25 Nov 2024
- 2024Stability and Sharper Risk Bounds with Convergence Rate tildeO(1/n2)13 Oct 2024
- 2024The Price of Implicit Bias in Adversarially Robust Generalization7 Jun 2024
- 2024Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets26 Apr 2024
- 2023Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds31 Oct 2023
- 2023Generalization Guarantees via Algorithm-dependent Rademacher Complexity4 Jul 2023
12 newest of 23 All 23 (JSON)