{"total":120,"rows":[{"id":"2110.11216","title":"User-friendly introduction to PAC-Bayes bounds","created":"2021-10-21","cited_by_count":239,"area":null},{"id":"2201.04234","title":"Leveraging Unlabeled Data to Predict Out-of-Distribution Performance","created":"2022-01-11","cited_by_count":145,"area":null},{"id":"2211.13609","title":"PAC-Bayes Compression Bounds So Tight That They Can Explain Generalization","created":"2022-11-24","cited_by_count":76,"area":null},{"id":"2106.15535","title":"Subgroup Generalization and Fairness of Graph Neural Networks","created":"2021-06-29","cited_by_count":69,"area":null},{"id":"2304.05366","title":"The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning","created":"2023-04-11","cited_by_count":63,"area":null},{"id":"2202.11678","title":"Bayesian Model Selection, the Marginal Likelihood, and Generalization","created":"2022-02-23","cited_by_count":57,"area":null},{"id":"2503.02113","title":"Deep Learning is Not So Mysterious or Different","created":"2025-03-03","cited_by_count":56,"area":null},{"id":"2312.17173","title":"Non-Vacuous Generalization Bounds for Large Language Models","created":"2023-12-28","cited_by_count":53,"area":null},{"id":"2111.04578","title":"Improved Regularization and Robustness for Fine-tuning in Neural Networks","created":"2021-11-08","cited_by_count":45,"area":null},{"id":"2202.00155","title":"Fortuitous Forgetting in Connectionist Networks","created":"2022-02-01","cited_by_count":39,"area":null},{"id":"2206.02659","title":"Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees","created":"2022-06-06","cited_by_count":34,"area":null},{"id":"2306.08777","title":"MMD-FUSE: Learning and Combining Kernels for Two-Sample Testing Without Data Splitting","created":"2023-06-14","cited_by_count":33,"area":null},{"id":"2106.09683","title":"PAC-Bayes, MAC-Bayes and Conditional Mutual Information: Fast rate bounds that handle general VC classes","created":"2021-06-17","cited_by_count":31,"area":null},{"id":"2102.06589","title":"Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability","created":"2021-02-12","cited_by_count":30,"area":null},{"id":"2202.03038","title":"Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry","created":"2022-02-07","cited_by_count":28,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2312.03656","title":"Interpretability Illusions in the Generalization of Simplified Models","created":"2023-12-06","cited_by_count":25,"area":null},{"id":"2407.18158","title":"Unlocking Tokens as Data Points for Generalization Bounds on Larger Language Models","created":"2024-07-25","cited_by_count":25,"area":null},{"id":"2106.03542","title":"How Tight Can PAC-Bayes be in the Small Data Regime?","created":"2021-06-07","cited_by_count":24,"area":null},{"id":"2202.01627","title":"Non-Vacuous Generalisation Bounds for Shallow Neural Networks","created":"2022-02-03","cited_by_count":22,"area":null},{"id":"2212.11110","title":"Lifelong Reinforcement Learning with Modulating Masks","created":"2022-12-21","cited_by_count":22,"area":null},{"id":"2105.00303","title":"RATT: Leveraging Unlabeled Data to Guarantee Generalization","created":"2021-05-01","cited_by_count":20,"area":null},{"id":"2205.12694","title":"Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models","created":"2022-05-25","cited_by_count":20,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2102.07804","title":"Scaling Up Exact Neural Network Compression by ReLU Stability","created":"2021-02-15","cited_by_count":19,"area":null},{"id":"2107.03955","title":"On Margins and Derandomisation in PAC-Bayes","created":"2021-07-08","cited_by_count":19,"area":null},{"id":"2306.12214","title":"More PAC-Bayes bounds: From bounded losses, to losses with general tail behaviors, to anytime validity","created":"2023-06-21","cited_by_count":17,"area":null},{"id":"2401.12689","title":"Energy-based Automated Model Evaluation","created":"2024-01-23","cited_by_count":17,"area":null},{"id":"2208.04284","title":"On Rademacher Complexity-based Generalization Bounds for Deep Learning","created":"2022-08-08","cited_by_count":16,"area":null},{"id":"2306.00312","title":"(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy","created":"2023-06-01","cited_by_count":16,"area":null},{"id":"2105.10065","title":"A Probabilistic Approach to Neural Network Pruning","created":"2021-05-20","cited_by_count":15,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2110.14163","title":"Does the Data Induce Capacity Control in Deep Learning?","created":"2021-10-27","cited_by_count":14,"area":null},{"id":"2207.05685","title":"PAC-Bayesian Domain Adaptation Bounds for Multiclass Learners","created":"2022-07-12","cited_by_count":13,"area":null},{"id":"2211.01258","title":"Instance-Dependent Generalization Bounds via Optimal Transport","created":"2022-11-02","cited_by_count":13,"area":null},{"id":"2302.05829","title":"Tighter PAC-Bayes Bounds Through Coin-Betting","created":"2023-02-12","cited_by_count":13,"area":null},{"id":"2102.03748","title":"PAC-Bayes Bounds for Meta-learning with Data-Dependent Prior","created":"2021-02-07","cited_by_count":11,"area":null},{"id":"2112.02668","title":"On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons","created":"2021-12-05","cited_by_count":11,"area":null},{"id":"2202.13216","title":"Adversarial robustness of sparse local Lipschitz predictors","created":"2022-02-26","cited_by_count":11,"area":null},{"id":"2206.00706","title":"Split-kl and PAC-Bayes-split-kl Inequalities for Ternary Random Variables","created":"2022-06-01","cited_by_count":11,"area":null},{"id":"2103.06002","title":"Robustness to Pruning Predicts Generalization in Deep Neural Networks","created":"2021-03-10","cited_by_count":10,"area":null},{"id":"2106.09798","title":"Wide stochastic networks: Gaussian limit and PAC-Bayesian training","created":"2021-06-17","cited_by_count":10,"area":null},{"id":"2404.03176","title":"Information-Theoretic Generalization Bounds for Deep Neural Networks","created":"2024-04-04","cited_by_count":10,"area":null},{"id":"2201.11059","title":"Generalization Error Bounds on Deep Learning with Markov Datasets","created":"2021-12-23","cited_by_count":9,"area":null},{"id":"2208.07951","title":"On the generalization of learning algorithms that do not converge","created":"2022-08-16","cited_by_count":9,"area":null},{"id":"2209.02525","title":"Generalisation under gradient descent via deterministic PAC-Bayes","created":"2022-09-06","cited_by_count":9,"area":null},{"id":"2210.11289","title":"Tighter PAC-Bayes Generalisation Bounds by Leveraging Example Difficulty","created":"2022-10-20","cited_by_count":9,"area":null},{"id":"2303.05369","title":"Data-dependent Generalization Bounds via Variable-Size Compressibility","created":"2023-03-09","cited_by_count":9,"area":null},{"id":"2102.07725","title":"Neural Network Compression for Noisy Storage Devices","created":"2021-02-15","cited_by_count":8,"area":null},{"id":"2105.03491","title":"Uniform Convergence, Adversarial Spheres and a Simple Remedy","created":"2021-05-07","cited_by_count":8,"area":null},{"id":"2306.05862","title":"Lessons from Generalization Error Analysis of Federated Learning: You May Communicate Less Often!","created":"2023-06-09","cited_by_count":8,"area":null},{"id":"2307.00426","title":"Sparsity-aware generalization theory for deep neural networks","created":"2023-07-01","cited_by_count":8,"area":null},{"id":"2110.11886","title":"Conditionally Gaussian PAC-Bayes","created":"2021-10-22","cited_by_count":7,"area":null},{"id":"2206.04607","title":"On Margins and Generalisation for Voting Classifiers","created":"2022-06-09","cited_by_count":7,"area":null},{"id":"2209.15208","title":"Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel","created":"2022-09-30","cited_by_count":7,"area":null},{"id":"2301.12033","title":"Norm-based Generalization Bounds for Compositionally Sparse Neural Networks","created":"2023-01-28","cited_by_count":7,"area":null},{"id":"2105.01867","title":"A Theoretical-Empirical Approach to Estimating Sample Complexity of DNNs","created":"2021-05-05","cited_by_count":6,"area":null},{"id":"2305.19243","title":"Improving Generalization of Complex Models under Unbounded Loss Using PAC-Bayes Bounds","created":"2023-05-30","cited_by_count":6,"area":null},{"id":"2412.03486","title":"Tight PAC-Bayesian Risk Certificates for Contrastive Learning","created":"2024-12-04","cited_by_count":6,"area":null},{"id":"2106.06153","title":"Towards Understanding Generalization via Decomposing Excess Risk Dynamics","created":"2021-06-11","cited_by_count":5,"area":null},{"id":"2205.13799","title":"Generalization Bounds for Gradient Methods via Discrete and Continuous Prior","created":"2022-05-27","cited_by_count":5,"area":null},{"id":"2305.01143","title":"Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective","created":"2023-05-02","cited_by_count":5,"area":null},{"id":"2310.10534","title":"Comparing Comparators in Generalization Bounds","created":"2023-10-16","cited_by_count":5,"area":null},{"id":"2501.19067","title":"From Low Intrinsic Dimensionality to Non-Vacuous Generalization Bounds in Deep Multi-Task Learning","created":"2025-01-31","cited_by_count":5,"area":null},{"id":"2504.15208","title":"Compute-Optimal LLMs Provably Generalize Better With Scale","created":"2025-04-21","cited_by_count":5,"area":null},{"id":"2206.07199","title":"Benefits of Additive Noise in Composing Classes with Bounded Capacity","created":"2022-06-14","cited_by_count":4,"area":null},{"id":"2207.09408","title":"Bounding generalization error with input compression: An empirical study with infinite-width networks","created":"2022-07-19","cited_by_count":4,"area":null},{"id":"2307.13962","title":"Understanding Deep Neural Networks via Linear Separability of Hidden Layers","created":"2023-07-26","cited_by_count":4,"area":null},{"id":"2312.09323","title":"Perspectives on the State and Future of Deep Learning - 2023","created":"2023-12-07","cited_by_count":4,"area":null},{"id":"2410.02147","title":"Efficient Source-Free Time-Series Adaptation via Parameter Subspace Disentanglement","created":"2024-10-03","cited_by_count":4,"area":null},{"id":"2412.06381","title":"Gentle Local Robustness implies Generalization","created":"2024-12-09","cited_by_count":4,"area":null},{"id":"2503.08231","title":"How good is PAC-Bayes at explaining generalisation?","created":"2025-03-11","cited_by_count":4,"area":null},{"id":"2601.08100","title":"Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Bounds","created":"2026-01-13","cited_by_count":4,"area":null},{"id":"2202.05560","title":"Controlling Multiple Errors Simultaneously with a PAC-Bayes Bound","created":"2022-02-11","cited_by_count":3,"area":null},{"id":"2309.05292","title":"The fine print on tempered posteriors","created":"2023-09-11","cited_by_count":3,"area":null},{"id":"2407.17120","title":"Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective","created":"2024-07-24","cited_by_count":3,"area":null},{"id":"2510.25569","title":"A Framework for Bounding Deterministic Risk with PAC-Bayes: Applications to Majority Votes","created":"2025-10-29","cited_by_count":3,"area":null},{"id":"2302.14518","title":"Generalization Error Bounds for Noisy, Iterative Algorithms via Maximal Leakage","created":"2023-02-28","cited_by_count":2,"area":null},{"id":"2311.04561","title":"Information-Theoretic Generalization Bounds for Transductive Learning and its Applications","created":"2023-11-08","cited_by_count":2,"area":null},{"id":"2503.07325","title":"Non-vacuous Generalization Bounds for Deep Neural Networks without any modification to the trained models","created":"2025-03-10","cited_by_count":2,"area":null},{"id":"2506.12903","title":"Variational Learning Finds Flatter Solutions at the Edge of Stability","created":"2025-06-15","cited_by_count":2,"area":null},{"id":"2508.00357","title":"Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimization","created":"2025-08-01","cited_by_count":2,"area":null},{"id":"2601.01465","title":"Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD","created":"2026-01-04","cited_by_count":2,"area":null},{"id":"2602.23128","title":"Bound to Disagree: Generalization Bounds via Certifiable Surrogates","created":"2026-02-26","cited_by_count":2,"area":null},{"id":"2102.03802","title":"Dimension Free Generalization Bounds for Non Linear Metric Learning","created":"2021-02-07","cited_by_count":1,"area":null},{"id":"2110.15137","title":"PAC-Bayesian Learning of Aggregated Binary Activated Neural Networks with Probabilities over Representations","created":"2021-10-28","cited_by_count":1,"area":null},{"id":"2112.05547","title":"PACMAN: PAC-style bounds accounting for the Mismatch between Accuracy and Negative log-loss","created":"2021-12-10","cited_by_count":1,"area":null},{"id":"2202.01958","title":"Demystify Optimization and Generalization of Over-parameterized PAC-Bayesian Learning","created":"2022-02-04","cited_by_count":1,"area":null},{"id":"2203.15972","title":"Higher-Order Generalization Bounds: Learning Deep Probabilistic Programs via PAC-Bayes Objectives","created":"2022-03-30","cited_by_count":1,"area":null},{"id":"2210.05751","title":"Toward Sustainable Continual Learning: Detection and Knowledge Repurposing of Similar Tasks","created":"2022-10-11","cited_by_count":1,"area":null},{"id":"2302.00205","title":"Gradient Descent in Neural Networks as Sequential Learning in RKBS","created":"2023-02-01","cited_by_count":1,"area":null},{"id":"2312.13259","title":"A note on regularised NTK dynamics with an application to PAC-Bayesian training","created":"2023-12-20","cited_by_count":1,"area":null},{"id":"2409.01498","title":"A practical generalization metric for deep networks benchmarking","created":"2024-09-02","cited_by_count":1,"area":null},{"id":"2410.10230","title":"Learning via Surrogate PAC-Bayes","created":"2024-10-14","cited_by_count":1,"area":null},{"id":"2506.14978","title":"ODD: Overlap-aware Estimation of Model Performance under Distribution Shift","created":"2025-06-17","cited_by_count":1,"area":null},{"id":"2510.06028","title":"Generalization of Gibbs and Langevin Monte Carlo Algorithms in the Interpolation Regime","created":"2025-10-07","cited_by_count":1,"area":null},{"id":"2510.17303","title":"Symmetries in PAC-Bayesian Learning","created":"2025-10-20","cited_by_count":1,"area":null},{"id":"2512.06288","title":"Theoretical Compression Bounds for Wide Multilayer Perceptrons","created":"2025-12-06","cited_by_count":1,"area":null},{"id":"2604.10553","title":"Topology-Aware PAC-Bayesian Generalization Analysis for Graph Neural Networks","created":"2026-04-12","cited_by_count":1,"area":null},{"id":"2106.04181","title":"The Randomness of Input Data Spaces is an A Priori Predictor for Generalization","created":"2021-06-08","cited_by_count":0,"area":null}],"next_cursor":"100"}