{"total":299,"rows":[{"id":"2106.04538","title":"What Makes Multi-modal Learning Better than Single (Provably)","created":"2021-06-08","cited_by_count":153,"area":null},{"id":"2201.04234","title":"Leveraging Unlabeled Data to Predict Out-of-Distribution Performance","created":"2022-01-11","cited_by_count":145,"area":null},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2102.00931","title":"Information-Theoretic Generalization Bounds for Stochastic Gradient Descent","created":"2021-02-01","cited_by_count":84,"area":null},{"id":"2110.15777","title":"GBK-GNN: Gated Bi-Kernel Graph Neural Networks for Modeling Both Homophily and Heterophily","created":"2021-10-29","cited_by_count":84,"area":null},{"id":"2103.05127","title":"Model Complexity of Deep Learning: A Survey","created":"2021-03-08","cited_by_count":65,"area":null},{"id":"2105.03361","title":"What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory","created":"2021-05-07","cited_by_count":60,"area":null},{"id":"2109.09444","title":"When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?","created":"2021-09-20","cited_by_count":58,"area":null},{"id":"2106.01606","title":"Exploring Memorization in Adversarial Training","created":"2021-06-03","cited_by_count":55,"area":null},{"id":"2106.16225","title":"Analytic Insights into Structure and Rank of Neural Network Hessian Maps","created":"2021-06-30","cited_by_count":52,"area":null},{"id":"2106.03795","title":"Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks","created":"2021-06-07","cited_by_count":44,"area":null},{"id":"2305.17490","title":"The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent","created":"2023-05-27","cited_by_count":44,"area":null},{"id":"2110.03128","title":"On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications","created":"2021-10-07","cited_by_count":31,"area":null},{"id":"2210.13738","title":"Pruning's Effect on Generalization Through the Lens of Training and Regularization","created":"2022-10-25","cited_by_count":31,"area":null},{"id":"2101.06154","title":"On the statistical complexity of quantum circuits","created":"2021-01-15","cited_by_count":25,"area":null},{"id":"2106.03314","title":"Measuring Generalization with Optimal Transport","created":"2021-06-07","cited_by_count":25,"area":null},{"id":"2110.06972","title":"Block Contextual MDPs for Continual Learning","created":"2021-10-13","cited_by_count":25,"area":null},{"id":"2302.13091","title":"Explaining Generalization Power of a DNN Using Interactive Concepts","created":"2023-02-25","cited_by_count":25,"area":null},{"id":"2310.13061","title":"To grok or not to grok: Disentangling generalization and memorization on corrupted algorithmic datasets","created":"2023-10-19","cited_by_count":24,"area":null},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23,"area":null},{"id":"2411.07681","title":"What Do Learning Dynamics Reveal About Generalization in LLM Reasoning?","created":"2024-11-12","cited_by_count":23,"area":"lr"},{"id":"2103.02200","title":"Formalizing Generalization and Robustness of Neural Networks to Weight Perturbations","created":"2021-03-03","cited_by_count":22,"area":null},{"id":"2201.09418","title":"Approximation bounds for norm constrained neural networks with applications to regression and GANs","created":"2022-01-24","cited_by_count":22,"area":null},{"id":"2202.01627","title":"Non-Vacuous Generalisation Bounds for Shallow Neural Networks","created":"2022-02-03","cited_by_count":22,"area":null},{"id":"2305.18469","title":"Reducing Communication for Split Learning by Randomized Top-k Sparsification","created":"2023-05-29","cited_by_count":22,"area":null},{"id":"2109.06099","title":"Uniform Generalization Bounds for Overparameterized Neural Networks","created":"2021-09-13","cited_by_count":21,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2305.06648","title":"Generalization bounds for neural ordinary differential equations and deep residual networks","created":"2023-05-11","cited_by_count":21,"area":null},{"id":"2405.20231","title":"The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof","created":"2024-05-30","cited_by_count":21,"area":null},{"id":"2105.00303","title":"RATT: Leveraging Unlabeled Data to Guarantee Generalization","created":"2021-05-01","cited_by_count":20,"area":null},{"id":"2107.09370","title":"An Embedding of ReLU Networks and an Analysis of their Identifiability","created":"2021-07-20","cited_by_count":20,"area":null},{"id":"2109.00267","title":"The Impact of Reinitialization on Generalization in Convolutional Neural Networks","created":"2021-09-01","cited_by_count":20,"area":null},{"id":"2506.07902","title":"FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling","created":"2025-06-09","cited_by_count":20,"area":"diffusion"},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19,"area":null},{"id":"2107.03955","title":"On Margins and Derandomisation in PAC-Bayes","created":"2021-07-08","cited_by_count":19,"area":null},{"id":"2202.02842","title":"Evaluating natural language processing models with generalization metrics that do not need access to any training or testing data","created":"2022-02-06","cited_by_count":19,"area":null},{"id":"2207.00614","title":"Integral Probability Metrics PAC-Bayes Bounds","created":"2022-07-01","cited_by_count":19,"area":null},{"id":"2208.08741","title":"Quantifying the Knowledge in a DNN to Explain Knowledge Distillation for Classification","created":"2022-08-18","cited_by_count":19,"area":"distill"},{"id":"2309.13658","title":"Fantastic Generalization Measures are Nowhere to be Found","created":"2023-09-24","cited_by_count":19,"area":null},{"id":"2102.12238","title":"Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm","created":"2021-02-24","cited_by_count":18,"area":null},{"id":"2211.14966","title":"Adversarial Rademacher Complexity of Deep Neural Networks","created":"2022-11-27","cited_by_count":18,"area":null},{"id":"2402.06323","title":"How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers","created":"2024-02-09","cited_by_count":18,"area":null},{"id":"2102.10234","title":"Generalization bounds for graph convolutional neural networks via Rademacher complexity","created":"2021-02-20","cited_by_count":17,"area":null},{"id":"2206.14990","title":"Bridging Mean-Field Games and Normalizing Flows with Trajectory Regularization","created":"2022-06-30","cited_by_count":17,"area":null},{"id":"2101.04968","title":"Learning with Gradient Descent and Weakly Convex Losses","created":"2021-01-13","cited_by_count":16,"area":null},{"id":"2106.06251","title":"On Learnability via Gradient Method for Two-Layer ReLU Neural Networks in Teacher-Student Setting","created":"2021-06-11","cited_by_count":16,"area":"distill"},{"id":"2202.00856","title":"The Role of Linear Layers in Nonlinear Interpolating Networks","created":"2022-02-02","cited_by_count":16,"area":null},{"id":"2202.04513","title":"The no-free-lunch theorems of supervised learning","created":"2022-02-09","cited_by_count":16,"area":null},{"id":"2208.01003","title":"What Can Be Learnt With Wide Convolutional Neural Networks?","created":"2022-08-01","cited_by_count":16,"area":null},{"id":"2208.04284","title":"On Rademacher Complexity-based Generalization Bounds for Deep Learning","created":"2022-08-08","cited_by_count":16,"area":null},{"id":"2209.05150","title":"Bounding the Rademacher Complexity of Fourier neural operators","created":"2022-09-12","cited_by_count":16,"area":null},{"id":"2210.11530","title":"Theoretical analysis of deep neural networks for temporally dependent observations","created":"2022-10-20","cited_by_count":16,"area":null},{"id":"2306.00312","title":"(Almost) Provable Error Bounds Under Distribution Shift via Disagreement Discrepancy","created":"2023-06-01","cited_by_count":16,"area":null},{"id":"2108.11018","title":"A Scaling Law for Synthetic-to-Real Transfer: How Much Is Your Pre-training Effective?","created":"2021-08-25","cited_by_count":15,"area":null},{"id":"2304.01561","title":"Optimal rates of approximation by shallow ReLU$^k$ neural networks and applications to nonparametric regression","created":"2023-04-04","cited_by_count":15,"area":null},{"id":"2502.10381","title":"Balancing the Scales: A Theoretical and Algorithmic Framework for Learning from Imbalanced Data","created":"2025-02-14","cited_by_count":15,"area":null},{"id":"2110.09548","title":"Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks","created":"2021-10-18","cited_by_count":14,"area":null},{"id":"2112.04807","title":"Effective dimension of machine learning models","created":"2021-12-09","cited_by_count":14,"area":null},{"id":"2303.06484","title":"Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap","created":"2023-03-11","cited_by_count":14,"area":null},{"id":"2101.06459","title":"Robustness to Augmentations as a Generalization metric","created":"2021-01-16","cited_by_count":13,"area":null},{"id":"2101.09957","title":"Activation Functions in Artificial Neural Networks: A Systematic Overview","created":"2021-01-25","cited_by_count":13,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2211.01258","title":"Instance-Dependent Generalization Bounds via Optimal Transport","created":"2022-11-02","cited_by_count":13,"area":null},{"id":"2505.17646","title":"Unveiling the Basin-Like Loss Landscape in Large Language Models","created":"2025-05-23","cited_by_count":13,"area":null},{"id":"2506.03404","title":"The Impact of On-Policy Parallelized Data Collection on Deep Reinforcement Learning Networks","created":"2025-06-03","cited_by_count":13,"area":"deeprl"},{"id":"2111.00843","title":"How I Learned to Stop Worrying and Love Retraining","created":"2021-11-01","cited_by_count":12,"area":null},{"id":"2202.09028","title":"On the Implicit Bias Towards Minimal Depth of Deep Neural Networks","created":"2022-02-18","cited_by_count":12,"area":null},{"id":"2203.10736","title":"The activity-weight duality in feed forward neural networks: The geometric determinants of generalization","created":"2022-03-21","cited_by_count":12,"area":null},{"id":"2205.08099","title":"Dimensionality Reduced Training by Pruning and Freezing Parts of a Deep Neural Network, a Survey","created":"2022-05-17","cited_by_count":12,"area":null},{"id":"2210.14019","title":"The Curious Case of Benign Memorization","created":"2022-10-25","cited_by_count":12,"area":null},{"id":"2202.13216","title":"Adversarial robustness of sparse local Lipschitz predictors","created":"2022-02-26","cited_by_count":11,"area":null},{"id":"2209.07376","title":"Understanding Deep Neural Function Approximation in Reinforcement Learning via $\\epsilon$-Greedy Exploration","created":"2022-09-15","cited_by_count":11,"area":null},{"id":"2301.12309","title":"On the Lipschitz Constant of Deep Networks and Double Descent","created":"2023-01-28","cited_by_count":11,"area":null},{"id":"2103.06002","title":"Robustness to Pruning Predicts Generalization in Deep Neural Networks","created":"2021-03-10","cited_by_count":10,"area":null},{"id":"2202.06233","title":"The Sample Complexity of One-Hidden-Layer Neural Networks","created":"2022-02-13","cited_by_count":10,"area":null},{"id":"2203.03443","title":"Generalization Through The Lens Of Leave-One-Out Error","created":"2022-03-07","cited_by_count":10,"area":null},{"id":"2310.01225","title":"A path-norm toolkit for modern networks: consequences, promises and challenges","created":"2023-10-02","cited_by_count":10,"area":null},{"id":"2310.03957","title":"Understanding prompt engineering may not require rethinking generalization","created":"2023-10-06","cited_by_count":10,"area":"lr"},{"id":"2411.02824","title":"Layer-Adaptive State Pruning for Deep State Space Models","created":"2024-11-05","cited_by_count":10,"area":null},{"id":"2102.03282","title":"Effects of quantum resources on the statistical complexity of quantum circuits","created":"2021-02-05","cited_by_count":9,"area":null},{"id":"2103.00719","title":"LocalDrop: A Hybrid Regularization for Deep Neural Networks","created":"2021-03-01","cited_by_count":9,"area":null},{"id":"2109.12960","title":"Ridgeless Interpolation with Shallow ReLU Networks in $1D$ is Nearest Neighbor Curvature Extrapolation and Provably Generalizes on Lipschitz Functions","created":"2021-09-27","cited_by_count":9,"area":null},{"id":"2202.08070","title":"On Measuring Excess Capacity in Neural Networks","created":"2022-02-16","cited_by_count":9,"area":null},{"id":"2212.00261","title":"Task Discovery: Finding the Tasks that Neural Networks Generalize on","created":"2022-12-01","cited_by_count":9,"area":null},{"id":"2212.05427","title":"Statistical guarantees for sparse deep learning","created":"2022-12-11","cited_by_count":9,"area":null},{"id":"2302.05825","title":"Koopman-based generalization bound: New aspect for full-rank weights","created":"2023-02-12","cited_by_count":9,"area":null},{"id":"2305.00608","title":"Differentiable Neural Networks with RePU Activation: with Applications to Score Estimation and Isotonic Regression","created":"2023-05-01","cited_by_count":9,"area":null},{"id":"2305.16891","title":"Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks","created":"2023-05-26","cited_by_count":9,"area":null},{"id":"2309.14360","title":"Domain-Guided Conditional Diffusion Model for Unsupervised Domain Adaptation","created":"2023-09-23","cited_by_count":9,"area":"diffusion"},{"id":"2310.06182","title":"PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization","created":"2023-10-09","cited_by_count":9,"area":null},{"id":"2311.06748","title":"How do Minimum-Norm Shallow Denoisers Look in Function Space?","created":"2023-11-12","cited_by_count":9,"area":null},{"id":"2404.17442","title":"Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets","created":"2024-04-26","cited_by_count":9,"area":null},{"id":"2512.23947","title":"Improved Balanced Classification with Theoretically Grounded Loss Functions","created":"2025-12-30","cited_by_count":9,"area":null},{"id":"2105.03491","title":"Uniform Convergence, Adversarial Spheres and a Simple Remedy","created":"2021-05-07","cited_by_count":8,"area":null}],"next_cursor":"100"}