{"total":181,"rows":[{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2106.13799","title":"Assessing Generalization of SGD via Disagreement","created":"2021-06-25","cited_by_count":117,"area":null},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106,"area":null},{"id":"2308.08708","title":"Consciousness in Artificial Intelligence: Insights from the Science of Consciousness","created":"2023-08-17","cited_by_count":104,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2103.01550","title":"Label-Imbalanced and Group-Sensitive Classification under Overparameterization","created":"2021-03-02","cited_by_count":74,"area":null},{"id":"2302.05836","title":"Theory on Forgetting and Generalization of Continual Learning","created":"2023-02-12","cited_by_count":72,"area":null},{"id":"2110.09485","title":"Learning in High Dimension Always Amounts to Extrapolation","created":"2021-10-18","cited_by_count":66,"area":null},{"id":"2211.09773","title":"T-SEA: Transfer-based Self-Ensemble Attack on Object Detection","created":"2022-11-16","cited_by_count":59,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2503.02113","title":"Deep Learning is Not So Mysterious or Different","created":"2025-03-03","cited_by_count":56,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2104.13628","title":"Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures","created":"2021-04-28","cited_by_count":49,"area":null},{"id":"2204.10425","title":"Spectrum of inner-product kernel matrices in the polynomial regime and multiple descent phenomenon in kernel ridge regression","created":"2022-04-21","cited_by_count":45,"area":null},{"id":"2201.11489","title":"The Implicit Bias of Benign Overfitting","created":"2022-01-27","cited_by_count":38,"area":null},{"id":"2110.02424","title":"Spectral Bias in Practice: The Role of Function Frequency in Generalization","created":"2021-10-06","cited_by_count":37,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2306.03534","title":"Continual Learning in Linear Classification on Separable Data","created":"2023-06-06","cited_by_count":34,"area":null},{"id":"2104.04244","title":"How rotational invariance of common kernels prevents generalization in high dimensions","created":"2021-04-09","cited_by_count":32,"area":null},{"id":"2111.05451","title":"Importance of Kernel Bandwidth in Quantum Machine Learning","created":"2021-11-09","cited_by_count":31,"area":null},{"id":"2106.03212","title":"Towards an Understanding of Benign Overfitting in Neural Networks","created":"2021-06-06","cited_by_count":30,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2302.05933","title":"Generalization Ability of Wide Neural Networks on $\\mathbb{R}$","created":"2023-02-12","cited_by_count":30,"area":null},{"id":"2209.15259","title":"On the Impossible Safety of Large AI Models","created":"2022-09-30","cited_by_count":28,"area":null},{"id":"2304.06670","title":"Deep neural networks have an inbuilt Occam's razor","created":"2023-04-13","cited_by_count":28,"area":null},{"id":"2305.14077","title":"Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension","created":"2023-05-23","cited_by_count":26,"area":null},{"id":"2403.08160","title":"Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime","created":"2024-03-13","cited_by_count":26,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2106.01202","title":"Framing RNN as a kernel method: A neural ODE approach","created":"2021-06-02","cited_by_count":23,"area":null},{"id":"2106.02261","title":"Out-of-Distribution Generalization in Kernel Regression","created":"2021-06-04","cited_by_count":21,"area":null},{"id":"2108.12006","title":"When and how epochwise double descent happens","created":"2021-08-26","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2205.06798","title":"Sharp Asymptotics of Kernel Ridge Regression Beyond the Linear Regime","created":"2022-05-13","cited_by_count":19,"area":null},{"id":"2102.07379","title":"On the Inherent Regularization Effects of Noise Injection During Training","created":"2021-02-15","cited_by_count":18,"area":null},{"id":"2110.11805","title":"Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model","created":"2021-10-22","cited_by_count":17,"area":null},{"id":"2305.15141","title":"From Tempered to Benign Overfitting in ReLU Neural Networks","created":"2023-05-24","cited_by_count":16,"area":null},{"id":"2108.02883","title":"Interpolation can hurt robust generalization even when there is no noise","created":"2021-08-05","cited_by_count":15,"area":null},{"id":"2110.12231","title":"Learning curves for Gaussian process regression with power-law priors and targets","created":"2021-10-23","cited_by_count":15,"area":null},{"id":"2111.05198","title":"Harmless interpolation in regression and classification with structured features","created":"2021-11-09","cited_by_count":14,"area":null},{"id":"2202.09889","title":"Memorize to Generalize: on the Necessity of Interpolation in High Dimensional Linear Regression","created":"2022-02-20","cited_by_count":14,"area":null},{"id":"2309.12821","title":"A Spectral Theory of Neural Prediction and Alignment","created":"2023-09-22","cited_by_count":14,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2103.05243","title":"On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models","created":"2021-03-09","cited_by_count":13,"area":null},{"id":"2205.13525","title":"On the Inconsistency of Kernel Ridgeless Regression in Fixed Dimensions","created":"2022-05-26","cited_by_count":13,"area":null},{"id":"2112.15250","title":"Benign Overfitting in Adversarially Robust Linear Classification","created":"2021-12-31","cited_by_count":11,"area":null},{"id":"2210.07612","title":"Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2408.16939","title":"Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning","created":"2024-08-29","cited_by_count":11,"area":null},{"id":"2101.09849","title":"Deep Learning Generalization and the Convex Hull of Training Sets","created":"2021-01-25","cited_by_count":10,"area":null},{"id":"2202.07184","title":"On the Origins of the Block Structure Phenomenon in Neural Network Representations","created":"2022-02-15","cited_by_count":10,"area":null},{"id":"2203.00977","title":"Chained Generalisation Bounds","created":"2022-03-02","cited_by_count":10,"area":null},{"id":"2204.09664","title":"Deep Learning meets Nonparametric Regression: Are Weight-Decayed DNNs Locally Adaptive?","created":"2022-04-20","cited_by_count":10,"area":null},{"id":"2309.08044","title":"How many Neurons do we need? A refined Analysis for Shallow Networks trained with Gradient Descent","created":"2023-09-14","cited_by_count":10,"area":null},{"id":"2105.08966","title":"Latent Gaussian Model Boosting","created":"2021-05-19","cited_by_count":9,"area":null},{"id":"2106.02630","title":"Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes","created":"2021-06-04","cited_by_count":9,"area":null},{"id":"2204.06935","title":"Concentration of Random Feature Matrices in High-Dimensions","created":"2022-04-14","cited_by_count":9,"area":null},{"id":"2210.14184","title":"Learning Ability of Interpolating Deep Convolutional Neural Networks","created":"2022-10-25","cited_by_count":9,"area":null},{"id":"2401.12236","title":"The Surprising Harmfulness of Benign Overfitting for Adversarial Robustness","created":"2024-01-19","cited_by_count":9,"area":null},{"id":"2410.09638","title":"On Goodhart's law, with an application to value alignment","created":"2024-10-12","cited_by_count":9,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2105.03491","title":"Uniform Convergence, Adversarial Spheres and a Simple Remedy","created":"2021-05-07","cited_by_count":8,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2206.01399","title":"Generalization for multiclass classification with overparameterized linear models","created":"2022-06-03","cited_by_count":8,"area":null},{"id":"2305.06472","title":"ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps","created":"2023-05-10","cited_by_count":8,"area":null},{"id":"2403.07264","title":"Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2404.00897","title":"Machine Learning Robustness: A Primer","created":"2024-04-01","cited_by_count":8,"area":null},{"id":"2410.00645","title":"LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning","created":"2024-10-01","cited_by_count":8,"area":null},{"id":"2110.11477","title":"Conditioning of Random Feature Matrices: Double Descent and Generalization Error","created":"2021-10-21","cited_by_count":7,"area":null},{"id":"2306.09955","title":"Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign?","created":"2023-06-16","cited_by_count":7,"area":null},{"id":"2403.02418","title":"The Role of the Time-Dependent Hessian in High-Dimensional Optimization","created":"2024-03-04","cited_by_count":7,"area":null},{"id":"2403.17592","title":"On the Benefits of Over-parameterization for Out-of-Distribution Generalization","created":"2024-03-26","cited_by_count":7,"area":null},{"id":"2406.15275","title":"How language models extrapolate outside the training data: A case study in Textualized Gridworld","created":"2024-06-21","cited_by_count":7,"area":null},{"id":"2206.07892","title":"Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence","created":"2022-06-16","cited_by_count":6,"area":null},{"id":"2207.06080","title":"Efficient Augmentation for Imbalanced Deep Learning","created":"2022-07-13","cited_by_count":6,"area":null},{"id":"2308.06338","title":"Size Lowerbounds for Deep Operator Networks","created":"2023-08-11","cited_by_count":6,"area":null},{"id":"2403.06903","title":"Benign overfitting in leaky ReLU networks with moderate input dimension","created":"2024-03-11","cited_by_count":6,"area":null},{"id":"2410.16201","title":"Theoretical Limitations of Ensembles in the Age of Overparameterization","created":"2024-10-21","cited_by_count":6,"area":null},{"id":"2501.00288","title":"Solving Partial Differential Equations with Random Feature Models","created":"2024-12-31","cited_by_count":6,"area":null},{"id":"2202.01944","title":"Learning Representation from Neural Fisher Kernel with Low-rank Approximation","created":"2022-02-04","cited_by_count":5,"area":null},{"id":"2206.00501","title":"Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models","created":"2022-06-01","cited_by_count":5,"area":null},{"id":"2211.00227","title":"Transfer Learning with Kernel Methods","created":"2022-11-01","cited_by_count":5,"area":null},{"id":"2302.11836","title":"On Statistical Properties of Sharpness-Aware Minimization: Provable Guarantees","created":"2023-02-23","cited_by_count":5,"area":null},{"id":"2409.18842","title":"Classical Statistical (In-Sample) Intuitions Don't Generalize Well: A Note on Bias-Variance Tradeoffs, Overfitting and Moving from Fixed to Random Designs","created":"2024-09-27","cited_by_count":5,"area":null},{"id":"2501.19158","title":"A theoretical framework for overfitting in energy-based modeling","created":"2025-01-31","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2201.12719","title":"Faster Convergence of Local SGD for Over-Parameterized Models","created":"2022-01-30","cited_by_count":4,"area":null},{"id":"2205.15549","title":"VC Theoretical Explanation of Double Descent","created":"2022-05-31","cited_by_count":4,"area":null},{"id":"2207.09408","title":"Bounding generalization error with input compression: An empirical study with infinite-width networks","created":"2022-07-19","cited_by_count":4,"area":null},{"id":"2304.04312","title":"Theoretical Characterization of the Generalization Performance of Overfitted Meta-Learning","created":"2023-04-09","cited_by_count":4,"area":null},{"id":"2305.00700","title":"Double and Single Descent in Causal Inference with an Application to High-Dimensional Synthetic Control","created":"2023-05-01","cited_by_count":4,"area":null},{"id":"2306.04901","title":"Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes","created":"2023-06-08","cited_by_count":4,"area":null},{"id":"2309.06195","title":"Optimization Guarantees of Unfolded ISTA and ADMM Networks With Smooth Soft-Thresholding","created":"2023-09-12","cited_by_count":4,"area":null},{"id":"2312.17431","title":"MVPatch: More Vivid Patch for Adversarial Camouflaged Attacks on Object Detectors in the Physical World","created":"2023-12-29","cited_by_count":4,"area":null},{"id":"2405.16639","title":"A direct proof of a unified law of robustness for Bregman divergence losses","created":"2024-05-26","cited_by_count":4,"area":null},{"id":"2409.05800","title":"Input Space Mode Connectivity in Deep Neural Networks","created":"2024-09-09","cited_by_count":4,"area":null},{"id":"2411.11176","title":"Infinite Width Limits of Self Supervised Neural Networks","created":"2024-11-17","cited_by_count":4,"area":null}],"next_cursor":"100"}