{"total":549,"rows":[{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2202.10054","title":"Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution","created":"2022-02-21","cited_by_count":739,"area":null},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166,"area":null},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154,"area":null},{"id":"2105.12806","title":"A Universal Law of Robustness via Isoperimetry","created":"2021-05-26","cited_by_count":151,"area":null},{"id":"2209.05364","title":"If Influence Functions are the Answer, Then What is the Question?","created":"2022-09-12","cited_by_count":144,"area":null},{"id":"2212.04612","title":"Training Data Influence Analysis and Estimation: A Survey","created":"2022-12-09","cited_by_count":135,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126,"area":"distill"},{"id":"2310.02664","title":"On Memorization in Diffusion Models","created":"2023-10-04","cited_by_count":125,"area":"diffusion"},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110,"area":null},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96,"area":null},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2103.01550","title":"Label-Imbalanced and Group-Sensitive Classification under Overparameterization","created":"2021-03-02","cited_by_count":74,"area":null},{"id":"2202.05928","title":"Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data","created":"2022-02-11","cited_by_count":74,"area":null},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74,"area":null},{"id":"2302.05836","title":"Theory on Forgetting and Generalization of Continual Learning","created":"2023-02-12","cited_by_count":72,"area":null},{"id":"2103.12692","title":"Benign Overfitting of Constant-Stepsize SGD for Linear Regression","created":"2021-03-23","cited_by_count":71,"area":null},{"id":"2307.09542","title":"Can Neural Network Memorization Be Localized?","created":"2023-07-18","cited_by_count":69,"area":null},{"id":"2403.13043","title":"When Do We Not Need Larger Vision Models?","created":"2024-03-19","cited_by_count":67,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57,"area":null},{"id":"2503.02113","title":"Deep Learning is Not So Mysterious or Different","created":"2025-03-03","cited_by_count":56,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2106.09276","title":"Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and Benign Overfitting","created":"2021-06-17","cited_by_count":54,"area":null},{"id":"2210.08571","title":"Dimension free ridge regression","created":"2022-10-16","cited_by_count":51,"area":null},{"id":"2202.05834","title":"Predicting Out-of-Distribution Error with the Projection Norm","created":"2022-02-11","cited_by_count":50,"area":null},{"id":"2104.13628","title":"Risk Bounds for Over-parameterized Maximum Margin Classification on Sub-Gaussian Mixtures","created":"2021-04-28","cited_by_count":49,"area":null},{"id":"2303.01372","title":"High-dimensional analysis of double descent for linear regression with random projections","created":"2023-03-02","cited_by_count":47,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2106.10865","title":"Benign Overfitting in Multiclass Classification: All Roads Lead to Interpolation","created":"2021-06-21","cited_by_count":42,"area":null},{"id":"2110.06198","title":"Last Iterate Risk Bounds of SGD with Decaying Stepsize for Overparameterized Linear Regression","created":"2021-10-12","cited_by_count":38,"area":null},{"id":"2201.11489","title":"The Implicit Bias of Benign Overfitting","created":"2022-01-27","cited_by_count":38,"area":null},{"id":"2211.16327","title":"On the Power of Foundation Models","created":"2022-11-29","cited_by_count":37,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2210.17020","title":"A Law of Data Separation in Deep Learning","created":"2022-10-31","cited_by_count":36,"area":null},{"id":"2402.03502","title":"How Does Unlabeled Data Provably Help Out-of-Distribution Detection?","created":"2024-02-05","cited_by_count":36,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2509.23024","title":"Tracing the Representation Geometry of Language Models from Pretraining to Post-training","created":"2025-09-27","cited_by_count":35,"area":null},{"id":"2106.05932","title":"Early-stopped neural networks are consistent","created":"2021-06-10","cited_by_count":34,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2310.02541","title":"Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2104.04244","title":"How rotational invariance of common kernels prevents generalization in high dimensions","created":"2021-04-09","cited_by_count":32,"area":null},{"id":"2108.04552","title":"The Benefits of Implicit Regularization from SGD in Least Squares Problems","created":"2021-08-10","cited_by_count":32,"area":null},{"id":"2301.11039","title":"WL meet VC","created":"2023-01-26","cited_by_count":31,"area":null},{"id":"2305.02657","title":"On the Eigenvalue Decay Rates of a Class of Neural-Network Related Kernel Functions Defined on General Domains","created":"2023-05-04","cited_by_count":31,"area":null},{"id":"2406.17746","title":"Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon","created":"2024-06-25","cited_by_count":31,"area":null},{"id":"2106.03212","title":"Towards an Understanding of Benign Overfitting in Neural Networks","created":"2021-06-06","cited_by_count":30,"area":null},{"id":"2212.14032","title":"On Implicit Bias in Overparameterized Bilevel Optimization","created":"2022-12-28","cited_by_count":30,"area":null},{"id":"2302.05933","title":"Generalization Ability of Wide Neural Networks on $\\mathbb{R}$","created":"2023-02-12","cited_by_count":30,"area":null},{"id":"2207.06475","title":"Analysis of Catastrophic Forgetting for Random Orthogonal Transformation Tasks in the Overparameterized Regime","created":"2022-06-01","cited_by_count":29,"area":null},{"id":"2303.01462","title":"Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization","created":"2023-03-02","cited_by_count":29,"area":null},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28,"area":null},{"id":"2310.07269","title":"Why Does Sharpness-Aware Minimization Generalize Better Than SGD?","created":"2023-10-11","cited_by_count":28,"area":null},{"id":"2211.13312","title":"A Moment-Matching Approach to Testable Learning and a New Characterization of Rademacher Complexity","created":"2022-11-23","cited_by_count":27,"area":null},{"id":"2307.05831","title":"Memorization Through the Lens of Curvature of Loss Function Around Samples","created":"2023-07-11","cited_by_count":27,"area":null},{"id":"2205.13303","title":"Gaussian Universality of Perceptrons with Random Labels","created":"2022-05-26","cited_by_count":26,"area":null},{"id":"2208.01857","title":"The Power and Limitation of Pretraining-Finetuning for Linear Regression under Covariate Shift","created":"2022-08-03","cited_by_count":26,"area":null},{"id":"2302.08923","title":"Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation","created":"2023-02-17","cited_by_count":26,"area":null},{"id":"2302.10886","title":"Some Fundamental Aspects about Lipschitz Continuity of Neural Networks","created":"2023-02-21","cited_by_count":26,"area":null},{"id":"2305.14077","title":"Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension","created":"2023-05-23","cited_by_count":26,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2505.16959","title":"Bigger Isn't Always Memorizing: Early Stopping Overparameterized Diffusion Models","created":"2025-05-22","cited_by_count":25,"area":"diffusion"},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24,"area":null},{"id":"2110.02914","title":"Foolish Crowds Support Benign Overfitting","created":"2021-10-06","cited_by_count":24,"area":null},{"id":"2210.05021","title":"The good, the bad and the ugly sides of data augmentation: An implicit spectral regularization perspective","created":"2022-10-10","cited_by_count":24,"area":null},{"id":"2303.10263","title":"Fixed Design Analysis of Regularization-Based Continual Learning","created":"2023-03-17","cited_by_count":24,"area":null},{"id":"2306.08321","title":"Nonparametric regression using over-parameterized shallow ReLU neural networks","created":"2023-06-14","cited_by_count":24,"area":null},{"id":"2101.11815","title":"Interpolating Classifiers Make Few Mistakes","created":"2021-01-28","cited_by_count":22,"area":null},{"id":"2111.07167","title":"The Three Stages of Learning Dynamics in High-Dimensional Kernel Methods","created":"2021-11-13","cited_by_count":22,"area":null},{"id":"2203.03597","title":"Fast Rates for Noisy Interpolation Require Rethinking the Effects of Inductive Bias","created":"2022-03-07","cited_by_count":22,"area":null},{"id":"2302.06210","title":"Precise Asymptotic Analysis of Deep Random Feature Models","created":"2023-02-13","cited_by_count":22,"area":null},{"id":"2402.06031","title":"An operator learning perspective on parameter-to-observable maps","created":"2024-02-08","cited_by_count":22,"area":null},{"id":"2410.18837","title":"High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws","created":"2024-10-24","cited_by_count":22,"area":"distill"},{"id":"2508.17689","title":"On the Edge of Memorization in Diffusion Models","created":"2025-08-25","cited_by_count":22,"area":"diffusion"},{"id":"2201.06142","title":"Towards Sample-efficient Overparameterized Meta-learning","created":"2022-01-16","cited_by_count":21,"area":null},{"id":"2204.06274","title":"Overparameterized Linear Regression under Adversarial Attacks","created":"2022-04-13","cited_by_count":21,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2304.14545","title":"Augmented balancing weights as linear regression","created":"2023-04-27","cited_by_count":21,"area":null},{"id":"2305.01604","title":"The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold","created":"2023-05-02","cited_by_count":21,"area":null},{"id":"2502.07551","title":"Early Stopping Against Label Noise Without Validation Data","created":"2025-02-11","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20,"area":null},{"id":"2405.16391","title":"When does compositional structure yield compositional generalization? A kernel theory","created":"2024-05-26","cited_by_count":20,"area":null},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2202.13361","title":"Benign Underfitting of Stochastic Gradient Descent","created":"2022-02-27","cited_by_count":19,"area":null},{"id":"2309.13337","title":"On the Asymptotic Learning Curves of Kernel Ridge Regression under Power-law Decay","created":"2023-09-23","cited_by_count":19,"area":null},{"id":"2412.07684","title":"The Pitfalls of Memorization: When Memorization Hurts Generalization","created":"2024-12-10","cited_by_count":19,"area":null},{"id":"2108.11489","title":"The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks","created":"2021-08-25","cited_by_count":18,"area":null},{"id":"2205.14055","title":"A Blessing of Dimensionality in Membership Inference through Regularization","created":"2022-05-27","cited_by_count":18,"area":"safety"},{"id":"2310.10807","title":"Regularization properties of adversarially-trained linear regression","created":"2023-10-16","cited_by_count":18,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2401.12233","title":"Memorization in Self-Supervised Learning Improves Downstream Generalization","created":"2024-01-19","cited_by_count":18,"area":null},{"id":"2510.01378","title":"Selective Underfitting in Diffusion Models","created":"2025-10-01","cited_by_count":18,"area":"diffusion"}],"next_cursor":"100"}