{"total":187,"rows":[{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110,"area":null},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2102.13219","title":"Learning with invariances in random features and kernel models","created":"2021-02-25","cited_by_count":89,"area":null},{"id":"2202.05928","title":"Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data","created":"2022-02-11","cited_by_count":74,"area":null},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2201.11489","title":"The Implicit Bias of Benign Overfitting","created":"2022-01-27","cited_by_count":38,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2310.02541","title":"Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2104.04244","title":"How rotational invariance of common kernels prevents generalization in high dimensions","created":"2021-04-09","cited_by_count":32,"area":null},{"id":"2305.02657","title":"On the Eigenvalue Decay Rates of a Class of Neural-Network Related Kernel Functions Defined on General Domains","created":"2023-05-04","cited_by_count":31,"area":null},{"id":"2106.03212","title":"Towards an Understanding of Benign Overfitting in Neural Networks","created":"2021-06-06","cited_by_count":30,"area":null},{"id":"2302.05933","title":"Generalization Ability of Wide Neural Networks on $\\mathbb{R}$","created":"2023-02-12","cited_by_count":30,"area":null},{"id":"2309.07418","title":"A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time","created":"2023-09-14","cited_by_count":30,"area":null},{"id":"2303.01462","title":"Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization","created":"2023-03-02","cited_by_count":29,"area":null},{"id":"2312.15995","title":"Generalization in Kernel Regression Under Realistic Assumptions","created":"2023-12-26","cited_by_count":27,"area":null},{"id":"2305.14077","title":"Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension","created":"2023-05-23","cited_by_count":26,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2306.08321","title":"Nonparametric regression using over-parameterized shallow ReLU neural networks","created":"2023-06-14","cited_by_count":24,"area":null},{"id":"2101.11815","title":"Interpolating Classifiers Make Few Mistakes","created":"2021-01-28","cited_by_count":22,"area":null},{"id":"2111.07167","title":"The Three Stages of Learning Dynamics in High-Dimensional Kernel Methods","created":"2021-11-13","cited_by_count":22,"area":null},{"id":"2104.03093","title":"Spectral Analysis of the Neural Tangent Kernel for Deep Residual Networks","created":"2021-04-07","cited_by_count":21,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2111.08308","title":"Learning with convolution and pooling operations in kernel methods","created":"2021-11-16","cited_by_count":21,"area":null},{"id":"2305.01604","title":"The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold","created":"2023-05-02","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2205.06798","title":"Sharp Asymptotics of Kernel Ridge Regression Beyond the Linear Regime","created":"2022-05-13","cited_by_count":19,"area":null},{"id":"2309.13337","title":"On the Asymptotic Learning Curves of Kernel Ridge Regression under Power-law Decay","created":"2023-09-23","cited_by_count":19,"area":null},{"id":"2108.11489","title":"The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks","created":"2021-08-25","cited_by_count":18,"area":null},{"id":"2202.12328","title":"Cutting Some Slack for SGD with Adaptive Polyak Stepsizes","created":"2022-02-24","cited_by_count":18,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2303.15809","title":"Kernel interpolation generalizes poorly","created":"2023-03-28","cited_by_count":16,"area":null},{"id":"2305.15141","title":"From Tempered to Benign Overfitting in ReLU Neural Networks","created":"2023-05-24","cited_by_count":16,"area":null},{"id":"2108.02883","title":"Interpolation can hurt robust generalization even when there is no noise","created":"2021-08-05","cited_by_count":15,"area":null},{"id":"2110.14163","title":"Does the Data Induce Capacity Control in Deep Learning?","created":"2021-10-27","cited_by_count":14,"area":null},{"id":"2111.05198","title":"Harmless interpolation in regression and classification with structured features","created":"2021-11-09","cited_by_count":14,"area":null},{"id":"2202.09889","title":"Memorize to Generalize: on the Necessity of Interpolation in High Dimensional Linear Regression","created":"2022-02-20","cited_by_count":14,"area":null},{"id":"2306.13853","title":"A Unified Approach to Controlling Implicit Regularization via Mirror Descent","created":"2023-06-24","cited_by_count":14,"area":null},{"id":"2309.12821","title":"A Spectral Theory of Neural Prediction and Alignment","created":"2023-09-22","cited_by_count":14,"area":null},{"id":"2310.10767","title":"Wide Neural Networks as Gaussian Processes: Lessons from Deep Equilibrium Models","created":"2023-10-16","cited_by_count":14,"area":null},{"id":"2102.09645","title":"SVRG Meets AdaGrad: Painless Variance Reduction","created":"2021-02-18","cited_by_count":13,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2205.13525","title":"On the Inconsistency of Kernel Ridgeless Regression in Fixed Dimensions","created":"2022-05-26","cited_by_count":13,"area":null},{"id":"2302.01576","title":"ResMem: Learn what you can and memorize the rest","created":"2023-02-03","cited_by_count":13,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2402.01297","title":"Characterizing Overfitting in Kernel Ridgeless Regression Through the Eigenspectrum","created":"2024-02-02","cited_by_count":13,"area":null},{"id":"2406.04142","title":"Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance","created":"2024-06-06","cited_by_count":13,"area":null},{"id":"2202.02877","title":"HARFE: Hard-Ridge Random Feature Expansion","created":"2022-02-06","cited_by_count":12,"area":null},{"id":"2210.07612","title":"Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2309.04268","title":"Optimal Rate of Kernel Regression in Large Dimensions","created":"2023-09-08","cited_by_count":11,"area":null},{"id":"2401.01599","title":"Generalization Error Curves for Analytic Spectral Algorithms under Power-law Decay","created":"2024-01-03","cited_by_count":11,"area":null},{"id":"2101.09849","title":"Deep Learning Generalization and the Convex Hull of Training Sets","created":"2021-01-25","cited_by_count":10,"area":null},{"id":"2202.07184","title":"On the Origins of the Block Structure Phenomenon in Neural Network Representations","created":"2022-02-15","cited_by_count":10,"area":null},{"id":"2205.12937","title":"Mitigating multiple descents: A model-agnostic framework for risk monotonization","created":"2022-05-25","cited_by_count":10,"area":null},{"id":"2301.07605","title":"Strong inductive biases provably prevent harmless interpolation","created":"2023-01-18","cited_by_count":10,"area":null},{"id":"2305.18496","title":"Generalized equivalences between subsampling and ridge regularization","created":"2023-05-29","cited_by_count":10,"area":null},{"id":"2305.19377","title":"Benign Overfitting in Deep Neural Networks under Lazy Training","created":"2023-05-30","cited_by_count":10,"area":null},{"id":"2106.02630","title":"Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes","created":"2021-06-04","cited_by_count":9,"area":null},{"id":"2112.04002","title":"SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruning","created":"2021-12-07","cited_by_count":9,"area":null},{"id":"2206.01378","title":"Regularization-wise double descent: Why it occurs and how to eliminate it","created":"2022-06-03","cited_by_count":9,"area":null},{"id":"2401.12236","title":"The Surprising Harmfulness of Benign Overfitting for Adversarial Robustness","created":"2024-01-19","cited_by_count":9,"area":null},{"id":"2404.12597","title":"The phase diagram of kernel interpolation in large dimensions","created":"2024-04-19","cited_by_count":9,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2209.09315","title":"Deep Linear Networks can Benignly Overfit when Shallow Ones Do","created":"2022-09-19","cited_by_count":8,"area":null},{"id":"2310.00987","title":"A Theoretical Analysis of the Test Error of Finite-Rank Kernel Ridge Regression","created":"2023-10-02","cited_by_count":8,"area":null},{"id":"2403.07264","title":"Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2406.09366","title":"Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations","created":"2024-06-13","cited_by_count":8,"area":null},{"id":"2110.09502","title":"Minimum $\\ell_{1}$-norm interpolators: Precise asymptotics and multiple descent","created":"2021-10-18","cited_by_count":7,"area":null},{"id":"2110.11477","title":"Conditioning of Random Feature Matrices: Double Descent and Generalization Error","created":"2021-10-21","cited_by_count":7,"area":null},{"id":"2203.05443","title":"Bias-variance decomposition of overparameterized regression with random linear features","created":"2022-03-10","cited_by_count":7,"area":null},{"id":"2207.11621","title":"A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors","created":"2022-07-23","cited_by_count":7,"area":null},{"id":"2211.06077","title":"Overparameterized random feature regression with nearly orthogonal data","created":"2022-11-11","cited_by_count":7,"area":null},{"id":"2302.01088","title":"Sketched Ridgeless Linear Regression: The Role of Downsampling","created":"2023-02-02","cited_by_count":7,"area":null},{"id":"2306.09955","title":"Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign?","created":"2023-06-16","cited_by_count":7,"area":null},{"id":"2403.17592","title":"On the Benefits of Over-parameterization for Out-of-Distribution Generalization","created":"2024-03-26","cited_by_count":7,"area":null},{"id":"2306.03335","title":"Unraveling Projection Heads in Contrastive Learning: Insights from Expansion and Shrinkage","created":"2023-06-06","cited_by_count":6,"area":null},{"id":"2310.05337","title":"What do larger image classifiers memorise?","created":"2023-10-09","cited_by_count":6,"area":null},{"id":"2401.11600","title":"Understanding the Generalization Benefits of Late Learning Rate Decay","created":"2024-01-21","cited_by_count":6,"area":null},{"id":"2403.06903","title":"Benign overfitting in leaky ReLU networks with moderate input dimension","created":"2024-03-11","cited_by_count":6,"area":null},{"id":"2501.00288","title":"Solving Partial Differential Equations with Random Feature Models","created":"2024-12-31","cited_by_count":6,"area":null},{"id":"2103.15996","title":"Minimum complexity interpolation in random features models","created":"2021-03-30","cited_by_count":5,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2201.00073","title":"Kernel Two-Sample Tests in High Dimension: Interplay Between Moment Discrepancy and Dimension-and-Sample Orders","created":"2021-12-31","cited_by_count":5,"area":null},{"id":"2201.04545","title":"On generalization bounds for deep networks based on loss surface implicit regularization","created":"2022-01-12","cited_by_count":5,"area":null},{"id":"2206.00501","title":"Benign Overfitting in Classification: Provably Counter Label Noise with Larger Models","created":"2022-06-01","cited_by_count":5,"area":null},{"id":"2302.11836","title":"On Statistical Properties of Sharpness-Aware Minimization: Provable Guarantees","created":"2023-02-23","cited_by_count":5,"area":null},{"id":"2305.18506","title":"Generalization Ability of Wide Residual Networks","created":"2023-05-29","cited_by_count":5,"area":null},{"id":"2311.07013","title":"A PAC-Bayesian Perspective on the Interpolating Information Criterion","created":"2023-11-13","cited_by_count":5,"area":null},{"id":"2502.09003","title":"RoSTE: An Efficient Quantization-Aware Supervised Fine-Tuning Approach for Large Language Models","created":"2025-02-13","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2102.08474","title":"Adversarially Robust Kernel Smoothing","created":"2021-02-16","cited_by_count":4,"area":null}],"next_cursor":"100"}