{"total":97,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2107.13034","title":"Dataset Distillation with Infinitely Wide Convolutional Networks","created":"2021-07-27","cited_by_count":218,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2110.09485","title":"Learning in High Dimension Always Amounts to Extrapolation","created":"2021-10-18","cited_by_count":66,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2106.03212","title":"Towards an Understanding of Benign Overfitting in Neural Networks","created":"2021-06-06","cited_by_count":30,"area":null},{"id":"2202.00553","title":"Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization","created":"2022-02-01","cited_by_count":30,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2302.10886","title":"Some Fundamental Aspects about Lipschitz Continuity of Neural Networks","created":"2023-02-21","cited_by_count":26,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2402.13728","title":"Average gradient outer product as a mechanism for deep neural collapse","created":"2024-02-21","cited_by_count":22,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2204.06274","title":"Overparameterized Linear Regression under Adversarial Attacks","created":"2022-04-13","cited_by_count":21,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2205.06798","title":"Sharp Asymptotics of Kernel Ridge Regression Beyond the Linear Regime","created":"2022-05-13","cited_by_count":19,"area":null},{"id":"2206.01029","title":"Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions","created":"2022-06-02","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2404.19261","title":"High dimensional analysis reveals conservative sharpening and a stochastic edge of stability","created":"2024-04-30","cited_by_count":18,"area":null},{"id":"2110.11805","title":"Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model","created":"2021-10-22","cited_by_count":17,"area":null},{"id":"2112.03657","title":"Understanding Square Loss in Training Overparametrized Neural Network Classifiers","created":"2021-12-07","cited_by_count":14,"area":null},{"id":"2302.01629","title":"Beyond the Universal Law of Robustness: Sharper Laws for Random Features and Neural Tangent Kernels","created":"2023-02-03","cited_by_count":13,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2301.13371","title":"Demystifying Disagreement-on-the-Line in High Dimensions","created":"2023-01-31","cited_by_count":12,"area":null},{"id":"2210.07612","title":"Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2304.13016","title":"Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation","created":"2023-04-25","cited_by_count":11,"area":null},{"id":"2305.12100","title":"How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features","created":"2023-05-20","cited_by_count":11,"area":null},{"id":"2310.04357","title":"Asymptotically free sketched ridge ensembles: Risks, cross-validation, and tuning","created":"2023-10-06","cited_by_count":11,"area":null},{"id":"2208.09897","title":"Multiple Descent in the Multiple Random Feature Model","created":"2022-08-21","cited_by_count":10,"area":null},{"id":"2402.05271","title":"Feature learning as alignment: a structural property of gradient descent in non-linear neural networks","created":"2024-02-07","cited_by_count":10,"area":null},{"id":"2506.06280","title":"Eigenspectrum Analysis of Neural Networks without Aspect Ratio Bias","created":"2025-06-06","cited_by_count":10,"area":null},{"id":"2106.02630","title":"Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes","created":"2021-06-04","cited_by_count":9,"area":null},{"id":"2206.01378","title":"Regularization-wise double descent: Why it occurs and how to eliminate it","created":"2022-06-03","cited_by_count":9,"area":null},{"id":"2401.12236","title":"The Surprising Harmfulness of Benign Overfitting for Adversarial Robustness","created":"2024-01-19","cited_by_count":9,"area":null},{"id":"2102.06740","title":"Appearance of Random Matrix Theory in Deep Learning","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2207.11621","title":"A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors","created":"2022-07-23","cited_by_count":7,"area":null},{"id":"2211.06077","title":"Overparameterized random feature regression with nearly orthogonal data","created":"2022-11-11","cited_by_count":7,"area":null},{"id":"2306.09955","title":"Training shallow ReLU networks on noisy data using hinge loss: when do we overfit and is it benign?","created":"2023-06-16","cited_by_count":7,"area":null},{"id":"2406.15275","title":"How language models extrapolate outside the training data: A case study in Textualized Gridworld","created":"2024-06-21","cited_by_count":7,"area":null},{"id":"2502.05074","title":"Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models","created":"2025-02-07","cited_by_count":7,"area":null},{"id":"2207.04612","title":"Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm","created":"2022-07-11","cited_by_count":6,"area":null},{"id":"2306.11232","title":"Eight challenges in developing theory of intelligence","created":"2023-06-20","cited_by_count":6,"area":null},{"id":"2403.06903","title":"Benign overfitting in leaky ReLU networks with moderate input dimension","created":"2024-03-11","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2212.06757","title":"Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures","created":"2022-12-13","cited_by_count":5,"area":null},{"id":"2310.01374","title":"Corrected generalized cross-validation for finite ensembles of penalized estimators","created":"2023-10-02","cited_by_count":5,"area":null},{"id":"2406.11703","title":"Unveiling Multiple Descents in Unsupervised Autoencoders","created":"2024-06-17","cited_by_count":5,"area":null},{"id":"2105.00507","title":"Universal scaling laws in the gradient descent training of neural networks","created":"2021-05-02","cited_by_count":4,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2305.14689","title":"Least Squares Regression Can Exhibit Under-Parameterized Double Descent","created":"2023-05-24","cited_by_count":4,"area":null},{"id":"2404.03139","title":"Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networks","created":"2024-04-04","cited_by_count":4,"area":null},{"id":"2208.08003","title":"Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise","created":"2022-08-17","cited_by_count":3,"area":null},{"id":"2403.00258","title":"\"Lossless\" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach","created":"2024-03-01","cited_by_count":3,"area":null},{"id":"2112.03660","title":"A generalization gap estimation for overparameterized models via the Langevin functional variance","created":"2021-12-07","cited_by_count":2,"area":null},{"id":"2404.12481","title":"Understanding Optimal Feature Transfer via a Fine-Grained Bias-Variance Analysis","created":"2024-04-18","cited_by_count":2,"area":null},{"id":"2405.18274","title":"Signal-Plus-Noise Decomposition of Nonlinear Spiked Random Matrix Models","created":"2024-05-28","cited_by_count":2,"area":null},{"id":"2406.01435","title":"Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning","created":"2024-06-03","cited_by_count":2,"area":null},{"id":"2410.13991","title":"Generalization for Least Squares Regression With Simple Spiked Covariances","created":"2024-10-17","cited_by_count":2,"area":null},{"id":"2502.15131","title":"Optimal and Provable Calibration in High-Dimensional Binary Classification: Angular Calibration and Platt Scaling","created":"2025-02-21","cited_by_count":2,"area":null},{"id":"2504.03035","title":"High-dimensional ridge regression with random features for non-identically distributed data with a variance profile","created":"2025-04-03","cited_by_count":2,"area":null},{"id":"2508.20036","title":"Eigenvalue distribution of the Neural Tangent Kernel in the quadratic scaling","created":"2025-08-27","cited_by_count":2,"area":null},{"id":"2601.06961","title":"The Impact of Anisotropic Covariance Structure on the Training Dynamics and Generalization Error of Linear Networks","created":"2026-01-11","cited_by_count":2,"area":null},{"id":"2605.30741","title":"Is the Last Layer Sufficient for Uncertainty Quantification?","created":"2026-05-29","cited_by_count":2,"area":null},{"id":"2207.12547","title":"The BUTTER Zone: An Empirical Study of Training Dynamics in Fully Connected Neural Networks","created":"2022-07-25","cited_by_count":1,"area":null},{"id":"2303.09474","title":"Gradient flow on extensive-rank positive semi-definite matrix denoising","created":"2023-03-16","cited_by_count":1,"area":null},{"id":"2306.03783","title":"Asymptotics of Bayesian Uncertainty Estimation in Random Features Regression","created":"2023-06-06","cited_by_count":1,"area":null},{"id":"2311.01762","title":"Changing the Kernel During Training Leads to Double Descent in Kernel Regression","created":"2023-11-03","cited_by_count":1,"area":null},{"id":"2408.15784","title":"Implicit Regularization Paths of Weighted Neural Representations","created":"2024-08-28","cited_by_count":1,"area":null},{"id":"2605.18022","title":"Unveiling Memorization-Generalization Coexistence: A Case Study on Arithmetic Tasks with Label Noise","created":"2026-05-18","cited_by_count":1,"area":null},{"id":"2104.00526","title":"Fitting Elephants","created":"2021-03-31","cited_by_count":0,"area":null},{"id":"2309.06774","title":"Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss","created":"2023-09-13","cited_by_count":0,"area":null},{"id":"2504.08628","title":"Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks","created":"2025-04-11","cited_by_count":0,"area":null},{"id":"2504.10754","title":"auto-fpt: Automating Free Probability Theory Calculations for Machine Learning Theory","created":"2025-04-14","cited_by_count":0,"area":null},{"id":"2506.02406","title":"Random at First, Fast at Last: NTK-Guided Fourier Pre-Processing for Tabular DL","created":"2025-06-03","cited_by_count":0,"area":null},{"id":"2512.11089","title":"TPV: Parameter Perturbations Through the Lens of Test Prediction Variance","created":"2025-12-11","cited_by_count":0,"area":null},{"id":"2602.08350","title":"All ERMs Can Fail in Stochastic Convex Optimization Lower Bounds in Linear Dimension","created":"2026-02-09","cited_by_count":0,"area":null},{"id":"2604.12827","title":"Loop Corrections in Random Feature Models: Training Error and Generalization Gap","created":"2026-04-14","cited_by_count":0,"area":null},{"id":"2605.17767","title":"Feature Learning in Linear-Width Two-Layer Networks: Two vs. One Step of Gradient Descent","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2609.32298","title":"Refresh or Realize? Compute Allocation in Drifting Models","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":null}