{"total":90,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2203.08124","title":"Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent from the Decision Boundary Perspective","created":"2022-03-15","cited_by_count":57,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28,"area":null},{"id":"2206.08684","title":"Sparse Double Descent: Where Network Pruning Aggravates Overfitting","created":"2022-06-17","cited_by_count":26,"area":null},{"id":"2106.05418","title":"Probing transfer learning with a model of synthetic correlated datasets","created":"2021-06-09","cited_by_count":25,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2106.02261","title":"Out-of-Distribution Generalization in Kernel Regression","created":"2021-06-04","cited_by_count":21,"area":null},{"id":"2110.00683","title":"Learning through atypical \"phase transitions\" in overparameterized neural networks","created":"2021-10-01","cited_by_count":21,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2205.06798","title":"Sharp Asymptotics of Kernel Ridge Regression Beyond the Linear Regime","created":"2022-05-13","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2110.11805","title":"Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model","created":"2021-10-22","cited_by_count":17,"area":null},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16,"area":null},{"id":"2302.00704","title":"Pathologies of Predictive Diversity in Deep Ensembles","created":"2023-02-01","cited_by_count":16,"area":null},{"id":"2312.10935","title":"AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices","created":"2023-12-18","cited_by_count":15,"area":null},{"id":"2111.05198","title":"Harmless interpolation in regression and classification with structured features","created":"2021-11-09","cited_by_count":14,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2103.05243","title":"On the Generalization Power of Overfitted Two-Layer Neural Tangent Kernel Models","created":"2021-03-09","cited_by_count":13,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2202.04167","title":"Understanding the bias-variance tradeoff of Bregman divergences","created":"2022-02-08","cited_by_count":11,"area":null},{"id":"2304.13016","title":"Subsample Ridge Ensembles: Equivalences and Generalized Cross-Validation","created":"2023-04-25","cited_by_count":11,"area":null},{"id":"2203.01726","title":"Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology","created":"2022-03-03","cited_by_count":10,"area":null},{"id":"2203.03443","title":"Generalization Through The Lens Of Leave-One-Out Error","created":"2022-03-07","cited_by_count":10,"area":null},{"id":"2208.09897","title":"Multiple Descent in the Multiple Random Feature Model","created":"2022-08-21","cited_by_count":10,"area":null},{"id":"2305.18496","title":"Generalized equivalences between subsampling and ridge regularization","created":"2023-05-29","cited_by_count":10,"area":null},{"id":"2106.03485","title":"Redundant representations help generalization in wide neural networks","created":"2021-06-07","cited_by_count":9,"area":null},{"id":"2108.05258","title":"Deep Learning Classification of Lake Zooplankton","created":"2021-08-11","cited_by_count":9,"area":null},{"id":"2112.04002","title":"SHRIMP: Sparser Random Feature Models via Iterative Magnitude Pruning","created":"2021-12-07","cited_by_count":9,"area":null},{"id":"2206.01378","title":"Regularization-wise double descent: Why it occurs and how to eliminate it","created":"2022-06-03","cited_by_count":9,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2203.05443","title":"Bias-variance decomposition of overparameterized regression with random linear features","created":"2022-03-10","cited_by_count":7,"area":null},{"id":"2103.05621","title":"The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression","created":"2021-03-09","cited_by_count":6,"area":null},{"id":"2206.02047","title":"On the Generalization Power of the Overfitted Three-Layer Neural Tangent Kernel Model","created":"2022-06-04","cited_by_count":6,"area":null},{"id":"2206.10566","title":"Ensembling over Classifiers: a Bias-Variance Perspective","created":"2022-06-21","cited_by_count":6,"area":null},{"id":"2310.13434","title":"Random Matrix Analysis to Balance between Supervised and Unsupervised Learning under the Low Density Separation Assumption","created":"2023-10-20","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2106.04003","title":"Double Descent and Other Interpolation Phenomena in GANs","created":"2021-06-07","cited_by_count":5,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2202.04146","title":"A Neural Phillips Curve and a Deep Output Gap","created":"2022-02-08","cited_by_count":5,"area":null},{"id":"2212.06757","title":"Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures","created":"2022-12-13","cited_by_count":5,"area":null},{"id":"2407.08641","title":"How more data can hurt: Instability and regularization in next-generation reservoir computing","created":"2024-07-11","cited_by_count":5,"area":null},{"id":"2103.14108","title":"The Geometry of Over-parameterized Regression and Adversarial Perturbations","created":"2021-03-25","cited_by_count":4,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2402.13622","title":"Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression","created":"2024-02-21","cited_by_count":4,"area":null},{"id":"2404.09779","title":"A replica analysis of under-bagging","created":"2024-04-15","cited_by_count":4,"area":null},{"id":"2409.05782","title":"Unified Neural Network Scaling Laws and Scale-time Equivalence","created":"2024-09-09","cited_by_count":4,"area":null},{"id":"2204.02678","title":"Random Features Model with General Convex Regularization: A Fine Grained Analysis with Precise Asymptotic Learning Curves","created":"2022-04-06","cited_by_count":3,"area":null},{"id":"2208.08003","title":"Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise","created":"2022-08-17","cited_by_count":3,"area":null},{"id":"2307.11838","title":"Data-Induced Interactions of Sparse Sensors Using Statistical Physics","created":"2023-07-21","cited_by_count":3,"area":null},{"id":"2103.07986","title":"Pre-interpolation loss behaviour in neural networks","created":"2021-03-14","cited_by_count":2,"area":null},{"id":"2206.12832","title":"Prediction Errors for Penalized Regressions based on Generalized Approximate Message Passing","created":"2022-06-26","cited_by_count":2,"area":null},{"id":"2306.12190","title":"Quantifying lottery tickets under label noise: accuracy, calibration, and complexity","created":"2023-06-21","cited_by_count":2,"area":null},{"id":"2504.03035","title":"High-dimensional ridge regression with random features for non-identically distributed data with a variance profile","created":"2025-04-03","cited_by_count":2,"area":null},{"id":"2103.00500","title":"Asymptotic Risk of Overparameterized Likelihood Models: Double Descent Theory for Deep Neural Networks","created":"2021-02-28","cited_by_count":1,"area":null},{"id":"2306.12582","title":"Adversarial Training with Generated Data in High-Dimensional Regression: An Asymptotic Study","created":"2023-06-21","cited_by_count":1,"area":null},{"id":"2412.05418","title":"No Free Lunch From Random Feature Ensembles: Scaling Laws and Near-Optimality Conditions","created":"2024-12-06","cited_by_count":1,"area":null},{"id":"2504.12700","title":"A Two-Phase Perspective on Deep Learning Dynamics","created":"2025-04-17","cited_by_count":1,"area":null},{"id":"2604.03068","title":"Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2605.21402","title":"Memorisation, convergence and generalisation in generative models","created":"2026-05-20","cited_by_count":1,"area":null},{"id":"2103.03466","title":"Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change","created":"2021-03-05","cited_by_count":0,"area":null},{"id":"2109.02252","title":"Generative Models Improve Radiomics Performance in Different Tasks and Different Datasets: An Experimental Study","created":"2021-09-06","cited_by_count":0,"area":null},{"id":"2201.12803","title":"Generalizing similarity in noisy setups: the DIBS phenomenon","created":"2022-01-30","cited_by_count":0,"area":null},{"id":"2212.00433","title":"Regularization Trade-offs with Fake Features","created":"2022-12-01","cited_by_count":0,"area":null},{"id":"2303.14083","title":"Online Learning for the Random Feature Model in the Student-Teacher Framework","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2305.15907","title":"Double Descent of Discrepancy: A Task-, Data-, and Model-Agnostic Phenomenon","created":"2023-05-25","cited_by_count":0,"area":null},{"id":"2306.05583","title":"Gibbs-Based Information Criteria and the Over-Parameterized Regime","created":"2023-06-08","cited_by_count":0,"area":null},{"id":"2312.03951","title":"Understanding the Role of Optimization in Double Descent","created":"2023-12-06","cited_by_count":0,"area":null},{"id":"2401.12610","title":"The twin peaks of learning neural networks","created":"2024-01-23","cited_by_count":0,"area":null},{"id":"2408.08294","title":"eGAD! double descent is explained by Generalized Aliasing Decomposition","created":"2024-08-15","cited_by_count":0,"area":null},{"id":"2410.00699","title":"Investigating the Impact of Model Complexity in Large Language Models","created":"2024-10-01","cited_by_count":0,"area":null},{"id":"2410.10690","title":"Dynamical loss functions shape landscape topography and improve learning in artificial neural networks","created":"2024-10-14","cited_by_count":0,"area":null},{"id":"2411.02184","title":"Double Descent Meets Out-of-Distribution Detection: Theoretical Insights and Empirical Analysis on the role of model complexity","created":"2024-11-04","cited_by_count":0,"area":null},{"id":"2411.04695","title":"Is network fragmentation a useful complexity measure?","created":"2024-11-07","cited_by_count":0,"area":null},{"id":"2501.05550","title":"Emergent weight morphologies in deep neural networks","created":"2025-01-09","cited_by_count":0,"area":null},{"id":"2504.19351","title":"The Double Descent Behavior in Two Layer Neural Network for Binary Classification","created":"2025-04-27","cited_by_count":0,"area":null},{"id":"2508.17412","title":"A Ridge Too Far: Correcting Over-Shrinkage via Negative Regularization","created":"2025-08-24","cited_by_count":0,"area":null},{"id":"2601.23208","title":"A Random Matrix Theory of Masked Self-Supervised Regression","created":"2026-01-30","cited_by_count":0,"area":null},{"id":"2607.21409","title":"Cautious optimism for deep parameterized quantum circuits","created":"2026-07-23","cited_by_count":0,"area":null},{"id":"2607.26414","title":"Origins and mitigation of double descent in reduced order modeling","created":"2026-07-29","cited_by_count":0,"area":null}],"next_cursor":null}