{"total":83,"rows":[{"id":"2006.16668","title":"GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding","created":"2020-06-30","cited_by_count":1631,"area":"moe"},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2006.13198","title":"Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks","created":"2020-06-23","cited_by_count":166,"area":"alignment"},{"id":"2109.07740","title":"Scaling Laws for Neural Machine Translation","created":"2021-09-16","cited_by_count":111,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2106.11642","title":"Repulsive Deep Ensembles are Bayesian","created":"2021-06-22","cited_by_count":104,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2205.12253","title":"Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing","created":"2022-05-24","cited_by_count":50,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2303.01372","title":"High-dimensional analysis of double descent for linear regression with random projections","created":"2023-03-02","cited_by_count":47,"area":null},{"id":"2106.10865","title":"Benign Overfitting in Multiclass Classification: All Roads Lead to Interpolation","created":"2021-06-21","cited_by_count":42,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2202.00553","title":"Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization","created":"2022-02-01","cited_by_count":30,"area":null},{"id":"2108.13499","title":"Scene Synthesis via Uncertainty-Driven Attribute Synchronization","created":"2021-08-30","cited_by_count":29,"area":null},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2305.14247","title":"Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Science","created":"2023-05-23","cited_by_count":25,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24,"area":null},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2110.00683","title":"Learning through atypical \"phase transitions\" in overparameterized neural networks","created":"2021-10-01","cited_by_count":21,"area":null},{"id":"2204.06274","title":"Overparameterized Linear Regression under Adversarial Attacks","created":"2022-04-13","cited_by_count":21,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2305.12313","title":"When are ensembles really effective?","created":"2023-05-21","cited_by_count":21,"area":null},{"id":"2102.08668","title":"Non-asymptotic approximations of neural networks by Gaussian processes","created":"2021-02-17","cited_by_count":19,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2110.11805","title":"Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model","created":"2021-10-22","cited_by_count":17,"area":null},{"id":"2103.05524","title":"On the interplay between data structure and loss function in classification problems","created":"2021-03-09","cited_by_count":13,"area":null},{"id":"2203.07337","title":"Phenomenology of Double Descent in Finite-Width Neural Networks","created":"2022-03-14","cited_by_count":12,"area":null},{"id":"2210.04520","title":"Continual task learning in natural and artificial agents","created":"2022-10-10","cited_by_count":12,"area":null},{"id":"2210.07612","title":"Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2208.09897","title":"Multiple Descent in the Multiple Random Feature Model","created":"2022-08-21","cited_by_count":10,"area":null},{"id":"2106.03485","title":"Redundant representations help generalization in wide neural networks","created":"2021-06-07","cited_by_count":9,"area":null},{"id":"2108.05258","title":"Deep Learning Classification of Lake Zooplankton","created":"2021-08-11","cited_by_count":9,"area":null},{"id":"2501.10077","title":"Double descent in quantum kernel methods","created":"2025-01-17","cited_by_count":9,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2102.03793","title":"Tilting the playing field: Dynamical loss functions for machine learning","created":"2021-02-07","cited_by_count":7,"area":null},{"id":"2209.08399","title":"Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$","created":"2022-09-17","cited_by_count":7,"area":null},{"id":"2103.05621","title":"The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression","created":"2021-03-09","cited_by_count":6,"area":null},{"id":"2209.01018","title":"Normalization effects on deep neural networks","created":"2022-09-02","cited_by_count":6,"area":null},{"id":"2407.05664","title":"How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning","created":"2024-07-08","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2212.06757","title":"Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures","created":"2022-12-13","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2101.06509","title":"Phases of learning dynamics in artificial neural networks: with or without mislabeled data","created":"2021-01-16","cited_by_count":4,"area":null},{"id":"2106.01714","title":"Optimization Variance: Exploring Generalization Properties of DNNs","created":"2021-06-03","cited_by_count":4,"area":null},{"id":"2210.09818","title":"Disentangling the Predictive Variance of Deep Ensembles through the Neural Tangent Kernel","created":"2022-10-18","cited_by_count":4,"area":null},{"id":"2307.09550","title":"The semantic landscape paradigm for neural networks","created":"2023-07-18","cited_by_count":4,"area":null},{"id":"2508.11522","title":"Finite-Width Neural Tangent Kernels from Feynman Diagrams","created":"2025-08-15","cited_by_count":4,"area":null},{"id":"2107.00797","title":"Mitigating deep double descent by concatenating inputs","created":"2021-07-02","cited_by_count":3,"area":null},{"id":"2203.15100","title":"Understanding out-of-distribution accuracies through quantifying difficulty of test samples","created":"2022-03-28","cited_by_count":3,"area":null},{"id":"2204.02678","title":"Random Features Model with General Convex Regularization: A Fine Grained Analysis with Precise Asymptotic Learning Curves","created":"2022-04-06","cited_by_count":3,"area":null},{"id":"2403.10459","title":"Understanding the Double Descent Phenomenon in Deep Learning","created":"2024-03-15","cited_by_count":3,"area":null},{"id":"2404.13404","title":"Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions","created":"2024-04-20","cited_by_count":3,"area":null},{"id":"2105.10373","title":"A Precise Performance Analysis of Support Vector Regression","created":"2021-05-21","cited_by_count":2,"area":null},{"id":"2112.03660","title":"A generalization gap estimation for overparameterized models via the Langevin functional variance","created":"2021-12-07","cited_by_count":2,"area":null},{"id":"2201.08652","title":"A phase transition for finding needles in nonlinear haystacks with LASSO artificial neural networks","created":"2022-01-21","cited_by_count":2,"area":null},{"id":"2202.10679","title":"Physics-Informed Graph Learning","created":"2022-02-22","cited_by_count":2,"area":null},{"id":"2309.04860","title":"Approximation Results for Gradient Descent trained Neural Networks","created":"2023-09-09","cited_by_count":2,"area":null},{"id":"2409.20250","title":"Input-Label Correlation Governs a Linear-to-Nonlinear Transition in Random Features under Spiked Covariance","created":"2024-09-30","cited_by_count":2,"area":null},{"id":"2507.06367","title":"The Riemannian Geometry Associated to Gradient Flows of Linear Convolutional Networks","created":"2025-07-08","cited_by_count":2,"area":null},{"id":"2509.00924","title":"Beyond Universal Approximation Theorems: Algorithmic Uniform Approximation by Neural Networks Trained with Noisy Data","created":"2025-08-31","cited_by_count":2,"area":null},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2311.01762","title":"Changing the Kernel During Training Leads to Double Descent in Kernel Regression","created":"2023-11-03","cited_by_count":1,"area":null},{"id":"2505.20030","title":"Multiple Descents in Deep Learning as a Sequence of Order-Chaos Transitions in LSTM Networks","created":"2025-05-26","cited_by_count":1,"area":null},{"id":"2604.03068","title":"Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2607.06382","title":"A Function-Space Dichotomy for Compositional Learning: Exponential Sub-Optimality of the Neural Tangent Kernel","created":"2026-07-07","cited_by_count":1,"area":null},{"id":"2609.26392","title":"Double Descent and Malign Overfitting in Diffusion Models","created":"2026-09-22","cited_by_count":1,"area":"diffusion"},{"id":"2103.03466","title":"Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change","created":"2021-03-05","cited_by_count":0,"area":null},{"id":"2111.14493","title":"On the Effectiveness of Neural Ensembles for Image Classification with Small Datasets","created":"2021-11-29","cited_by_count":0,"area":null},{"id":"2205.00477","title":"Ridgeless Regression with Random Features","created":"2022-05-01","cited_by_count":0,"area":null},{"id":"2302.07419","title":"Spatially heterogeneous learning by a deep student machine","created":"2023-02-15","cited_by_count":0,"area":null},{"id":"2407.11057","title":"SPIN: SE(3)-Invariant Physics Informed Network for Binding Affinity Prediction","created":"2024-07-10","cited_by_count":0,"area":null},{"id":"2410.10690","title":"Dynamical loss functions shape landscape topography and improve learning in artificial neural networks","created":"2024-10-14","cited_by_count":0,"area":null},{"id":"2501.05550","title":"Emergent weight morphologies in deep neural networks","created":"2025-01-09","cited_by_count":0,"area":null},{"id":"2504.19351","title":"The Double Descent Behavior in Two Layer Neural Network for Binary Classification","created":"2025-04-27","cited_by_count":0,"area":null},{"id":"2604.02338","title":"LiME: Lightweight Mixture of Experts for Efficient Multimodal Multi-task Learning","created":"2026-02-01","cited_by_count":0,"area":"moe"},{"id":"2605.21167","title":"A Rigorous, Tractable Measure of Model Complexity","created":"2026-05-20","cited_by_count":0,"area":null},{"id":"2607.20535","title":"A Graph Neural Network approach to zero-shot Digital Twins","created":"2026-07-10","cited_by_count":0,"area":null},{"id":"2609.19076","title":"Double descent is the principle of least action","created":"2026-09-16","cited_by_count":0,"area":null}],"next_cursor":null}