{"total":166,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2310.17813","title":"A Spectral Condition for Feature Learning","created":"2023-10-26","cited_by_count":109,"area":null},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108,"area":null},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96,"area":null},{"id":"2106.03747","title":"The Inductive Bias of Quantum Kernels","created":"2021-06-07","cited_by_count":91,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2306.04891","title":"In-Context Learning through the Bayesian Prism","created":"2023-06-08","cited_by_count":83,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2111.04225","title":"Representation Learning via Quantum Neural Tangent Kernels","created":"2021-11-08","cited_by_count":40,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35,"area":null},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33,"area":null},{"id":"2206.06686","title":"Bandwidth Enables Generalization in Quantum Kernel Models","created":"2022-06-14","cited_by_count":32,"area":null},{"id":"2402.04362","title":"Neural Networks Learn Statistics of Increasing Complexity","created":"2024-02-06","cited_by_count":31,"area":null},{"id":"2302.05933","title":"Generalization Ability of Wide Neural Networks on $\\mathbb{R}$","created":"2023-02-12","cited_by_count":30,"area":null},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2208.04924","title":"On the Activation Function Dependence of the Spectral Bias of Neural Networks","created":"2022-08-09","cited_by_count":28,"area":null},{"id":"2304.06670","title":"Deep neural networks have an inbuilt Occam's razor","created":"2023-04-13","cited_by_count":28,"area":null},{"id":"2312.15995","title":"Generalization in Kernel Regression Under Realistic Assumptions","created":"2023-12-26","cited_by_count":27,"area":null},{"id":"2106.08619","title":"Locality defeats the curse of dimensionality in convolutional teacher-student scenarios","created":"2021-06-16","cited_by_count":26,"area":"distill"},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24,"area":null},{"id":"2407.10005","title":"Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond","created":"2024-07-13","cited_by_count":24,"area":null},{"id":"2504.12532","title":"Generalization through variance: how noise shapes inductive biases in diffusion models","created":"2025-04-16","cited_by_count":23,"area":"diffusion"},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2106.02261","title":"Out-of-Distribution Generalization in Kernel Regression","created":"2021-06-04","cited_by_count":21,"area":null},{"id":"2111.08308","title":"Learning with convolution and pooling operations in kernel methods","created":"2021-11-16","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2405.16391","title":"When does compositional structure yield compositional generalization? A kernel theory","created":"2024-05-26","cited_by_count":20,"area":null},{"id":"2205.06798","title":"Sharp Asymptotics of Kernel Ridge Regression Beyond the Linear Regime","created":"2022-05-13","cited_by_count":19,"area":null},{"id":"2206.04672","title":"Overcoming the Spectral Bias of Neural Value Approximation","created":"2022-06-09","cited_by_count":19,"area":null},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2201.12655","title":"Error Scaling Laws for Kernel Classification under Source and Capacity Conditions","created":"2022-01-29","cited_by_count":17,"area":null},{"id":"2208.01003","title":"What Can Be Learnt With Wide Convolutional Neural Networks?","created":"2022-08-01","cited_by_count":16,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2110.12231","title":"Learning curves for Gaussian process regression with power-law priors and targets","created":"2021-10-23","cited_by_count":15,"area":null},{"id":"2310.08513","title":"How connectivity structure shapes rich and lazy learning in neural circuits","created":"2023-10-12","cited_by_count":15,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2503.02877","title":"Weak-to-Strong Generalization Even in Random Feature Networks, Provably","created":"2025-03-04","cited_by_count":15,"area":null},{"id":"2112.01653","title":"Learning Curves for Continual Learning in Neural Networks: Self-Knowledge Transfer and Forgetting","created":"2021-12-03","cited_by_count":14,"area":null},{"id":"2309.12821","title":"A Spectral Theory of Neural Prediction and Alignment","created":"2023-09-22","cited_by_count":14,"area":null},{"id":"2212.13069","title":"Homophily modulates double descent generalization in graph convolution networks","created":"2022-12-26","cited_by_count":13,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2303.15484","title":"Regularize implicit neural representation by itself","created":"2023-03-27","cited_by_count":13,"area":null},{"id":"2402.05173","title":"Towards Understanding Inductive Bias in Transformers: A View From Infinity","created":"2024-02-07","cited_by_count":13,"area":null},{"id":"2410.08194","title":"Features are fate: a theory of transfer learning in high-dimensional regression","created":"2024-10-10","cited_by_count":13,"area":null},{"id":"2202.03348","title":"Failure and success of the spectral bias prediction for Kernel Ridge Regression: the case of low-dimensional data","created":"2022-02-07","cited_by_count":12,"area":null},{"id":"2102.08991","title":"Generalization in Quantum Machine Learning: a Quantum Information Perspective","created":"2021-02-17","cited_by_count":11,"area":null},{"id":"2206.11124","title":"A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2211.16551","title":"Numerical evidence against advantage with quantum fidelity kernels on classical data","created":"2022-11-29","cited_by_count":11,"area":null},{"id":"2309.04268","title":"Optimal Rate of Kernel Regression in Large Dimensions","created":"2023-09-08","cited_by_count":11,"area":null},{"id":"2206.09313","title":"Laziness, Barren Plateau, and Noise in Machine Learning","created":"2022-06-19","cited_by_count":10,"area":null},{"id":"2209.11144","title":"Automatic and effective discovery of quantum kernels","created":"2022-09-22","cited_by_count":10,"area":null},{"id":"2412.11521","title":"On the Ability of Deep Networks to Learn Symmetries from Data: A Neural Kernel Theory","created":"2024-12-16","cited_by_count":10,"area":null},{"id":"2502.00472","title":"Binned Spectral Power Loss for Improved Prediction of Chaotic Systems","created":"2025-02-01","cited_by_count":10,"area":null},{"id":"2202.00992","title":"Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions","created":"2022-02-02","cited_by_count":9,"area":null},{"id":"2402.16770","title":"Neural population geometry and optimal coding of tasks with shared latent structure","created":"2024-02-26","cited_by_count":9,"area":null},{"id":"2405.15926","title":"Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers","created":"2024-05-24","cited_by_count":9,"area":null},{"id":"2503.18114","title":"Feature Learning beyond the Lazy-Rich Dichotomy: Insights from Representational Geometry","created":"2025-03-23","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2201.06656","title":"Generalization in Supervised Learning Through Riemannian Contraction","created":"2022-01-17","cited_by_count":8,"area":null},{"id":"2303.14844","title":"Analyzing Convergence in Quantum Neural Networks: Deviations from Neural Tangent Kernels","created":"2023-03-26","cited_by_count":8,"area":null},{"id":"2402.01089","title":"No Free Prune: Information-Theoretic Barriers to Pruning at Initialization","created":"2024-02-02","cited_by_count":8,"area":null},{"id":"2403.07264","title":"Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2405.06008","title":"Wilsonian Renormalization of Neural Network Gaussian Processes","created":"2024-05-09","cited_by_count":8,"area":null},{"id":"2408.04607","title":"Risk and cross validation in ridge regression with correlated samples","created":"2024-08-08","cited_by_count":8,"area":null},{"id":"2509.26551","title":"Pretrain-Test Task Alignment Governs Generalization in In-Context Learning","created":"2025-09-30","cited_by_count":8,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2409.03891","title":"Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality","created":"2024-09-05","cited_by_count":7,"area":null},{"id":"2502.05074","title":"Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models","created":"2025-02-07","cited_by_count":7,"area":null},{"id":"2112.07806","title":"Representation Alignment in Neural Networks","created":"2021-12-15","cited_by_count":6,"area":null},{"id":"2310.17163","title":"Low-Dimensional Gradient Helps Out-of-Distribution Detection","created":"2023-10-26","cited_by_count":6,"area":null},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2202.01944","title":"Learning Representation from Neural Fisher Kernel with Low-rank Approximation","created":"2022-02-04","cited_by_count":5,"area":null},{"id":"2306.13185","title":"An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression","created":"2023-06-22","cited_by_count":5,"area":null},{"id":"2409.05780","title":"Breaking Neural Network Scaling Laws with Modularity","created":"2024-09-09","cited_by_count":5,"area":null},{"id":"2605.05683","title":"Spectral Lens: Activation and Gradient Spectra as Diagnostics of LLM Optimization","created":"2026-05-07","cited_by_count":5,"area":null},{"id":"2105.00507","title":"Universal scaling laws in the gradient descent training of neural networks","created":"2021-05-02","cited_by_count":4,"area":null},{"id":"2206.14255","title":"Target alignment in truncated kernel ridge regression","created":"2022-06-28","cited_by_count":4,"area":null},{"id":"2207.09408","title":"Bounding generalization error with input compression: An empirical study with infinite-width networks","created":"2022-07-19","cited_by_count":4,"area":null},{"id":"2512.04165","title":"Mitigating the Curse of Detail: Scaling Arguments for Feature Learning and Sample Complexity","created":"2025-12-03","cited_by_count":4,"area":null},{"id":"2607.26654","title":"Constitutional Midtraining: Content Presence Drives Alignment Gains","created":"2026-07-29","cited_by_count":4,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2406.02663","title":"Demystifying Spectral Bias on Real-World Data","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2407.04371","title":"Exploiting the equivalence between quantum neural networks and perceptrons","created":"2024-07-05","cited_by_count":3,"area":null}],"next_cursor":"100"}