{"total":96,"rows":[{"id":"2404.01413","title":"Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data","created":"2024-04-01","cited_by_count":151,"area":"synth"},{"id":"2402.07043","title":"A Tale of Tails: Model Collapse as a Change of Scaling Laws","created":"2024-02-10","cited_by_count":130,"area":"synth"},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2402.07712","title":"Model Collapse Demystified: The Case of Regression","created":"2024-02-12","cited_by_count":82,"area":"synth"},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2410.04840","title":"Strong Model Collapse","created":"2024-10-07","cited_by_count":65,"area":"synth"},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2303.01372","title":"High-dimensional analysis of double descent for linear regression with random projections","created":"2023-03-02","cited_by_count":47,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2410.16377","title":"A Simple Model of Inference Scaling Laws","created":"2024-10-21","cited_by_count":36,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2303.14942","title":"On the Optimality of Misspecified Spectral Algorithms","created":"2023-03-27","cited_by_count":28,"area":null},{"id":"2304.06670","title":"Deep neural networks have an inbuilt Occam's razor","created":"2023-04-13","cited_by_count":28,"area":null},{"id":"2312.15995","title":"Generalization in Kernel Regression Under Realistic Assumptions","created":"2023-12-26","cited_by_count":27,"area":null},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26,"area":null},{"id":"2205.13303","title":"Gaussian Universality of Perceptrons with Random Labels","created":"2022-05-26","cited_by_count":26,"area":null},{"id":"2302.08923","title":"Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation","created":"2023-02-17","cited_by_count":26,"area":null},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23,"area":null},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23,"area":null},{"id":"2211.07844","title":"Characterizing the Spectrum of the NTK via a Power Series Expansion","created":"2022-11-15","cited_by_count":22,"area":null},{"id":"2410.18837","title":"High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws","created":"2024-10-24","cited_by_count":22,"area":"distill"},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2111.08308","title":"Learning with convolution and pooling operations in kernel methods","created":"2021-11-16","cited_by_count":21,"area":null},{"id":"2305.07241","title":"On the Optimality of Misspecified Kernel Ridge Regression","created":"2023-05-12","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2309.13337","title":"On the Asymptotic Learning Curves of Kernel Ridge Regression under Power-law Decay","created":"2023-09-23","cited_by_count":19,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2201.12655","title":"Error Scaling Laws for Kernel Classification under Source and Capacity Conditions","created":"2022-01-29","cited_by_count":17,"area":null},{"id":"2208.01003","title":"What Can Be Learnt With Wide Convolutional Neural Networks?","created":"2022-08-01","cited_by_count":16,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2110.12231","title":"Learning curves for Gaussian process regression with power-law priors and targets","created":"2021-10-23","cited_by_count":15,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2402.01297","title":"Characterizing Overfitting in Kernel Ridgeless Regression Through the Eigenspectrum","created":"2024-02-02","cited_by_count":13,"area":null},{"id":"2405.14630","title":"Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension","created":"2024-05-23","cited_by_count":13,"area":null},{"id":"2202.03348","title":"Failure and success of the spectral bias prediction for Kernel Ridge Regression: the case of low-dimensional data","created":"2022-02-07","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2206.11124","title":"A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2401.01270","title":"Optimal Rates of Kernel Ridge Regression under Source Condition in Large Dimensions","created":"2024-01-02","cited_by_count":11,"area":null},{"id":"2401.01599","title":"Generalization Error Curves for Analytic Spectral Algorithms under Power-law Decay","created":"2024-01-03","cited_by_count":11,"area":null},{"id":"2510.04780","title":"Kernel ridge regression under power-law data: spectrum and generalization","created":"2025-10-06","cited_by_count":10,"area":null},{"id":"2202.00992","title":"Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions","created":"2022-02-02","cited_by_count":9,"area":null},{"id":"2404.12597","title":"The phase diagram of kernel interpolation in large dimensions","created":"2024-04-19","cited_by_count":9,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2602.05846","title":"Optimal scaling laws in learning hierarchical multi-index models","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2403.07264","title":"Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization","created":"2024-03-12","cited_by_count":8,"area":null},{"id":"2408.04607","title":"Risk and cross validation in ridge regression with correlated samples","created":"2024-08-08","cited_by_count":8,"area":null},{"id":"2410.17796","title":"A Comprehensive Analysis on the Learning Curve in Kernel Ridge Regression","created":"2024-10-23","cited_by_count":7,"area":null},{"id":"2412.11979","title":"AlphaZero Neural Scaling and Zipf's Law: a Tale of Board Games and Power Laws","created":"2024-12-16","cited_by_count":7,"area":null},{"id":"2310.13434","title":"Random Matrix Analysis to Balance between Supervised and Unsupervised Learning under the Low Density Separation Assumption","created":"2023-10-20","cited_by_count":6,"area":null},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2305.18506","title":"Generalization Ability of Wide Residual Networks","created":"2023-05-29","cited_by_count":5,"area":null},{"id":"2409.05780","title":"Breaking Neural Network Scaling Laws with Modularity","created":"2024-09-09","cited_by_count":5,"area":null},{"id":"2410.05626","title":"On the Impacts of the Random Initialization in the Neural Tangent Kernel Theory","created":"2024-10-08","cited_by_count":5,"area":null},{"id":"2505.07070","title":"Scaling Laws and Representation Learning in Simple Hierarchical Languages: Transformers vs. Convolutional Architectures","created":"2025-05-11","cited_by_count":5,"area":null},{"id":"2206.14255","title":"Target alignment in truncated kernel ridge regression","created":"2022-06-28","cited_by_count":4,"area":null},{"id":"2409.03734","title":"Safety vs. Performance: How Multi-Objective Learning Reduces Barriers to Market Entry","created":"2024-09-05","cited_by_count":4,"area":null},{"id":"2503.01314","title":"Scaling Law Phenomena Across Regression Paradigms: Multiple and Kernel Approaches","created":"2025-03-03","cited_by_count":4,"area":null},{"id":"2505.22048","title":"Learning Curves of Stochastic Gradient Descent in Kernel Regression","created":"2025-05-28","cited_by_count":4,"area":null},{"id":"2203.09347","title":"Dimensionality Reduction and Wasserstein Stability for Kernel Regression","created":"2022-03-17","cited_by_count":3,"area":null},{"id":"2402.15718","title":"Optimal Rates and Saturation for Noiseless Kernel Ridge Regression","created":"2024-02-24","cited_by_count":3,"area":null},{"id":"2407.02322","title":"Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent","created":"2024-07-02","cited_by_count":3,"area":null},{"id":"2407.04371","title":"Exploiting the equivalence between quantum neural networks and perceptrons","created":"2024-07-05","cited_by_count":3,"area":null},{"id":"2409.00894","title":"Improving Adaptivity via Over-Parameterization in Sequence Models","created":"2024-09-02","cited_by_count":3,"area":null},{"id":"2509.21049","title":"Physics of Learning: A Lagrangian perspective to different learning paradigms","created":"2025-09-25","cited_by_count":3,"area":null},{"id":"2511.18661","title":"Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data","created":"2025-11-24","cited_by_count":3,"area":null},{"id":"2308.00556","title":"Robust Linear Regression: Phase-Transitions and Precise Tradeoffs for General Norms","created":"2023-08-01","cited_by_count":2,"area":null},{"id":"2402.00645","title":"Spectrally Transformed Kernel Regression","created":"2024-02-01","cited_by_count":2,"area":null},{"id":"2409.00915","title":"On the Pinsker bound of inner product kernel regression in large dimensions","created":"2024-09-02","cited_by_count":2,"area":null},{"id":"2410.04228","title":"SGD with memory: fundamental properties and stochastic acceleration","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2410.04264","title":"Decoupling Dynamical Richness from Representation Learning: Towards Practical Measurement","created":"2024-10-05","cited_by_count":2,"area":null},{"id":"2503.00504","title":"On the Saturation Effects of Spectral Algorithms in Large Dimensions","created":"2025-03-01","cited_by_count":2,"area":null},{"id":"2510.08095","title":"Beyond Real Data: Synthetic Data through the Lens of Regularization","created":"2025-10-09","cited_by_count":2,"area":null},{"id":"2403.11696","title":"Generalization error of spectral algorithms","created":"2024-03-18","cited_by_count":1,"area":null},{"id":"2408.15784","title":"Implicit Regularization Paths of Weighted Neural Representations","created":"2024-08-28","cited_by_count":1,"area":null},{"id":"2509.21174","title":"Breaking the curse of dimensionality for linear rules: optimal predictors over the ellipsoid","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2602.01045","title":"Superposition unifies power-law training dynamics","created":"2026-02-01","cited_by_count":1,"area":"mechinterp"},{"id":"2307.06362","title":"Spectral-Bias and Kernel-Task Alignment in Physically Informed Neural Networks","created":"2023-07-12","cited_by_count":0,"area":null},{"id":"2406.09194","title":"Benign overfitting in Fixed Dimension via Physics-Informed Learning with Smooth Inductive Bias","created":"2024-06-13","cited_by_count":0,"area":null},{"id":"2412.18756","title":"Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories","created":"2024-12-25","cited_by_count":0,"area":null},{"id":"2605.10395","title":"Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2605.14524","title":"Large Dimensional Kernel Ridge Regression: Extending to Product Kernels","created":"2026-05-14","cited_by_count":0,"area":null},{"id":"2605.26067","title":"Conditional KRR: Injecting Unpenalized Features into Kernel Methods with Applications to Kernel Thresholding","created":"2026-05-25","cited_by_count":0,"area":null},{"id":"2606.28242","title":"How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2608.22953","title":"Stochastic gradient descent with initial regularization","created":"2026-08-24","cited_by_count":0,"area":null},{"id":"2609.33675","title":"Benign Overfitting for General Norms and Distributions","created":"2026-09-27","cited_by_count":0,"area":null},{"id":"2610.19281","title":"Exact Scaling Laws for a Random-Features Bigram Model","created":"2026-10-13","cited_by_count":0,"area":null}],"next_cursor":null}