{"total":118,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96,"area":null},{"id":"2202.08832","title":"Universality of empirical risk minimization","created":"2022-02-17","cited_by_count":75,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2405.11751","title":"Asymptotic theory of in-context learning by linear attention","created":"2024-05-20","cited_by_count":55,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2202.03038","title":"Deep Networks on Toroids: Removing Symmetries Reveals the Structure of Flat Regions in the Landscape Geometry","created":"2022-02-07","cited_by_count":28,"area":null},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28,"area":null},{"id":"2205.06308","title":"An Equivalence Principle for the Spectrum of Random Inner-Product Kernel Matrices with Polynomial Scalings","created":"2022-05-12","cited_by_count":27,"area":null},{"id":"2312.15995","title":"Generalization in Kernel Regression Under Realistic Assumptions","created":"2023-12-26","cited_by_count":27,"area":null},{"id":"2205.13303","title":"Gaussian Universality of Perceptrons with Random Labels","created":"2022-05-26","cited_by_count":26,"area":null},{"id":"2302.08923","title":"Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation","created":"2023-02-17","cited_by_count":26,"area":null},{"id":"2106.05418","title":"Probing transfer learning with a model of synthetic correlated datasets","created":"2021-06-09","cited_by_count":25,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2103.04902","title":"Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem","created":"2021-03-08","cited_by_count":23,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2302.06210","title":"Precise Asymptotic Analysis of Deep Random Feature Models","created":"2023-02-13","cited_by_count":22,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2110.00683","title":"Learning through atypical \"phase transitions\" in overparameterized neural networks","created":"2021-10-01","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2304.07235","title":"Mapping of attention mechanisms to a generalized Potts model","created":"2023-04-14","cited_by_count":19,"area":null},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19,"area":null},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19,"area":null},{"id":"2102.07379","title":"On the Inherent Regularization Effects of Noise Injection During Training","created":"2021-02-15","cited_by_count":18,"area":null},{"id":"2202.03295","title":"Theoretical characterization of uncertainty in high-dimensional linear classification","created":"2022-02-07","cited_by_count":18,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2110.11805","title":"Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model","created":"2021-10-22","cited_by_count":17,"area":null},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2111.05198","title":"Harmless interpolation in regression and classification with structured features","created":"2021-11-09","cited_by_count":14,"area":null},{"id":"2101.06967","title":"On Data-Augmentation and Consistency-Based Semi-Supervised Learning","created":"2021-01-18","cited_by_count":13,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2103.05524","title":"On the interplay between data structure and loss function in classification problems","created":"2021-03-09","cited_by_count":13,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2406.03260","title":"Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers","created":"2024-06-05","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2210.07612","title":"Monotonicity and Double Descent in Uncertainty Estimation with Gaussian Processes","created":"2022-10-14","cited_by_count":11,"area":null},{"id":"2303.16880","title":"Storage and Learning phase transitions in the Random-Features Hopfield Model","created":"2023-03-29","cited_by_count":11,"area":null},{"id":"2304.02912","title":"Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach","created":"2023-04-06","cited_by_count":11,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2310.18280","title":"Universality for the global spectrum of random inner-product kernel matrices in the polynomial regime","created":"2023-10-27","cited_by_count":10,"area":null},{"id":"2106.02630","title":"Fundamental tradeoffs between memorization and robustness in random features and neural tangent regimes","created":"2021-06-04","cited_by_count":9,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2406.04657","title":"From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks","created":"2024-06-07","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2407.05658","title":"Random Features Hopfield Networks generalize retrieval to previously unseen examples","created":"2024-07-08","cited_by_count":8,"area":null},{"id":"2408.04607","title":"Risk and cross validation in ridge regression with correlated samples","created":"2024-08-08","cited_by_count":8,"area":null},{"id":"2102.06740","title":"Appearance of Random Matrix Theory in Deep Learning","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2203.05443","title":"Bias-variance decomposition of overparameterized regression with random linear features","created":"2022-03-10","cited_by_count":7,"area":null},{"id":"2211.06077","title":"Overparameterized random feature regression with nearly orthogonal data","created":"2022-11-11","cited_by_count":7,"area":null},{"id":"2402.05674","title":"A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs","created":"2024-02-08","cited_by_count":7,"area":null},{"id":"2512.22768","title":"Understanding the Mechanisms of Fast Hyperparameter Transfer","created":"2025-12-28","cited_by_count":7,"area":null},{"id":"2103.05621","title":"The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression","created":"2021-03-09","cited_by_count":6,"area":null},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2405.09535","title":"Restoring balance: principled under/oversampling of data for optimal classification","created":"2024-05-15","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2103.15996","title":"Minimum complexity interpolation in random features models","created":"2021-03-30","cited_by_count":5,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2212.06757","title":"Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures","created":"2022-12-13","cited_by_count":5,"area":null},{"id":"2306.10404","title":"The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions","created":"2023-06-17","cited_by_count":5,"area":null},{"id":"2309.07663","title":"High-dimensional Asymptotics of VAEs: Threshold of Posterior Collapse and Dataset-Size Dependence of Rate-Distortion Curve","created":"2023-09-14","cited_by_count":5,"area":null},{"id":"2602.10867","title":"Deep Learning of Compositional Targets with Hierarchical Spectral Methods","created":"2026-02-11","cited_by_count":5,"area":null},{"id":"2101.06509","title":"Phases of learning dynamics in artificial neural networks: with or without mislabeled data","created":"2021-01-16","cited_by_count":4,"area":null},{"id":"2102.03988","title":"Ising Model Selection Using $\\ell_{1}$-Regularized Linear Regression: A Statistical Mechanics Analysis","created":"2021-02-08","cited_by_count":4,"area":null},{"id":"2103.14108","title":"The Geometry of Over-parameterized Regression and Adversarial Perturbations","created":"2021-03-25","cited_by_count":4,"area":null},{"id":"2206.01332","title":"Optimal Activation Functions for the Random Features Regression Model","created":"2022-05-31","cited_by_count":4,"area":null},{"id":"2305.14689","title":"Least Squares Regression Can Exhibit Under-Parameterized Double Descent","created":"2023-05-24","cited_by_count":4,"area":null},{"id":"2404.09779","title":"A replica analysis of under-bagging","created":"2024-04-15","cited_by_count":4,"area":null},{"id":"2410.05609","title":"The Breakdown of Gaussian Universality in Classification of High-dimensional Linear Factor Mixtures","created":"2024-10-08","cited_by_count":4,"area":null},{"id":"2410.16073","title":"On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds","created":"2024-10-21","cited_by_count":4,"area":null},{"id":"2210.00583","title":"The Dynamic of Consensus in Deep Networks and the Identification of Noisy Labels","created":"2022-10-02","cited_by_count":3,"area":null},{"id":"2309.16846","title":"Optimal Nonlinearities Improve Generalization Performance of Random Features","created":"2023-09-28","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2402.04783","title":"Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2410.18858","title":"Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens","created":"2024-10-24","cited_by_count":3,"area":null},{"id":"2507.07907","title":"A statistical physics framework for optimal learning","created":"2025-07-10","cited_by_count":3,"area":null},{"id":"2206.12832","title":"Prediction Errors for Penalized Regressions based on Generalized Approximate Message Passing","created":"2022-06-26","cited_by_count":2,"area":null},{"id":"2409.20250","title":"Input-Label Correlation Governs a Linear-to-Nonlinear Transition in Random Features under Spiked Covariance","created":"2024-09-30","cited_by_count":2,"area":null},{"id":"2506.12454","title":"On the Existence of Consistent Adversarial Attacks in High-Dimensional Linear Classification","created":"2025-06-14","cited_by_count":2,"area":null},{"id":"2507.05147","title":"Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings","created":"2025-07-07","cited_by_count":2,"area":null},{"id":"2511.02625","title":"Condition Numbers and Eigenvalue Spectra of Shallow Networks on Spheres","created":"2025-11-04","cited_by_count":2,"area":null},{"id":"2605.31413","title":"Improved Guarantees for Langevin Monte Carlo with Average Smoothness","created":"2026-05-29","cited_by_count":2,"area":null},{"id":"2112.01292","title":"Optimal regularizations for data generation with probabilistic graphical models","created":"2021-12-02","cited_by_count":1,"area":null},{"id":"2310.07370","title":"Orthogonal Random Features: Explicit Forms and Sharp Inequalities","created":"2023-10-11","cited_by_count":1,"area":null},{"id":"2409.06053","title":"Statistical Mechanics of Min-Max Problems","created":"2024-09-09","cited_by_count":1,"area":null}],"next_cursor":"100"}