{"total":103,"rows":[{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2211.11567","title":"Neural networks trained with SGD learn distributions of increasing complexity","created":"2022-11-21","cited_by_count":50,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2106.15427","title":"Fast Approximation of the Sliced-Wasserstein Distance Using Concentration of Random Projections","created":"2021-06-29","cited_by_count":33,"area":null},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28,"area":null},{"id":"2201.02115","title":"The dynamics of representation learning in shallow, non-linear autoencoders","created":"2022-01-06","cited_by_count":27,"area":null},{"id":"2205.06308","title":"An Equivalence Principle for the Spectrum of Random Inner-Product Kernel Matrices with Polynomial Scalings","created":"2022-05-12","cited_by_count":27,"area":null},{"id":"2205.13303","title":"Gaussian Universality of Perceptrons with Random Labels","created":"2022-05-26","cited_by_count":26,"area":null},{"id":"2302.08923","title":"Are Gaussian data all you need? Extents and limits of universality in high-dimensional generalized linear estimation","created":"2023-02-17","cited_by_count":26,"area":null},{"id":"2402.10127","title":"Nonlinear spiked covariance matrices and signal propagation in deep neural networks","created":"2024-02-15","cited_by_count":26,"area":null},{"id":"2403.08160","title":"Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime","created":"2024-03-13","cited_by_count":26,"area":null},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2302.06210","title":"Precise Asymptotic Analysis of Deep Random Feature Models","created":"2023-02-13","cited_by_count":22,"area":null},{"id":"2110.00683","title":"Learning through atypical \"phase transitions\" in overparameterized neural networks","created":"2021-10-01","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2201.13383","title":"Fluctuations, Bias, Variance & Ensemble of Learners: Exact Asymptotics for Convex Losses in High-Dimension","created":"2022-01-31","cited_by_count":19,"area":null},{"id":"2304.07235","title":"Mapping of attention mechanisms to a generalized Potts model","created":"2023-04-14","cited_by_count":19,"area":null},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19,"area":null},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19,"area":null},{"id":"2102.07379","title":"On the Inherent Regularization Effects of Noise Injection During Training","created":"2021-02-15","cited_by_count":18,"area":null},{"id":"2202.03295","title":"Theoretical characterization of uncertainty in high-dimensional linear classification","created":"2022-02-07","cited_by_count":18,"area":null},{"id":"2210.12760","title":"On double-descent in uncertainty quantification in overparametrized models","created":"2022-10-23","cited_by_count":16,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2202.04925","title":"Decomposing neural networks as mappings of correlation functions","created":"2022-02-10","cited_by_count":12,"area":null},{"id":"2301.13371","title":"Demystifying Disagreement-on-the-Line in High Dimensions","created":"2023-01-31","cited_by_count":12,"area":null},{"id":"2310.15440","title":"Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealing","created":"2023-10-24","cited_by_count":12,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2406.03260","title":"Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers","created":"2024-06-05","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2206.11124","title":"A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2206.11600","title":"Disentangling representations in Restricted Boltzmann Machines without adversaries","created":"2022-06-23","cited_by_count":11,"area":null},{"id":"2303.16880","title":"Storage and Learning phase transitions in the Random-Features Hopfield Model","created":"2023-03-29","cited_by_count":11,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2310.18280","title":"Universality for the global spectrum of random inner-product kernel matrices in the polynomial regime","created":"2023-10-27","cited_by_count":10,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2402.16770","title":"Neural population geometry and optimal coding of tasks with shared latent structure","created":"2024-02-26","cited_by_count":9,"area":null},{"id":"2406.04657","title":"From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks","created":"2024-06-07","cited_by_count":9,"area":null},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9,"area":null},{"id":"2502.01347","title":"Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization","created":"2025-02-03","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2407.05658","title":"Random Features Hopfield Networks generalize retrieval to previously unseen examples","created":"2024-07-08","cited_by_count":8,"area":null},{"id":"2102.06740","title":"Appearance of Random Matrix Theory in Deep Learning","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2211.06077","title":"Overparameterized random feature regression with nearly orthogonal data","created":"2022-11-11","cited_by_count":7,"area":null},{"id":"2402.05674","title":"A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs","created":"2024-02-08","cited_by_count":7,"area":null},{"id":"2410.17796","title":"A Comprehensive Analysis on the Learning Curve in Kernel Ridge Regression","created":"2024-10-23","cited_by_count":7,"area":null},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2410.16201","title":"Theoretical Limitations of Ensembles in the Age of Overparameterization","created":"2024-10-21","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2306.10404","title":"The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions","created":"2023-06-17","cited_by_count":5,"area":null},{"id":"2306.13185","title":"An Agnostic View on the Cost of Overfitting in (Kernel) Ridge Regression","created":"2023-06-22","cited_by_count":5,"area":null},{"id":"2309.07663","title":"High-dimensional Asymptotics of VAEs: Threshold of Posterior Collapse and Dataset-Size Dependence of Rate-Distortion Curve","created":"2023-09-14","cited_by_count":5,"area":null},{"id":"2602.10867","title":"Deep Learning of Compositional Targets with Hierarchical Spectral Methods","created":"2026-02-11","cited_by_count":5,"area":null},{"id":"2206.01332","title":"Optimal Activation Functions for the Random Features Regression Model","created":"2022-05-31","cited_by_count":4,"area":null},{"id":"2410.05609","title":"The Breakdown of Gaussian Universality in Classification of High-dimensional Linear Factor Mixtures","created":"2024-10-08","cited_by_count":4,"area":null},{"id":"2410.16073","title":"On the Geometry of Regularization in Adversarial Training: High-Dimensional Asymptotics and Generalization Bounds","created":"2024-10-21","cited_by_count":4,"area":null},{"id":"2503.00856","title":"Asymptotic Analysis of Two-Layer Neural Networks after One Gradient Step under Gaussian Mixtures Data with Structure","created":"2025-03-02","cited_by_count":4,"area":null},{"id":"2506.13139","title":"Random Matrix Theory for Deep Learning: Beyond Eigenvalues of Linear Models","created":"2025-06-16","cited_by_count":4,"area":null},{"id":"2510.10693","title":"High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator","created":"2025-10-12","cited_by_count":4,"area":null},{"id":"2204.02678","title":"Random Features Model with General Convex Regularization: A Fine Grained Analysis with Precise Asymptotic Learning Curves","created":"2022-04-06","cited_by_count":3,"area":null},{"id":"2212.13468","title":"Fundamental Limits of Two-layer Autoencoders, and Achieving Them with Gradient Methods","created":"2022-12-27","cited_by_count":3,"area":null},{"id":"2306.13255","title":"Precise Asymptotic Generalization for Multiclass Classification with Overparameterized Linear Models","created":"2023-06-23","cited_by_count":3,"area":null},{"id":"2309.16846","title":"Optimal Nonlinearities Improve Generalization Performance of Random Features","created":"2023-09-28","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2401.17269","title":"Effect of Weight Quantization on Learning Models by Typical Case Analysis","created":"2024-01-30","cited_by_count":3,"area":null},{"id":"2405.19585","title":"The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms","created":"2024-05-30","cited_by_count":3,"area":null},{"id":"2507.07907","title":"A statistical physics framework for optimal learning","created":"2025-07-10","cited_by_count":3,"area":null},{"id":"2512.13634","title":"Universality of high-dimensional scaling limits of stochastic gradient descent","created":"2025-12-15","cited_by_count":3,"area":null},{"id":"2206.12832","title":"Prediction Errors for Penalized Regressions based on Generalized Approximate Message Passing","created":"2022-06-26","cited_by_count":2,"area":null},{"id":"2405.18274","title":"Signal-Plus-Noise Decomposition of Nonlinear Spiked Random Matrix Models","created":"2024-05-28","cited_by_count":2,"area":null},{"id":"2409.20250","title":"Input-Label Correlation Governs a Linear-to-Nonlinear Transition in Random Features under Spiked Covariance","created":"2024-09-30","cited_by_count":2,"area":null},{"id":"2412.06943","title":"Entrywise application of non-linear functions on orthogonally invariant matrices","created":"2024-12-09","cited_by_count":2,"area":null},{"id":"2506.12454","title":"On the Existence of Consistent Adversarial Attacks in High-Dimensional Linear Classification","created":"2025-06-14","cited_by_count":2,"area":null},{"id":"2606.28486","title":"Spectral phase transitions and trainability in neural network learning dynamics","created":"2026-06-26","cited_by_count":2,"area":null},{"id":"2106.02713","title":"Learning Curves for SGD on Structured Features","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2205.14683","title":"The impact of memory on learning sequence-to-sequence tasks","created":"2022-05-29","cited_by_count":1,"area":null},{"id":"2310.07370","title":"Orthogonal Random Features: Explicit Forms and Sharp Inequalities","created":"2023-10-11","cited_by_count":1,"area":null},{"id":"2412.06545","title":"On How Iterative Magnitude Pruning Discovers Local Receptive Fields in Fully Connected Neural Networks","created":"2024-12-09","cited_by_count":1,"area":null},{"id":"2501.17284","title":"Nonlinear dynamics of localization in neural receptive fields","created":"2025-01-28","cited_by_count":1,"area":null},{"id":"2510.06685","title":"Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix","created":"2025-10-08","cited_by_count":1,"area":null},{"id":"2510.25753","title":"How Data Mixing Shapes In-Context Learning: Asymptotic Equivalence for Transformers with MLPs","created":"2025-10-29","cited_by_count":1,"area":null},{"id":"2604.03146","title":"Characterization of Gaussian Universality Breakdown in High-Dimensional Empirical Risk Minimization","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2605.10795","title":"Factual recall in linear associative memories: sharp asymptotics and mechanistic insights","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2608.10184","title":"The sharp SAT/UNSAT phase transition in random ellipsoid fitting","created":"2026-08-10","cited_by_count":1,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2210.04745","title":"Low-power multi-mode fiber projector overcomes shallow neural networks classifiers","created":"2022-10-10","cited_by_count":0,"area":null},{"id":"2302.07419","title":"Spatially heterogeneous learning by a deep student machine","created":"2023-02-15","cited_by_count":0,"area":null},{"id":"2504.10754","title":"auto-fpt: Automating Free Probability Theory Calculations for Machine Learning Theory","created":"2025-04-14","cited_by_count":0,"area":null},{"id":"2508.10915","title":"Insect-Wing Structured Microfluidic System for Reservoir Computing","created":"2025-08-01","cited_by_count":0,"area":null},{"id":"2510.16250","title":"One-Bit Quantization for Random Features Models","created":"2025-10-17","cited_by_count":0,"area":null},{"id":"2510.24616","title":"Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation","created":"2025-10-28","cited_by_count":0,"area":null},{"id":"2604.27883","title":"Decoupled Descent: Exact Test Error Tracking Via Approximate Message Passing","created":"2026-04-30","cited_by_count":0,"area":null}],"next_cursor":"100"}