{"total":54,"rows":[{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52,"area":null},{"id":"2211.11567","title":"Neural networks trained with SGD learn distributions of increasing complexity","created":"2022-11-21","cited_by_count":50,"area":null},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2103.04902","title":"Stochasticity helps to navigate rough landscapes: comparing gradient-descent-based algorithms in the phase retrieval problem","created":"2021-03-08","cited_by_count":23,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2210.02157","title":"The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks","created":"2022-10-05","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2110.11805","title":"Model, sample, and epoch-wise descents: exact solution of gradient flow in the random feature model","created":"2021-10-22","cited_by_count":17,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2208.09550","title":"Sudakov-Fernique post-AMP, and a new proof of the local convexity of the TAP free energy","created":"2022-08-19","cited_by_count":9,"area":null},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8,"area":null},{"id":"2309.04522","title":"Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics","created":"2023-09-08","cited_by_count":6,"area":null},{"id":"2403.07310","title":"How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance","created":"2024-03-12","cited_by_count":6,"area":null},{"id":"2102.11755","title":"Analytical Study of Momentum-Based Acceleration Methods in Paradigmatic High-Dimensional Non-Convex Problems","created":"2021-02-23","cited_by_count":5,"area":null},{"id":"2212.06757","title":"Gradient flow in the gaussian covariate model: exact solution of learning curves and multiple descent structures","created":"2022-12-13","cited_by_count":5,"area":null},{"id":"2202.04509","title":"Optimal learning rate schedules in high-dimensional non-convex optimization problems","created":"2022-02-09","cited_by_count":4,"area":null},{"id":"2310.19919","title":"Meta-Learning Strategies through Value Maximization in Neural Networks","created":"2023-10-30","cited_by_count":4,"area":null},{"id":"2309.04788","title":"Stochastic Gradient Descent outperforms Gradient Descent in recovering a high-dimensional signal in a glassy energy landscape","created":"2023-09-09","cited_by_count":3,"area":null},{"id":"2309.05337","title":"Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems","created":"2023-09-11","cited_by_count":3,"area":null},{"id":"2402.04751","title":"Asymptotic Dynamics of Alternating Minimization for Bilinear Regression","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2405.19585","title":"The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms","created":"2024-05-30","cited_by_count":3,"area":null},{"id":"2410.18858","title":"Bilinear Sequence Regression: A Model for Learning from Long Sequences of High-dimensional Tokens","created":"2024-10-24","cited_by_count":3,"area":null},{"id":"2507.04448","title":"Transfer Learning in Infinite Width Feature Learning Networks","created":"2025-07-06","cited_by_count":3,"area":null},{"id":"2507.07907","title":"A statistical physics framework for optimal learning","created":"2025-07-10","cited_by_count":3,"area":null},{"id":"2511.01734","title":"A Proof of Learning Rate Transfer under $\\mu$P","created":"2025-11-03","cited_by_count":3,"area":null},{"id":"2101.01571","title":"Exact solution to the random sequential dynamics of a message passing algorithm","created":"2021-01-05","cited_by_count":2,"area":null},{"id":"2204.04476","title":"High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models","created":"2022-04-09","cited_by_count":2,"area":null},{"id":"2503.06181","title":"Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2505.07792","title":"Analytic theory of dropout regularization","created":"2025-05-12","cited_by_count":2,"area":null},{"id":"2510.01930","title":"Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory","created":"2025-10-02","cited_by_count":2,"area":null},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2106.02713","title":"Learning Curves for SGD on Structured Features","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2202.08198","title":"Analysis of Random Sequential Message Passing Algorithms for Approximate Inference","created":"2022-02-16","cited_by_count":1,"area":null},{"id":"2212.09040","title":"The Underlying Correlated Dynamics in Neural Training","created":"2022-12-18","cited_by_count":1,"area":null},{"id":"2402.07626","title":"Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features","created":"2024-02-12","cited_by_count":1,"area":null},{"id":"2505.18046","title":"Learning with Restricted Boltzmann Machines: Asymptotics of AMP and GD in High Dimensions","created":"2025-05-23","cited_by_count":1,"area":null},{"id":"2605.14927","title":"Learning with Shallow Neural Networks on Cluster-Structured Features","created":"2026-05-14","cited_by_count":1,"area":null},{"id":"2608.22361","title":"Dataset Complexity Shapes Finite-Distance Loss Geometry in Neural Networks","created":"2026-08-23","cited_by_count":1,"area":null},{"id":"2307.04841","title":"Loss Dynamics of Temporal Difference Reinforcement Learning","created":"2023-07-10","cited_by_count":0,"area":null},{"id":"2311.00143","title":"Two-Stage Classifier for Campaign Negativity Detection using Axis Embeddings: A Case Study on Tweets of Political Users during 2021 Presidential Election in Iran","created":"2023-10-31","cited_by_count":0,"area":null},{"id":"2505.18535","title":"Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD","created":"2025-05-24","cited_by_count":0,"area":null},{"id":"2603.09310","title":"A Gaussian Comparison Theorem for Training Dynamics in Machine Learning","created":"2026-03-10","cited_by_count":0,"area":null},{"id":"2604.27883","title":"Decoupled Descent: Exact Test Error Tracking Via Approximate Message Passing","created":"2026-04-30","cited_by_count":0,"area":null},{"id":"2606.00309","title":"Large-scale Uncertainty Quantification for Latent Variable Models Using Subsampling Markov Chain Monte Carlo","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2606.07247","title":"Theory of learning of high-dimensional controlled non-linear dynamical systems (I): models and methods","created":"2026-06-05","cited_by_count":0,"area":null}],"next_cursor":null}