{"total":100,"rows":[{"id":"2312.10794","title":"A mathematical perspective on Transformers","created":"2023-12-17","cited_by_count":164,"area":null},{"id":"2310.17813","title":"A Spectral Condition for Feature Learning","created":"2023-10-26","cited_by_count":109,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2206.00939","title":"Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs","created":"2022-06-02","cited_by_count":76,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2102.12781","title":"Do Input Gradients Highlight Discriminative Features?","created":"2021-02-25","cited_by_count":52,"area":null},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52,"area":null},{"id":"2212.07469","title":"Learning threshold neurons via the \"edge of stability\"","created":"2022-12-14","cited_by_count":51,"area":null},{"id":"2202.00293","title":"Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks","created":"2022-02-01","cited_by_count":50,"area":null},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2410.23228","title":"Emergence of meta-stable clustering in mean-field transformer models","created":"2024-10-30","cited_by_count":39,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2405.15459","title":"Repetita Iuvant: Data Repetition Allows SGD to Learn High-Dimensional Multi-Index Functions","created":"2024-05-24","cited_by_count":37,"area":null},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2509.25040","title":"A multiscale analysis of mean-field transformers in the moderate interaction regime","created":"2025-09-29","cited_by_count":25,"area":null},{"id":"2212.03050","title":"Uniform-in-time propagation of chaos for mean field Langevin dynamics","created":"2022-12-06","cited_by_count":23,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2305.18512","title":"A Rainbow in Deep Network Black Boxes","created":"2023-05-29","cited_by_count":18,"area":null},{"id":"2509.10167","title":"The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram","created":"2025-09-12","cited_by_count":17,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15,"area":null},{"id":"2102.08373","title":"Analysis of feature learning in weight-tied autoencoders via the mean field lens","created":"2021-02-16","cited_by_count":14,"area":null},{"id":"2409.18061","title":"Optimal Protocols for Continual Learning via Statistical Physics and Control Theory","created":"2024-09-26","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2212.08791","title":"Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective","created":"2022-12-17","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2410.08194","title":"Features are fate: a theory of transfer learning in high-dimensional regression","created":"2024-10-10","cited_by_count":13,"area":null},{"id":"2502.07998","title":"Adaptive kernel predictors from feature-learning infinite limits of neural networks","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2405.15767","title":"Improved Particle Approximation Error for Mean Field Neural Networks","created":"2024-05-24","cited_by_count":12,"area":null},{"id":"2406.03260","title":"Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers","created":"2024-06-05","cited_by_count":12,"area":null},{"id":"2306.16308","title":"Gaussian random field approximation via Stein's method with applications to wide random neural networks","created":"2023-06-28","cited_by_count":11,"area":null},{"id":"2410.02348","title":"Simplicity bias and optimization threshold in two-layer ReLU networks","created":"2024-10-03","cited_by_count":11,"area":null},{"id":"2409.01832","title":"Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data","created":"2024-09-03","cited_by_count":10,"area":null},{"id":"2406.01589","title":"Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks","created":"2024-06-03","cited_by_count":9,"area":null},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9,"area":null},{"id":"2412.18283","title":"On the Local Complexity of Linear Regions in Deep ReLU Networks","created":"2024-12-24","cited_by_count":9,"area":null},{"id":"2506.02651","title":"Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks","created":"2025-06-03","cited_by_count":9,"area":null},{"id":"2106.03589","title":"Nonparametric adaptive control and prediction: theory and randomized algorithms","created":"2021-06-07","cited_by_count":8,"area":null},{"id":"2510.15262","title":"Robust Layerwise Scaling Rules by Proper Weight Decay Tuning","created":"2025-10-17","cited_by_count":8,"area":null},{"id":"2302.07125","title":"Stochastic Modified Flows, Mean-Field Limits and Dynamics of Stochastic Gradient Descent","created":"2023-02-14","cited_by_count":7,"area":null},{"id":"2402.07355","title":"Sampling from the Mean-Field Stationary Distribution","created":"2024-02-12","cited_by_count":7,"area":null},{"id":"2202.12927","title":"A blob method for inhomogeneous diffusion with applications to multi-agent control and sampling","created":"2022-02-25","cited_by_count":6,"area":null},{"id":"2304.00707","title":"High-dimensional scaling limits and fluctuations of online least-squares SGD with smooth covariance","created":"2023-04-03","cited_by_count":6,"area":null},{"id":"2410.14837","title":"Topological obstruction to the training of shallow ReLU neural networks","created":"2024-10-18","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2602.00693","title":"Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities","created":"2026-01-31","cited_by_count":6,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2406.03944","title":"Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples","created":"2024-06-06","cited_by_count":5,"area":null},{"id":"2105.00507","title":"Universal scaling laws in the gradient descent training of neural networks","created":"2021-05-02","cited_by_count":4,"area":null},{"id":"2411.15067","title":"Linear convergence of proximal descent schemes on the Wasserstein space","created":"2024-11-22","cited_by_count":4,"area":null},{"id":"2502.17405","title":"Function-Space Learning Rates","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2207.05705","title":"Conservative SPDEs as fluctuating mean field limits of stochastic gradient descent","created":"2022-07-12","cited_by_count":3,"area":null},{"id":"2210.16286","title":"A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2306.09778","title":"Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent","created":"2023-06-16","cited_by_count":3,"area":null},{"id":"2406.02157","title":"Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2411.15267","title":"Proportional infinite-width infinite-depth limit for deep linear neural networks","created":"2024-11-22","cited_by_count":3,"area":null},{"id":"2507.04448","title":"Transfer Learning in Infinite Width Feature Learning Networks","created":"2025-07-06","cited_by_count":3,"area":null},{"id":"2507.05164","title":"A Dynamical Systems Perspective on the Analysis of Neural Networks","created":"2025-07-07","cited_by_count":3,"area":null},{"id":"2510.07554","title":"Phase Diagram of Dropout for Two-Layer Neural Networks in the Mean-Field Regime","created":"2025-10-08","cited_by_count":3,"area":null},{"id":"2606.10469","title":"A Mean-Field Analysis of Multi-Head Self-Attention under Cross-Entropy Training","created":"2026-06-09","cited_by_count":3,"area":null},{"id":"2106.04795","title":"Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off","created":"2021-06-09","cited_by_count":2,"area":null},{"id":"2405.19995","title":"Symmetries in Overparametrized Neural Networks: A Mean-Field View","created":"2024-05-30","cited_by_count":2,"area":null},{"id":"2410.02132","title":"Nonuniform random feature models using derivative information","created":"2024-10-03","cited_by_count":2,"area":null},{"id":"2410.19912","title":"Simmering: Sufficient is better than optimal for training neural networks","created":"2024-10-25","cited_by_count":2,"area":null},{"id":"2502.16331","title":"A Gap Between the Gaussian RKHS and Neural Networks: An Infinite-Center Asymptotic Analysis","created":"2025-02-22","cited_by_count":2,"area":null},{"id":"2503.09781","title":"Learning richness modulates equality reasoning in neural networks","created":"2025-03-12","cited_by_count":2,"area":null},{"id":"2505.07642","title":"Convergence of Time-Averaged Mean Field Gradient Descent Dynamics for Continuous Multi-Player Zero-Sum Games","created":"2025-05-12","cited_by_count":2,"area":null},{"id":"2505.22760","title":"Non-convex entropic mean-field optimization via Best Response flow","created":"2025-05-28","cited_by_count":2,"area":null},{"id":"2605.08237","title":"Distributional Spectral Diagnostics for Localizing Grokking Transitions","created":"2026-05-07","cited_by_count":2,"area":null},{"id":"2607.03613","title":"Implicit Bias of SGD in Multivariate ReLU Networks: Effective Width Collapse","created":"2026-07-03","cited_by_count":2,"area":null},{"id":"2210.13879","title":"Proximal Mean Field Learning in Shallow Neural Networks","created":"2022-10-25","cited_by_count":1,"area":null},{"id":"2402.08948","title":"Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input","created":"2024-02-14","cited_by_count":1,"area":null},{"id":"2505.14777","title":"KO: Kinetics-inspired Neural Optimizer with PDE Simulation Approaches","created":"2025-05-20","cited_by_count":1,"area":null},{"id":"2505.22578","title":"Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2511.02258","title":"Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks","created":"2025-11-04","cited_by_count":1,"area":null},{"id":"2605.28589","title":"Thinned Mean Field Langevin Dynamics","created":"2026-05-27","cited_by_count":1,"area":null},{"id":"2606.23235","title":"A First-Order Mean Field Control Analysis of Transformer Layers under Cross-Entropy Training","created":"2026-06-22","cited_by_count":1,"area":null},{"id":"2206.03254","title":"Demystifying the Global Convergence Puzzle of Learning Over-parameterized ReLU Nets in Very High Dimensions","created":"2022-06-05","cited_by_count":0,"area":null},{"id":"2210.15323","title":"Stochastic Mirror Descent in Average Ensemble Models","created":"2022-10-27","cited_by_count":0,"area":null},{"id":"2303.14083","title":"Online Learning for the Random Feature Model in the Student-Teacher Framework","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2306.13442","title":"Minibatch training of neural network ensembles via trajectory sampling","created":"2023-06-23","cited_by_count":0,"area":null},{"id":"2501.09659","title":"Fokker-Planck to Callan-Symanzik: evolution of weight matrices under training","created":"2025-01-16","cited_by_count":0,"area":null},{"id":"2503.02129","title":"Path Regularization: A Near-Complete and Optimal Nonasymptotic Generalization Theory for Multilayer Neural Networks and Double Descent Phenomenon","created":"2025-03-03","cited_by_count":0,"area":null},{"id":"2503.10587","title":"The Spectral Bias of Shallow Neural Network Learning is Shaped by the Choice of Non-linearity","created":"2025-03-13","cited_by_count":0,"area":null},{"id":"2504.03158","title":"Accelerating Particle-based Energetic Variational Inference","created":"2025-04-04","cited_by_count":0,"area":null},{"id":"2508.04883","title":"Gaussian mixture layers for neural networks","created":"2025-08-06","cited_by_count":0,"area":null},{"id":"2601.01306","title":"Towards a Principled Muon under $\\mu\\mathsf{P}$: Ensuring Spectral Conditions throughout Training","created":"2026-01-04","cited_by_count":0,"area":null},{"id":"2605.00786","title":"Recursive Maximum Likelihood Estimation for Interacting Particle Systems using Virtual Particles","created":"2026-05-01","cited_by_count":0,"area":null},{"id":"2605.08352","title":"Convergence Analysis of Newton's Method for Neural Networks in the Overparameterized Limit","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2605.17767","title":"Feature Learning in Linear-Width Two-Layer Networks: Two vs. One Step of Gradient Descent","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2606.04048","title":"Unlocking Feature Learning in Gated Delta Networks at Scale","created":"2026-06-02","cited_by_count":0,"area":null},{"id":"2606.07247","title":"Theory of learning of high-dimensional controlled non-linear dynamical systems (I): models and methods","created":"2026-06-05","cited_by_count":0,"area":null},{"id":"2607.05735","title":"Width-Robust Learnability in Mean-Field Bayesian Neural Networks","created":"2026-07-07","cited_by_count":0,"area":null},{"id":"2607.10869","title":"Singular perturbations and hierarchical learning in two-layer neural networks","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2607.16761","title":"Dropout and Random Gradient Masking Are Asymptotically Equivalent in Large ResNets","created":"2026-07-18","cited_by_count":0,"area":null}],"next_cursor":null}