{"total":96,"rows":[{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187,"area":null},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95,"area":null},{"id":"2210.15651","title":"Learning Single-Index Models with Shallow Neural Networks","created":"2022-10-27","cited_by_count":92,"area":null},{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63,"area":null},{"id":"2202.00293","title":"Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks","created":"2022-02-01","cited_by_count":50,"area":null},{"id":"2102.09972","title":"Implicit Regularization in Tensor Factorization","created":"2021-02-19","cited_by_count":44,"area":null},{"id":"2302.05882","title":"From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks","created":"2023-02-12","cited_by_count":43,"area":null},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39,"area":null},{"id":"2207.06569","title":"Benign, Tempered, or Catastrophic: A Taxonomy of Overfitting","created":"2022-07-14","cited_by_count":36,"area":null},{"id":"2202.00565","title":"Data-driven emergence of convolutional structure in neural networks","created":"2022-02-01","cited_by_count":29,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2201.02115","title":"The dynamics of representation learning in shallow, non-linear autoencoders","created":"2022-01-06","cited_by_count":27,"area":null},{"id":"2304.07235","title":"Mapping of attention mechanisms to a generalized Potts model","created":"2023-04-14","cited_by_count":19,"area":null},{"id":"2304.09576","title":"Leveraging the two timescale regime to demonstrate convergence of neural networks","created":"2023-04-19","cited_by_count":19,"area":null},{"id":"2102.09449","title":"Quantum field-theoretic machine learning","created":"2021-02-18","cited_by_count":16,"area":null},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2205.09029","title":"Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation","created":"2022-05-18","cited_by_count":16,"area":null},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15,"area":null},{"id":"2409.18061","title":"Optimal Protocols for Continual Learning via Statistical Physics and Control Theory","created":"2024-09-26","cited_by_count":14,"area":null},{"id":"2410.13300","title":"A theoretical perspective on mode collapse in variational inference","created":"2024-10-17","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2302.05440","title":"Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization","created":"2023-02-10","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2310.15440","title":"Learning Dynamics in Linear VAE: Posterior Collapse Threshold, Superfluous Latent Space Pitfalls, and Speedup with KL Annealing","created":"2023-10-24","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2106.03485","title":"Redundant representations help generalization in wide neural networks","created":"2021-06-07","cited_by_count":9,"area":null},{"id":"2208.09550","title":"Sudakov-Fernique post-AMP, and a new proof of the local convexity of the TAP free energy","created":"2022-08-19","cited_by_count":9,"area":null},{"id":"2210.06088","title":"Annihilation of Spurious Minima in Two-Layer ReLU Networks","created":"2022-10-12","cited_by_count":9,"area":null},{"id":"2302.09160","title":"Identifying Equivalent Training Dynamics","created":"2023-02-17","cited_by_count":9,"area":null},{"id":"2305.06435","title":"Phase transitions in the mini-batch size for sparse and dense two-layer neural networks","created":"2023-05-10","cited_by_count":9,"area":null},{"id":"2411.08798","title":"Learning Gaussian Multi-Index Models with Gradient Flow: Time Complexity and Directional Convergence","created":"2024-11-13","cited_by_count":9,"area":null},{"id":"2110.05960","title":"Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations","created":"2021-10-11","cited_by_count":8,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2311.01644","title":"Should Under-parameterized Student Networks Copy or Average Teacher Weights?","created":"2023-11-03","cited_by_count":8,"area":null},{"id":"2405.18296","title":"Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training","created":"2024-05-28","cited_by_count":8,"area":null},{"id":"2104.14546","title":"Soft Mode in the Dynamics of Over-realizable On-line Learning for Soft Committee Machines","created":"2021-04-29","cited_by_count":7,"area":null},{"id":"2503.02526","title":"A Theory of Initialisation's Impact on Specialisation","created":"2025-03-04","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2601.22652","title":"Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval","created":"2026-01-30","cited_by_count":6,"area":null},{"id":"2101.07464","title":"Householder Dice: A Matrix-Free Algorithm for Simulating Dynamics on Gaussian and Random Orthogonal Ensembles","created":"2021-01-19","cited_by_count":5,"area":null},{"id":"2206.08558","title":"How You Start Matters for Generalization","created":"2022-06-17","cited_by_count":5,"area":null},{"id":"2211.04589","title":"Finite Sample Identification of Wide Shallow Neural Networks with Biases","created":"2022-11-08","cited_by_count":5,"area":null},{"id":"2306.10404","title":"The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions","created":"2023-06-17","cited_by_count":5,"area":null},{"id":"2312.13247","title":"Enhancing Neural Training via a Correlated Dynamics Model","created":"2023-12-20","cited_by_count":5,"area":null},{"id":"2402.06751","title":"Low-Rank Learning by Design: the Role of Network Architecture and Activation Linearity in Gradient Rank Collapse","created":"2024-02-09","cited_by_count":5,"area":null},{"id":"2505.20970","title":"Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective","created":"2025-05-27","cited_by_count":5,"area":null},{"id":"2202.04509","title":"Optimal learning rate schedules in high-dimensional non-convex optimization problems","created":"2022-02-09","cited_by_count":4,"area":null},{"id":"2310.19919","title":"Meta-Learning Strategies through Value Maximization in Neural Networks","created":"2023-10-30","cited_by_count":4,"area":null},{"id":"2510.10693","title":"High-Dimensional Learning Dynamics of Quantized Models with Straight-Through Estimator","created":"2025-10-12","cited_by_count":4,"area":null},{"id":"2201.04194","title":"Neural Capacitance: A New Perspective of Neural Network Selection via Edge Dynamics","created":"2022-01-11","cited_by_count":3,"area":null},{"id":"2202.06054","title":"Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression","created":"2022-02-12","cited_by_count":3,"area":null},{"id":"2301.10638","title":"MLPGradientFlow: going with the flow of multilayer perceptrons (and finding minima fast and accurately)","created":"2023-01-25","cited_by_count":3,"area":null},{"id":"2308.08070","title":"Max-affine regression via first-order methods","created":"2023-08-15","cited_by_count":3,"area":null},{"id":"2405.19585","title":"The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms","created":"2024-05-30","cited_by_count":3,"area":null},{"id":"2406.02157","title":"Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2407.09845","title":"Towards Understanding Epoch-wise Double descent in Two-layer Linear Neural Networks","created":"2024-07-13","cited_by_count":3,"area":null},{"id":"2506.01582","title":"Bayes optimal learning of attention-indexed models","created":"2025-06-02","cited_by_count":3,"area":null},{"id":"2507.07907","title":"A statistical physics framework for optimal learning","created":"2025-07-10","cited_by_count":3,"area":null},{"id":"2509.19773","title":"Sobolev acceleration for neural networks","created":"2025-09-24","cited_by_count":3,"area":null},{"id":"2511.18661","title":"Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data","created":"2025-11-24","cited_by_count":3,"area":null},{"id":"2512.00196","title":"Emergent Riemannian geometry over learning discrete computations on continuous manifolds","created":"2025-11-28","cited_by_count":3,"area":null},{"id":"2512.13634","title":"Universality of high-dimensional scaling limits of stochastic gradient descent","created":"2025-12-15","cited_by_count":3,"area":null},{"id":"2605.22341","title":"A Boundary-Layer Mechanism for One-Third Scaling in Online Softmax Classification","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2408.14445","title":"Symmetry & Critical Points","created":"2024-08-26","cited_by_count":2,"area":null},{"id":"2503.06181","title":"Make Haste Slowly: A Theory of Emergent Structured Mixed Selectivity in Feature Learning ReLU Networks","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2503.09781","title":"Learning richness modulates equality reasoning in neural networks","created":"2025-03-12","cited_by_count":2,"area":null},{"id":"2505.07792","title":"Analytic theory of dropout regularization","created":"2025-05-12","cited_by_count":2,"area":null},{"id":"2510.02765","title":"Curl Descent: Non-Gradient Learning Dynamics with Sign-Diverse Plasticity","created":"2025-10-03","cited_by_count":2,"area":null},{"id":"2602.02855","title":"When pre-training hurts LoRA fine-tuning: a dynamical analysis via single-index models","created":"2026-02-02","cited_by_count":2,"area":null},{"id":"2603.03993","title":"Specialization of softmax attention heads: insights from the high-dimensional single-location model","created":"2026-03-04","cited_by_count":2,"area":null},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2106.02713","title":"Learning Curves for SGD on Structured Features","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2406.06909","title":"Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit","created":"2024-06-11","cited_by_count":1,"area":null},{"id":"2501.17284","title":"Nonlinear dynamics of localization in neural receptive fields","created":"2025-01-28","cited_by_count":1,"area":null},{"id":"2511.02258","title":"Limit Theorems for Stochastic Gradient Descent in High-Dimensional Single-Layer Networks","created":"2025-11-04","cited_by_count":1,"area":null},{"id":"2601.07830","title":"Optimal Learning Rate Schedule for Balancing Effort and Performance","created":"2026-01-12","cited_by_count":1,"area":null},{"id":"2604.03068","title":"Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks","created":"2026-04-03","cited_by_count":1,"area":null},{"id":"2103.01887","title":"Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural Networks","created":"2021-03-02","cited_by_count":0,"area":null},{"id":"2106.10617","title":"Cogradient Descent for Dependable Learning","created":"2021-06-20","cited_by_count":0,"area":null},{"id":"2303.14083","title":"Online Learning for the Random Feature Model in the Student-Teacher Framework","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2406.03696","title":"Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression","created":"2024-06-06","cited_by_count":0,"area":null},{"id":"2411.03082","title":"Self-supervised cross-modality learning for uncertainty-aware object detection and recognition in applications which lack pre-labelled training data","created":"2024-11-05","cited_by_count":0,"area":null},{"id":"2505.02853","title":"A Computational Model of Inclusive Pedagogy: From Understanding to Application","created":"2025-05-02","cited_by_count":0,"area":null},{"id":"2510.19382","title":"A Derandomization Framework for Structure Discovery: Applications in Neural Networks and Beyond","created":"2025-10-22","cited_by_count":0,"area":null},{"id":"2605.01288","title":"A Theory of Saddle Escape in Deep Nonlinear Networks","created":"2026-05-02","cited_by_count":0,"area":null},{"id":"2607.10869","title":"Singular perturbations and hierarchical learning in two-layer neural networks","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2608.21561","title":"Loss-Parameterized Fisher Width Along Learning Trajectories","created":"2026-08-21","cited_by_count":0,"area":null},{"id":"2609.05126","title":"Coarse-Graining Hidden Representations: Unsupervised Neuron Selection via Mapping Entropy","created":"2026-09-04","cited_by_count":0,"area":null},{"id":"2609.29774","title":"An Analytical Theory of Auxiliary Learning","created":"2026-09-24","cited_by_count":0,"area":null},{"id":"2609.39367","title":"A Dynamical Theory of LoRA in Continual Learning","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}