{"total":87,"rows":[{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143,"area":null},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2105.15004","title":"Generalization Error Rates in Kernel Regression: The Crossover from the Noiseless to Noisy Regime","created":"2021-05-31","cited_by_count":96,"area":null},{"id":"2107.04384","title":"Continual Learning in the Teacher-Student Setup: Impact of Task Similarity","created":"2021-07-09","cited_by_count":88,"area":"distill"},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63,"area":null},{"id":"2201.10469","title":"Convex Analysis of the Mean Field Langevin Dynamics","created":"2022-01-25","cited_by_count":55,"area":null},{"id":"2106.03791","title":"Learning Gaussian Mixtures with Generalised Linear Models: Precise Asymptotics in High-dimensions","created":"2021-06-07","cited_by_count":54,"area":null},{"id":"2306.07042","title":"Transformers learn through gradual rank increase","created":"2023-06-12","cited_by_count":52,"area":null},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52,"area":null},{"id":"2103.01210","title":"Quantifying the Benefit of Using Differentiable Learning over Tangent Kernels","created":"2021-03-01","cited_by_count":41,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2306.04073","title":"Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks","created":"2023-06-07","cited_by_count":35,"area":"moe"},{"id":"2309.03843","title":"Gradient-Based Feature Learning under Structured Data","created":"2023-09-07","cited_by_count":32,"area":null},{"id":"2407.01704","title":"Weight Clipping for Deep Continual and Reinforcement Learning","created":"2024-07-01","cited_by_count":29,"area":"deeprl"},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2405.20236","title":"Disentangling and Mitigating the Impact of Task Similarity for Continual Learning","created":"2024-05-30","cited_by_count":19,"area":null},{"id":"2101.01708","title":"A Priori Generalization Analysis of the Deep Ritz Method for Solving High Dimensional Elliptic Equations","created":"2021-01-05","cited_by_count":18,"area":null},{"id":"2112.05611","title":"Eigenspace Restructuring: a Principle of Space and Frequency in Neural Networks","created":"2021-12-10","cited_by_count":17,"area":null},{"id":"2410.18938","title":"A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities","created":"2024-10-24","cited_by_count":16,"area":null},{"id":"2106.03227","title":"Neural Tangent Kernel Maximum Mean Discrepancy","created":"2021-06-06","cited_by_count":15,"area":null},{"id":"2305.18502","title":"Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD","created":"2023-05-29","cited_by_count":15,"area":null},{"id":"2408.07254","title":"Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics","created":"2024-08-14","cited_by_count":15,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2105.02468","title":"Relative stability toward diffeomorphisms indicates performance in deep nets","created":"2021-05-06","cited_by_count":12,"area":null},{"id":"2403.06398","title":"On the Diminishing Returns of Width for Continual Learning","created":"2024-03-11","cited_by_count":12,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2203.11864","title":"On the (Non-)Robustness of Two-Layer Neural Networks in Different Learning Regimes","created":"2022-03-22","cited_by_count":11,"area":null},{"id":"2304.02912","title":"Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach","created":"2023-04-06","cited_by_count":11,"area":null},{"id":"2309.02028","title":"Non-Parametric Representation Learning with Kernels","created":"2023-09-05","cited_by_count":11,"area":null},{"id":"2402.05271","title":"Feature learning as alignment: a structural property of gradient descent in non-linear neural networks","created":"2024-02-07","cited_by_count":10,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2104.05785","title":"A Recipe for Global Convergence Guarantee in Deep Neural Networks","created":"2021-04-12","cited_by_count":8,"area":null},{"id":"2104.07531","title":"On Energy-Based Models with Overparametrized Shallow Neural Networks","created":"2021-04-15","cited_by_count":8,"area":null},{"id":"2107.14324","title":"Deep Networks Provably Classify Data on Curves","created":"2021-07-29","cited_by_count":6,"area":null},{"id":"2205.10772","title":"Fast Instrument Learning with Faster Rates","created":"2022-05-22","cited_by_count":6,"area":null},{"id":"2402.10164","title":"Random features and polynomial rules","created":"2024-02-15","cited_by_count":6,"area":null},{"id":"2407.13957","title":"The Group Robustness is in the Details: Revisiting Finetuning under Spurious Correlations","created":"2024-07-19","cited_by_count":6,"area":null},{"id":"2410.16201","title":"Theoretical Limitations of Ensembles in the Age of Overparameterization","created":"2024-10-21","cited_by_count":6,"area":null},{"id":"2306.10404","title":"The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions","created":"2023-06-17","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2311.07025","title":"Embarassingly Simple Dataset Distillation","created":"2023-11-13","cited_by_count":5,"area":null},{"id":"2303.02957","title":"Primal and Dual Analysis of Entropic Fictitious Play for Finite-sum Problems","created":"2023-03-06","cited_by_count":4,"area":null},{"id":"2305.14689","title":"Least Squares Regression Can Exhibit Under-Parameterized Double Descent","created":"2023-05-24","cited_by_count":4,"area":null},{"id":"2503.00856","title":"Asymptotic Analysis of Two-Layer Neural Networks after One Gradient Step under Gaussian Mixtures Data with Structure","created":"2025-03-02","cited_by_count":4,"area":null},{"id":"2210.16286","title":"A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2510.05573","title":"On the Theory of Continual Learning with Gradient Descent for Neural Networks","created":"2025-10-07","cited_by_count":3,"area":null},{"id":"2305.16508","title":"Most Neural Networks Are Almost Learnable","created":"2023-05-25","cited_by_count":2,"area":null},{"id":"2412.04785","title":"Differentially Private Random Feature Model","created":"2024-12-06","cited_by_count":2,"area":null},{"id":"2412.13526","title":"MOMA: Masked Orthogonal Matrix Alignment for Zero-Additional-Parameter Model Merging","created":"2024-12-18","cited_by_count":2,"area":null},{"id":"2502.16331","title":"A Gap Between the Gaussian RKHS and Neural Networks: An Infinite-Center Asymptotic Analysis","created":"2025-02-22","cited_by_count":2,"area":null},{"id":"2510.21078","title":"Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2103.11558","title":"Weighted Neural Tangent Kernel: A Generalized and Improved Network-Induced Kernel","created":"2021-03-22","cited_by_count":1,"area":null},{"id":"2106.05739","title":"Separation Results between Fixed-Kernel and Feature-Learning Probability Metrics","created":"2021-06-10","cited_by_count":1,"area":null},{"id":"2203.05417","title":"Deep Regression Ensembles","created":"2022-03-10","cited_by_count":1,"area":null},{"id":"2205.14553","title":"Long-Tailed Learning Requires Feature Learning","created":"2022-05-29","cited_by_count":1,"area":null},{"id":"2205.14683","title":"The impact of memory on learning sequence-to-sequence tasks","created":"2022-05-29","cited_by_count":1,"area":null},{"id":"2303.06726","title":"Global Optimality of Elman-type RNN in the Mean-Field Regime","created":"2023-03-12","cited_by_count":1,"area":null},{"id":"2401.07606","title":"RedEx: Beyond Fixed Representation Methods via Convex Optimization","created":"2024-01-15","cited_by_count":1,"area":null},{"id":"2411.12029","title":"On the Efficiency of ERM in Feature Learning","created":"2024-11-18","cited_by_count":1,"area":null},{"id":"2605.27567","title":"Why LLMs Fail at Causal Discovery and How Interventional Agents Escape","created":"2026-05-26","cited_by_count":1,"area":"lr"},{"id":"2103.03466","title":"Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change","created":"2021-03-05","cited_by_count":0,"area":null},{"id":"2103.07287","title":"Neural Networks with Complex-Valued Weights Have No Spurious Local Minima","created":"2021-01-31","cited_by_count":0,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2301.07820","title":"On the limits of neural network explainability via descrambling","created":"2023-01-18","cited_by_count":0,"area":null},{"id":"2303.14083","title":"Online Learning for the Random Feature Model in the Student-Teacher Framework","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2412.18756","title":"Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories","created":"2024-12-25","cited_by_count":0,"area":null},{"id":"2606.09853","title":"SynIB: Informational Bottleneck for Maximizing Synergy in Multimodal Learning","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2607.23397","title":"A Statistical Difference between Single-Layer Learning and Hierarchical Learning in Wide Neural Networks","created":"2026-07-26","cited_by_count":0,"area":null}],"next_cursor":null}