{"total":79,"rows":[{"id":"2303.14186","title":"TRAK: Attributing Model Behavior at Scale","created":"2023-03-24","cited_by_count":283,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119,"area":null},{"id":"2210.15651","title":"Learning Single-Index Models with Shallow Neural Networks","created":"2022-10-27","cited_by_count":92,"area":null},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84,"area":null},{"id":"2208.02813","title":"Towards Understanding Mixture of Experts in Deep Learning","created":"2022-08-04","cited_by_count":52,"area":"moe"},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49,"area":null},{"id":"2406.01581","title":"Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit","created":"2024-06-03","cited_by_count":46,"area":null},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2309.15111","title":"SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem","created":"2023-09-26","cited_by_count":39,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2306.04073","title":"Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks","created":"2023-06-07","cited_by_count":35,"area":"moe"},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2411.02544","title":"Pretrained transformer efficiently learns low-dimensional target functions in-context","created":"2024-11-04","cited_by_count":31,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2107.12723","title":"Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel","created":"2021-07-27","cited_by_count":26,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2311.02076","title":"Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos","created":"2023-11-03","cited_by_count":22,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2209.09298","title":"Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks","created":"2022-09-19","cited_by_count":21,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2110.09771","title":"On Reward-Free RL with Kernel and Neural Function Approximations: Single-Agent MDP and Markov Game","created":"2021-10-19","cited_by_count":20,"area":null},{"id":"2206.00833","title":"Finite-Time Analysis of Entropy-Regularized Neural Natural Actor-Critic Algorithm","created":"2022-06-02","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2112.02393","title":"Optimization-Based Separations for Neural Networks","created":"2021-12-04","cited_by_count":17,"area":null},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2307.06887","title":"Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks","created":"2023-07-13","cited_by_count":16,"area":null},{"id":"2105.10065","title":"A Probabilistic Approach to Neural Network Pruning","created":"2021-05-20","cited_by_count":15,"area":null},{"id":"2107.04518","title":"Optimal Gradient-based Algorithms for Non-concave Bandit Optimization","created":"2021-07-09","cited_by_count":15,"area":null},{"id":"2206.10816","title":"Fighting Fire with Fire: Avoiding DNN Shortcuts through Priming","created":"2022-06-22","cited_by_count":15,"area":null},{"id":"2208.02789","title":"Feature selection with gradient descent on two-layer networks in low-rotation regimes","created":"2022-08-04","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2206.06426","title":"Provably Efficient Offline Reinforcement Learning with Trajectory-Wise Reward","created":"2022-06-13","cited_by_count":13,"area":"offlinerl"},{"id":"2205.15235","title":"Non-convex online learning via algorithmic equivalence","created":"2022-05-30","cited_by_count":11,"area":null},{"id":"2103.01391","title":"Sample Complexity and Overparameterization Bounds for Temporal Difference Learning with Neural Network Approximation","created":"2021-03-02","cited_by_count":10,"area":null},{"id":"2205.14818","title":"Excess Risk of Two-Layer ReLU Neural Networks in Teacher-Student Settings and its Superiority to Kernel Methods","created":"2022-05-30","cited_by_count":10,"area":"distill"},{"id":"2310.01975","title":"Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data","created":"2023-10-03","cited_by_count":10,"area":null},{"id":"2107.06466","title":"Going Beyond Linear RL: Sample Efficient Neural Function Approximation","created":"2021-07-14","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2311.13774","title":"Learning Hierarchical Polynomials with Three-Layer Neural Networks","created":"2023-11-23","cited_by_count":9,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2405.18221","title":"Recurrent Natural Policy Gradient for POMDPs","created":"2024-05-28","cited_by_count":8,"area":"deeprl"},{"id":"2209.08399","title":"Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$","created":"2022-09-17","cited_by_count":7,"area":null},{"id":"2410.10024","title":"Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods","created":"2024-10-13","cited_by_count":7,"area":null},{"id":"2109.14142","title":"On the Provable Generalization of Recurrent Neural Networks","created":"2021-09-29","cited_by_count":6,"area":null},{"id":"2110.07807","title":"Provable Regret Bounds for Deep Online Learning and Control","created":"2021-10-15","cited_by_count":6,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2305.00995","title":"Towards a Phenomenological Understanding of Neural Networks: Data","created":"2023-05-01","cited_by_count":4,"area":null},{"id":"2310.10171","title":"On permutation symmetries in Bayesian neural network posteriors: a variational perspective","created":"2023-10-16","cited_by_count":4,"area":null},{"id":"2310.05105","title":"How Graph Neural Networks Learn: Lessons from Training Dynamics","created":"2023-10-08","cited_by_count":3,"area":null},{"id":"2412.14031","title":"A Riemannian Optimization Perspective of the Gauss-Newton Method for Feedforward Neural Networks","created":"2024-12-18","cited_by_count":3,"area":null},{"id":"2509.25741","title":"Test time training enhances in-context learning of nonlinear functions","created":"2025-09-30","cited_by_count":3,"area":null},{"id":"2309.04860","title":"Approximation Results for Gradient Descent trained Neural Networks","created":"2023-09-09","cited_by_count":2,"area":null},{"id":"2302.00205","title":"Gradient Descent in Neural Networks as Sequential Learning in RKBS","created":"2023-02-01","cited_by_count":1,"area":null},{"id":"2305.13141","title":"Tight conditions for when the NTK approximation is valid","created":"2023-05-22","cited_by_count":1,"area":null},{"id":"2405.11696","title":"Approximation and Gradient Descent Training with Neural Networks","created":"2024-05-19","cited_by_count":1,"area":null},{"id":"2411.19468","title":"Learning Expressive Random Feature Models via Parametrized Activations","created":"2024-11-29","cited_by_count":1,"area":null},{"id":"2601.16514","title":"Finite-Time Analysis of Gradient Descent for Shallow Transformers","created":"2026-01-23","cited_by_count":1,"area":null},{"id":"2103.03466","title":"Unintended Effects on Adaptive Learning Rate for Training Neural Network with Output Scale Change","created":"2021-03-05","cited_by_count":0,"area":null},{"id":"2111.01166","title":"Dynamics of Local Elasticity During Training of Neural Nets","created":"2021-11-01","cited_by_count":0,"area":null},{"id":"2405.15254","title":"Novel Kernel Models and Exact Representor Theory for Neural Networks Beyond the Over-Parameterized Regime","created":"2024-05-24","cited_by_count":0,"area":null},{"id":"2411.19819","title":"GradAlign for Training-free Model Performance Inference","created":"2024-11-29","cited_by_count":0,"area":null},{"id":"2510.21245","title":"Convergence of Stochastic Gradient Langevin Dynamics in the Lazy Training Regime","created":"2025-10-24","cited_by_count":0,"area":null},{"id":"2512.15749","title":"A Special Case of Quadratic Extrapolation Under the Neural Tangent Kernel","created":"2025-12-11","cited_by_count":0,"area":null},{"id":"2512.20562","title":"Shallow Neural Networks Learn Low-Degree Spherical Polynomials with Feature Learning by Learnable Channel Attention","created":"2025-12-23","cited_by_count":0,"area":null},{"id":"2603.21062","title":"Gradient Descent with Projection Finds Over-Parameterized Neural Networks for Learning Low-Degree Polynomials with Nearly Minimax Optimal Rate","created":"2026-03-22","cited_by_count":0,"area":null},{"id":"2605.24749","title":"How Neural Reward Models Learn Features for Policy Optimization: A Single-Index Analysis","created":"2026-05-23","cited_by_count":0,"area":"alignment"},{"id":"2609.01952","title":"Convergence Theory of Knowledge Distillation in Asynchronous P2P Gossip Learning Network","created":"2026-09-01","cited_by_count":0,"area":"distill"}],"next_cursor":null}