{"total":131,"rows":[{"id":"2303.14186","title":"TRAK: Attributing Model Behavior at Scale","created":"2023-03-24","cited_by_count":283,"area":null},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187,"area":null},{"id":"2203.08065","title":"Surrogate Gap Minimization Improves Sharpness-Aware Training","created":"2022-03-15","cited_by_count":172,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2110.05025","title":"Self-supervised Learning is More Robust to Dataset Imbalance","created":"2021-10-11","cited_by_count":123,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2112.04716","title":"DR3: Value-Based Deep Reinforcement Learning Requires Explicit Regularization","created":"2021-12-09","cited_by_count":66,"area":"offlinerl"},{"id":"2201.10469","title":"Convex Analysis of the Mean Field Langevin Dynamics","created":"2022-01-25","cited_by_count":55,"area":null},{"id":"2102.02410","title":"A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network","created":"2021-02-04","cited_by_count":47,"area":null},{"id":"2402.01258","title":"Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape","created":"2024-02-02","cited_by_count":46,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2103.15209","title":"Understanding the role of importance weighting for deep learning","created":"2021-03-28","cited_by_count":39,"area":null},{"id":"2307.11007","title":"Sharpness Minimization Algorithms Do Not Only Minimize Sharpness To Achieve Better Generalization","created":"2023-07-20","cited_by_count":39,"area":null},{"id":"2309.15111","title":"SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem","created":"2023-09-26","cited_by_count":39,"area":null},{"id":"2407.12332","title":"Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition","created":"2024-07-17","cited_by_count":36,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2305.19753","title":"The Tunnel Effect: Building Data Representations in Deep Neural Networks","created":"2023-05-31","cited_by_count":34,"area":null},{"id":"2306.03534","title":"Continual Learning in Linear Classification on Separable Data","created":"2023-06-06","cited_by_count":34,"area":null},{"id":"2310.02541","title":"Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2311.07568","title":"Feature emergence via margin maximization: case studies in algebraic tasks","created":"2023-11-13","cited_by_count":33,"area":null},{"id":"2309.03843","title":"Gradient-Based Feature Learning under Structured Data","created":"2023-09-07","cited_by_count":32,"area":null},{"id":"2102.10032","title":"Approximation and Learning with Deep Convolutional Models: a Kernel Perspective","created":"2021-02-19","cited_by_count":31,"area":null},{"id":"2211.00450","title":"Birth-death dynamics for sampling: Global convergence, approximations and their asymptotics","created":"2022-11-01","cited_by_count":30,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2202.12482","title":"Sparse Neural Additive Model: Interpretable Deep Learning with Feature Selection via Group Sparsity","created":"2022-02-25","cited_by_count":25,"area":null},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25,"area":null},{"id":"2302.10034","title":"Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron","created":"2023-02-20","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2512.05117","title":"The Universal Weight Subspace Hypothesis","created":"2025-12-04","cited_by_count":24,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2101.02533","title":"Towards Understanding Learning in Neural Networks with Linear Teachers","created":"2021-01-07","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2307.08283","title":"Complexity Matters: Rethinking the Latent Space for Generative Modeling","created":"2023-07-17","cited_by_count":19,"area":"diffusion"},{"id":"2102.12238","title":"Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm","created":"2021-02-24","cited_by_count":18,"area":null},{"id":"2208.03113","title":"On the non-universality of deep learning: quantifying the cost of symmetry","created":"2022-08-05","cited_by_count":18,"area":null},{"id":"2209.04121","title":"Fast Neural Kernel Embeddings for General Activations","created":"2022-09-09","cited_by_count":18,"area":null},{"id":"2310.01769","title":"How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization","created":"2023-10-03","cited_by_count":18,"area":null},{"id":"2101.01152","title":"Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise","created":"2021-01-04","cited_by_count":17,"area":null},{"id":"2111.06063","title":"On the Equivalence between Neural Network and Support Vector Machine","created":"2021-11-11","cited_by_count":17,"area":null},{"id":"2105.05228","title":"Global Convergence of Three-layer Neural Networks in the Mean Field Regime","created":"2021-05-11","cited_by_count":16,"area":null},{"id":"2107.04518","title":"Optimal Gradient-based Algorithms for Non-concave Bandit Optimization","created":"2021-07-09","cited_by_count":15,"area":null},{"id":"2312.00379","title":"Optimal Sample Complexity of Contrastive Learning","created":"2023-12-01","cited_by_count":15,"area":null},{"id":"2408.07254","title":"Learning Multi-Index Models with Neural Networks via Mean-Field Langevin Dynamics","created":"2024-08-14","cited_by_count":15,"area":null},{"id":"2208.02789","title":"Feature selection with gradient descent on two-layer networks in low-rotation regimes","created":"2022-08-04","cited_by_count":14,"area":null},{"id":"2505.03793","title":"LENSLLM: Unveiling Fine-Tuning Dynamics for LLM Selection","created":"2025-05-01","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2309.03800","title":"Pareto Frontiers in Neural Feature Learning: Data, Compute, Width, and Luck","created":"2023-09-07","cited_by_count":13,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2101.07833","title":"Implicit Bias of Linear RNNs","created":"2021-01-19","cited_by_count":11,"area":null},{"id":"2405.17299","title":"Simplicity Bias of Two-Layer Networks beyond Linearly Separable Data","created":"2024-05-27","cited_by_count":11,"area":null},{"id":"2309.08044","title":"How many Neurons do we need? A refined Analysis for Shallow Networks trained with Gradient Descent","created":"2023-09-14","cited_by_count":10,"area":null},{"id":"2310.01975","title":"Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data","created":"2023-10-03","cited_by_count":10,"area":null},{"id":"2410.07476","title":"Towards a unified and verified understanding of group-operation networks","created":"2024-10-09","cited_by_count":10,"area":"mechinterp"},{"id":"2107.06466","title":"Going Beyond Linear RL: Sample Efficient Neural Function Approximation","created":"2021-07-14","cited_by_count":9,"area":null},{"id":"2206.01378","title":"Regularization-wise double descent: Why it occurs and how to eliminate it","created":"2022-06-03","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2311.13774","title":"Learning Hierarchical Polynomials with Three-Layer Neural Networks","created":"2023-11-23","cited_by_count":9,"area":null},{"id":"2403.12729","title":"Posterior Uncertainty Quantification in Neural Networks using Data Augmentation","created":"2024-03-18","cited_by_count":9,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2104.05785","title":"A Recipe for Global Convergence Guarantee in Deep Neural Networks","created":"2021-04-12","cited_by_count":8,"area":null},{"id":"2104.07531","title":"On Energy-Based Models with Overparametrized Shallow Neural Networks","created":"2021-04-15","cited_by_count":8,"area":null},{"id":"2110.12141","title":"Rethinking Neural vs. Matrix-Factorization Collaborative Filtering: the Theoretical Perspectives","created":"2021-10-23","cited_by_count":8,"area":null},{"id":"2404.18769","title":"Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks","created":"2024-04-29","cited_by_count":8,"area":null},{"id":"2410.11182","title":"A Middle Path for On-Premises LLM Deployment: Preserving Privacy Without Sacrificing Model Confidentiality","created":"2024-10-15","cited_by_count":8,"area":null},{"id":"2103.13598","title":"Recent Advances in Large Margin Learning","created":"2021-03-25","cited_by_count":7,"area":null},{"id":"2112.13530","title":"Wasserstein Flow Meets Replicator Dynamics: A Mean-Field Analysis of Representation Learning in Actor-Critic","created":"2021-12-27","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2410.10024","title":"Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods","created":"2024-10-13","cited_by_count":7,"area":null},{"id":"2110.07807","title":"Provable Regret Bounds for Deep Online Learning and Control","created":"2021-10-15","cited_by_count":6,"area":null},{"id":"2205.10772","title":"Fast Instrument Learning with Faster Rates","created":"2022-05-22","cited_by_count":6,"area":null},{"id":"2206.07892","title":"Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence","created":"2022-06-16","cited_by_count":6,"area":null},{"id":"2512.06797","title":"Optimal and Diffusion Transports in Machine Learning","created":"2025-12-07","cited_by_count":6,"area":null},{"id":"2102.08868","title":"Bridging the Gap Between Adversarial Robustness and Optimization Bias","created":"2021-02-17","cited_by_count":5,"area":null},{"id":"2110.15954","title":"Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training","created":"2021-10-29","cited_by_count":5,"area":null},{"id":"2205.13799","title":"Generalization Bounds for Gradient Methods via Discrete and Continuous Prior","created":"2022-05-27","cited_by_count":5,"area":null},{"id":"2206.05317","title":"Intrinsic dimensionality and generalization properties of the $\\mathcal{R}$-norm inductive bias","created":"2022-06-10","cited_by_count":5,"area":null},{"id":"2206.08558","title":"How You Start Matters for Generalization","created":"2022-06-17","cited_by_count":5,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2410.16449","title":"Robust Feature Learning for Multi-Index Models in High Dimensions","created":"2024-10-21","cited_by_count":5,"area":null},{"id":"2502.17340","title":"Low-rank bias, weight decay, and model merging in neural networks","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2312.02470","title":"Generator Born from Classifier","created":"2023-12-05","cited_by_count":4,"area":null},{"id":"2404.10824","title":"Decoupled Weight Decay for Any $p$ Norm","created":"2024-04-16","cited_by_count":4,"area":null},{"id":"2406.02105","title":"Can Kernel Methods Explain How the Data Affects Neural Collapse?","created":"2024-06-04","cited_by_count":4,"area":null},{"id":"2104.11895","title":"Achieving Small Test Error in Mildly Overparameterized Neural Networks","created":"2021-04-24","cited_by_count":3,"area":null},{"id":"2110.03673","title":"Tighter Sparse Approximation Bounds for ReLU Neural Networks","created":"2021-10-07","cited_by_count":3,"area":null},{"id":"2210.16286","title":"A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2301.00335","title":"Pruning Before Training May Improve Generalization, Provably","created":"2023-01-01","cited_by_count":3,"area":null},{"id":"2309.09258","title":"Global Convergence of SGD For Logistic Loss on Two Layer Neural Nets","created":"2023-09-17","cited_by_count":3,"area":null},{"id":"2403.09889","title":"Generalization of Scaled Deep ResNets in the Mean-Field Regime","created":"2024-03-14","cited_by_count":3,"area":null},{"id":"2404.14875","title":"Regularized Gauss-Newton for Optimizing Overparameterized Neural Networks","created":"2024-04-23","cited_by_count":3,"area":null},{"id":"2503.11272","title":"When Do Transformers Outperform Feedforward and Recurrent Networks? A Statistical Perspective","created":"2025-03-14","cited_by_count":3,"area":null},{"id":"2507.20853","title":"Geometry of Neural Reinforcement Learning in Continuous State and Action Spaces","created":"2025-07-28","cited_by_count":3,"area":"deeprl"},{"id":"2510.05573","title":"On the Theory of Continual Learning with Gradient Descent for Neural Networks","created":"2025-10-07","cited_by_count":3,"area":null}],"next_cursor":"100"}