{"total":84,"rows":[{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2202.14026","title":"Robust Training under Label Noise by Over-parameterization","created":"2022-02-28","cited_by_count":93,"area":null},{"id":"2102.00931","title":"Information-Theoretic Generalization Bounds for Stochastic Gradient Descent","created":"2021-02-01","cited_by_count":84,"area":null},{"id":"2106.15013","title":"Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction","created":"2021-06-28","cited_by_count":78,"area":null},{"id":"2103.01550","title":"Label-Imbalanced and Group-Sensitive Classification under Overparameterization","created":"2021-03-02","cited_by_count":74,"area":null},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74,"area":null},{"id":"2211.12316","title":"Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions","created":"2022-11-22","cited_by_count":70,"area":null},{"id":"2306.13596","title":"Max-Margin Token Selection in Attention Mechanism","created":"2023-06-23","cited_by_count":58,"area":null},{"id":"2201.12760","title":"Implicit Regularization Towards Rank Minimization in ReLU Networks","created":"2022-01-30","cited_by_count":53,"area":null},{"id":"2102.09972","title":"Implicit Regularization in Tensor Factorization","created":"2021-02-19","cited_by_count":44,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2302.01186","title":"The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing","created":"2023-02-02","cited_by_count":33,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2201.11729","title":"Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks","created":"2022-01-27","cited_by_count":27,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2306.02601","title":"Aiming towards the minimizers: fast convergence of SGD for overparametrized problems","created":"2023-06-05","cited_by_count":22,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2106.01101","title":"Learning a Single Neuron with Bias Using Gradient Descent","created":"2021-06-02","cited_by_count":17,"area":null},{"id":"2110.08532","title":"Pro-KD: Progressive Distillation by Following the Footsteps of the Teacher","created":"2021-10-16","cited_by_count":17,"area":null},{"id":"2406.03334","title":"Reparameterization invariance in approximate Bayesian inference","created":"2024-06-05","cited_by_count":17,"area":null},{"id":"2402.19262","title":"Masks, Signs, And Learning Rate Rewinding","created":"2024-02-29","cited_by_count":15,"area":null},{"id":"2104.05605","title":"Understanding Overparameterization in Generative Adversarial Networks","created":"2021-04-12","cited_by_count":14,"area":null},{"id":"2104.14132","title":"Generalization Guarantees for Neural Architecture Search with Train-Validation Split","created":"2021-04-29","cited_by_count":14,"area":null},{"id":"2108.00207","title":"The Separation Capacity of Random Neural Networks","created":"2021-07-31","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2202.08064","title":"Learning a Single Neuron for Non-monotonic Activation Functions","created":"2022-02-16","cited_by_count":13,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2105.06569","title":"The Dynamics of Gradient Descent for Overparametrized Neural Networks","created":"2021-05-13","cited_by_count":11,"area":null},{"id":"2112.02668","title":"On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons","created":"2021-12-05","cited_by_count":11,"area":null},{"id":"2206.11872","title":"Provable Acceleration of Heavy Ball beyond Quadratics for a Class of Polyak-\\L{}ojasiewicz Functions when the Non-Convexity is Averaged-Out","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2210.05956","title":"Towards Theoretically Inspired Neural Initialization Optimization","created":"2022-10-12","cited_by_count":11,"area":null},{"id":"2305.12100","title":"How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features","created":"2023-05-20","cited_by_count":11,"area":null},{"id":"2408.16939","title":"Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning","created":"2024-08-29","cited_by_count":11,"area":null},{"id":"2103.01391","title":"Sample Complexity and Overparameterization Bounds for Temporal Difference Learning with Neural Network Approximation","created":"2021-03-02","cited_by_count":10,"area":null},{"id":"2209.10675","title":"A Validation Approach to Over-parameterized Matrix and Image Recovery","created":"2022-09-21","cited_by_count":8,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2106.14749","title":"A Theory-Driven Self-Labeling Refinement Method for Contrastive Representation Learning","created":"2021-06-28","cited_by_count":7,"area":null},{"id":"2203.09413","title":"Stability and Risk Bounds of Iterative Hard Thresholding","created":"2022-03-17","cited_by_count":7,"area":null},{"id":"2410.10024","title":"Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods","created":"2024-10-13","cited_by_count":7,"area":null},{"id":"2302.07851","title":"Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization","created":"2023-02-15","cited_by_count":6,"area":null},{"id":"2310.00176","title":"Universality of max-margin classifiers","created":"2023-09-29","cited_by_count":6,"area":null},{"id":"2206.08558","title":"How You Start Matters for Generalization","created":"2022-06-17","cited_by_count":5,"area":null},{"id":"2301.08117","title":"Convergence beyond the over-parameterized regime using Rayleigh quotients","created":"2023-01-19","cited_by_count":5,"area":null},{"id":"2306.02422","title":"A Generalized Alternating Method for Bilevel Learning under the Polyak-{\\L}ojasiewicz Condition","created":"2023-06-04","cited_by_count":5,"area":null},{"id":"2103.04557","title":"Asymptotics of Ridge Regression in Convolutional Models","created":"2021-03-08","cited_by_count":3,"area":null},{"id":"2305.13471","title":"Fast Convergence in Learning Two-Layer Neural Networks with Separable Data","created":"2023-05-22","cited_by_count":3,"area":null},{"id":"2306.09778","title":"Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent","created":"2023-06-16","cited_by_count":3,"area":null},{"id":"2309.12128","title":"Convergence and Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems","created":"2023-09-21","cited_by_count":3,"area":null},{"id":"2311.05061","title":"Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics","created":"2023-11-08","cited_by_count":3,"area":null},{"id":"2205.13507","title":"A Framework for Overparameterized Learning","created":"2022-05-26","cited_by_count":2,"area":null},{"id":"2303.11265","title":"Convergence Guarantees of Overparametrized Wide Deep Inverse Prior","created":"2023-03-20","cited_by_count":2,"area":null},{"id":"2405.07083","title":"Data-Efficient and Robust Task Selection for Meta-Learning","created":"2024-05-11","cited_by_count":2,"area":null},{"id":"2202.12831","title":"Benchmark Assessment for DeepSpeed Optimization Library","created":"2022-02-12","cited_by_count":1,"area":null},{"id":"2302.09526","title":"Mixed Semi-Supervised Generalized-Linear-Regression with Applications to Deep-Learning and Interpolators","created":"2023-02-19","cited_by_count":1,"area":null},{"id":"2304.00459","title":"Fast Convergence of Random Reshuffling under Over-Parameterization and the Polyak-\\L ojasiewicz Condition","created":"2023-04-02","cited_by_count":1,"area":null},{"id":"2403.05395","title":"Recovery Guarantees of Unsupervised Neural Networks for Inverse Problems trained with Gradient Descent","created":"2024-03-08","cited_by_count":1,"area":null},{"id":"2508.03002","title":"Where and How to Enhance: Discovering Bit-Width Contribution for Mixed Precision Quantization","created":"2025-08-05","cited_by_count":1,"area":null},{"id":"2601.22409","title":"Optimization, Generalization and Differential Privacy Bounds for Gradient Descent on Kolmogorov-Arnold Networks","created":"2026-01-29","cited_by_count":1,"area":null},{"id":"2603.13872","title":"On Interpolation Formulas Describing Neural Network Generalization","created":"2026-03-14","cited_by_count":1,"area":null},{"id":"2606.04476","title":"When Both Layers Learn: Training Dynamics of Representing Linear Models via ReLU Networks","created":"2026-06-03","cited_by_count":1,"area":null},{"id":"2609.25705","title":"On the Gradient Heterogeneity Dynamics of Adversarially Robust Federated Regression","created":"2026-09-22","cited_by_count":1,"area":null},{"id":"2102.00853","title":"Painless step size adaptation for SGD","created":"2021-02-01","cited_by_count":0,"area":null},{"id":"2102.13333","title":"Layer-Wise Interpretation of Deep Neural Networks Using Identity Initialization","created":"2021-02-26","cited_by_count":0,"area":null},{"id":"2104.02578","title":"Neurons learn slower than they think","created":"2021-04-02","cited_by_count":0,"area":null},{"id":"2210.07100","title":"Dissipative residual layers for unsupervised implicit parameterization of data manifolds","created":"2022-10-13","cited_by_count":0,"area":null},{"id":"2303.14244","title":"Implicit Balancing and Regularization: Generalization and Convergence Guarantees for Overparameterized Asymmetric Matrix Sensing","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2404.02378","title":"Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation","created":"2024-04-03","cited_by_count":0,"area":null},{"id":"2405.13787","title":"Disentangle Sample Size and Initialization Effect on Perfect Generalization for Single-Neuron Target","created":"2024-05-22","cited_by_count":0,"area":null},{"id":"2406.03824","title":"Predictability Analysis of Regression Problems via Conditional Entropy Estimations","created":"2024-06-06","cited_by_count":0,"area":null},{"id":"2410.10984","title":"Data-Aware Training Quality Monitoring and Certification for Reliable Deep Learning","created":"2024-10-14","cited_by_count":0,"area":null},{"id":"2410.15155","title":"On the Convergence Theory of Pipeline Gradient-based Analog In-memory Training","created":"2024-10-19","cited_by_count":0,"area":null},{"id":"2411.05771","title":"Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems","created":"2024-11-08","cited_by_count":0,"area":null},{"id":"2506.02986","title":"Implicit Regularization of the Deep Inverse Prior Trained with Inertia","created":"2025-06-03","cited_by_count":0,"area":null},{"id":"2511.01605","title":"The Optimization Landscape of Carath\\'eodory Decomposition of Toeplitz Covariances","created":"2025-11-03","cited_by_count":0,"area":null},{"id":"2602.06208","title":"Emergent Low-Rank Training Dynamics in MLPs with Smooth Activations","created":"2026-02-05","cited_by_count":0,"area":null},{"id":"2602.20078","title":"Descent-Guided Policy Gradient for Scalable Cooperative Multi-Agent Learning","created":"2026-02-23","cited_by_count":0,"area":null},{"id":"2602.22644","title":"Plug, Play, and Fortify: A Low-Cost Module for Robust Multimodal Image Understanding Models","created":"2026-02-26","cited_by_count":0,"area":null},{"id":"2603.10485","title":"Dual Space Preconditioning for Gradient Descent in the Overparameterized Regime","created":"2026-03-11","cited_by_count":0,"area":null},{"id":"2604.00505","title":"Towards Initialization-dependent and Non-vacuous Generalization Bounds for Overparameterized Shallow Neural Networks","created":"2026-04-01","cited_by_count":0,"area":null},{"id":"2605.17606","title":"The Neural Tangent Kernel for Classification","created":"2026-05-17","cited_by_count":0,"area":null},{"id":"2606.26125","title":"Geometric Fairness-Aware Routing for Federated Edge Networks","created":"2026-05-31","cited_by_count":0,"area":null},{"id":"2609.32962","title":"Clipped or Unclipped? Finite-Sample Trade-offs for Averaged SGD under Heavy-Tailed Noise","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":null}