{"total":120,"rows":[{"id":"2102.02887","title":"Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training","created":"2021-02-04","cited_by_count":110,"area":null},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77,"area":null},{"id":"2206.00187","title":"DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training","created":"2022-06-01","cited_by_count":74,"area":null},{"id":"2112.07628","title":"Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time","created":"2021-12-14","cited_by_count":62,"area":null},{"id":"2302.10911","title":"Revisiting Weighted Aggregation in Federated Learning with Neural Networks","created":"2023-02-14","cited_by_count":58,"area":null},{"id":"2106.06770","title":"What can linearized neural networks actually say about generalization?","created":"2021-06-12","cited_by_count":49,"area":null},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2106.03110","title":"Asymmetric Loss Functions for Learning with Noisy Labels","created":"2021-06-06","cited_by_count":46,"area":null},{"id":"2101.09612","title":"On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths","created":"2021-01-24","cited_by_count":44,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2402.15607","title":"How Do Nonlinear Transformers Learn and Generalize in In-Context Learning?","created":"2024-02-23","cited_by_count":35,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2110.04622","title":"Does Preprocessing Help Training Over-parameterized Neural Networks?","created":"2021-10-09","cited_by_count":32,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2309.07418","title":"A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time","created":"2023-09-14","cited_by_count":30,"area":null},{"id":"2211.14227","title":"Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing","created":"2022-11-25","cited_by_count":29,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2308.12247","title":"How to Protect Copyright Data in Optimization of Large Language Models?","created":"2023-08-23","cited_by_count":26,"area":null},{"id":"2211.07844","title":"Characterizing the Spectrum of the NTK via a Power Series Expansion","created":"2022-11-15","cited_by_count":22,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2203.14577","title":"Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training?","created":"2022-03-28","cited_by_count":18,"area":null},{"id":"2101.01152","title":"Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise","created":"2021-01-04","cited_by_count":17,"area":null},{"id":"2110.05645","title":"A global convergence theory for deep ReLU implicit networks via over-parameterization","created":"2021-10-11","cited_by_count":17,"area":null},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2101.04968","title":"Learning with Gradient Descent and Weakly Convex Losses","created":"2021-01-13","cited_by_count":16,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2410.04887","title":"Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse","created":"2024-10-07","cited_by_count":16,"area":null},{"id":"2206.12802","title":"Bounding the Width of Neural Networks via Coupled Initialization -- A Worst Case Analysis","created":"2022-06-26","cited_by_count":15,"area":null},{"id":"2403.12329","title":"FedFisher: Leveraging Fisher Information for One-Shot Federated Learning","created":"2024-03-19","cited_by_count":15,"area":null},{"id":"2104.05605","title":"Understanding Overparameterization in Generative Adversarial Networks","created":"2021-04-12","cited_by_count":14,"area":null},{"id":"2108.00207","title":"The Separation Capacity of Random Neural Networks","created":"2021-07-31","cited_by_count":14,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2406.01977","title":"What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding","created":"2024-06-04","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2405.14630","title":"Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension","created":"2024-05-23","cited_by_count":13,"area":null},{"id":"2410.23169","title":"The Persistence of Neural Collapse Despite Low-Rank Bias","created":"2024-10-30","cited_by_count":13,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2307.06565","title":"Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification","created":"2023-07-13","cited_by_count":11,"area":null},{"id":"2403.19205","title":"From Activation to Initialization: Scaling Insights for Optimizing Neural Fields","created":"2024-03-28","cited_by_count":11,"area":null},{"id":"2107.10868","title":"Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time","created":"2021-07-22","cited_by_count":10,"area":null},{"id":"2205.13814","title":"Global Convergence of Over-parameterized Deep Equilibrium Models","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2210.04349","title":"Nonlinear Sufficient Dimension Reduction with a Stochastic Neural Network","created":"2022-10-09","cited_by_count":10,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2201.05319","title":"A Kernel-Expanded Stochastic Neural Network","created":"2022-01-14","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2402.05164","title":"A Resource Model For Neural Scaling Law","created":"2024-02-07","cited_by_count":9,"area":null},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2305.01134","title":"PGrad: Learning Principal Gradients For Domain Generalization","created":"2023-05-02","cited_by_count":8,"area":null},{"id":"2110.00653","title":"Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration","created":"2021-10-01","cited_by_count":7,"area":null},{"id":"2209.08399","title":"Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$","created":"2022-09-17","cited_by_count":7,"area":null},{"id":"2209.15106","title":"Restricted Strong Convexity of Deep Learning Models with Smooth Activations","created":"2022-09-29","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2308.08358","title":"Convergence of Two-Layer Regression with Nonlinear Units","created":"2023-08-16","cited_by_count":6,"area":null},{"id":"2101.02338","title":"Max-Affine Spline Insights Into Deep Network Pruning","created":"2021-01-07","cited_by_count":5,"area":null},{"id":"2110.06910","title":"On the Double Descent of Random Features Models Trained with SGD","created":"2021-10-13","cited_by_count":5,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2211.04589","title":"Finite Sample Identification of Wide Shallow Neural Networks with Biases","created":"2022-11-08","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2111.14039","title":"Generalization Performance of Empirical Risk Minimization on Over-parameterized Deep ReLU Nets","created":"2021-11-28","cited_by_count":4,"area":null},{"id":"2205.11786","title":"Transition to Linearity of General Neural Networks with Directed Acyclic Graph Architecture","created":"2022-05-24","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2503.13145","title":"High-entropy Advantage in Neural Networks' Generalizability","created":"2025-03-17","cited_by_count":4,"area":null},{"id":"2509.20829","title":"Explaining Grokking and Information Bottleneck through Neural Collapse Emergence","created":"2025-09-25","cited_by_count":4,"area":null},{"id":"2105.00262","title":"One-pass Stochastic Gradient Descent in Overparametrized Two-layer Neural Networks","created":"2021-05-01","cited_by_count":3,"area":null},{"id":"2105.12920","title":"Search Spaces for Neural Model Training","created":"2021-05-27","cited_by_count":3,"area":null},{"id":"2111.06027","title":"Theoretical Exploration of Flexible Transmitter Model","created":"2021-11-11","cited_by_count":3,"area":null},{"id":"2204.07261","title":"Convergence and Implicit Regularization Properties of Gradient Descent for Deep Residual Networks","created":"2022-04-14","cited_by_count":3,"area":null},{"id":"2210.00176","title":"A Combinatorial Perspective on the Optimization of Shallow ReLU Networks","created":"2022-10-01","cited_by_count":3,"area":null},{"id":"2301.00335","title":"Pruning Before Training May Improve Generalization, Provably","created":"2023-01-01","cited_by_count":3,"area":null},{"id":"2302.01002","title":"Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning","created":"2023-02-02","cited_by_count":3,"area":null},{"id":"2303.12981","title":"Connected Superlevel Set in (Deep) Reinforcement Learning and its Application to Minimax Theorems","created":"2023-03-23","cited_by_count":3,"area":null},{"id":"2310.03243","title":"Sparse Deep Learning for Time Series Data: Theory and Applications","created":"2023-10-05","cited_by_count":3,"area":null},{"id":"2402.04783","title":"Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2407.02827","title":"Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks","created":"2024-07-03","cited_by_count":3,"area":null},{"id":"2411.05979","title":"Variance-Aware Linear UCB with Deep Representation for Neural Contextual Bandits","created":"2024-11-08","cited_by_count":3,"area":null},{"id":"2202.03524","title":"Finite-Sum Optimization: A New Perspective for Convergence to a Global Solution","created":"2022-02-07","cited_by_count":2,"area":null},{"id":"2205.13507","title":"A Framework for Overparameterized Learning","created":"2022-05-26","cited_by_count":2,"area":null},{"id":"2206.05869","title":"On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms","created":"2022-06-13","cited_by_count":2,"area":null},{"id":"2301.00327","title":"Neural Networks with Sparse Activation Induced by Large Bias: Tighter Analysis with Bias-Generalized NTK","created":"2023-01-01","cited_by_count":2,"area":null},{"id":"2309.04860","title":"Approximation Results for Gradient Descent trained Neural Networks","created":"2023-09-09","cited_by_count":2,"area":null},{"id":"2411.02904","title":"Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression","created":"2024-11-05","cited_by_count":2,"area":null},{"id":"2504.21501","title":"Deep Learning Optimization Using Self-Adaptive Weighted Auxiliary Variables","created":"2025-04-30","cited_by_count":2,"area":null},{"id":"2111.05478","title":"SGD Through the Lens of Kolmogorov Complexity","created":"2021-11-10","cited_by_count":1,"area":null},{"id":"2201.06658","title":"Learning Neural Ranking Models Online from Implicit User Feedback","created":"2022-01-17","cited_by_count":1,"area":null},{"id":"2201.12052","title":"Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks","created":"2022-01-28","cited_by_count":1,"area":null},{"id":"2206.15058","title":"A note on Linear Bottleneck networks and their Transition to Multilinearity","created":"2022-06-30","cited_by_count":1,"area":null},{"id":"2212.02323","title":"Improved Convergence Guarantees for Shallow Neural Networks","created":"2022-12-05","cited_by_count":1,"area":null},{"id":"2302.00205","title":"Gradient Descent in Neural Networks as Sequential Learning in RKBS","created":"2023-02-01","cited_by_count":1,"area":null},{"id":"2302.11244","title":"Considering Layerwise Importance in the Lottery Ticket Hypothesis","created":"2023-02-22","cited_by_count":1,"area":null},{"id":"2402.11179","title":"Uncertainty Quantification of Graph Convolution Neural Network Models of Evolving Processes","created":"2024-02-17","cited_by_count":1,"area":null},{"id":"2405.11451","title":"Error Analysis of Three-Layer Neural Network Trained with PGD for Deep Ritz Method","created":"2024-05-19","cited_by_count":1,"area":null},{"id":"2405.11696","title":"Approximation and Gradient Descent Training with Neural Networks","created":"2024-05-19","cited_by_count":1,"area":null},{"id":"2409.11995","title":"Unraveling the Hessian: A Key to Smooth Convergence in Loss Function Landscapes","created":"2024-09-18","cited_by_count":1,"area":null},{"id":"2502.05360","title":"Curse of Dimensionality in Neural Network Optimization","created":"2025-02-07","cited_by_count":1,"area":null},{"id":"2506.24120","title":"Data Uniformity Improves Training Efficiency and More, with a Convergence Framework Beyond the NTK Regime","created":"2025-06-30","cited_by_count":1,"area":null}],"next_cursor":"100"}