{"total":85,"rows":[{"id":"2208.06677","title":"Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models","created":"2022-08-13","cited_by_count":174,"area":null},{"id":"2411.04330","title":"Scaling Laws for Precision","created":"2024-11-07","cited_by_count":95,"area":null},{"id":"2101.09612","title":"On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths","created":"2021-01-24","cited_by_count":44,"area":null},{"id":"2104.08135","title":"Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums","created":"2021-04-16","cited_by_count":37,"area":null},{"id":"2310.12680","title":"On the Optimization and Generalization of Multi-head Attention","created":"2023-10-19","cited_by_count":37,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2305.02657","title":"On the Eigenvalue Decay Rates of a Class of Neural-Network Related Kernel Functions Defined on General Domains","created":"2023-05-04","cited_by_count":31,"area":null},{"id":"2312.15995","title":"Generalization in Kernel Regression Under Realistic Assumptions","created":"2023-12-26","cited_by_count":27,"area":null},{"id":"2211.07844","title":"Characterizing the Spectrum of the NTK via a Power Series Expansion","created":"2022-11-15","cited_by_count":22,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2209.07263","title":"Robustness in deep learning: The good (width), the bad (depth), and the ugly (initialization)","created":"2022-09-15","cited_by_count":18,"area":null},{"id":"2406.03334","title":"Reparameterization invariance in approximate Bayesian inference","created":"2024-06-05","cited_by_count":17,"area":null},{"id":"2310.18123","title":"Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling","created":"2023-10-27","cited_by_count":16,"area":null},{"id":"2107.00379","title":"On the Expected Complexity of Maxout Networks","created":"2021-07-01","cited_by_count":15,"area":null},{"id":"2107.12530","title":"Convergence of Deep ReLU Networks","created":"2021-07-27","cited_by_count":15,"area":null},{"id":"2209.07238","title":"Generalization Properties of NAS under Activation and Skip Connection Search","created":"2022-09-15","cited_by_count":14,"area":null},{"id":"2302.01629","title":"Beyond the Universal Law of Robustness: Sharper Laws for Random Features and Neural Tangent Kernels","created":"2023-02-03","cited_by_count":13,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2404.12928","title":"The Positivity of the Neural Tangent Kernel","created":"2024-04-19","cited_by_count":13,"area":null},{"id":"2405.14630","title":"Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension","created":"2024-05-23","cited_by_count":13,"area":null},{"id":"2203.07337","title":"Phenomenology of Double Descent in Finite-Width Neural Networks","created":"2022-03-14","cited_by_count":12,"area":null},{"id":"2305.12100","title":"How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features","created":"2023-05-20","cited_by_count":11,"area":null},{"id":"2305.19377","title":"Benign Overfitting in Deep Neural Networks under Lazy Training","created":"2023-05-30","cited_by_count":10,"area":null},{"id":"2310.20579","title":"Initialization Matters: Privacy-Utility Analysis of Overparameterized Neural Networks","created":"2023-10-31","cited_by_count":10,"area":null},{"id":"2203.14328","title":"On the Neural Tangent Kernel Analysis of Randomly Pruned Neural Networks","created":"2022-03-27","cited_by_count":9,"area":null},{"id":"2206.00228","title":"Lower and Upper Bounds for Numbers of Linear Regions of Graph Convolutional Networks","created":"2022-06-01","cited_by_count":9,"area":null},{"id":"2307.14531","title":"Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum","created":"2023-07-26","cited_by_count":9,"area":null},{"id":"2310.06112","title":"Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach","created":"2023-10-09","cited_by_count":9,"area":null},{"id":"2502.01347","title":"Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization","created":"2025-02-03","cited_by_count":9,"area":null},{"id":"2504.13112","title":"Hadamard product in deep learning: Introduction, Advances and Challenges","created":"2025-04-17","cited_by_count":9,"area":null},{"id":"2106.03947","title":"TENGraD: Time-Efficient Natural Gradient Descent with Exact Fisher-Block Inversion","created":"2021-06-07","cited_by_count":7,"area":null},{"id":"2107.12685","title":"On the Role of Optimization in Double Descent: A Least Squares Study","created":"2021-07-27","cited_by_count":7,"area":null},{"id":"2209.07736","title":"Extrapolation and Spectral Bias of Neural Nets with Hadamard Product: a Polynomial Net Study","created":"2022-09-16","cited_by_count":7,"area":null},{"id":"2209.15106","title":"Restricted Strong Convexity of Deep Learning Models with Smooth Activations","created":"2022-09-29","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2403.15654","title":"The Effectiveness of Local Updates for Decentralized Learning under Data Heterogeneity","created":"2024-03-23","cited_by_count":7,"area":null},{"id":"2305.08813","title":"Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networks","created":"2023-05-15","cited_by_count":6,"area":null},{"id":"2506.05249","title":"On the Convergence of Gradient Descent on Learning Transformers with Residual Connections","created":"2025-06-05","cited_by_count":6,"area":null},{"id":"2605.03601","title":"Most ReLU Networks Admit Identifiable Parameters","created":"2026-05-05","cited_by_count":6,"area":null},{"id":"2205.07463","title":"Gradient Descent Optimizes Infinite-Depth ReLU Implicit Networks with Linear Widths","created":"2022-05-16","cited_by_count":5,"area":null},{"id":"2207.09097","title":"Lazy Estimation of Variable Importance for Large Neural Networks","created":"2022-07-19","cited_by_count":5,"area":null},{"id":"2212.13848","title":"Learning Lipschitz Functions by GD-trained Shallow Overparameterized ReLU Neural Networks","created":"2022-12-28","cited_by_count":5,"area":null},{"id":"2306.01692","title":"Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths","created":"2023-06-02","cited_by_count":5,"area":null},{"id":"2402.02969","title":"Towards Understanding the Word Sensitivity of Attention Layers: A Study via Random Features","created":"2024-02-05","cited_by_count":5,"area":null},{"id":"2411.02139","title":"Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks","created":"2024-11-04","cited_by_count":5,"area":null},{"id":"2108.00259","title":"How much pre-training is enough to discover a good subnetwork?","created":"2021-07-31","cited_by_count":4,"area":null},{"id":"2108.12862","title":"Neural Network Gaussian Processes by Increasing Depth","created":"2021-08-29","cited_by_count":4,"area":null},{"id":"2205.11786","title":"Transition to Linearity of General Neural Networks with Directed Acyclic Graph Architecture","created":"2022-05-24","cited_by_count":4,"area":null},{"id":"2409.07401","title":"Convergence of continuous-time stochastic gradient descent with applications to deep neural networks","created":"2024-09-11","cited_by_count":4,"area":null},{"id":"2510.17506","title":"Convergence Rates for Gradient Descent on the Edge of Stability in Overparametrised Least Squares","created":"2025-10-20","cited_by_count":4,"area":null},{"id":"2302.01002","title":"Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning","created":"2023-02-02","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2402.04783","title":"Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2403.09889","title":"Generalization of Scaled Deep ResNets in the Mean-Field Regime","created":"2024-03-14","cited_by_count":3,"area":null},{"id":"2410.16901","title":"Bayes without Underfitting: Fully Correlated Deep Learning Posteriors via Alternating Projections","created":"2024-10-22","cited_by_count":3,"area":null},{"id":"2504.11130","title":"Divergence of Empirical Neural Tangent Kernel in Classification Problems","created":"2025-04-15","cited_by_count":3,"area":null},{"id":"2506.22429","title":"Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks","created":"2025-06-27","cited_by_count":3,"area":null},{"id":"2508.03867","title":"Constraining the outputs of ReLU neural networks","created":"2025-08-05","cited_by_count":3,"area":null},{"id":"2509.22214","title":"A Law of Data Reconstruction for Random Features (and Beyond)","created":"2025-09-26","cited_by_count":3,"area":null},{"id":"2205.13507","title":"A Framework for Overparameterized Learning","created":"2022-05-26","cited_by_count":2,"area":null},{"id":"2209.15562","title":"On the optimization and generalization of overparameterized implicit neural networks","created":"2022-09-30","cited_by_count":2,"area":null},{"id":"2311.01356","title":"Upper and lower bounds for the Lipschitz constant of random neural networks","created":"2023-11-02","cited_by_count":2,"area":null},{"id":"2405.13738","title":"Interpolation with deep neural networks with non-polynomial activations: necessary and sufficient numbers of neurons","created":"2024-05-22","cited_by_count":2,"area":null},{"id":"2410.23382","title":"Estimating Neural Network Robustness via Lipschitz Constant and Architecture Sensitivity","created":"2024-10-30","cited_by_count":2,"area":null},{"id":"2411.02904","title":"Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression","created":"2024-11-05","cited_by_count":2,"area":null},{"id":"2508.21571","title":"Convergence of Stochastic Gradient Methods for Wide Two-Layer Physics-Informed Neural Networks for the Poisson Equation","created":"2025-08-29","cited_by_count":2,"area":null},{"id":"2201.12052","title":"Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks","created":"2022-01-28","cited_by_count":1,"area":null},{"id":"2212.02323","title":"Improved Convergence Guarantees for Shallow Neural Networks","created":"2022-12-05","cited_by_count":1,"area":null},{"id":"2309.10736","title":"Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation","created":"2023-09-19","cited_by_count":1,"area":null},{"id":"2403.17467","title":"A Unified Kernel for Neural Network Learning","created":"2024-03-26","cited_by_count":1,"area":null},{"id":"2509.24544","title":"Quantitative convergence of trained single layer neural networks to Gaussian processes","created":"2025-09-29","cited_by_count":1,"area":null},{"id":"2510.10188","title":"INR-Bench: A Unified Benchmark for Implicit Neural Representations in Multi-Domain Regression and Reconstruction","created":"2025-10-11","cited_by_count":1,"area":null},{"id":"2511.05585","title":"Depth-induced NTK: Bridging Over-parameterized Neural Networks and Deep Neural Kernels","created":"2025-11-05","cited_by_count":1,"area":null},{"id":"2601.16514","title":"Finite-Time Analysis of Gradient Descent for Shallow Transformers","created":"2026-01-23","cited_by_count":1,"area":null},{"id":"2603.29824","title":"Curvature-Guided LoRA: Matching Full Fine-Tuning in Function Space","created":"2026-03-31","cited_by_count":1,"area":null},{"id":"2607.08380","title":"Dynamics of Gradient Descent with Large Step Size Near a Manifold of Flat Minima","created":"2026-07-09","cited_by_count":1,"area":null},{"id":"2112.14011","title":"To Supervise or Not: How to Effectively Learn Wireless Interference Management Models?","created":"2021-12-28","cited_by_count":0,"area":null},{"id":"2303.09216","title":"Controlled Descent Training","created":"2023-03-16","cited_by_count":0,"area":null},{"id":"2310.08176","title":"Infinite Width Graph Neural Networks for Node Regression/ Classification","created":"2023-10-12","cited_by_count":0,"area":null},{"id":"2402.02711","title":"Architectural Strategies for the optimization of Physics-Informed Neural Networks","created":"2024-02-05","cited_by_count":0,"area":null},{"id":"2506.11357","title":"Generalization Bound of Gradient Flow through Training Trajectory and Data-dependent Kernel","created":"2025-06-12","cited_by_count":0,"area":null},{"id":"2511.07272","title":"Revisiting the Neural Tangent Kernel: the role of large width and depth","created":"2025-11-10","cited_by_count":0,"area":null},{"id":"2607.10200","title":"The Differential Neural Tangent Kernel and Its Positivity","created":"2026-07-11","cited_by_count":0,"area":null},{"id":"2609.39855","title":"Dimension-Free Rank Lifting from Random Hyperplane Arrangements","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}