{"total":137,"rows":[{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2112.08304","title":"On the Convergence and Robustness of Adversarial Training","created":"2021-12-15","cited_by_count":130,"area":null},{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128,"area":null},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110,"area":null},{"id":"2102.02887","title":"Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training","created":"2021-02-04","cited_by_count":110,"area":null},{"id":"2102.13219","title":"Learning with invariances in random features and kernel models","created":"2021-02-25","cited_by_count":89,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57,"area":null},{"id":"2105.09513","title":"Deep Kronecker neural networks: A general framework for neural networks with adaptive activation functions","created":"2021-05-20","cited_by_count":49,"area":null},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49,"area":null},{"id":"2402.11867","title":"LoRA Training in the NTK Regime has No Spurious Local Minima","created":"2024-02-19","cited_by_count":48,"area":null},{"id":"2204.11326","title":"Beyond the Quadratic Approximation: the Multiscale Structure of Neural Network Loss Landscapes","created":"2022-04-24","cited_by_count":43,"area":null},{"id":"2105.14573","title":"Embedding Principle of Loss Landscape of Deep Neural Networks","created":"2021-05-30","cited_by_count":38,"area":null},{"id":"2102.07346","title":"On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers","created":"2021-02-15","cited_by_count":35,"area":null},{"id":"2402.15926","title":"Large Stepsize Gradient Descent for Logistic Loss: Non-Monotonicity of the Loss Improves Optimization Efficiency","created":"2024-02-24","cited_by_count":35,"area":null},{"id":"2106.05932","title":"Early-stopped neural networks are consistent","created":"2021-06-10","cited_by_count":34,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2106.07880","title":"Scaling Neural Tangent Kernels via Sketching and Random Features","created":"2021-06-15","cited_by_count":32,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2111.15527","title":"Embedding Principle: a hierarchical structure of loss landscape of deep neural networks","created":"2021-11-30","cited_by_count":22,"area":null},{"id":"2211.07844","title":"Characterizing the Spectrum of the NTK via a Power Series Expansion","created":"2022-11-15","cited_by_count":22,"area":null},{"id":"2106.13792","title":"Proxy Convexity: A Unified Framework for the Analysis of Neural Networks Trained by Gradient Descent","created":"2021-06-25","cited_by_count":21,"area":null},{"id":"2111.08308","title":"Learning with convolution and pooling operations in kernel methods","created":"2021-11-16","cited_by_count":21,"area":null},{"id":"2209.09298","title":"Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks","created":"2022-09-19","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2101.01152","title":"Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise","created":"2021-01-04","cited_by_count":17,"area":null},{"id":"2110.05645","title":"A global convergence theory for deep ReLU implicit networks via over-parameterization","created":"2021-10-11","cited_by_count":17,"area":null},{"id":"2112.05611","title":"Eigenspace Restructuring: a Principle of Space and Frequency in Neural Networks","created":"2021-12-10","cited_by_count":17,"area":null},{"id":"2205.12101","title":"Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2101.04968","title":"Learning with Gradient Descent and Weakly Convex Losses","created":"2021-01-13","cited_by_count":16,"area":null},{"id":"2105.05228","title":"Global Convergence of Three-layer Neural Networks in the Mean Field Regime","created":"2021-05-11","cited_by_count":16,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2307.06887","title":"Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks","created":"2023-07-13","cited_by_count":16,"area":null},{"id":"2106.03227","title":"Neural Tangent Kernel Maximum Mean Discrepancy","created":"2021-06-06","cited_by_count":15,"area":null},{"id":"2305.12467","title":"Understanding Multi-phase Optimization Dynamics and Rich Nonlinear Behaviors of ReLU Networks","created":"2023-05-21","cited_by_count":15,"area":null},{"id":"2102.09924","title":"A proof of convergence for gradient descent in the training of artificial neural networks for constant target functions","created":"2021-02-19","cited_by_count":14,"area":null},{"id":"2103.03113","title":"Towards Deepening Graph Neural Networks: A GNTK-based Optimization Perspective","created":"2021-03-03","cited_by_count":14,"area":null},{"id":"2104.14132","title":"Generalization Guarantees for Neural Architecture Search with Train-Validation Split","created":"2021-04-29","cited_by_count":14,"area":null},{"id":"2306.13853","title":"A Unified Approach to Controlling Implicit Regularization via Mirror Descent","created":"2023-06-24","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2111.08922","title":"Traversing the Local Polytopes of ReLU Neural Networks: A Unified Approach for Network Verification","created":"2021-11-17","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12,"area":null},{"id":"2101.07833","title":"Implicit Bias of Linear RNNs","created":"2021-01-19","cited_by_count":11,"area":null},{"id":"2102.09671","title":"When Are Solutions Connected in Deep Networks?","created":"2021-02-18","cited_by_count":11,"area":null},{"id":"2112.02668","title":"On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons","created":"2021-12-05","cited_by_count":11,"area":null},{"id":"2205.15235","title":"Non-convex online learning via algorithmic equivalence","created":"2022-05-30","cited_by_count":11,"area":null},{"id":"2402.03625","title":"Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time","created":"2024-02-06","cited_by_count":11,"area":null},{"id":"2110.12122","title":"Quantifying Epistemic Uncertainty in Deep Learning","created":"2021-10-23","cited_by_count":10,"area":null},{"id":"2205.13814","title":"Global Convergence of Over-parameterized Deep Equilibrium Models","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2310.08425","title":"Differentially Private Non-convex Learning for Multi-layer Neural Networks","created":"2023-10-12","cited_by_count":10,"area":null},{"id":"2104.00277","title":"A proof of convergence for stochastic gradient descent in the training of artificial neural networks with ReLU activation for constant target functions","created":"2021-04-01","cited_by_count":9,"area":null},{"id":"2107.06466","title":"Going Beyond Linear RL: Sample Efficient Neural Function Approximation","created":"2021-07-14","cited_by_count":9,"area":null},{"id":"2112.07369","title":"Convergence proof for stochastic gradient descent in the training of deep neural networks with ReLU activation for constant target functions","created":"2021-12-13","cited_by_count":9,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2104.05785","title":"A Recipe for Global Convergence Guarantee in Deep Neural Networks","created":"2021-04-12","cited_by_count":8,"area":null},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2110.00653","title":"Sparse Deep Learning: A New Framework Immune to Local Traps and Miscalibration","created":"2021-10-01","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2110.07807","title":"Provable Regret Bounds for Deep Online Learning and Control","created":"2021-10-15","cited_by_count":6,"area":null},{"id":"2203.05104","title":"Transition to Linearity of Wide Neural Networks is an Emerging Property of Assembling Weak Models","created":"2022-03-10","cited_by_count":6,"area":null},{"id":"2203.08961","title":"On the Convergence of Certified Robust Training with Interval Bound Propagation","created":"2022-03-16","cited_by_count":5,"area":null},{"id":"2205.07463","title":"Gradient Descent Optimizes Infinite-Depth ReLU Implicit Networks with Linear Widths","created":"2022-05-16","cited_by_count":5,"area":null},{"id":"2206.02139","title":"Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks","created":"2022-06-05","cited_by_count":5,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2211.04589","title":"Finite Sample Identification of Wide Shallow Neural Networks with Biases","created":"2022-11-08","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2406.03944","title":"Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples","created":"2024-06-06","cited_by_count":5,"area":null},{"id":"2410.23610","title":"Global Convergence in Training Large-Scale Transformers","created":"2024-10-31","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2109.08282","title":"AdaLoss: A computationally-efficient and provably convergent adaptive gradient method","created":"2021-09-17","cited_by_count":4,"area":null},{"id":"2309.06195","title":"Optimization Guarantees of Unfolded ISTA and ADMM Networks With Smooth Soft-Thresholding","created":"2023-09-12","cited_by_count":4,"area":null},{"id":"2402.05696","title":"Fixed width treelike neural networks capacity analysis -- generic activations","created":"2024-02-08","cited_by_count":4,"area":null},{"id":"2505.23489","title":"SGD as Free Energy Minimization: A Thermodynamic View on Neural Network Training","created":"2025-05-29","cited_by_count":4,"area":null},{"id":"2103.04557","title":"Asymptotics of Ridge Regression in Convolutional Models","created":"2021-03-08","cited_by_count":3,"area":null},{"id":"2209.15265","title":"Overparameterized ReLU Neural Networks Learn the Simplest Models: Neural Isometry and Exact Recovery","created":"2022-09-30","cited_by_count":3,"area":null},{"id":"2312.08244","title":"Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper bounds","created":"2023-12-13","cited_by_count":3,"area":null},{"id":"2312.08257","title":"\\emph{Lifted} RDT based capacity analysis of the 1-hidden layer treelike \\emph{sign} perceptrons neural networks","created":"2023-12-13","cited_by_count":3,"area":null},{"id":"2404.14875","title":"Regularized Gauss-Newton for Optimizing Overparameterized Neural Networks","created":"2024-04-23","cited_by_count":3,"area":null},{"id":"2510.02779","title":"Optimal Rates for Generalization of Gradient Descent for Deep ReLU Classification","created":"2025-10-03","cited_by_count":3,"area":null},{"id":"2102.13522","title":"Experiments with Rich Regime Training for Deep Learning","created":"2021-02-26","cited_by_count":2,"area":null},{"id":"2111.12963","title":"Error Bounds for a Matrix-Vector Product Approximation with Deep ReLU Neural Networks","created":"2021-11-25","cited_by_count":2,"area":null},{"id":"2202.03524","title":"Finite-Sum Optimization: A New Perspective for Convergence to a Global Solution","created":"2022-02-07","cited_by_count":2,"area":null},{"id":"2206.05869","title":"On the Convergence to a Global Solution of Shuffling-Type Gradient Algorithms","created":"2022-06-13","cited_by_count":2,"area":null},{"id":"2206.07483","title":"Blind Estimation of a Doubly Selective OFDM Channel: A Deep Learning Algorithm and Theory","created":"2022-05-30","cited_by_count":2,"area":null},{"id":"2312.17007","title":"On the rate of convergence of an over-parametrized Transformer classifier learned by gradient descent","created":"2023-12-28","cited_by_count":2,"area":null},{"id":"2402.11942","title":"The effect of Leaky ReLUs on the training and generalization of overparameterized networks","created":"2024-02-19","cited_by_count":2,"area":null},{"id":"2510.01943","title":"Smooth Quasar-Convex Optimization with Constraints","created":"2025-10-02","cited_by_count":2,"area":null}],"next_cursor":"100"}