{"total":128,"rows":[{"id":"2107.06917","title":"A Field Guide to Federated Optimization","created":"2021-07-14","cited_by_count":315,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2107.04384","title":"Continual Learning in the Teacher-Student Setup: Impact of Task Similarity","created":"2021-07-09","cited_by_count":88,"area":"distill"},{"id":"2202.05928","title":"Benign Overfitting without Linearity: Neural Network Classifiers Trained by Gradient Descent for Noisy Linear Data","created":"2022-02-11","cited_by_count":74,"area":null},{"id":"2107.03436","title":"Tensor Methods in Computer Vision and Deep Learning","created":"2021-07-07","cited_by_count":52,"area":null},{"id":"2209.09211","title":"Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold","created":"2022-09-19","cited_by_count":50,"area":null},{"id":"2402.11867","title":"LoRA Training in the NTK Regime has No Spurious Local Minima","created":"2024-02-19","cited_by_count":48,"area":null},{"id":"2210.07082","title":"Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data","created":"2022-10-13","cited_by_count":46,"area":null},{"id":"2103.05134","title":"Constrained Learning with Non-Convex Losses","created":"2021-03-08","cited_by_count":42,"area":null},{"id":"2103.06460","title":"Recent Advances on Neural Network Pruning at Initialization","created":"2021-03-11","cited_by_count":41,"area":null},{"id":"2110.15767","title":"Adversarial Robustness with Semi-Infinite Constrained Learning","created":"2021-10-29","cited_by_count":39,"area":null},{"id":"2202.01136","title":"Probabilistically Robust Learning: Balancing Average- and Worst-case Performance","created":"2022-02-02","cited_by_count":37,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2302.01186","title":"The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing","created":"2023-02-02","cited_by_count":33,"area":null},{"id":"2210.00965","title":"Green Learning: Introduction, Examples and Outlook","created":"2022-10-03","cited_by_count":30,"area":null},{"id":"2304.02840","title":"NTK-SAP: Improving neural network pruning by aligning training dynamics","created":"2023-04-06","cited_by_count":30,"area":null},{"id":"2203.03756","title":"Flat minima generalize for low-rank matrix recovery","created":"2022-03-07","cited_by_count":28,"area":null},{"id":"2303.10464","title":"SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models","created":"2023-03-18","cited_by_count":28,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2203.16462","title":"Convergence of gradient descent for deep neural networks","created":"2022-03-30","cited_by_count":24,"area":null},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23,"area":null},{"id":"2206.14373","title":"Theoretical Perspectives on Deep Learning Methods in Inverse Problems","created":"2022-06-29","cited_by_count":22,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2205.09072","title":"On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias","created":"2022-05-18","cited_by_count":21,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2311.03794","title":"On the Impact of Overparameterization on the Training of a Shallow Neural Network in High Dimensions","created":"2023-11-07","cited_by_count":21,"area":"distill"},{"id":"2108.06129","title":"Learning Transferable Parameters for Unsupervised Domain Adaptation","created":"2021-08-13","cited_by_count":19,"area":null},{"id":"2201.08514","title":"How does unlabeled data improve generalization in self-training? A one-hidden-layer theoretical analysis","created":"2022-01-21","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2310.16173","title":"On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $\\epsilon$-Greedy Exploration","created":"2023-10-24","cited_by_count":17,"area":null},{"id":"2507.12224","title":"Optimizers Qualitatively Alter Solutions And We Should Leverage This","created":"2025-07-16","cited_by_count":17,"area":null},{"id":"2305.19591","title":"Traffic Prediction using Artificial Intelligence: Review of Recent Advances and Emerging Opportunities","created":"2023-05-31","cited_by_count":16,"area":null},{"id":"2206.08756","title":"Tensor-on-Tensor Regression: Riemannian Optimization, Over-parameterization, Statistical-computational Gap, and Their Interplay","created":"2022-06-17","cited_by_count":15,"area":null},{"id":"2306.02426","title":"Resilient Constrained Learning","created":"2023-06-04","cited_by_count":15,"area":null},{"id":"2101.02429","title":"Neural Spectrahedra and Semidefinite Lifts: Global Convex Optimization of Polynomial Activation Neural Networks in Fully Polynomial-Time","created":"2021-01-07","cited_by_count":14,"area":null},{"id":"2104.05605","title":"Understanding Overparameterization in Generative Adversarial Networks","created":"2021-04-12","cited_by_count":14,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2302.01629","title":"Beyond the Universal Law of Robustness: Sharper Laws for Random Features and Neural Tangent Kernels","created":"2023-02-03","cited_by_count":13,"area":null},{"id":"2410.23169","title":"The Persistence of Neural Collapse Despite Low-Rank Bias","created":"2024-10-30","cited_by_count":13,"area":null},{"id":"2101.06309","title":"Fundamental Tradeoffs in Distributionally Adversarial Training","created":"2021-01-15","cited_by_count":12,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2103.10922","title":"Landscape analysis for shallow neural networks: complete classification of critical points for affine target functions","created":"2021-03-19","cited_by_count":11,"area":null},{"id":"2112.02668","title":"On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons","created":"2021-12-05","cited_by_count":11,"area":null},{"id":"2203.11864","title":"On the (Non-)Robustness of Two-Layer Neural Networks in Different Learning Regimes","created":"2022-03-22","cited_by_count":11,"area":null},{"id":"2205.15235","title":"Non-convex online learning via algorithmic equivalence","created":"2022-05-30","cited_by_count":11,"area":null},{"id":"2305.12100","title":"How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features","created":"2023-05-20","cited_by_count":11,"area":null},{"id":"2402.13425","title":"Investigating the Histogram Loss in Regression","created":"2024-02-20","cited_by_count":11,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2602.16340","title":"The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2306.17378","title":"Global Optimality in Bivariate Gradient-based DAG Learning","created":"2023-06-30","cited_by_count":10,"area":null},{"id":"2501.06074","title":"Geometry and Optimization of Shallow Polynomial Networks","created":"2025-01-10","cited_by_count":10,"area":"distill"},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2205.06701","title":"Knowledge Distillation Meets Open-Set Semi-Supervised Learning","created":"2022-05-13","cited_by_count":9,"area":"distill"},{"id":"2210.06088","title":"Annihilation of Spurious Minima in Two-Layer ReLU Networks","created":"2022-10-12","cited_by_count":9,"area":null},{"id":"2311.13774","title":"Learning Hierarchical Polynomials with Three-Layer Neural Networks","created":"2023-11-23","cited_by_count":9,"area":null},{"id":"2403.11844","title":"Near-Optimal Solutions of Constrained Learning Problems","created":"2024-03-18","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2101.07150","title":"Stable Recovery of Entangled Weights: Towards Robust Identification of Deep Neural Networks from Minimal Samples","created":"2021-01-18","cited_by_count":8,"area":null},{"id":"2102.02485","title":"Image Restoration by Deep Projected GSURE","created":"2021-02-04","cited_by_count":8,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2104.05785","title":"A Recipe for Global Convergence Guarantee in Deep Neural Networks","created":"2021-04-12","cited_by_count":8,"area":null},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2311.01644","title":"Should Under-parameterized Student Networks Copy or Average Teacher Weights?","created":"2023-11-03","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2112.12175","title":"Recur, Attend or Convolve? On Whether Temporal Modeling Matters for Cross-Domain Robustness in Action Recognition","created":"2021-12-22","cited_by_count":7,"area":null},{"id":"2205.13283","title":"Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks","created":"2022-05-26","cited_by_count":7,"area":null},{"id":"2403.08121","title":"Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations","created":"2024-03-12","cited_by_count":7,"area":null},{"id":"2109.14142","title":"On the Provable Generalization of Recurrent Neural Networks","created":"2021-09-29","cited_by_count":6,"area":null},{"id":"2110.07807","title":"Provable Regret Bounds for Deep Online Learning and Control","created":"2021-10-15","cited_by_count":6,"area":null},{"id":"2202.10452","title":"A Classical-Quantum Convolutional Neural Network for Detecting Pneumonia from Chest Radiographs","created":"2022-02-19","cited_by_count":6,"area":null},{"id":"2305.08813","title":"Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networks","created":"2023-05-15","cited_by_count":6,"area":null},{"id":"2402.05626","title":"Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding","created":"2024-02-08","cited_by_count":6,"area":null},{"id":"2109.10935","title":"Robust Generalization of Quadratic Neural Networks via Function Identification","created":"2021-09-22","cited_by_count":5,"area":null},{"id":"2208.02083","title":"Gradient descent provably escapes saddle points in the training of shallow ReLU networks","created":"2022-08-03","cited_by_count":5,"area":null},{"id":"2211.04589","title":"Finite Sample Identification of Wide Shallow Neural Networks with Biases","created":"2022-11-08","cited_by_count":5,"area":null},{"id":"2405.15920","title":"SF-DQN: Provable Knowledge Transfer using Successor Feature for Deep Reinforcement Learning","created":"2024-05-24","cited_by_count":5,"area":"deeprl"},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2205.05662","title":"Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis","created":"2022-05-11","cited_by_count":4,"area":null},{"id":"2210.12953","title":"Implementation of Trained Factorization Machine Recommendation System on Quantum Annealer","created":"2022-10-24","cited_by_count":4,"area":null},{"id":"2103.04557","title":"Asymptotics of Ridge Regression in Convolutional Models","created":"2021-03-08","cited_by_count":3,"area":null},{"id":"2104.11895","title":"Achieving Small Test Error in Mildly Overparameterized Neural Networks","created":"2021-04-24","cited_by_count":3,"area":null},{"id":"2208.09529","title":"Intersection of Parallels as an Early Stopping Criterion","created":"2022-08-19","cited_by_count":3,"area":null},{"id":"2304.09221","title":"Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks","created":"2023-04-18","cited_by_count":3,"area":null},{"id":"2306.08191","title":"Solving Large-scale Spatial Problems with Convolutional Neural Networks","created":"2023-06-14","cited_by_count":3,"area":null},{"id":"2306.09778","title":"Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent","created":"2023-06-16","cited_by_count":3,"area":null},{"id":"2410.04254","title":"Entity Insertion in Multilingual Linked Corpora: The Case of Wikipedia","created":"2024-10-05","cited_by_count":3,"area":null},{"id":"2506.13714","title":"Understanding Learning Invariance in Deep Linear Networks","created":"2025-06-16","cited_by_count":3,"area":null},{"id":"2509.22214","title":"A Law of Data Reconstruction for Random Features (and Beyond)","created":"2025-09-26","cited_by_count":3,"area":null},{"id":"2106.04795","title":"Nonasymptotic theory for two-layer neural networks: Beyond the bias-variance trade-off","created":"2021-06-09","cited_by_count":2,"area":null},{"id":"2201.05868","title":"Large-Scale Inventory Optimization: A Recurrent-Neural-Networks-Inspired Simulation Approach","created":"2022-01-15","cited_by_count":2,"area":null},{"id":"2206.07483","title":"Blind Estimation of a Doubly Selective OFDM Channel: A Deep Learning Algorithm and Theory","created":"2022-05-30","cited_by_count":2,"area":null},{"id":"2312.16819","title":"Hidden Minima in Two-Layer ReLU Networks","created":"2023-12-28","cited_by_count":2,"area":null},{"id":"2401.01373","title":"Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networks","created":"2023-12-29","cited_by_count":2,"area":null},{"id":"2501.02364","title":"Linearly Separable Features in Shallow Nonlinear Networks: Width Scales Polynomially with Intrinsic Data Dimension","created":"2025-01-04","cited_by_count":2,"area":null},{"id":"2505.17300","title":"Statistical Inference for Online Algorithms","created":"2025-05-22","cited_by_count":2,"area":null}],"next_cursor":"100"}