{"total":93,"rows":[{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2107.03436","title":"Tensor Methods in Computer Vision and Deep Learning","created":"2021-07-07","cited_by_count":52,"area":null},{"id":"2402.11867","title":"LoRA Training in the NTK Regime has No Spurious Local Minima","created":"2024-02-19","cited_by_count":48,"area":null},{"id":"2101.08366","title":"Quadratic Residual Networks: A New Class of Neural Networks for Solving Forward and Inverse Problems in Physics Involving PDEs","created":"2021-01-20","cited_by_count":43,"area":null},{"id":"2201.08025","title":"Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape","created":"2022-01-20","cited_by_count":39,"area":null},{"id":"2203.05071","title":"On the influence of over-parameterization in manifold based surrogates and deep neural operators","created":"2022-03-09","cited_by_count":29,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2110.05518","title":"Global Optimality Beyond Two Layers: Training Deep ReLU Networks via Convex Programs","created":"2021-10-11","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2208.05072","title":"Interpretable Polynomial Neural Ordinary Differential Equations","created":"2022-08-09","cited_by_count":24,"area":null},{"id":"2408.03733","title":"Bayes-optimal learning of an extensive-width neural network from quadratically many samples","created":"2024-08-07","cited_by_count":23,"area":null},{"id":"2110.02479","title":"Exponentially Many Local Minima in Quantum Neural Networks","created":"2021-10-06","cited_by_count":22,"area":null},{"id":"2402.03864","title":"The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks","created":"2024-02-06","cited_by_count":21,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2110.06081","title":"On Expressivity and Trainability of Quadratic Networks","created":"2021-10-12","cited_by_count":19,"area":null},{"id":"2202.13473","title":"The Spectral Bias of Polynomial Neural Networks","created":"2022-02-27","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2303.01052","title":"Demystifying Causal Features on Adversarial Examples and Causal Inoculation for Robust Network by Adversarial Instrumental Variable Regression","created":"2023-03-02","cited_by_count":18,"area":null},{"id":"2101.02429","title":"Neural Spectrahedra and Semidefinite Lifts: Global Convex Optimization of Polynomial Activation Neural Networks in Fully Polynomial-Time","created":"2021-01-07","cited_by_count":14,"area":null},{"id":"2110.09548","title":"Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks","created":"2021-10-18","cited_by_count":14,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2103.10922","title":"Landscape analysis for shallow neural networks: complete classification of critical points for affine target functions","created":"2021-03-19","cited_by_count":11,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2602.16340","title":"The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2107.10868","title":"Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time","created":"2021-07-22","cited_by_count":10,"area":null},{"id":"2202.06233","title":"The Sample Complexity of One-Hidden-Layer Neural Networks","created":"2022-02-13","cited_by_count":10,"area":null},{"id":"2504.13112","title":"Hadamard product in deep learning: Introduction, Advances and Challenges","created":"2025-04-17","cited_by_count":9,"area":null},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2205.13283","title":"Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks","created":"2022-05-26","cited_by_count":7,"area":null},{"id":"2109.14142","title":"On the Provable Generalization of Recurrent Neural Networks","created":"2021-09-29","cited_by_count":6,"area":null},{"id":"2402.02287","title":"Future Directions in the Theory of Graph Machine Learning","created":"2024-02-03","cited_by_count":6,"area":null},{"id":"2402.05626","title":"Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding","created":"2024-02-08","cited_by_count":6,"area":null},{"id":"2410.01779","title":"Composing Global Solutions to Reasoning Tasks via Algebraic Objects in Neural Nets","created":"2024-10-02","cited_by_count":6,"area":null},{"id":"2107.09532","title":"Estimation of a regression function on a manifold by fully connected deep neural networks","created":"2021-07-20","cited_by_count":5,"area":null},{"id":"2109.10935","title":"Robust Generalization of Quadratic Neural Networks via Function Identification","created":"2021-09-22","cited_by_count":5,"area":null},{"id":"2208.02083","title":"Gradient descent provably escapes saddle points in the training of shallow ReLU networks","created":"2022-08-03","cited_by_count":5,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2305.16475","title":"Initialization-Dependent Sample Complexity of Linear Predictors and Neural Networks","created":"2023-05-25","cited_by_count":4,"area":null},{"id":"2104.11895","title":"Achieving Small Test Error in Mildly Overparameterized Neural Networks","created":"2021-04-24","cited_by_count":3,"area":null},{"id":"2210.12818","title":"Pushing the Efficiency Limit Using Structured Sparse Convolutions","created":"2022-10-23","cited_by_count":3,"area":null},{"id":"2212.12770","title":"COLT: Cyclic Overlapping Lottery Tickets for Faster Pruning of Convolutional Neural Networks","created":"2022-12-24","cited_by_count":3,"area":null},{"id":"2305.19844","title":"Learning Task-preferred Inference Routes for Gradient De-conflict in Multi-output DNNs","created":"2023-05-31","cited_by_count":3,"area":null},{"id":"2306.08191","title":"Solving Large-scale Spatial Problems with Convolutional Neural Networks","created":"2023-06-14","cited_by_count":3,"area":null},{"id":"2306.09778","title":"Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent","created":"2023-06-16","cited_by_count":3,"area":null},{"id":"2309.09258","title":"Global Convergence of SGD For Logistic Loss on Two Layer Neural Nets","created":"2023-09-17","cited_by_count":3,"area":null},{"id":"2311.17539","title":"Critical Influence of Overparameterization on Sharpness-aware Minimization","created":"2023-11-29","cited_by_count":3,"area":null},{"id":"2402.08808","title":"Depth Separation in Norm-Bounded Infinite-Width Neural Networks","created":"2024-02-13","cited_by_count":3,"area":null},{"id":"2405.13721","title":"Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion","created":"2024-05-22","cited_by_count":3,"area":null},{"id":"2602.05887","title":"Escaping Local Minima Provably in Non-convex Matrix Sensing: A Deterministic Framework via Simulated Lifting","created":"2026-02-05","cited_by_count":3,"area":null},{"id":"2106.13834","title":"Ladder Polynomial Neural Networks","created":"2021-06-25","cited_by_count":2,"area":null},{"id":"2401.01373","title":"Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networks","created":"2023-12-29","cited_by_count":2,"area":null},{"id":"2405.07331","title":"Stochastic Bandits with ReLU Neural Networks","created":"2024-05-12","cited_by_count":2,"area":null},{"id":"2501.02364","title":"Linearly Separable Features in Shallow Nonlinear Networks: Width Scales Polynomially with Intrinsic Data Dimension","created":"2025-01-04","cited_by_count":2,"area":null},{"id":"2502.13935","title":"Foundations of a Developmental Design Paradigm for Integrated Continual Learning, Deliberative Behavior, and Comprehensibility","created":"2025-02-19","cited_by_count":2,"area":null},{"id":"2101.06847","title":"On the Differentially Private Nature of Perturbed Gradient Descent","created":"2021-01-18","cited_by_count":1,"area":null},{"id":"2103.06846","title":"Policy Search with Rare Significant Events: Choosing the Right Partner to Cooperate with","created":"2021-03-11","cited_by_count":1,"area":null},{"id":"2110.13859","title":"Defensive Tensorization","created":"2021-10-26","cited_by_count":1,"area":null},{"id":"2111.05478","title":"SGD Through the Lens of Kolmogorov Complexity","created":"2021-11-10","cited_by_count":1,"area":null},{"id":"2112.13269","title":"Over-Parametrized Matrix Factorization in the Presence of Spurious Stationary Points","created":"2021-12-25","cited_by_count":1,"area":null},{"id":"2202.11817","title":"Benefit of Interpolation in Nearest Neighbor Algorithms","created":"2022-02-23","cited_by_count":1,"area":null},{"id":"2205.15198","title":"STN: Scalable Tensorizing Networks via Structure-Aware Training and Adaptive Compression","created":"2022-05-30","cited_by_count":1,"area":null},{"id":"2207.08896","title":"On the Study of Sample Complexity for Polynomial Neural Networks","created":"2022-07-18","cited_by_count":1,"area":null},{"id":"2303.11453","title":"Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing","created":"2023-03-20","cited_by_count":1,"area":null},{"id":"2311.02818","title":"Signal Processing Meets SGD: From Momentum to Filter","created":"2023-11-06","cited_by_count":1,"area":null},{"id":"2311.15221","title":"The Local Landscape of Phase Retrieval Under Limited Samples","created":"2023-11-26","cited_by_count":1,"area":null},{"id":"2502.05360","title":"Curse of Dimensionality in Neural Network Optimization","created":"2025-02-07","cited_by_count":1,"area":null},{"id":"2503.10428","title":"Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data","created":"2025-03-13","cited_by_count":1,"area":null},{"id":"2505.23774","title":"On the Parallels Between Evolutionary Theory and the State of AI","created":"2025-05-13","cited_by_count":1,"area":null},{"id":"2602.04832","title":"It's Not a Lottery, It's a Race: Understanding How Gradient Descent Adapts the Network's Capacity to the Task","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.06120","title":"Dynamic Momentum Recalibration in Online Gradient Learning","created":"2026-03-06","cited_by_count":1,"area":null},{"id":"2103.01887","title":"Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural Networks","created":"2021-03-02","cited_by_count":0,"area":null},{"id":"2103.07287","title":"Neural Networks with Complex-Valued Weights Have No Spurious Local Minima","created":"2021-01-31","cited_by_count":0,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2202.03535","title":"Noise Regularizes Over-parameterized Rank One Matrix Recovery, Provably","created":"2022-02-07","cited_by_count":0,"area":null},{"id":"2206.03254","title":"Demystifying the Global Convergence Puzzle of Learning Over-parameterized ReLU Nets in Very High Dimensions","created":"2022-06-05","cited_by_count":0,"area":null},{"id":"2307.06287","title":"Rational Neural Network Controllers","created":"2023-07-12","cited_by_count":0,"area":null},{"id":"2404.06549","title":"Variational Stochastic Gradient Descent for Deep Neural Networks","created":"2024-04-09","cited_by_count":0,"area":null},{"id":"2405.00902","title":"MESA: Cooperative Meta-Exploration in Multi-Agent Learning through Exploiting State-Action Space Structure","created":"2024-05-01","cited_by_count":0,"area":null},{"id":"2405.07619","title":"Analysis of the rate of convergence of an over-parametrized convolutional neural network image classifier learned by gradient descent","created":"2024-05-13","cited_by_count":0,"area":null},{"id":"2408.01374","title":"Hybrid Coordinate Descent for Efficient Neural Network Learning Using Line Search and Gradient Descent","created":"2024-08-02","cited_by_count":0,"area":null},{"id":"2408.03599","title":"Activations Through Extensions: A Framework To Boost Performance Of Neural Networks","created":"2024-08-07","cited_by_count":0,"area":null},{"id":"2410.19844","title":"A practical, fast method for solving sum-of-squares problems for very large polynomials","created":"2024-10-21","cited_by_count":0,"area":null},{"id":"2502.05134","title":"Information-Theoretic Guarantees for Recovering Low-Rank Tensors from Symmetric Rank-One Measurements","created":"2025-02-07","cited_by_count":0,"area":null},{"id":"2505.18289","title":"Convexified Message-Passing Graph Neural Networks","created":"2025-05-23","cited_by_count":0,"area":null},{"id":"2506.12891","title":"Evolutionary Developmental Biology Can Serve as the Conceptual Foundation for a New Design Paradigm in Artificial Intelligence","created":"2025-06-15","cited_by_count":0,"area":null},{"id":"2510.24616","title":"Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation","created":"2025-10-28","cited_by_count":0,"area":null},{"id":"2602.19017","title":"Why ReLU? A Bit-Model Dichotomy for Deep Network Training","created":"2026-02-22","cited_by_count":0,"area":null},{"id":"2606.28242","title":"How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2609.33016","title":"Relative Generalization Invariance of LLM Pretraining","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":null}