{"total":100,"rows":[{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63,"area":null},{"id":"2108.10573","title":"The staircase property: How hierarchical structure can guide deep learning","created":"2021-08-24","cited_by_count":62,"area":null},{"id":"2106.06899","title":"Memory-efficient Transformers via Top-$k$ Attention","created":"2021-06-13","cited_by_count":60,"area":null},{"id":"2105.04550","title":"Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth","created":"2021-05-10","cited_by_count":55,"area":null},{"id":"2109.09710","title":"Understanding neural networks with reproducing kernel Banach spaces","created":"2021-09-20","cited_by_count":50,"area":null},{"id":"2406.01581","title":"Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit","created":"2024-06-03","cited_by_count":46,"area":null},{"id":"2103.01210","title":"Quantifying the Benefit of Using Differentiable Learning over Tangent Kernels","created":"2021-03-01","cited_by_count":41,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2102.07346","title":"On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers","created":"2021-02-15","cited_by_count":35,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2309.03843","title":"Gradient-Based Feature Learning under Structured Data","created":"2023-09-07","cited_by_count":32,"area":null},{"id":"2102.02336","title":"On the Approximation Power of Two-Layer Networks of Random ReLUs","created":"2021-02-03","cited_by_count":29,"area":null},{"id":"2108.04190","title":"On the Power of Differentiable Learning versus PAC and SQ Learning","created":"2021-08-09","cited_by_count":28,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2202.12482","title":"Sparse Neural Additive Model: Interpretable Deep Learning with Feature Selection via Group Sparsity","created":"2022-02-25","cited_by_count":25,"area":null},{"id":"2302.10034","title":"Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron","created":"2023-02-20","cited_by_count":25,"area":null},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23,"area":null},{"id":"2104.03093","title":"Spectral Analysis of the Neural Tangent Kernel for Deep Residual Networks","created":"2021-04-07","cited_by_count":21,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2408.06526","title":"Operator Learning Using Random Features: A Tool for Scientific Computing","created":"2024-08-12","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2101.02533","title":"Towards Understanding Learning in Neural Networks with Linear Teachers","created":"2021-01-07","cited_by_count":19,"area":null},{"id":"2102.00434","title":"The Connection Between Approximation, Depth Separation and Learnability in Neural Networks","created":"2021-01-31","cited_by_count":19,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2106.01101","title":"Learning a Single Neuron with Bias Using Gradient Descent","created":"2021-06-02","cited_by_count":17,"area":null},{"id":"2112.02393","title":"Optimization-Based Separations for Neural Networks","created":"2021-12-04","cited_by_count":17,"area":null},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2108.00207","title":"The Separation Capacity of Random Neural Networks","created":"2021-07-31","cited_by_count":14,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2202.08064","title":"Learning a Single Neuron for Non-monotonic Activation Functions","created":"2022-02-16","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2302.07937","title":"The Expressive Power of Tuning Only the Normalization Layers","created":"2023-02-15","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2403.14917","title":"Mean-field Analysis on Two-layer Neural Networks from a Kernel Perspective","created":"2024-03-22","cited_by_count":13,"area":null},{"id":"2105.02468","title":"Relative stability toward diffeomorphisms indicates performance in deep nets","created":"2021-05-06","cited_by_count":12,"area":null},{"id":"2209.07376","title":"Understanding Deep Neural Function Approximation in Reinforcement Learning via $\\epsilon$-Greedy Exploration","created":"2022-09-15","cited_by_count":11,"area":null},{"id":"2105.05553","title":"Principal Components Bias in Over-parameterized Linear Models, and its Manifestation in Deep Neural Networks","created":"2021-05-12","cited_by_count":10,"area":null},{"id":"2109.04623","title":"ReLU Regression with Massart Noise","created":"2021-09-10","cited_by_count":10,"area":null},{"id":"2310.07235","title":"Are GATs Out of Balance?","created":"2023-10-11","cited_by_count":10,"area":null},{"id":"2402.05271","title":"Feature learning as alignment: a structural property of gradient descent in non-linear neural networks","created":"2024-02-07","cited_by_count":10,"area":null},{"id":"2107.06466","title":"Going Beyond Linear RL: Sample Efficient Neural Function Approximation","created":"2021-07-14","cited_by_count":9,"area":null},{"id":"2210.06088","title":"Annihilation of Spurious Minima in Two-Layer ReLU Networks","created":"2022-10-12","cited_by_count":9,"area":null},{"id":"2302.06677","title":"System identification of neural systems: If we got it right, would we know?","created":"2023-02-13","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2104.05785","title":"A Recipe for Global Convergence Guarantee in Deep Neural Networks","created":"2021-04-12","cited_by_count":8,"area":null},{"id":"2211.08771","title":"On the symmetries in the dynamics of wide two-layer neural networks","created":"2022-11-16","cited_by_count":8,"area":null},{"id":"2404.18769","title":"Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks","created":"2024-04-29","cited_by_count":8,"area":null},{"id":"2108.04964","title":"A spectral-based analysis of the separation between two-layer neural networks and linear methods","created":"2021-08-10","cited_by_count":7,"area":null},{"id":"2107.14324","title":"Deep Networks Provably Classify Data on Curves","created":"2021-07-29","cited_by_count":6,"area":null},{"id":"2110.07807","title":"Provable Regret Bounds for Deep Online Learning and Control","created":"2021-10-15","cited_by_count":6,"area":null},{"id":"2205.11716","title":"Randomly Initialized One-Layer Neural Networks Make Data Linearly Separable","created":"2022-05-24","cited_by_count":6,"area":null},{"id":"2103.15996","title":"Minimum complexity interpolation in random features models","created":"2021-03-30","cited_by_count":5,"area":null},{"id":"2206.02139","title":"Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks","created":"2022-06-05","cited_by_count":5,"area":null},{"id":"2206.05317","title":"Intrinsic dimensionality and generalization properties of the $\\mathcal{R}$-norm inductive bias","created":"2022-06-10","cited_by_count":5,"area":null},{"id":"2208.08835","title":"Differentiable Architecture Search with Random Features","created":"2022-08-18","cited_by_count":4,"area":null},{"id":"2310.10171","title":"On permutation symmetries in Bayesian neural network posteriors: a variational perspective","created":"2023-10-16","cited_by_count":4,"area":null},{"id":"2311.14609","title":"Analysis of the expected $L_2$ error of an over-parametrized deep neural network estimate learned by gradient descent without regularization","created":"2023-11-24","cited_by_count":4,"area":null},{"id":"2406.02105","title":"Can Kernel Methods Explain How the Data Affects Neural Collapse?","created":"2024-06-04","cited_by_count":4,"area":null},{"id":"2501.18283","title":"Random Feature Representation Boosting","created":"2025-01-30","cited_by_count":4,"area":null},{"id":"2505.08146","title":"Tensor Sketch: Fast and Scalable Polynomial Kernel Approximation","created":"2025-05-13","cited_by_count":4,"area":null},{"id":"2112.09741","title":"Envisioning Future Deep Learning Theories: Some Basic Concepts and Characteristics","created":"2021-12-17","cited_by_count":3,"area":null},{"id":"2311.09858","title":"Polynomially Over-Parameterized Convolutional Neural Networks Contain Structured Strong Winning Lottery Tickets","created":"2023-11-16","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2506.22429","title":"Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks","created":"2025-06-27","cited_by_count":3,"area":null},{"id":"2510.14331","title":"LLM Priors for ERM over Programs","created":"2025-10-16","cited_by_count":3,"area":null},{"id":"2305.16508","title":"Most Neural Networks Are Almost Learnable","created":"2023-05-25","cited_by_count":2,"area":null},{"id":"2312.17007","title":"On the rate of convergence of an over-parametrized Transformer classifier learned by gradient descent","created":"2023-12-28","cited_by_count":2,"area":null},{"id":"2410.06399","title":"Adaptive Random Fourier Features Training Stabilized By Resampling With Applications in Image Regression","created":"2024-10-08","cited_by_count":2,"area":null},{"id":"2412.13526","title":"MOMA: Masked Orthogonal Matrix Alignment for Zero-Additional-Parameter Model Merging","created":"2024-12-18","cited_by_count":2,"area":null},{"id":"2501.16476","title":"Closed-Form Feedback-Free Learning with Forward Projection","created":"2025-01-27","cited_by_count":2,"area":null},{"id":"2502.16331","title":"A Gap Between the Gaussian RKHS and Neural Networks: An Infinite-Center Asymptotic Analysis","created":"2025-02-22","cited_by_count":2,"area":null},{"id":"2510.21078","title":"Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2605.18468","title":"Shallow ReLU$^s$ Networks in $L^p$-Type and Sobolev Spaces: Approximation and Path-Norm Controlled Generalization","created":"2026-05-18","cited_by_count":2,"area":null},{"id":"2203.05417","title":"Deep Regression Ensembles","created":"2022-03-10","cited_by_count":1,"area":null},{"id":"2205.14553","title":"Long-Tailed Learning Requires Feature Learning","created":"2022-05-29","cited_by_count":1,"area":null},{"id":"2210.06509","title":"Understanding Impacts of Task Similarity on Backdoor Attack and Detection","created":"2022-10-12","cited_by_count":1,"area":null},{"id":"2310.07370","title":"Orthogonal Random Features: Explicit Forms and Sharp Inequalities","created":"2023-10-11","cited_by_count":1,"area":null},{"id":"2310.13836","title":"Foundation Model's Embedded Representations May Detect Distribution Shift","created":"2023-10-20","cited_by_count":1,"area":null},{"id":"2401.07606","title":"RedEx: Beyond Fixed Representation Methods via Convex Optimization","created":"2024-01-15","cited_by_count":1,"area":null},{"id":"2402.08948","title":"Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input","created":"2024-02-14","cited_by_count":1,"area":null},{"id":"2507.19680","title":"Feature learning is decoupled from generalization in high capacity neural networks","created":"2025-07-25","cited_by_count":1,"area":null},{"id":"2603.00971","title":"Random Features for Operator-Valued Kernels: Bridging Kernel Methods and Neural Operators","created":"2026-03-01","cited_by_count":1,"area":null},{"id":"2605.31244","title":"Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2106.06097","title":"Neural Optimization Kernel: Towards Robust Deep Learning","created":"2021-06-11","cited_by_count":0,"area":null},{"id":"2303.14083","title":"Online Learning for the Random Feature Model in the Student-Teacher Framework","created":"2023-03-24","cited_by_count":0,"area":null},{"id":"2303.16251","title":"Function Approximation with Randomly Initialized Neural Networks for Approximate Model Reference Adaptive Control","created":"2023-03-28","cited_by_count":0,"area":null},{"id":"2603.02234","title":"Structured vs. Unstructured Pruning: An Exponential Gap","created":"2026-02-13","cited_by_count":0,"area":null},{"id":"2606.04754","title":"Beyond Structural Symmetries: Linear Mode Connectivity via Neuron Identifiability","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2607.06369","title":"Feature Learning for the High Dimensional Stationary Sch\\\"odinger Equation with Deep Ritz Method","created":"2026-07-07","cited_by_count":0,"area":null},{"id":"2607.10869","title":"Singular perturbations and hierarchical learning in two-layer neural networks","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2608.10523","title":"Improving TensorSketch Using Complex Random Variables","created":"2026-08-11","cited_by_count":0,"area":null},{"id":"2608.11479","title":"Convergence Guarantees of Gradient Descent for Neural Networks via Generalized Lipschitz Smoothness","created":"2026-08-11","cited_by_count":0,"area":null}],"next_cursor":null}