{"total":94,"rows":[{"id":"2102.06810","title":"Understanding self-supervised Learning Dynamics without Contrastive Pairs","created":"2021-02-12","cited_by_count":256,"area":null},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2102.02887","title":"Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training","created":"2021-02-04","cited_by_count":110,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2201.08025","title":"Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape","created":"2022-01-20","cited_by_count":39,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2201.12680","title":"Understanding Deep Contrastive Learning via Coordinate-wise Optimization","created":"2022-01-29","cited_by_count":35,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2304.02840","title":"NTK-SAP: Improving neural network pruning by aligning training dynamics","created":"2023-04-06","cited_by_count":30,"area":null},{"id":"2211.05641","title":"Regression as Classification: Influence of Task Formulation on Neural Network Features","created":"2022-11-10","cited_by_count":29,"area":null},{"id":"2105.14301","title":"A Theory of Neural Tangent Kernel Alignment and Its Influence on Training","created":"2021-05-29","cited_by_count":25,"area":null},{"id":"2110.05518","title":"Global Optimality Beyond Two Layers: Training Deep ReLU Networks via Convex Programs","created":"2021-10-11","cited_by_count":25,"area":null},{"id":"2302.10034","title":"Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron","created":"2023-02-20","cited_by_count":25,"area":null},{"id":"2202.04777","title":"Exact Solutions of a Deep Linear Network","created":"2022-02-10","cited_by_count":24,"area":null},{"id":"2403.11871","title":"The Real Tropical Geometry of Neural Networks","created":"2024-03-18","cited_by_count":24,"area":null},{"id":"2110.02479","title":"Exponentially Many Local Minima in Quantum Neural Networks","created":"2021-10-06","cited_by_count":22,"area":null},{"id":"2301.08203","title":"An SDE for Modeling SAM: Theory and Insights","created":"2023-01-19","cited_by_count":22,"area":null},{"id":"2205.09072","title":"On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias","created":"2022-05-18","cited_by_count":21,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2201.08514","title":"How does unlabeled data improve generalization in self-training? A one-hidden-layer theoretical analysis","created":"2022-01-21","cited_by_count":19,"area":null},{"id":"2310.01769","title":"How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization","created":"2023-10-03","cited_by_count":18,"area":null},{"id":"2305.19510","title":"Mildly Overparameterized ReLU Networks Have a Favorable Loss Landscape","created":"2023-05-31","cited_by_count":17,"area":null},{"id":"2310.16173","title":"On the Convergence and Sample Complexity Analysis of Deep Q-Networks with $\\epsilon$-Greedy Exploration","created":"2023-10-24","cited_by_count":17,"area":null},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2302.02922","title":"Joint Edge-Model Sparse Learning is Provably Efficient for Graph Neural Networks","created":"2023-02-06","cited_by_count":16,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2110.09548","title":"Path Regularization: A Convexity and Sparsity Inducing Regularization for Parallel ReLU Networks","created":"2021-10-18","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2410.23169","title":"The Persistence of Neural Collapse Despite Low-Rank Bias","created":"2024-10-30","cited_by_count":13,"area":null},{"id":"2102.09671","title":"When Are Solutions Connected in Deep Networks?","created":"2021-02-18","cited_by_count":11,"area":null},{"id":"2103.10922","title":"Landscape analysis for shallow neural networks: complete classification of critical points for affine target functions","created":"2021-03-19","cited_by_count":11,"area":null},{"id":"2509.09033","title":"Generative quantum advantage for classical and quantum problems","created":"2025-09-10","cited_by_count":11,"area":null},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10,"area":null},{"id":"2210.06088","title":"Annihilation of Spurious Minima in Two-Layer ReLU Networks","created":"2022-10-12","cited_by_count":9,"area":null},{"id":"2404.06391","title":"Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity","created":"2024-04-09","cited_by_count":9,"area":null},{"id":"2411.08798","title":"Learning Gaussian Multi-Index Models with Gradient Flow: Time Complexity and Directional Convergence","created":"2024-11-13","cited_by_count":9,"area":null},{"id":"2202.12262","title":"On the Omnipresence of Spurious Local Minima in Certain Neural Network Training Problems","created":"2022-02-23","cited_by_count":8,"area":null},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2311.01644","title":"Should Under-parameterized Student Networks Copy or Average Teacher Weights?","created":"2023-11-03","cited_by_count":8,"area":null},{"id":"2410.12455","title":"Loss Landscape Characterization of Neural Networks without Over-Parametrization","created":"2024-10-16","cited_by_count":8,"area":null},{"id":"2506.02269","title":"A Tale of Two Symmetries: Exploring the Loss Landscape of Equivariant Models","created":"2025-06-02","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2109.14142","title":"On the Provable Generalization of Recurrent Neural Networks","created":"2021-09-29","cited_by_count":6,"area":null},{"id":"2302.14690","title":"On the existence of minimizers in shallow residual ReLU neural network optimization landscapes","created":"2023-02-28","cited_by_count":6,"area":null},{"id":"2403.07310","title":"How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance","created":"2024-03-12","cited_by_count":6,"area":null},{"id":"2410.14837","title":"Topological obstruction to the training of shallow ReLU neural networks","created":"2024-10-18","cited_by_count":6,"area":null},{"id":"2107.02422","title":"Equivariant bifurcation, quadratic equivariants, and symmetry breaking for the standard representation of $S_n$","created":"2021-07-06","cited_by_count":5,"area":null},{"id":"2204.12589","title":"Self-scalable Tanh (Stan): Faster Convergence and Better Generalization in Physics-informed Neural Networks","created":"2022-04-26","cited_by_count":5,"area":null},{"id":"2206.02139","title":"Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks","created":"2022-06-05","cited_by_count":5,"area":null},{"id":"2208.02083","title":"Gradient descent provably escapes saddle points in the training of shallow ReLU networks","created":"2022-08-03","cited_by_count":5,"area":null},{"id":"2211.04589","title":"Finite Sample Identification of Wide Shallow Neural Networks with Biases","created":"2022-11-08","cited_by_count":5,"area":null},{"id":"2303.03950","title":"On the existence of optimal shallow feedforward networks with ReLU activation","created":"2023-03-06","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2210.00346","title":"Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition","created":"2022-10-01","cited_by_count":4,"area":null},{"id":"2210.06819","title":"Mean-field analysis for heavy ball methods: Dropout-stability, connectivity, and global convergence","created":"2022-10-13","cited_by_count":3,"area":null},{"id":"2306.09778","title":"Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent","created":"2023-06-16","cited_by_count":3,"area":null},{"id":"2310.17610","title":"A qualitative difference between gradient flows of convex functions in finite- and infinite-dimensional Hilbert spaces","created":"2023-10-26","cited_by_count":3,"area":null},{"id":"2311.06138","title":"Minimum norm interpolation by perceptra: Explicit regularization and implicit bias","created":"2023-11-10","cited_by_count":3,"area":null},{"id":"2404.13404","title":"Solution space and storage capacity of fully connected two-layer neural networks with generic activation functions","created":"2024-04-20","cited_by_count":3,"area":null},{"id":"2503.20879","title":"Quantum advantage for learning shallow neural networks with natural data distributions","created":"2025-03-26","cited_by_count":3,"area":null},{"id":"2506.14951","title":"Flat Channels to Infinity in Neural Loss Landscapes","created":"2025-06-17","cited_by_count":3,"area":null},{"id":"2306.16090","title":"Empirical Loss Landscape Analysis of Neural Network Activation Functions","created":"2023-06-28","cited_by_count":2,"area":null},{"id":"2601.16884","title":"Multigrade Neural Network Approximation","created":"2026-01-23","cited_by_count":2,"area":null},{"id":"2101.08310","title":"Non-Convex Compressed Sensing with Training Data","created":"2021-01-20","cited_by_count":1,"area":null},{"id":"2111.05311","title":"Mode connectivity in the loss landscape of parameterized quantum circuits","created":"2021-11-09","cited_by_count":1,"area":null},{"id":"2111.05478","title":"SGD Through the Lens of Kolmogorov Complexity","created":"2021-11-10","cited_by_count":1,"area":null},{"id":"2201.12052","title":"Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks","created":"2022-01-28","cited_by_count":1,"area":null},{"id":"2309.15096","title":"Fixing the NTK: From Neural Network Linearizations to Exact Convex Programs","created":"2023-09-26","cited_by_count":1,"area":null},{"id":"2401.03824","title":"A topological description of loss surfaces based on Betti Numbers","created":"2024-01-08","cited_by_count":1,"area":null},{"id":"2401.07606","title":"RedEx: Beyond Fixed Representation Methods via Convex Optimization","created":"2024-01-15","cited_by_count":1,"area":null},{"id":"2402.08948","title":"Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input","created":"2024-02-14","cited_by_count":1,"area":null},{"id":"2505.22578","title":"Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2510.25060","title":"Nonlinear Dynamics In Optimization Landscape of Shallow Neural Networks with Tunable Leaky ReLU","created":"2025-10-29","cited_by_count":1,"area":null},{"id":"2511.19246","title":"Neural Architecture Search for Quantum Autoencoders","created":"2025-11-24","cited_by_count":1,"area":null},{"id":"2605.10775","title":"On the global convergence of gradient flow for wide shallow models beyond homogeneous nonlinearities","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2101.02776","title":"The Nonconvex Geometry of Linear Inverse Problems","created":"2021-01-07","cited_by_count":0,"area":null},{"id":"2103.01887","title":"Self-Regularity of Non-Negative Output Weights for Overparameterized Two-Layer Neural Networks","created":"2021-03-02","cited_by_count":0,"area":null},{"id":"2201.02761","title":"Global Convergence Analysis of Deep Linear Networks with A One-neuron Layer","created":"2022-01-08","cited_by_count":0,"area":null},{"id":"2206.03254","title":"Demystifying the Global Convergence Puzzle of Learning Over-parameterized ReLU Nets in Very High Dimensions","created":"2022-06-05","cited_by_count":0,"area":null},{"id":"2210.07100","title":"Dissipative residual layers for unsupervised implicit parameterization of data manifolds","created":"2022-10-13","cited_by_count":0,"area":null},{"id":"2211.10582","title":"Linear RNNs Provably Learn Linear Dynamic Systems","created":"2022-11-19","cited_by_count":0,"area":null},{"id":"2306.14817","title":"Black holes and the loss landscape in machine learning","created":"2023-06-26","cited_by_count":0,"area":null},{"id":"2307.15456","title":"Worrisome Properties of Neural Network Controllers and Their Symbolic Representations","created":"2023-07-28","cited_by_count":0,"area":null},{"id":"2402.17089","title":"Learnability of high-dimensional targets by two-parameter models and gradient flow","created":"2024-02-26","cited_by_count":0,"area":null},{"id":"2510.22667","title":"Block Coordinate Descent for Neural Networks Provably Finds Global Minima","created":"2025-10-26","cited_by_count":0,"area":null},{"id":"2512.06347","title":"Zero Generalization Error Theorem for Random Interpolators via Algebraic Geometry","created":"2025-12-06","cited_by_count":0,"area":null},{"id":"2601.15915","title":"Progressive Power Homotopy for Non-convex Optimization","created":"2026-01-22","cited_by_count":0,"area":null},{"id":"2606.04327","title":"A Geometric Characterization of the Stationary Plateau for Two-Layer Neural Networks","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2609.13057","title":"Benign Loss Landscapes Can Coexist with Worst-Case Hardness","created":"2026-09-11","cited_by_count":0,"area":null},{"id":"2609.34667","title":"Two-Timescale Fine-tuning Provably Learns New Features for Two-Layer ReLU Networks","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2609.37657","title":"The double descent and Runge phenomena in overparametrized polynomial interpolation","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2610.01728","title":"Removing spurious minima for planar features by skip connections","created":"2026-10-01","cited_by_count":0,"area":null}],"next_cursor":null}