{"total":115,"rows":[{"id":"2104.13478","title":"Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges","created":"2021-04-27","cited_by_count":1167,"area":null},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154,"area":null},{"id":"2206.07758","title":"Reconstructing Training Data from Trained Neural Networks","created":"2022-06-15","cited_by_count":133,"area":null},{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128,"area":null},{"id":"2202.14026","title":"Robust Training under Label Noise by Over-parameterization","created":"2022-02-28","cited_by_count":93,"area":null},{"id":"2110.02796","title":"An Unconstrained Layer-Peeled Perspective on Neural Collapse","created":"2021-10-06","cited_by_count":87,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80,"area":null},{"id":"2106.15013","title":"Small random initialization is akin to spectral learning: Optimization and generalization guarantees for overparameterized low-rank matrix reconstruction","created":"2021-06-28","cited_by_count":78,"area":null},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73,"area":null},{"id":"2102.09769","title":"On the Implicit Bias of Initialization Shape: Beyond Infinitesimal Mirror Descent","created":"2021-02-19","cited_by_count":70,"area":null},{"id":"2201.12760","title":"Implicit Regularization Towards Rank Minimization in ReLU Networks","created":"2022-01-30","cited_by_count":53,"area":null},{"id":"2306.07042","title":"Transformers learn through gradual rank increase","created":"2023-06-12","cited_by_count":52,"area":null},{"id":"2210.07082","title":"Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data","created":"2022-10-13","cited_by_count":46,"area":null},{"id":"2102.09972","title":"Implicit Regularization in Tensor Factorization","created":"2021-02-19","cited_by_count":44,"area":null},{"id":"2306.13812","title":"Maintaining Plasticity in Deep Continual Learning","created":"2023-06-23","cited_by_count":43,"area":null},{"id":"2301.11500","title":"Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing","created":"2023-01-27","cited_by_count":42,"area":null},{"id":"2207.04036","title":"Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent","created":"2022-07-08","cited_by_count":39,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2406.10650","title":"The Implicit Bias of Adam on Separable Data","created":"2024-06-15","cited_by_count":36,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2110.02732","title":"On Margin Maximization in Linear and ReLU Networks","created":"2021-10-06","cited_by_count":34,"area":null},{"id":"2108.04552","title":"The Benefits of Implicit Regularization from SGD in Least Squares Problems","created":"2021-08-10","cited_by_count":32,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2305.16536","title":"Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression","created":"2023-05-25","cited_by_count":30,"area":null},{"id":"2305.16038","title":"Implicit bias of SGD in $L_{2}$-regularized linear DNNs: One-way jumps from high to low rank","created":"2023-05-25","cited_by_count":29,"area":null},{"id":"2205.14814","title":"Your Contrastive Learning Is Secretly Doing Stochastic Neighbor Embedding","created":"2022-05-30","cited_by_count":28,"area":null},{"id":"2201.11729","title":"Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks","created":"2022-01-27","cited_by_count":27,"area":null},{"id":"2310.20703","title":"Vanishing Gradients in Reinforcement Finetuning of Language Models","created":"2023-10-31","cited_by_count":27,"area":null},{"id":"2410.23819","title":"Weight decay induces low-rank attention layers","created":"2024-10-31","cited_by_count":27,"area":null},{"id":"2302.00457","title":"Simplicity Bias in 1-Hidden Layer Neural Networks","created":"2023-02-01","cited_by_count":26,"area":null},{"id":"2302.00849","title":"Implicit regularization in Heavy-ball momentum accelerated stochastic gradient descent","created":"2023-02-02","cited_by_count":25,"area":null},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24,"area":null},{"id":"2112.11027","title":"More is Less: Inducing Sparsity via Overparameterization","created":"2021-12-21","cited_by_count":24,"area":null},{"id":"2107.05074","title":"SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs","created":"2021-07-11","cited_by_count":22,"area":null},{"id":"2108.02040","title":"Convergence of gradient descent for learning linear neural networks","created":"2021-08-04","cited_by_count":22,"area":null},{"id":"2205.09072","title":"On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias","created":"2022-05-18","cited_by_count":21,"area":null},{"id":"2211.16980","title":"Infinite-width limit of deep linear neural networks","created":"2022-11-29","cited_by_count":20,"area":null},{"id":"2110.06084","title":"Implicit Bias of Linear Equivariant Networks","created":"2021-10-12","cited_by_count":19,"area":null},{"id":"2303.01353","title":"Penalising the biases in norm regularisation enforces sparsity","created":"2023-03-02","cited_by_count":19,"area":null},{"id":"2102.12238","title":"Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm","created":"2021-02-24","cited_by_count":18,"area":null},{"id":"2108.11489","title":"The Interplay Between Implicit Bias and Benign Overfitting in Two-Layer Linear Networks","created":"2021-08-25","cited_by_count":18,"area":null},{"id":"2107.01641","title":"A Theoretical Analysis of Fine-tuning with Linear Teachers","created":"2021-07-04","cited_by_count":17,"area":null},{"id":"2205.13647","title":"Learning to Reason with Neural Networks: Generalization, Unseen Data and Boolean Measures","created":"2022-05-26","cited_by_count":17,"area":null},{"id":"2202.00856","title":"The Role of Linear Layers in Nonlinear Interpolating Networks","created":"2022-02-02","cited_by_count":16,"area":null},{"id":"2306.06479","title":"Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs","created":"2023-06-10","cited_by_count":16,"area":null},{"id":"2401.04553","title":"Linear Recursive Feature Machines provably recover low-rank matrices","created":"2024-01-09","cited_by_count":16,"area":null},{"id":"2306.17499","title":"The Implicit Bias of Minima Stability in Multivariate Shallow ReLU Networks","created":"2023-06-30","cited_by_count":15,"area":null},{"id":"2202.08325","title":"A Data-Augmentation Is Worth A Thousand Samples: Exact Quantification From Analytical Augmented Sample Moments","created":"2022-02-16","cited_by_count":14,"area":null},{"id":"2305.01090","title":"Autoencoders for discovering manifold dimension and coordinates in data from complex dynamical systems","created":"2023-05-01","cited_by_count":13,"area":null},{"id":"2211.16494","title":"On the Ability of Graph Neural Networks to Model Interactions Between Vertices","created":"2022-11-29","cited_by_count":12,"area":null},{"id":"2305.05448","title":"Robust Implicit Regularization via Weight Normalization","created":"2023-05-09","cited_by_count":12,"area":null},{"id":"2105.13831","title":"Implicit Regularization in Matrix Sensing via Mirror Descent","created":"2021-05-28","cited_by_count":11,"area":null},{"id":"2306.08805","title":"Exact Count of Boundary Pieces of ReLU Classifiers: Towards the Proper Complexity Measure for Classification","created":"2023-06-15","cited_by_count":11,"area":null},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10,"area":null},{"id":"2310.07235","title":"Are GATs Out of Balance?","created":"2023-10-11","cited_by_count":10,"area":null},{"id":"2310.02396","title":"Inductive biases of multi-task learning and finetuning: multiple regimes of feature reuse","created":"2023-10-03","cited_by_count":9,"area":null},{"id":"2209.09315","title":"Deep Linear Networks can Benignly Overfit when Shallow Ones Do","created":"2022-09-19","cited_by_count":8,"area":null},{"id":"2210.05248","title":"Self-supervised debiasing using low rank regularization","created":"2022-10-11","cited_by_count":8,"area":null},{"id":"2210.12497","title":"Deep Linear Networks for Matrix Completion -- An Infinite Depth Limit","created":"2022-10-22","cited_by_count":8,"area":null},{"id":"2305.15598","title":"ReLU Neural Networks with Linear Layers are Biased Towards Single- and Multi-Index Models","created":"2023-05-24","cited_by_count":8,"area":null},{"id":"2502.17788","title":"On-device edge learning for IoT data streams: a survey","created":"2025-02-25","cited_by_count":8,"area":null},{"id":"2210.14064","title":"Learning Low Dimensional State Spaces with Overparameterized Recurrent Neural Nets","created":"2022-10-25","cited_by_count":7,"area":null},{"id":"2311.17094","title":"In Search of a Data Transformation That Accelerates Neural Field Training","created":"2023-11-28","cited_by_count":7,"area":null},{"id":"2312.12657","title":"The Convex Landscape of Neural Networks: Characterizing Global Optima and Stationary Points via Lasso Models","created":"2023-12-19","cited_by_count":7,"area":null},{"id":"2306.13239","title":"The Inductive Bias of Flatness Regularization for Deep Matrix Factorization","created":"2023-06-22","cited_by_count":6,"area":null},{"id":"2105.01346","title":"Implicit Regularization in Deep Tensor Factorization","created":"2021-05-04","cited_by_count":5,"area":null},{"id":"2105.13228","title":"Optimization Induced Equilibrium Networks","created":"2021-05-27","cited_by_count":5,"area":null},{"id":"2310.14423","title":"A Quadratic Synchronization Rule for Distributed Deep Learning","created":"2023-10-22","cited_by_count":5,"area":null},{"id":"2202.09885","title":"On Optimal Early Stopping: Over-informative versus Under-informative Parametrization","created":"2022-02-20","cited_by_count":4,"area":null},{"id":"2205.01421","title":"A Falsificationist Account of Artificial Neural Networks","created":"2022-05-03","cited_by_count":4,"area":null},{"id":"2212.09396","title":"Rank-1 Matrix Completion with Gradient Descent and Small Random Initialization","created":"2022-12-19","cited_by_count":4,"area":null},{"id":"2303.11249","title":"What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglement","created":"2023-03-20","cited_by_count":4,"area":null},{"id":"2305.11417","title":"Exploring the Complexity of Deep Neural Networks through Functional Equivalence","created":"2023-05-19","cited_by_count":4,"area":null},{"id":"2307.07410","title":"Implicit regularization in AI meets generalized hardness of approximation in optimization -- Sharp results for diagonal linear networks","created":"2023-07-13","cited_by_count":4,"area":null},{"id":"2112.09741","title":"Envisioning Future Deep Learning Theories: Some Basic Concepts and Characteristics","created":"2021-12-17","cited_by_count":3,"area":null},{"id":"2207.08942","title":"Implicit Regularization with Polynomial Growth in Deep Tensor Factorization","created":"2022-07-18","cited_by_count":3,"area":null},{"id":"2303.17805","title":"On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks","created":"2023-03-31","cited_by_count":3,"area":null},{"id":"2310.12977","title":"Training Dynamics of Deep Network Linear Regions","created":"2023-10-19","cited_by_count":3,"area":null},{"id":"2403.08585","title":"Improving Implicit Regularization of SGD with Preconditioning for Least Square Problems","created":"2024-03-13","cited_by_count":3,"area":null},{"id":"2403.19381","title":"On Uncertainty Quantification for Near-Bayes Optimal Algorithms","created":"2024-03-28","cited_by_count":3,"area":null},{"id":"2405.13721","title":"Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion","created":"2024-05-22","cited_by_count":3,"area":null},{"id":"2102.13522","title":"Experiments with Rich Regime Training for Deep Learning","created":"2021-02-26","cited_by_count":2,"area":null},{"id":"2307.05789","title":"Implicit regularisation in stochastic gradient descent: from single-objective to two-player games","created":"2023-07-11","cited_by_count":2,"area":null},{"id":"2402.02454","title":"On the Role of Initialization on the Implicit Bias in Deep Linear Networks","created":"2024-02-04","cited_by_count":2,"area":null},{"id":"2410.08898","title":"Low-Dimension-to-High-Dimension Generalization And Its Implications for Length Generalization","created":"2024-10-11","cited_by_count":2,"area":null},{"id":"2512.04006","title":"Diagonalizing the Softmax: Hadamard Initialization for Tractable Cross-Entropy Dynamics","created":"2025-12-03","cited_by_count":2,"area":null},{"id":"2602.19533","title":"Grokking Finite-Dimensional Algebra","created":"2026-02-23","cited_by_count":2,"area":null},{"id":"2606.23198","title":"Incremental Learning in Mirror Flows","created":"2026-06-22","cited_by_count":2,"area":null},{"id":"2107.01301","title":"Implicit Greedy Rank Learning in Autoencoders via Overparameterized Linear Networks","created":"2021-07-02","cited_by_count":1,"area":null},{"id":"2110.11402","title":"On the Regularization of Autoencoders","created":"2021-10-21","cited_by_count":1,"area":null},{"id":"2212.14150","title":"A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization","created":"2022-12-29","cited_by_count":1,"area":null},{"id":"2402.17595","title":"Implicit Regularization via Spectral Neural Networks and Non-linear Matrix Sensing","created":"2024-02-27","cited_by_count":1,"area":null},{"id":"2408.13767","title":"Lecture Notes on Linear Neural Networks: A Tale of Optimization and Generalization in Deep Learning","created":"2024-08-25","cited_by_count":1,"area":null},{"id":"2501.16322","title":"Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture","created":"2025-01-27","cited_by_count":1,"area":null},{"id":"2506.17809","title":"Flatness After All?","created":"2025-06-21","cited_by_count":1,"area":null},{"id":"2605.05659","title":"Structural Correspondence and Universal Approximation in Diagonal plus Low-Rank Neural Networks","created":"2026-05-07","cited_by_count":1,"area":null},{"id":"2103.11327","title":"Comments on Leo Breiman's paper 'Statistical Modeling: The Two Cultures' (Statistical Science, 2001, 16(3), 199-231)","created":"2021-03-21","cited_by_count":0,"area":null}],"next_cursor":"100"}