{"total":110,"rows":[{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154,"area":null},{"id":"2304.13960","title":"Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be","created":"2023-04-27","cited_by_count":114,"area":null},{"id":"2110.02796","title":"An Unconstrained Layer-Peeled Perspective on Neural Collapse","created":"2021-10-06","cited_by_count":87,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2208.05512","title":"Imbalance Trouble: Revisiting Neural-Collapse Geometry","created":"2022-08-10","cited_by_count":80,"area":null},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80,"area":null},{"id":"2402.19449","title":"Heavy-Tailed Class Imbalance and Why Adam Outperforms Gradient Descent on Language Models","created":"2024-02-29","cited_by_count":80,"area":null},{"id":"2103.01550","title":"Label-Imbalanced and Group-Sensitive Classification under Overparameterization","created":"2021-03-02","cited_by_count":74,"area":null},{"id":"2106.07820","title":"On Large-Cohort Training for Federated Learning","created":"2021-06-15","cited_by_count":74,"area":null},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74,"area":null},{"id":"2102.08817","title":"Dissecting Supervised Contrastive Learning","created":"2021-02-17","cited_by_count":64,"area":null},{"id":"2306.13596","title":"Max-Margin Token Selection in Attention Mechanism","created":"2023-06-23","cited_by_count":58,"area":null},{"id":"2404.04454","title":"Implicit Bias of AdamW: $\\ell_\\infty$ Norm Constrained Optimization","created":"2024-04-05","cited_by_count":58,"area":null},{"id":"2201.12760","title":"Implicit Regularization Towards Rank Minimization in ReLU Networks","created":"2022-01-30","cited_by_count":53,"area":null},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50,"area":null},{"id":"2102.09972","title":"Implicit Regularization in Tensor Factorization","created":"2021-02-19","cited_by_count":44,"area":null},{"id":"2305.11788","title":"Implicit Bias of Gradient Descent for Logistic Regression at the Edge of Stability","created":"2023-05-19","cited_by_count":42,"area":null},{"id":"2412.19529","title":"Nonconvex Stochastic Optimization under Heavy-Tailed Noises: Optimal Convergence without Gradient Clipping","created":"2024-12-27","cited_by_count":42,"area":null},{"id":"2502.04664","title":"Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data","created":"2025-02-07","cited_by_count":41,"area":null},{"id":"2207.04036","title":"Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent","created":"2022-07-08","cited_by_count":39,"area":null},{"id":"2110.02732","title":"On Margin Maximization in Linear and ReLU Networks","created":"2021-10-06","cited_by_count":34,"area":null},{"id":"2107.00595","title":"Fast Margin Maximization via Dual Acceleration","created":"2021-07-01","cited_by_count":33,"area":null},{"id":"2402.05738","title":"Implicit Bias and Fast Convergence Rates for Self-attention","created":"2024-02-08","cited_by_count":31,"area":null},{"id":"2309.07418","title":"A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time","created":"2023-09-14","cited_by_count":30,"area":null},{"id":"2202.13441","title":"Stability vs Implicit Bias of Gradient Methods on Separable Data and Beyond","created":"2022-02-27","cited_by_count":29,"area":null},{"id":"2303.01462","title":"Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization","created":"2023-03-02","cited_by_count":29,"area":null},{"id":"2201.11729","title":"Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks","created":"2022-01-27","cited_by_count":27,"area":null},{"id":"2309.00079","title":"On the Implicit Bias of Adam","created":"2023-08-31","cited_by_count":27,"area":null},{"id":"2205.12808","title":"Mirror Descent Maximizes Generalized Margin and Can Be Implemented Efficiently","created":"2022-05-25","cited_by_count":26,"area":null},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25,"area":null},{"id":"2408.15417","title":"Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations","created":"2024-08-27","cited_by_count":24,"area":null},{"id":"2110.03891","title":"Does Momentum Change the Implicit Regularization on Separable Data?","created":"2021-10-08","cited_by_count":22,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2112.12986","title":"Is Importance Weighting Incompatible with Interpolating Classifiers?","created":"2021-12-24","cited_by_count":19,"area":null},{"id":"2403.08699","title":"Implicit Regularization of Gradient Flow on One-Layer Softmax Attention","created":"2024-03-13","cited_by_count":19,"area":null},{"id":"2406.08654","title":"Large Stepsize Gradient Descent for Non-Homogeneous Two-Layer Networks: Margin Improvement and Fast Optimization","created":"2024-06-12","cited_by_count":17,"area":null},{"id":"2102.07048","title":"Connecting Interpretability and Robustness in Decision Trees through Separation","created":"2021-02-14","cited_by_count":16,"area":null},{"id":"2306.17499","title":"The Implicit Bias of Minima Stability in Multivariate Shallow ReLU Networks","created":"2023-06-30","cited_by_count":15,"area":null},{"id":"2306.13853","title":"A Unified Approach to Controlling Implicit Regularization via Mirror Descent","created":"2023-06-24","cited_by_count":14,"area":null},{"id":"2402.18551","title":"Implicit Optimization Bias of Next-Token Prediction in Linear Models","created":"2024-02-28","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2405.20763","title":"Improving Generalization and Convergence by Enhancing Implicit Regularization","created":"2024-05-31","cited_by_count":14,"area":null},{"id":"2409.17335","title":"Non-asymptotic Convergence of Training Transformers for Next-token Prediction","created":"2024-09-25","cited_by_count":13,"area":null},{"id":"2505.24022","title":"The Rich and the Simple: On the Implicit Bias of Adam and SGD","created":"2025-05-29","cited_by_count":13,"area":null},{"id":"2410.04489","title":"Grokking at the Edge of Linear Separability","created":"2024-10-06","cited_by_count":12,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2411.01350","title":"The Implicit Bias of Gradient Descent on Separable Multiclass Data","created":"2024-11-02","cited_by_count":11,"area":null},{"id":"2505.00926","title":"How Transformers Learn Regular Language Recognition: A Theoretical Study on Training Dynamics and Implicit Bias","created":"2025-05-02","cited_by_count":11,"area":null},{"id":"2602.16340","title":"The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2502.12706","title":"Scalable Model Merging with Progressive Layer-wise Distillation","created":"2025-02-18","cited_by_count":10,"area":null},{"id":"2506.10887","title":"Generalization or Hallucination? Understanding Out-of-Context Reasoning in Transformers","created":"2025-06-12","cited_by_count":10,"area":"lr"},{"id":"2403.12729","title":"Posterior Uncertainty Quantification in Neural Networks using Data Augmentation","created":"2024-03-18","cited_by_count":9,"area":null},{"id":"2406.12763","title":"Implicit Bias of Mirror Flow on Separable Data","created":"2024-06-18","cited_by_count":9,"area":null},{"id":"2410.14581","title":"Optimizing Attention with Mirror Descent: Generalized Max-Margin Token Selection","created":"2024-10-18","cited_by_count":9,"area":null},{"id":"2206.01399","title":"Generalization for multiclass classification with overparameterized linear models","created":"2022-06-03","cited_by_count":8,"area":null},{"id":"2209.07116","title":"On Generalization of Decentralized Learning with Separable Data","created":"2022-09-15","cited_by_count":8,"area":null},{"id":"2301.12540","title":"Implicit Regularization for Group Sparsity","created":"2023-01-29","cited_by_count":8,"area":null},{"id":"2306.11680","title":"The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks","created":"2023-06-20","cited_by_count":8,"area":null},{"id":"2103.13598","title":"Recent Advances in Large Margin Learning","created":"2021-03-25","cited_by_count":7,"area":null},{"id":"2303.01135","title":"Tight Risk Bounds for Gradient Descent on Separable Data","created":"2023-03-02","cited_by_count":7,"area":null},{"id":"2306.14381","title":"Gradient Descent Converges Linearly for Logistic Regression on Separable Data","created":"2023-06-26","cited_by_count":7,"area":null},{"id":"2504.04105","title":"Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes","created":"2025-04-05","cited_by_count":7,"area":null},{"id":"2108.06808","title":"Implicit Regularization of Bregman Proximal Point Algorithm and Mirror Descent on Separable Data","created":"2021-08-15","cited_by_count":6,"area":null},{"id":"2209.08745","title":"Importance Tempering: Group Robustness for Overparameterized Models","created":"2022-09-19","cited_by_count":6,"area":null},{"id":"2210.09371","title":"On Accelerated Perceptrons and Beyond","created":"2022-10-17","cited_by_count":6,"area":null},{"id":"2502.02132","title":"How Memory in Optimization Algorithms Implicitly Modifies the Loss","created":"2025-02-04","cited_by_count":6,"area":null},{"id":"2506.23908","title":"Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence","created":"2025-06-30","cited_by_count":6,"area":"lr"},{"id":"2102.08868","title":"Bridging the Gap Between Adversarial Robustness and Optimization Bias","created":"2021-02-17","cited_by_count":5,"area":null},{"id":"2201.04545","title":"On generalization bounds for deep networks based on loss surface implicit regularization","created":"2022-01-12","cited_by_count":5,"area":null},{"id":"2301.08117","title":"Convergence beyond the over-parameterized regime using Rayleigh quotients","created":"2023-01-19","cited_by_count":5,"area":null},{"id":"2112.00980","title":"Trap of Feature Diversity in the Learning of MLPs","created":"2021-12-02","cited_by_count":4,"area":null},{"id":"2303.07475","title":"General Loss Functions Lead to (Approximate) Interpolation in High Dimensions","created":"2023-03-13","cited_by_count":4,"area":null},{"id":"2311.14387","title":"Achieving Margin Maximization Exponentially Fast via Progressive Norm Rescaling","created":"2023-11-24","cited_by_count":4,"area":null},{"id":"2602.01642","title":"The Effect of Mini-Batch Noise on the Implicit Bias of Adam","created":"2026-02-02","cited_by_count":4,"area":null},{"id":"2302.12444","title":"On the Training Instability of Shuffling SGD with Batch Normalization","created":"2023-02-24","cited_by_count":3,"area":null},{"id":"2305.13471","title":"Fast Convergence in Learning Two-Layer Neural Networks with Separable Data","created":"2023-05-22","cited_by_count":3,"area":null},{"id":"2204.04476","title":"High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models","created":"2022-04-09","cited_by_count":2,"area":null},{"id":"2403.01420","title":"The Implicit Bias of Heterogeneity towards Invariance: A Study of Multi-Environment Matrix Sensing","created":"2024-03-03","cited_by_count":2,"area":null},{"id":"2505.22359","title":"Multiclass Loss Geometry Matters for Generalization of Gradient Descent in Separable Classification","created":"2025-05-28","cited_by_count":2,"area":null},{"id":"2512.04006","title":"Diagonalizing the Softmax: Hadamard Initialization for Tractable Cross-Entropy Dynamics","created":"2025-12-03","cited_by_count":2,"area":null},{"id":"2602.02470","title":"Breaking the Reversal Curse in Autoregressive Language Models via Identity Bridge","created":"2026-02-02","cited_by_count":2,"area":"lr"},{"id":"2607.06013","title":"Stability Annealing Selects the Implicit Bias of Smoothed Sign Descent: A Rate-Indexed Barrier Path on Separable Data","created":"2026-07-07","cited_by_count":2,"area":null},{"id":"2408.05560","title":"Incremental Gauss-Newton Descent for Machine Learning","created":"2024-08-10","cited_by_count":1,"area":null},{"id":"2502.05668","title":"The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks","created":"2025-02-08","cited_by_count":1,"area":null},{"id":"2602.04832","title":"It's Not a Lottery, It's a Race: Understanding How Gradient Descent Adapts the Network's Capacity to the Task","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.20967","title":"Hard labels sampled from sparse targets mislead rotation invariant algorithms","created":"2026-03-21","cited_by_count":1,"area":null},{"id":"2606.21683","title":"Finite-Sample Performance of Gradient Descent in Logistic Regression with Gaussian Design","created":"2026-06-19","cited_by_count":1,"area":null},{"id":"2104.02578","title":"Neurons learn slower than they think","created":"2021-04-02","cited_by_count":0,"area":null},{"id":"2105.03879","title":"Directional Convergence Analysis under Spherically Symmetric Distribution","created":"2021-05-09","cited_by_count":0,"area":null},{"id":"2201.02761","title":"Global Convergence Analysis of Deep Linear Networks with A One-neuron Layer","created":"2022-01-08","cited_by_count":0,"area":null},{"id":"2212.12675","title":"Iterative regularization in classification via hinge loss diagonal descent","created":"2022-12-24","cited_by_count":0,"area":null},{"id":"2305.17544","title":"Faster Margin Maximization Rates for Generic and Adversarially Robust Optimization Methods","created":"2023-05-27","cited_by_count":0,"area":null},{"id":"2311.02622","title":"Hierarchical Simplicity Bias of Neural Networks","created":"2023-11-05","cited_by_count":0,"area":null},{"id":"2505.12419","title":"Embedding principle of homogeneous neural network for classification problem","created":"2025-05-18","cited_by_count":0,"area":null},{"id":"2505.20235","title":"Variational Deep Learning via Implicit Regularization","created":"2025-05-26","cited_by_count":0,"area":null},{"id":"2510.02107","title":"PENEX: AdaBoost-Inspired Neural Network Regularization","created":"2025-10-02","cited_by_count":0,"area":null}],"next_cursor":"100"}