{"total":83,"rows":[{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84,"area":null},{"id":"2206.00939","title":"Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs","created":"2022-06-02","cited_by_count":76,"area":null},{"id":"2404.04454","title":"Implicit Bias of AdamW: $\\ell_\\infty$ Norm Constrained Optimization","created":"2024-04-05","cited_by_count":58,"area":null},{"id":"2201.12760","title":"Implicit Regularization Towards Rank Minimization in ReLU Networks","created":"2022-01-30","cited_by_count":53,"area":null},{"id":"2210.07082","title":"Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data","created":"2022-10-13","cited_by_count":46,"area":null},{"id":"2403.02241","title":"Neural Redshift: Random Networks are not Random Functions","created":"2024-03-04","cited_by_count":43,"area":null},{"id":"2301.11500","title":"Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing","created":"2023-01-27","cited_by_count":42,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2207.04036","title":"Implicit Bias of Gradient Descent on Reparametrized Models: On Equivalence to Mirror Descent","created":"2022-07-08","cited_by_count":39,"area":null},{"id":"2309.15111","title":"SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem","created":"2023-09-26","cited_by_count":39,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2311.07568","title":"Feature emergence via margin maximization: case studies in algebraic tasks","created":"2023-11-13","cited_by_count":33,"area":null},{"id":"2305.16536","title":"Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression","created":"2023-05-25","cited_by_count":30,"area":null},{"id":"2303.01462","title":"Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization","created":"2023-03-02","cited_by_count":29,"area":null},{"id":"2307.12851","title":"Early Neuron Alignment in Two-layer ReLU Networks with Small Initialization","created":"2023-07-24","cited_by_count":28,"area":null},{"id":"2201.11729","title":"Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks","created":"2022-01-27","cited_by_count":27,"area":null},{"id":"2302.00457","title":"Simplicity Bias in 1-Hidden Layer Neural Networks","created":"2023-02-01","cited_by_count":26,"area":null},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25,"area":null},{"id":"2303.01456","title":"The Double-Edged Sword of Implicit Bias: Generalization vs. Robustness in ReLU Networks","created":"2023-03-02","cited_by_count":23,"area":null},{"id":"2205.12101","title":"Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2504.09484","title":"An overview of condensation phenomenon in deep learning","created":"2025-04-13","cited_by_count":17,"area":null},{"id":"2303.06561","title":"Phase Diagram of Initial Condensation for Two-layer Neural Networks","created":"2023-03-12","cited_by_count":16,"area":null},{"id":"2306.06479","title":"Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs","created":"2023-06-10","cited_by_count":16,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2208.02789","title":"Feature selection with gradient descent on two-layer networks in low-rotation regimes","created":"2022-08-04","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2405.20763","title":"Improving Generalization and Convergence by Enhancing Implicit Regularization","created":"2024-05-31","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2503.10065","title":"Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild","created":"2025-03-13","cited_by_count":13,"area":null},{"id":"2402.09226","title":"Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networks","created":"2024-02-14","cited_by_count":11,"area":null},{"id":"2405.17299","title":"Simplicity Bias of Two-Layer Networks beyond Linearly Separable Data","created":"2024-05-27","cited_by_count":11,"area":null},{"id":"2410.02348","title":"Simplicity bias and optimization threshold in two-layer ReLU networks","created":"2024-10-03","cited_by_count":11,"area":null},{"id":"2411.01350","title":"The Implicit Bias of Gradient Descent on Separable Multiclass Data","created":"2024-11-02","cited_by_count":11,"area":null},{"id":"2411.01432","title":"Meta-Exploiting Frequency Prior for Cross-Domain Few-Shot Learning","created":"2024-11-03","cited_by_count":11,"area":null},{"id":"2503.03595","title":"Towards Understanding Text Hallucination of Diffusion Models via Local Generation Bias","created":"2025-03-05","cited_by_count":11,"area":"diffusion"},{"id":"2206.03466","title":"Adversarial Reprogramming Revisited","created":"2022-06-07","cited_by_count":10,"area":null},{"id":"2502.09297","title":"When Do Neural Networks Learn World Models?","created":"2025-02-13","cited_by_count":8,"area":"wm"},{"id":"2403.08121","title":"Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations","created":"2024-03-12","cited_by_count":7,"area":null},{"id":"2206.07892","title":"Max-Margin Works while Large Margin Fails: Generalization without Uniform Convergence","created":"2022-06-16","cited_by_count":6,"area":null},{"id":"2303.10758","title":"Lower Generalization Bounds for GD and SGD in Smooth Stochastic Convex Optimization","created":"2023-03-19","cited_by_count":6,"area":null},{"id":"2410.14837","title":"Topological obstruction to the training of shallow ReLU neural networks","created":"2024-10-18","cited_by_count":6,"area":null},{"id":"2505.22650","title":"On Learning Verifiers and Implications to Chain-of-Thought Reasoning","created":"2025-05-28","cited_by_count":6,"area":"lr"},{"id":"2602.00693","title":"Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities","created":"2026-01-31","cited_by_count":6,"area":null},{"id":"2206.02139","title":"Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks","created":"2022-06-05","cited_by_count":5,"area":null},{"id":"2305.09145","title":"Deep ReLU Networks Have Surprisingly Simple Polytopes","created":"2023-05-16","cited_by_count":5,"area":null},{"id":"2310.14423","title":"A Quadratic Synchronization Rule for Distributed Deep Learning","created":"2023-10-22","cited_by_count":5,"area":null},{"id":"2405.15942","title":"Can Implicit Bias Imply Adversarial Robustness?","created":"2024-05-24","cited_by_count":5,"area":null},{"id":"2311.14387","title":"Achieving Margin Maximization Exponentially Fast via Progressive Norm Rescaling","created":"2023-11-24","cited_by_count":4,"area":null},{"id":"2402.07875","title":"Implicit Bias of Policy Gradient in Linear Quadratic Control: Extrapolation to Unseen Initial States","created":"2024-02-12","cited_by_count":4,"area":"deeprl"},{"id":"2406.12615","title":"When Are Bias-Free ReLU Networks Effectively Linear Networks?","created":"2024-06-18","cited_by_count":4,"area":null},{"id":"2511.22270","title":"Towards Understanding Generalization in DP-GD: A Case Study in Training Two-Layer CNNs","created":"2025-11-27","cited_by_count":4,"area":null},{"id":"2202.06054","title":"Towards Data-Algorithm Dependent Generalization: a Case Study on Overparameterized Linear Regression","created":"2022-02-12","cited_by_count":3,"area":null},{"id":"2303.16887","title":"Towards Understanding the Effect of Pretraining Label Granularity","created":"2023-03-29","cited_by_count":3,"area":null},{"id":"2303.17805","title":"On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks","created":"2023-03-31","cited_by_count":3,"area":null},{"id":"2505.11370","title":"Understanding Nonlinear Implicit Bias via Region Counts in Input Space","created":"2025-05-16","cited_by_count":2,"area":null},{"id":"2505.22359","title":"Multiclass Loss Geometry Matters for Generalization of Gradient Descent in Separable Classification","created":"2025-05-28","cited_by_count":2,"area":null},{"id":"2507.10578","title":"When and Where do Data Poisons Attack Textual Inversion?","created":"2025-07-11","cited_by_count":2,"area":"diffusion"},{"id":"2607.06013","title":"Stability Annealing Selects the Implicit Bias of Smoothed Sign Descent: A Rate-Indexed Barrier Path on Separable Data","created":"2026-07-07","cited_by_count":2,"area":null},{"id":"2607.17624","title":"Can Transformers Really Do It All? On the Compatibility of Inductive Biases Across Tasks","created":"2026-07-20","cited_by_count":2,"area":null},{"id":"2306.01870","title":"Implicit Regularization in Feedback Alignment Learning Mechanisms for Neural Networks","created":"2023-06-02","cited_by_count":1,"area":null},{"id":"2409.08509","title":"Exploiting Supervised Poison Vulnerability to Strengthen Self-Supervised Defense","created":"2024-09-13","cited_by_count":1,"area":null},{"id":"2505.22578","title":"Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2311.02622","title":"Hierarchical Simplicity Bias of Neural Networks","created":"2023-11-05","cited_by_count":0,"area":null},{"id":"2312.16043","title":"An extended asymmetric sigmoid with Perceptron (SIGTRON) for imbalanced linear classification","created":"2023-12-26","cited_by_count":0,"area":null},{"id":"2410.06921","title":"Adversarial Vulnerability as a Consequence of On-Manifold Inseparibility","created":"2024-10-09","cited_by_count":0,"area":null},{"id":"2411.09133","title":"Computational metaoptics for imaging","created":"2024-11-14","cited_by_count":0,"area":null},{"id":"2502.11031","title":"A Critical Review of Predominant Bias in Neural Networks","created":"2025-02-16","cited_by_count":0,"area":null},{"id":"2504.08628","title":"Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks","created":"2025-04-11","cited_by_count":0,"area":null},{"id":"2505.06601","title":"Learning Guarantee of Reward Modeling Using Deep Neural Networks","created":"2025-05-10","cited_by_count":0,"area":"alignment"},{"id":"2505.16204","title":"Directional Convergence, Benign Overfitting of Gradient Descent in leaky ReLU two-layer Neural Networks","created":"2025-05-22","cited_by_count":0,"area":null},{"id":"2505.17919","title":"KITINet: KInetic Theory Inspired Inter-Channel Information Exchange for Residual Networks","created":"2025-05-23","cited_by_count":0,"area":null},{"id":"2602.00172","title":"Neuron Block Dynamics for XOR Classification with Zero-Margin","created":"2026-01-30","cited_by_count":0,"area":null},{"id":"2602.22936","title":"Generalization Bounds of Stochastic Gradient Descent in Homogeneous Neural Networks","created":"2026-02-26","cited_by_count":0,"area":null},{"id":"2603.02095","title":"On the Rate of Convergence of GD in Non-linear Neural Networks: An Adversarial Robustness Perspective","created":"2026-03-02","cited_by_count":0,"area":null},{"id":"2603.10397","title":"On the Learning Dynamics of Two-layer Linear Networks with Label Noise SGD","created":"2026-03-11","cited_by_count":0,"area":null},{"id":"2605.29823","title":"Quantifying and Optimizing Simplicity via Polynomial Representations","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2608.03197","title":"On the Implicit Flatness Bias of Sharpness-Aware Minimization: A Linear Stability Analysis with Quantitative Hyperparameter Bounds","created":"2026-08-04","cited_by_count":0,"area":null},{"id":"2610.15359","title":"Adversarial Detection for Pre-trained Classifiers via Lipschitz-Margin Analysis with Certification","created":"2026-10-11","cited_by_count":0,"area":null}],"next_cursor":null}