{"total":62,"rows":[{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2201.07395","title":"Overview frequency principle/spectral bias in deep learning","created":"2022-01-19","cited_by_count":69,"area":null},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2105.14301","title":"A Theory of Neural Tangent Kernel Alignment and Its Influence on Training","created":"2021-05-29","cited_by_count":25,"area":null},{"id":"2207.05952","title":"Implicit regularization of dropout","created":"2022-07-13","cited_by_count":25,"area":null},{"id":"2111.15527","title":"Embedding Principle: a hierarchical structure of loss landscape of deep neural networks","created":"2021-11-30","cited_by_count":22,"area":null},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19,"area":null},{"id":"2209.07263","title":"Robustness in deep learning: The good (width), the bad (depth), and the ugly (initialization)","created":"2022-09-15","cited_by_count":18,"area":null},{"id":"2405.05409","title":"Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing","created":"2024-05-08","cited_by_count":17,"area":null},{"id":"2504.09484","title":"An overview of condensation phenomenon in deep learning","created":"2025-04-13","cited_by_count":17,"area":null},{"id":"2303.06561","title":"Phase Diagram of Initial Condensation for Two-layer Neural Networks","created":"2023-03-12","cited_by_count":16,"area":null},{"id":"2305.12133","title":"Loss Spike in Training Neural Networks","created":"2023-05-20","cited_by_count":16,"area":null},{"id":"2312.12226","title":"On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width","created":"2023-12-19","cited_by_count":15,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2401.08309","title":"Anchor function: a type of benchmark functions for studying language models","created":"2024-01-16","cited_by_count":11,"area":null},{"id":"2402.09226","title":"Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networks","created":"2024-02-14","cited_by_count":11,"area":null},{"id":"2405.17299","title":"Simplicity Bias of Two-Layer Networks beyond Linearly Separable Data","created":"2024-05-27","cited_by_count":11,"area":null},{"id":"2310.20579","title":"Initialization Matters: Privacy-Utility Analysis of Overparameterized Neural Networks","created":"2023-10-31","cited_by_count":10,"area":null},{"id":"2510.06954","title":"From Condensation to Rank Collapse: A Two-Stage Analysis of Transformer Training Dynamics","created":"2025-10-08","cited_by_count":10,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2211.11623","title":"Linear Stability Hypothesis and Rank Stratification for Nonlinear Models","created":"2022-11-21","cited_by_count":7,"area":null},{"id":"2403.08121","title":"Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations","created":"2024-03-12","cited_by_count":7,"area":null},{"id":"2402.05626","title":"Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding","created":"2024-02-08","cited_by_count":6,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2307.08921","title":"Optimistic Estimate Uncovers the Potential of Nonlinear Models","created":"2023-07-18","cited_by_count":5,"area":null},{"id":"2105.11675","title":"An Upper Limit of Decaying Rate with Respect to Frequency in Deep Neural Network","created":"2021-05-25","cited_by_count":4,"area":null},{"id":"2309.10370","title":"Geometric structure of shallow neural networks and constructive ${\\mathcal L}^2$ cost minimization","created":"2023-09-19","cited_by_count":4,"area":null},{"id":"2309.15244","title":"Homotopy Relaxation Training Algorithms for Infinite-Width Two-Layer ReLU Neural Networks","created":"2023-09-26","cited_by_count":4,"area":null},{"id":"2406.12615","title":"When Are Bias-Free ReLU Networks Effectively Linear Networks?","created":"2024-06-18","cited_by_count":4,"area":null},{"id":"2505.21722","title":"Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape","created":"2025-05-27","cited_by_count":4,"area":null},{"id":"2210.16286","title":"A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2302.01002","title":"Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning","created":"2023-02-02","cited_by_count":3,"area":null},{"id":"2402.15958","title":"On the dynamics of three-layer neural networks: initial condensation","created":"2024-02-25","cited_by_count":3,"area":null},{"id":"2405.13721","title":"Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion","created":"2024-05-22","cited_by_count":3,"area":null},{"id":"2110.09902","title":"Toward Understanding Convolutional Neural Networks from Volterra Convolution Perspective","created":"2021-10-19","cited_by_count":2,"area":null},{"id":"2206.11533","title":"Stochastic Langevin Differential Inclusions with Applications to Machine Learning","created":"2022-06-23","cited_by_count":2,"area":null},{"id":"2405.01041","title":"Efficient and Flexible Method for Reducing Moderate-size Deep Neural Networks with Condensation","created":"2024-05-02","cited_by_count":2,"area":null},{"id":"2407.19353","title":"Spring-block theory of feature learning in deep neural networks","created":"2024-07-28","cited_by_count":2,"area":null},{"id":"2509.20124","title":"Probability Signature: Bridging Data Semantics and Embedding Structure in Language Models","created":"2025-09-24","cited_by_count":2,"area":null},{"id":"2510.21078","title":"Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2410.20119","title":"On Multi-Stage Loss Dynamics in Neural Networks: Mechanisms of Plateau and Descent Stages","created":"2024-10-26","cited_by_count":1,"area":null},{"id":"2509.01349","title":"Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks","created":"2025-09-01","cited_by_count":1,"area":null},{"id":"2510.25800","title":"FreIE: Low-Frequency Spectral Bias in Neural Networks for Time-Series Tasks","created":"2025-10-29","cited_by_count":1,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2201.12198","title":"Limitation of Characterizing Implicit Regularization by Data-independent Functions","created":"2022-01-28","cited_by_count":0,"area":null},{"id":"2304.00957","title":"Properties and Potential Applications of Random Functional-Linked Types of Neural Networks","created":"2023-04-03","cited_by_count":0,"area":null},{"id":"2404.04859","title":"Demystifying Lazy Training of Neural Networks from a Macroscopic Viewpoint","created":"2024-04-07","cited_by_count":0,"area":null},{"id":"2405.03095","title":"Loss Jump During Loss Switch in Solving PDEs with Neural Networks","created":"2024-05-06","cited_by_count":0,"area":null},{"id":"2406.18035","title":"Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization","created":"2024-06-26","cited_by_count":0,"area":null},{"id":"2503.10587","title":"The Spectral Bias of Shallow Neural Network Learning is Shaped by the Choice of Non-linearity","created":"2025-03-13","cited_by_count":0,"area":null},{"id":"2509.23178","title":"Limit Analysis for Symbolic Multi-step Reasoning Tasks with Information Propagation Rules Based on Transformers","created":"2025-09-27","cited_by_count":0,"area":null},{"id":"2511.00449","title":"Towards Reliable Pediatric Brain Tumor Segmentation: Task-Specific nnU-Net Enhancements","created":"2025-11-01","cited_by_count":0,"area":null},{"id":"2603.10397","title":"On the Learning Dynamics of Two-layer Linear Networks with Label Noise SGD","created":"2026-03-11","cited_by_count":0,"area":null},{"id":"2606.17945","title":"Small Initialization Matters for Large Language Models","created":"2026-06-16","cited_by_count":0,"area":null},{"id":"2606.31110","title":"Explaining Machine Learning and Memorization with Statistical Mechanics","created":"2026-06-30","cited_by_count":0,"area":null},{"id":"2607.16720","title":"Effects of width-dependent model hyperparameters and $\\ell_2$-regularization on the loss landscape of two-layer ReLU networks","created":"2026-07-18","cited_by_count":0,"area":null},{"id":"2609.02373","title":"Percolation Dynamics in Optimization: Variance Cascades and Nested Symmetry","created":"2026-09-02","cited_by_count":0,"area":null},{"id":"2609.35288","title":"$\\lambda$-JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.04533","title":"Weight Decay and Neuron Condensation: A Three-Stage Analysis of Two-Layer ReLU Networks","created":"2026-10-03","cited_by_count":0,"area":null}],"next_cursor":null}