{"total":85,"rows":[{"id":"2206.00939","title":"Gradient flow dynamics of shallow ReLU networks for square loss and orthogonal inputs","created":"2022-06-02","cited_by_count":76,"area":null},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2305.18270","title":"How Two-Layer Neural Networks Learn, One (Giant) Step at a Time","created":"2023-05-29","cited_by_count":68,"area":null},{"id":"2304.00488","title":"Saddle-to-Saddle Dynamics in Diagonal Linear Networks","created":"2023-04-02","cited_by_count":57,"area":null},{"id":"2310.19793","title":"On Learning Gaussian Multi-index Models with Gradient Flow","created":"2023-10-30","cited_by_count":57,"area":null},{"id":"2306.07042","title":"Transformers learn through gradual rank increase","created":"2023-06-12","cited_by_count":52,"area":null},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49,"area":null},{"id":"2410.06833","title":"Dynamic metastability in the self-attention model","created":"2024-10-09","cited_by_count":46,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2309.15111","title":"SGD Finds then Tunes Features in Two-Layer Neural Networks with near-Optimal Sample Complexity: A Case Study in the XOR problem","created":"2023-09-26","cited_by_count":39,"area":null},{"id":"2209.15055","title":"Implicit Bias of Large Depth Networks: a Notion of Rank for Nonlinear Functions","created":"2022-09-29","cited_by_count":38,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2305.16038","title":"Implicit bias of SGD in $L_{2}$-regularized linear DNNs: One-way jumps from high to low rank","created":"2023-05-25","cited_by_count":29,"area":null},{"id":"2310.06301","title":"Dynamical versus Bayesian Phase Transitions in a Toy Model of Superposition","created":"2023-10-10","cited_by_count":29,"area":"mechinterp"},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2110.12661","title":"ZerO Initialization: Initializing Neural Networks with only Zeros and Ones","created":"2021-10-25","cited_by_count":28,"area":null},{"id":"2208.14673","title":"Incremental Learning in Diagonal Linear Networks","created":"2022-08-31","cited_by_count":28,"area":null},{"id":"2505.17863","title":"The emergence of sparse attention: impact of data distribution and benefits of repetition","created":"2025-05-23","cited_by_count":25,"area":null},{"id":"2211.16980","title":"Infinite-width limit of deep linear neural networks","created":"2022-11-29","cited_by_count":20,"area":null},{"id":"2312.00935","title":"Understanding Unimodal Bias in Multimodal Deep Linear Networks","created":"2023-12-01","cited_by_count":19,"area":null},{"id":"2405.17580","title":"Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes","created":"2024-05-27","cited_by_count":18,"area":null},{"id":"2205.15809","title":"Feature Learning in $L_{2}$-regularized DNNs: Attraction/Repulsion and Sparsity","created":"2022-05-31","cited_by_count":17,"area":null},{"id":"2405.13456","title":"Deep linear networks for regression are implicitly regularized towards flat minima","created":"2024-05-22","cited_by_count":17,"area":null},{"id":"2405.18273","title":"Synchronization on circles and spheres with nonlinear interactions","created":"2024-05-28","cited_by_count":17,"area":null},{"id":"2306.06479","title":"Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs","created":"2023-06-10","cited_by_count":16,"area":null},{"id":"2402.18724","title":"Learning Associative Memories with Gradient Descent","created":"2024-02-28","cited_by_count":16,"area":null},{"id":"2508.12837","title":"Learning In-context n-grams with Transformers: Sub-n-grams Are Near-stationary Points","created":"2025-08-18","cited_by_count":16,"area":null},{"id":"2305.12467","title":"Understanding Multi-phase Optimization Dynamics and Rich Nonlinear Behaviors of ReLU Networks","created":"2023-05-21","cited_by_count":15,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2501.17745","title":"Dynamics of Transient Structure in In-Context Linear Regression Transformers","created":"2025-01-29","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2410.23169","title":"The Persistence of Neural Collapse Despite Low-Rank Bias","created":"2024-10-30","cited_by_count":13,"area":null},{"id":"2502.07998","title":"Adaptive kernel predictors from feature-learning infinite limits of neural networks","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2502.05300","title":"Parameter Symmetry Potentially Unifies Deep Learning Theory","created":"2025-02-07","cited_by_count":12,"area":null},{"id":"2306.11250","title":"InRank: Incremental Low-Rank Learning","created":"2023-06-20","cited_by_count":10,"area":null},{"id":"2408.11979","title":"Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?","created":"2024-08-21","cited_by_count":10,"area":null},{"id":"2602.03655","title":"Sequential Group Composition: A Window into the Mechanics of Deep Learning","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2603.00742","title":"To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters","created":"2026-02-28","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2303.13093","title":"Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent","created":"2023-03-23","cited_by_count":8,"area":null},{"id":"2305.10623","title":"The star-shaped space of solutions of the spherical negative perceptron","created":"2023-05-18","cited_by_count":8,"area":null},{"id":"2502.09863","title":"Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models","created":"2025-02-14","cited_by_count":8,"area":null},{"id":"2506.02269","title":"A Tale of Two Symmetries: Exploring the Loss Landscape of Equivariant Models","created":"2025-06-02","cited_by_count":8,"area":null},{"id":"2403.08121","title":"Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations","created":"2024-03-12","cited_by_count":7,"area":null},{"id":"2402.03698","title":"Estimating the Local Learning Coefficient at Scale","created":"2024-02-06","cited_by_count":6,"area":null},{"id":"2406.06534","title":"Compressed Meta-Optical Encoder for Image Classification","created":"2024-04-23","cited_by_count":6,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2402.05013","title":"Compression of Structured Data with Autoencoders: Provable Benefit of Nonlinearities and Depth","created":"2024-02-07","cited_by_count":5,"area":null},{"id":"2405.15942","title":"Can Implicit Bias Imply Adversarial Robustness?","created":"2024-05-24","cited_by_count":5,"area":null},{"id":"2502.17340","title":"Low-rank bias, weight decay, and model merging in neural networks","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2406.12615","title":"When Are Bias-Free ReLU Networks Effectively Linear Networks?","created":"2024-06-18","cited_by_count":4,"area":null},{"id":"2603.29805","title":"From Density Matrices to Phase Transitions in Deep Learning: Spectral Early Warnings and Interpretability","created":"2026-03-31","cited_by_count":4,"area":null},{"id":"2311.05061","title":"Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics","created":"2023-11-08","cited_by_count":3,"area":null},{"id":"2405.13721","title":"Connectivity Shapes Implicit Regularization in Matrix Factorization Models for Matrix Completion","created":"2024-05-22","cited_by_count":3,"area":null},{"id":"2406.02157","title":"Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2604.21905","title":"Low-Rank Adaptation Redux for Large Models","created":"2026-04-23","cited_by_count":3,"area":null},{"id":"2606.30509","title":"Muon learns balanced solutions in matrix factorization without slow saddle-to-saddle dynamics","created":"2026-06-29","cited_by_count":3,"area":null},{"id":"2503.16316","title":"On the Cone Effect in the Learning Dynamics","created":"2025-03-20","cited_by_count":2,"area":null},{"id":"2510.21078","title":"Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2512.04006","title":"Diagonalizing the Softmax: Hadamard Initialization for Tractable Cross-Entropy Dynamics","created":"2025-12-03","cited_by_count":2,"area":null},{"id":"2512.18452","title":"Secret mixtures of experts inside your LLM","created":"2025-12-20","cited_by_count":2,"area":"moe"},{"id":"2602.07697","title":"On the Infinite Width and Depth Limits of Predictive Coding Networks","created":"2026-02-07","cited_by_count":2,"area":null},{"id":"2602.19143","title":"Incremental Learning of Sparse Attention Patterns in Transformers","created":"2026-02-22","cited_by_count":2,"area":null},{"id":"2606.23198","title":"Incremental Learning in Mirror Flows","created":"2026-06-22","cited_by_count":2,"area":null},{"id":"2212.14150","title":"A Dynamics Theory of Implicit Regularization in Deep Low-Rank Matrix Factorization","created":"2022-12-29","cited_by_count":1,"area":null},{"id":"2406.06354","title":"On the Minimal Degree Bias in Generalization on the Unseen for non-Boolean Functions","created":"2024-06-10","cited_by_count":1,"area":null},{"id":"2602.04548","title":"Gradient Flow Through Diagram Expansions: Learning Regimes and Explicit Solutions","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.20967","title":"Hard labels sampled from sparse targets mislead rotation invariant algorithms","created":"2026-03-21","cited_by_count":1,"area":null},{"id":"2606.06814","title":"The Effect of Training Task Diversity on In-Context Learning through the Lens of Low-Dimensional Subspaces","created":"2026-06-05","cited_by_count":1,"area":null},{"id":"2607.12332","title":"Gradient Flow Dynamics and Implicit Bias of Diagonal Linear Networks under Infinitesimal Initialization","created":"2026-07-14","cited_by_count":1,"area":null},{"id":"2602.00827","title":"Over-Alignment vs Over-Fitting: The Role of Feature Learning Strength in Generalization","created":"2026-01-31","cited_by_count":0,"area":null},{"id":"2603.10397","title":"On the Learning Dynamics of Two-layer Linear Networks with Label Noise SGD","created":"2026-03-11","cited_by_count":0,"area":null},{"id":"2604.06366","title":"Stochastic Gradient Descent in the Saddle-to-Saddle Regime of Deep Linear Networks","created":"2026-04-07","cited_by_count":0,"area":null},{"id":"2605.01288","title":"A Theory of Saddle Escape in Deep Nonlinear Networks","created":"2026-05-02","cited_by_count":0,"area":null},{"id":"2605.27097","title":"Mildly Overparameterized ReLU Networks on Orthogonal Data: Incremental Learning and Implicit Bias","created":"2026-05-26","cited_by_count":0,"area":null},{"id":"2607.10869","title":"Singular perturbations and hierarchical learning in two-layer neural networks","created":"2026-07-12","cited_by_count":0,"area":null},{"id":"2608.06597","title":"Cascading Through the Hierarchy: Regularizer-Induced Feature Detection as Phase Transitions in Deep Linear Neural Networks","created":"2026-08-06","cited_by_count":0,"area":null},{"id":"2609.10879","title":"Learning Orthogonal Multi-Index Models Beyond Small Initialization: Incremental Learning, Competitive Dynamics and Symmetry","created":"2026-09-09","cited_by_count":0,"area":null},{"id":"2609.13057","title":"Benign Loss Landscapes Can Coexist with Worst-Case Hardness","created":"2026-09-11","cited_by_count":0,"area":null}],"next_cursor":null}