{"total":92,"rows":[{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230,"area":null},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127,"area":null},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104,"area":null},{"id":"2109.07103","title":"Automatic Symmetry Discovery with Lie Algebra Convolutional Network","created":"2021-09-15","cited_by_count":83,"area":null},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2205.14258","title":"On the Symmetries of Deep Learning Models and their Internal Representations","created":"2022-05-27","cited_by_count":64,"area":null},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50,"area":null},{"id":"2409.14623","title":"From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks","created":"2024-09-22","cited_by_count":49,"area":null},{"id":"2307.00144","title":"Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows","created":"2023-06-30","cited_by_count":45,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2202.07141","title":"Machine Learning in Aerodynamic Shape Optimization","created":"2022-02-15","cited_by_count":39,"area":null},{"id":"2306.04251","title":"Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks","created":"2023-06-07","cited_by_count":39,"area":null},{"id":"2306.06179","title":"Hidden symmetries of ReLU networks","created":"2023-06-09","cited_by_count":39,"area":null},{"id":"2506.13018","title":"Symmetry in Neural Network Parameter Spaces","created":"2025-06-16","cited_by_count":36,"area":null},{"id":"2102.04396","title":"SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality","created":"2021-02-08","cited_by_count":35,"area":null},{"id":"2210.17216","title":"Symmetries, flat minima, and the conserved quantities of gradient flow","created":"2022-10-31","cited_by_count":35,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2106.00694","title":"Symmetry-via-Duality: Invariant Neural Network Densities from Parameter-Space Correlators","created":"2021-06-01","cited_by_count":29,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2309.00079","title":"On the Implicit Bias of Adam","created":"2023-08-31","cited_by_count":27,"area":null},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26,"area":null},{"id":"2205.10637","title":"Symmetry Teleportation for Accelerated Optimization","created":"2022-05-21","cited_by_count":25,"area":null},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2406.10685","title":"Scale Equivariant Graph Metanetworks","created":"2024-06-15","cited_by_count":24,"area":null},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23,"area":null},{"id":"2301.08203","title":"An SDE for Modeling SAM: Theory and Insights","created":"2023-01-19","cited_by_count":22,"area":null},{"id":"2203.12610","title":"AI Poincar\\'{e} 2.0: Machine Learning Conservation Laws from Differential Equations","created":"2022-03-23","cited_by_count":20,"area":null},{"id":"2102.02805","title":"How do Quadratic Regularizers Prevent Catastrophic Forgetting: The Role of Interpolation","created":"2021-02-04","cited_by_count":19,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2209.03695","title":"Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes","created":"2022-09-08","cited_by_count":19,"area":null},{"id":"2402.07193","title":"Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent","created":"2024-02-11","cited_by_count":19,"area":null},{"id":"2305.16534","title":"Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2302.07384","title":"The Geometry of Neural Nets' Parameter Spaces Under Reparametrization","created":"2023-02-14","cited_by_count":16,"area":null},{"id":"2408.17221","title":"Geometry of Lightning Self-Attention: Identifiability and Dimension","created":"2024-08-30","cited_by_count":16,"area":null},{"id":"2502.00264","title":"Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion","created":"2025-02-01","cited_by_count":16,"area":null},{"id":"2501.11587","title":"Recurrent Diffusion for Large-Scale Parameter Generation","created":"2025-01-20","cited_by_count":15,"area":null},{"id":"2310.11428","title":"Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression","created":"2023-10-17","cited_by_count":14,"area":null},{"id":"2502.02496","title":"Deep Weight Factorization: Sparse Learning Through the Lens of Artificial Symmetries","created":"2025-02-04","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2210.15898","title":"Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis","created":"2022-10-28","cited_by_count":13,"area":null},{"id":"2301.00008","title":"Effects of Data Geometry in Early Deep Learning","created":"2022-12-29","cited_by_count":12,"area":null},{"id":"2103.12682","title":"How to decay your learning rate","created":"2021-03-23","cited_by_count":11,"area":null},{"id":"2405.12888","title":"Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows","created":"2024-05-21","cited_by_count":11,"area":null},{"id":"2406.16689","title":"Coding schemes in neural networks learning classification tasks","created":"2024-06-24","cited_by_count":11,"area":null},{"id":"2310.07235","title":"Are GATs Out of Balance?","created":"2023-10-11","cited_by_count":10,"area":null},{"id":"2505.23681","title":"Understanding Mode Connectivity via Parameter Space Symmetry","created":"2025-05-29","cited_by_count":10,"area":null},{"id":"2504.19274","title":"TeleSparse: Practical Privacy-Preserving Verification of Deep Neural Networks","created":"2025-04-27","cited_by_count":9,"area":null},{"id":"2202.04302","title":"On the Implicit Bias of Gradient Descent for Temporal Extrapolation","created":"2022-02-09","cited_by_count":7,"area":null},{"id":"2207.10283","title":"One-vs-the-Rest Loss to Focus on Important Samples in Adversarial Training","created":"2022-07-21","cited_by_count":7,"area":null},{"id":"2402.02362","title":"Unification of Symmetries Inside Neural Networks: Transformer, Feedforward and Neural ODE","created":"2024-02-04","cited_by_count":7,"area":null},{"id":"2410.14837","title":"Topological obstruction to the training of shallow ReLU neural networks","created":"2024-10-18","cited_by_count":6,"area":null},{"id":"2602.00693","title":"Topology and Geometry of the Learning Space of ReLU Networks: Connectivity and Singularities","created":"2026-01-31","cited_by_count":6,"area":null},{"id":"2602.19799","title":"Path-conditioned training: a principled way to rescale ReLU neural networks","created":"2026-02-23","cited_by_count":6,"area":null},{"id":"2302.03281","title":"Utility-based Perturbed Gradient Descent: An Optimizer for Continual Learning","created":"2023-02-07","cited_by_count":5,"area":null},{"id":"2601.22257","title":"Symmetry Breaking in Transformers for Efficient and Interpretable Training","created":"2026-01-29","cited_by_count":5,"area":null},{"id":"2411.05746","title":"Continuous-Time Analysis of Adaptive Optimization and Normalization","created":"2024-11-08","cited_by_count":4,"area":null},{"id":"2511.01137","title":"Regularization Implies balancedness in the deep linear network","created":"2025-11-03","cited_by_count":4,"area":null},{"id":"2210.06819","title":"Mean-field analysis for heavy ball methods: Dropout-stability, connectivity, and global convergence","created":"2022-10-13","cited_by_count":3,"area":null},{"id":"2509.23898","title":"Differentiable Sparsity via $D$-Gating: Simple and Versatile Structured Penalization","created":"2025-09-28","cited_by_count":3,"area":null},{"id":"2601.06597","title":"Understanding and inverse design of implicit bias in stochastic learning: a geometric perspective","created":"2026-01-10","cited_by_count":3,"area":null},{"id":"2605.18319","title":"The Symmetries of Three-Layer ReLU Networks","created":"2026-05-18","cited_by_count":3,"area":null},{"id":"2210.03069","title":"PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks","created":"2022-10-06","cited_by_count":2,"area":null},{"id":"2502.11362","title":"Teleportation With Null Space Gradient Projection for Optimization Acceleration","created":"2025-02-17","cited_by_count":2,"area":null},{"id":"2504.15399","title":"Improving Learning to Optimize Using Parameter Symmetries","created":"2025-04-21","cited_by_count":2,"area":null},{"id":"2602.18948","title":"Toward Manifest Relationality in Transformers via Symmetry Reduction","created":"2026-02-21","cited_by_count":2,"area":null},{"id":"2407.11158","title":"Physics-embedded Fourier Neural Network for Partial Differential Equations","created":"2024-07-15","cited_by_count":1,"area":null},{"id":"2605.04115","title":"Learning reveals invisible structure in low-rank RNNs","created":"2026-05-05","cited_by_count":1,"area":null},{"id":"2606.05957","title":"Dead Directions: Geometric Singular Learning","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2606.10913","title":"Conservation Laws from Data Symmetry in Neural Networks","created":"2026-06-09","cited_by_count":1,"area":null},{"id":"2606.17816","title":"Conservation Laws for Modern Neural Architectures","created":"2026-06-16","cited_by_count":1,"area":null},{"id":"2312.07174","title":"Investigation into the Training Dynamics of Learned Optimizers","created":"2023-12-12","cited_by_count":0,"area":null},{"id":"2511.17399","title":"Stable Coresets via Posterior Sampling: Aligning Induced and Full Loss Landscapes","created":"2025-11-21","cited_by_count":0,"area":null},{"id":"2512.21447","title":"An Equivariance Toolbox for Learning Dynamics","created":"2025-12-24","cited_by_count":0,"area":null},{"id":"2604.07405","title":"Conservation Law Breaking at the Edge of Stability: A Spectral Theory of Non-Convex Neural Network Optimization","created":"2026-04-08","cited_by_count":0,"area":null},{"id":"2604.14430","title":"Three-Phase Transformer","created":"2026-04-15","cited_by_count":0,"area":null},{"id":"2604.25150","title":"The Role of Symmetry in Optimizing Overparameterized Networks","created":"2026-04-28","cited_by_count":0,"area":null},{"id":"2605.01288","title":"A Theory of Saddle Escape in Deep Nonlinear Networks","created":"2026-05-02","cited_by_count":0,"area":null},{"id":"2606.00442","title":"Exploiting weight-space symmetries for approximating curvature","created":"2026-05-30","cited_by_count":0,"area":null},{"id":"2607.07845","title":"Explaining Near-Zero Hessian Eigenvalues Through Approximate Symmetries in Neural Networks","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2608.00097","title":"Untrainable elements determine what physical learning remembers","created":"2026-07-30","cited_by_count":0,"area":null},{"id":"2608.05136","title":"The Loss Does Not See the Basis, but Adam Does","created":"2026-08-05","cited_by_count":0,"area":null},{"id":"2609.09116","title":"When Does Scale-Invariant Optimization Become Unstable? An Exact Schedule Law with Weight Decay","created":"2026-09-08","cited_by_count":0,"area":null},{"id":"2609.13057","title":"Benign Loss Landscapes Can Coexist with Worst-Case Hardness","created":"2026-09-11","cited_by_count":0,"area":null},{"id":"2609.32752","title":"Action Shaping: Policies Absorb What They Can Express","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.33527","title":"Discovering Symmetries in Neural Network Parameter Spaces","created":"2026-09-27","cited_by_count":0,"area":null},{"id":"2609.34549","title":"On Parameter Symmetries and Conservation Laws in Gradient Flow","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2609.37535","title":"Why Adaptive Optimizers Underestimate Rare Tokens","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2610.00615","title":"Learning the identity: a case study of how SGD selects among functional decompositions","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.03640","title":"Broken scale symmetries in undercomplete linear autoencoders","created":"2026-10-02","cited_by_count":0,"area":null},{"id":"2610.04969","title":"Hamiltonian Metric Learning and Energy-Based Training: A Dissipative Geometric Framework for Optimization","created":"2026-10-04","cited_by_count":0,"area":null}],"next_cursor":null}