{"total":53,"rows":[{"id":"2206.07758","title":"Reconstructing Training Data from Trained Neural Networks","created":"2022-06-15","cited_by_count":133,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2308.16898","title":"Transformers as Support Vector Machines","created":"2023-08-31","cited_by_count":74,"area":null},{"id":"2306.07042","title":"Transformers learn through gradual rank increase","created":"2023-06-12","cited_by_count":52,"area":null},{"id":"2210.07082","title":"Implicit Bias in Leaky ReLU Networks Trained on High-Dimensional Data","created":"2022-10-13","cited_by_count":46,"area":null},{"id":"2301.11500","title":"Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing","created":"2023-01-27","cited_by_count":42,"area":null},{"id":"2209.15055","title":"Implicit Bias of Large Depth Networks: a Notion of Rank for Nonlinear Functions","created":"2022-09-29","cited_by_count":38,"area":null},{"id":"2305.16292","title":"Sharpness-Aware Minimization Leads to Low-Rank Features","created":"2023-05-25","cited_by_count":38,"area":null},{"id":"2406.06811","title":"Learning Continually by Spectral Regularization","created":"2024-06-10","cited_by_count":34,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2303.01462","title":"Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization","created":"2023-03-02","cited_by_count":29,"area":null},{"id":"2302.00457","title":"Simplicity Bias in 1-Hidden Layer Neural Networks","created":"2023-02-01","cited_by_count":26,"area":null},{"id":"2406.04112","title":"Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation","created":"2024-06-06","cited_by_count":26,"area":null},{"id":"2407.11239","title":"From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications","created":"2024-07-15","cited_by_count":25,"area":null},{"id":"2212.12206","title":"Understanding and Improving Transfer Learning of Deep Models via Neural Collapse","created":"2022-12-23","cited_by_count":24,"area":null},{"id":"2205.09072","title":"On the Effective Number of Linear Regions in Shallow Univariate ReLU Networks: Convergence Guarantees and Implicit Bias","created":"2022-05-18","cited_by_count":21,"area":null},{"id":"2206.05794","title":"SGD and Weight Decay Secretly Minimize the Rank of Your Neural Network","created":"2022-06-12","cited_by_count":19,"area":null},{"id":"2312.00935","title":"Understanding Unimodal Bias in Multimodal Deep Linear Networks","created":"2023-12-01","cited_by_count":19,"area":null},{"id":"2305.19008","title":"Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff","created":"2023-05-30","cited_by_count":17,"area":null},{"id":"2405.13456","title":"Deep linear networks for regression are implicitly regularized towards flat minima","created":"2024-05-22","cited_by_count":17,"area":null},{"id":"2405.14468","title":"Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?","created":"2024-05-23","cited_by_count":17,"area":null},{"id":"2306.06479","title":"Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs","created":"2023-06-10","cited_by_count":16,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2202.09028","title":"On the Implicit Bias Towards Minimal Depth of Deep Neural Networks","created":"2022-02-18","cited_by_count":12,"area":null},{"id":"2402.04051","title":"Analysis of Linear Mode Connectivity via Permutation-Based Weight Matching: With Insights into Other Permutation Search Methods","created":"2024-02-06","cited_by_count":9,"area":null},{"id":"2412.18283","title":"On the Local Complexity of Linear Regions in Deep ReLU Networks","created":"2024-12-24","cited_by_count":9,"area":null},{"id":"2209.09315","title":"Deep Linear Networks can Benignly Overfit when Shallow Ones Do","created":"2022-09-19","cited_by_count":8,"area":null},{"id":"2410.07687","title":"Learning to Compress: Local Rank and Information Compression in Deep Neural Networks","created":"2024-10-10","cited_by_count":7,"area":null},{"id":"2502.17340","title":"Low-rank bias, weight decay, and model merging in neural networks","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2302.00257","title":"Implicit Regularization Leads to Benign Overfitting for Sparse Linear Regression","created":"2023-02-01","cited_by_count":4,"area":null},{"id":"2303.00196","title":"Transformed Low-Rank Parameterization Can Help Robust Generalization for Tensor Neural Networks","created":"2023-03-01","cited_by_count":4,"area":null},{"id":"2404.18933","title":"Learning Low-Rank Feature for Thorax Disease Classification","created":"2024-02-14","cited_by_count":4,"area":null},{"id":"2406.12615","title":"When Are Bias-Free ReLU Networks Effectively Linear Networks?","created":"2024-06-18","cited_by_count":4,"area":null},{"id":"2411.13733","title":"On Generalization Bounds for Neural Networks with Low Rank Layers","created":"2024-11-20","cited_by_count":4,"area":null},{"id":"2510.01303","title":"Low Rank Gradients and Where to Find Them","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2603.03597","title":"NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training","created":"2026-03-04","cited_by_count":4,"area":null},{"id":"2502.02766","title":"Theoretical Guarantees for Low-Rank Compression of Deep Neural Networks","created":"2025-02-04","cited_by_count":3,"area":null},{"id":"2410.02176","title":"Towards Better Generalization: Weight Decay Induces Low-rank Bias for Neural Networks","created":"2024-10-03","cited_by_count":2,"area":null},{"id":"2506.12284","title":"GrokAlign: Geometric Characterisation and Acceleration of Grokking","created":"2025-06-14","cited_by_count":2,"area":null},{"id":"2508.00127","title":"Structured Transformations for Stable and Interpretable Neural Computation","created":"2025-07-31","cited_by_count":2,"area":null},{"id":"2510.08023","title":"Do We Really Need Permutations? Impact of Model Width on Linear Mode Connectivity","created":"2025-10-09","cited_by_count":2,"area":null},{"id":"2510.20295","title":"Quantifying Distributional Invariance in Causal Subgraph for IRM-Free Graph Generalization","created":"2025-10-23","cited_by_count":2,"area":null},{"id":"2310.00873","title":"Deep Neural Networks Tend To Extrapolate Predictably","created":"2023-10-02","cited_by_count":1,"area":null},{"id":"2501.16322","title":"Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture","created":"2025-01-27","cited_by_count":1,"area":null},{"id":"2602.12384","title":"Why Deep Jacobian Spectra Separate: Depth-Induced Scaling and Singular-Vector Alignment","created":"2026-02-12","cited_by_count":1,"area":null},{"id":"2602.13910","title":"Sufficient Conditions for Stability of Minimum-Norm Interpolating Deep ReLU Networks","created":"2026-02-14","cited_by_count":1,"area":null},{"id":"2606.05863","title":"Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2410.24106","title":"On Sampling Strategies for Spectral Model Sharding","created":"2024-10-31","cited_by_count":0,"area":null},{"id":"2504.08628","title":"Gradient Descent Robustly Learns the Intrinsic Dimension of Data in Training Convolutional Neural Networks","created":"2025-04-11","cited_by_count":0,"area":null},{"id":"2504.09873","title":"Truncated Matrix Completion - An Empirical Study","created":"2025-04-14","cited_by_count":0,"area":null},{"id":"2602.06208","title":"Emergent Low-Rank Training Dynamics in MLPs with Smooth Activations","created":"2026-02-05","cited_by_count":0,"area":null},{"id":"2605.23087","title":"The Implicit Bias of Depth: From Neural Collapse to Softmax Codes","created":"2026-05-21","cited_by_count":0,"area":null},{"id":"2609.30288","title":"Manifold Projection and Iterative Autoencoder Refinement for Masked Language Modeling","created":"2026-09-09","cited_by_count":0,"area":null}],"next_cursor":null}