{"list":"other","total":72,"rows":[{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"1706.04454","title":"Empirical Analysis of the Hessian of Over-Parametrized Neural Networks","created":"2017-06-14","cited_by_count":290},{"id":"1412.0233","title":"The Loss Surfaces of Multilayer Networks","created":"2014-11-30","cited_by_count":280},{"id":"1605.07110","title":"Deep Learning without Poor Local Minima","created":"2016-05-23","cited_by_count":234},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227},{"id":"1812.04754","title":"Gradient Descent Happens in a Tiny Subspace","created":"2018-12-12","cited_by_count":217},{"id":"1810.02281","title":"A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks","created":"2018-10-04","cited_by_count":184},{"id":"1810.02032","title":"Gradient descent aligns the layers of deep linear networks","created":"2018-10-04","cited_by_count":182},{"id":"1902.04674","title":"Towards moderate overparameterization: global convergence guarantees for training shallow neural networks","created":"2019-02-12","cited_by_count":176},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166},{"id":"1611.07476","title":"Eigenvalues of the Hessian in Deep Learning: Singularity and Beyond","created":"2016-11-22","cited_by_count":159},{"id":"2106.02073","title":"Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path","created":"2021-06-03","cited_by_count":158},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154},{"id":"2012.09839","title":"Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learning","created":"2020-12-17","cited_by_count":150},{"id":"2011.11619","title":"Neural collapse with unconstrained features","created":"2020-11-23","cited_by_count":142},{"id":"1707.04926","title":"Theoretical insights into the optimization landscape of over-parameterized shallow neural networks","created":"2017-07-16","cited_by_count":128},{"id":"1906.04688","title":"An Improved Analysis of Training Over-parameterized Deep Neural Networks","created":"2019-06-11","cited_by_count":121},{"id":"1712.08968","title":"Spurious Local Minima are Common in Two-Layer ReLU Neural Networks","created":"2017-12-24","cited_by_count":104},{"id":"2202.08087","title":"Extended Unconstrained Features Model for Exploring Deep Neural Collapse","created":"2022-02-16","cited_by_count":102},{"id":"2112.15121","title":"On the Role of Neural Collapse in Transfer Learning","created":"2021-12-30","cited_by_count":100},{"id":"2203.09081","title":"Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?","created":"2022-03-17","cited_by_count":100},{"id":"2203.01238","title":"On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features","created":"2022-03-02","cited_by_count":97},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95},{"id":"2008.11865","title":"Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra","created":"2020-08-27","cited_by_count":94},{"id":"2110.02796","title":"An Unconstrained Layer-Peeled Perspective on Neural Collapse","created":"2021-10-06","cited_by_count":87},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86},{"id":"2106.15933","title":"Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity","created":"2021-06-30","cited_by_count":85},{"id":"2208.05512","title":"Imbalance Trouble: Revisiting Neural-Collapse Geometry","created":"2022-08-10","cited_by_count":80},{"id":"2210.02192","title":"Are All Losses Created Equal: A Neural Collapse Perspective","created":"2022-10-04","cited_by_count":78},{"id":"1901.08244","title":"Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians","created":"2019-01-24","cited_by_count":68},{"id":"1712.01473","title":"Deep linear neural networks with arbitrary loss: All local minima are global","created":"2017-12-05","cited_by_count":65},{"id":"2202.08384","title":"Limitations of Neural Collapse for Understanding Generalization in Deep Learning","created":"2022-02-17","cited_by_count":63},{"id":"2007.01429","title":"The Global Landscape of Neural Networks: An Overview","created":"2020-07-02","cited_by_count":57},{"id":"2006.09092","title":"Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training","created":"2020-06-16","cited_by_count":50},{"id":"2209.09211","title":"Neural Collapse with Normalized Features: A Geometric Analysis over the Riemannian Manifold","created":"2022-09-19","cited_by_count":50},{"id":"2305.13165","title":"Deep Neural Collapse Is Provably Optimal for the Deep Unconstrained Features Model","created":"2023-05-22","cited_by_count":43},{"id":"2011.13772","title":"Gradient Descent for Deep Matrix Factorization: Dynamics and Implicit Bias towards Low Rank","created":"2020-11-27","cited_by_count":42},{"id":"2301.00437","title":"Neural Collapse in Deep Linear Networks: From Balanced to Imbalanced Data","created":"2023-01-01","cited_by_count":40},{"id":"2310.05351","title":"Generalized Neural Collapse for a Large Number of Classes","created":"2023-10-09","cited_by_count":39},{"id":"2309.09725","title":"Neural Collapse for Unconstrained Feature Model under Cross-entropy Loss with Imbalanced Data","created":"2023-09-18","cited_by_count":38},{"id":"2405.17767","title":"Linguistic Collapse: Neural Collapse in (Large) Language Models","created":"2024-05-28","cited_by_count":38},{"id":"2210.17020","title":"A Law of Data Separation in Deep Learning","created":"2022-10-31","cited_by_count":36},{"id":"2201.11968","title":"Training invariances and the low-rank phenomenon: beyond linear networks","created":"2022-01-28","cited_by_count":33},{"id":"2305.16038","title":"Implicit bias of SGD in $L_{2}$-regularized linear DNNs: One-way jumps from high to low rank","created":"2023-05-25","cited_by_count":29},{"id":"1802.03487","title":"Small nonlinearities in activation functions create bad local minima in neural networks","created":"2018-02-10","cited_by_count":28},{"id":"2107.01163","title":"Unveiling the structure of wide flat minima in neural networks","created":"2021-07-02","cited_by_count":28},{"id":"2408.15417","title":"Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations","created":"2024-08-27","cited_by_count":24},{"id":"2402.13728","title":"Average gradient outer product as a mechanism for deep neural collapse","created":"2024-02-21","cited_by_count":22},{"id":"2308.02760","title":"Neural Collapse in the Intermediate Hidden Layers of Classification Neural Networks","created":"2023-08-05","cited_by_count":21},{"id":"2409.04180","title":"The Prevalence of Neural Collapse in Neural Multivariate Regression","created":"2024-09-06","cited_by_count":21},{"id":"1810.07716","title":"The loss surface of deep linear networks viewed through the algebraic geometry lens","created":"2018-10-17","cited_by_count":20},{"id":"2006.09091","title":"Flatness is a False Friend","created":"2020-06-16","cited_by_count":19},{"id":"2401.02058","title":"Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model","created":"2024-01-04","cited_by_count":19},{"id":"2405.14468","title":"Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?","created":"2024-05-23","cited_by_count":17},{"id":"2202.00856","title":"The Role of Linear Layers in Nonlinear Interpolating Networks","created":"2022-02-02","cited_by_count":16},{"id":"2410.04887","title":"Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse","created":"2024-10-07","cited_by_count":16},{"id":"1811.07062","title":"The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size","created":"2018-11-16","cited_by_count":13},{"id":"2401.09018","title":"Residual Alignment: Uncovering the Mechanisms of Residual Networks","created":"2024-01-17","cited_by_count":13},{"id":"2405.17816","title":"Pursuing Feature Separation based on Neural Collapse for Out-of-Distribution Detection","created":"2024-05-28","cited_by_count":12},{"id":"1805.04938","title":"The Global Optimization Geometry of Shallow Linear Neural Networks","created":"2018-05-13","cited_by_count":11},{"id":"2402.03991","title":"Provable Emergence of Deep Neural Collapse and Low-Rank Bias in $L^2$-Regularized Nonlinear Networks","created":"2024-02-06","cited_by_count":11},{"id":"2404.06106","title":"Unifying Low Dimensional Spectra in Deep Learning","created":"2024-04-09","cited_by_count":11},{"id":"2401.01710","title":"EPA: Neural Collapse Inspired Robust Out-of-Distribution Detector","created":"2024-01-03","cited_by_count":10},{"id":"2409.01832","title":"Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data","created":"2024-09-03","cited_by_count":10},{"id":"2311.07444","title":"On the Robustness of Neural Collapse and the Neural Collapse of Robustness","created":"2023-11-13","cited_by_count":9},{"id":"1412.6615","title":"Explorations on high dimensional landscapes","created":"2014-12-20","cited_by_count":8},{"id":"2004.03959","title":"The Loss Surfaces of Neural Networks with General Activation Functions","created":"2020-04-08","cited_by_count":7},{"id":"1709.09625","title":"How regularization affects the critical points in linear networks","created":"2017-09-27","cited_by_count":5},{"id":"2101.02524","title":"A spin-glass model for the loss surfaces of generative adversarial networks","created":"2021-01-07","cited_by_count":4},{"id":"2406.02105","title":"Can Kernel Methods Explain How the Data Affects Neural Collapse?","created":"2024-06-04","cited_by_count":4}],"next_cursor":null}