{"list":"other","total":56,"rows":[{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2010.01412","title":"Sharpness-Aware Minimization for Efficiently Improving Generalization","created":"2020-10-03","cited_by_count":1417},{"id":"1312.6120","title":"Exact solutions to the nonlinear dynamics of learning in deep linear neural networks","created":"2013-12-20","cited_by_count":763},{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"1905.13655","title":"Implicit Regularization in Deep Matrix Factorization","created":"2019-05-31","cited_by_count":405},{"id":"1906.05890","title":"Gradient Descent Maximizes the Margin of Homogeneous Neural Networks","created":"2019-06-13","cited_by_count":320},{"id":"1706.04454","title":"Empirical Analysis of the Hessian of Over-Parametrized Neural Networks","created":"2017-06-14","cited_by_count":290},{"id":"1406.2572","title":"Identifying and attacking the saddle point problem in high-dimensional non-convex optimization","created":"2014-06-10","cited_by_count":289},{"id":"1412.0233","title":"The Loss Surfaces of Multilayer Networks","created":"2014-11-30","cited_by_count":280},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227},{"id":"1812.04754","title":"Gradient Descent Happens in a Tiny Subspace","created":"2018-12-12","cited_by_count":217},{"id":"1811.09716","title":"Robustness via curvature regularization, and vice versa","created":"2018-11-23","cited_by_count":175},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166},{"id":"1611.07476","title":"Eigenvalues of the Hessian in Deep Learning: Singularity and Beyond","created":"2016-11-22","cited_by_count":159},{"id":"2106.02073","title":"Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path","created":"2021-06-03","cited_by_count":158},{"id":"2002.09572","title":"The Break-Even Point on Optimization Trajectories of Deep Neural Networks","created":"2020-02-21","cited_by_count":150},{"id":"2011.11619","title":"Neural collapse with unconstrained features","created":"2020-11-23","cited_by_count":142},{"id":"2006.07322","title":"Evaluation of Neural Architectures Trained with Square Loss vs Cross-Entropy in Classification Tasks","created":"2020-06-12","cited_by_count":138},{"id":"2005.00060","title":"Bridging Mode Connectivity in Loss Landscapes and Adversarial Robustness","created":"2020-04-30","cited_by_count":132},{"id":"1901.08276","title":"Traditional and Heavy-Tailed Self Regularization in Neural Network Models","created":"2019-01-24","cited_by_count":105},{"id":"2202.08087","title":"Extended Unconstrained Features Model for Exploring Deep Neural Collapse","created":"2022-02-16","cited_by_count":102},{"id":"2203.01238","title":"On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features","created":"2022-03-02","cited_by_count":97},{"id":"2008.11865","title":"Traces of Class/Cross-Class Structure Pervade Deep Learning Spectra","created":"2020-08-27","cited_by_count":94},{"id":"1802.08241","title":"Hessian-based Analysis of Large Batch Training and Robustness to Adversaries","created":"2018-02-22","cited_by_count":87},{"id":"2110.02796","title":"An Unconstrained Layer-Peeled Perspective on Neural Collapse","created":"2021-10-06","cited_by_count":87},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86},{"id":"1706.10239","title":"Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapes","created":"2017-06-30","cited_by_count":84},{"id":"2208.05512","title":"Imbalance Trouble: Revisiting Neural-Collapse Geometry","created":"2022-08-10","cited_by_count":80},{"id":"2210.02192","title":"Are All Losses Created Equal: A Neural Collapse Perspective","created":"2022-10-04","cited_by_count":78},{"id":"2005.11879","title":"Spectra of the Conjugate Kernel and Neural Tangent Kernel for linear-width neural networks","created":"2020-05-25","cited_by_count":77},{"id":"1901.08244","title":"Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians","created":"2019-01-24","cited_by_count":68},{"id":"1906.05392","title":"Generalization Guarantees for Neural Networks via Harnessing the Low-rank Structure of the Jacobian","created":"2019-06-12","cited_by_count":67},{"id":"2006.09092","title":"Learning Rates as a Function of Batch Size: A Random Matrix Theory Approach to Neural Network Training","created":"2020-06-16","cited_by_count":50},{"id":"2010.04261","title":"Dissecting Hessian: Understanding Common Structure of Hessian in Neural Networks","created":"2020-10-08","cited_by_count":45},{"id":"2012.03801","title":"A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization","created":"2020-12-07","cited_by_count":44},{"id":"2305.13165","title":"Deep Neural Collapse Is Provably Optimal for the Deep Unconstrained Features Model","created":"2023-05-22","cited_by_count":43},{"id":"2301.00437","title":"Neural Collapse in Deep Linear Networks: From Balanced to Imbalanced Data","created":"2023-01-01","cited_by_count":40},{"id":"2310.05351","title":"Generalized Neural Collapse for a Large Number of Classes","created":"2023-10-09","cited_by_count":39},{"id":"2309.09725","title":"Neural Collapse for Unconstrained Feature Model under Cross-entropy Loss with Imbalanced Data","created":"2023-09-18","cited_by_count":38},{"id":"1907.10732","title":"Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization","created":"2019-07-24","cited_by_count":37},{"id":"2210.17020","title":"A Law of Data Separation in Deep Learning","created":"2022-10-31","cited_by_count":36},{"id":"2210.16658","title":"Perturbation Analysis of Neural Collapse","created":"2022-10-29","cited_by_count":35},{"id":"2103.01519","title":"Hessian Eigenspectra of More Realistic Nonlinear Models","created":"2021-03-02","cited_by_count":33},{"id":"2308.02760","title":"Neural Collapse in the Intermediate Hidden Layers of Classification Neural Networks","created":"2023-08-05","cited_by_count":21},{"id":"1910.02875","title":"The asymptotic spectrum of the Hessian of DNN throughout training","created":"2019-10-01","cited_by_count":19},{"id":"2307.01951","title":"A Neural Collapse Perspective on Feature Evolution in Graph Neural Networks","created":"2023-07-04","cited_by_count":19},{"id":"2401.02058","title":"Neural Collapse for Cross-entropy Class-Imbalanced Learning with Unconstrained ReLU Feature Model","created":"2024-01-04","cited_by_count":19},{"id":"2402.18551","title":"Implicit Optimization Bias of Next-Token Prediction in Linear Models","created":"2024-02-28","cited_by_count":14},{"id":"1811.07062","title":"The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size","created":"2018-11-16","cited_by_count":13},{"id":"2006.07721","title":"Beyond Random Matrix Theory for Deep Networks","created":"2020-06-13","cited_by_count":11},{"id":"2004.03959","title":"The Loss Surfaces of Neural Networks with General Activation Functions","created":"2020-04-08","cited_by_count":7},{"id":"2402.18884","title":"Supervised Contrastive Representation Learning: Landscape Analysis with Unconstrained Features","created":"2024-02-29","cited_by_count":5},{"id":"2205.08601","title":"Universal characteristics of deep neural network loss surfaces from random matrix theory","created":"2022-05-17","cited_by_count":4},{"id":"2206.08257","title":"Gradient Descent for Low-Rank Functions","created":"2022-06-16","cited_by_count":3}],"next_cursor":null}