{"list":"other","total":63,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"2103.14030","title":"Swin Transformer: Hierarchical Vision Transformer using Shifted Windows","created":"2021-03-25","cited_by_count":12139},{"id":"1608.03983","title":"SGDR: Stochastic Gradient Descent with Warm Restarts","created":"2016-08-13","cited_by_count":5045},{"id":"1411.7766","title":"Deep Learning Face Attributes in the Wild","created":"2014-11-28","cited_by_count":3693},{"id":"1703.01365","title":"Axiomatic Attribution for Deep Networks","created":"2017-03-04","cited_by_count":3384},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1803.03635","title":"The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks","created":"2018-03-09","cited_by_count":2262},{"id":"1706.05587","title":"Rethinking Atrous Convolution for Semantic Image Segmentation","created":"2017-06-17","cited_by_count":2161},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"1704.02685","title":"Learning Important Features Through Propagating Activation Differences","created":"2017-04-10","cited_by_count":1458},{"id":"2010.01412","title":"Sharpness-Aware Minimization for Efficiently Improving Generalization","created":"2020-10-03","cited_by_count":1417},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1911.08731","title":"Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization","created":"2019-11-20","cited_by_count":1247},{"id":"1608.08710","title":"Pruning Filters for Efficient ConvNets","created":"2016-08-31","cited_by_count":1143},{"id":"2404.06395","title":"MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies","created":"2024-04-09","cited_by_count":723},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1807.04975","title":"Recognition in Terra Incognita","created":"2018-07-13","cited_by_count":658},{"id":"2009.07896","title":"Captum: A unified and generic model interpretability library for PyTorch","created":"2020-09-16","cited_by_count":547},{"id":"1602.07868","title":"Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks","created":"2016-02-25","cited_by_count":543},{"id":"2107.09044","title":"Just Train Twice: Improving Group Robustness without Training Group Information","created":"2021-07-19","cited_by_count":523},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"2005.04345","title":"An Investigation of Why Overparameterization Exacerbates Spurious Correlations","created":"2020-05-09","cited_by_count":310},{"id":"1802.05296","title":"Stronger generalization bounds for deep nets via a compression approach","created":"2018-02-14","cited_by_count":307},{"id":"2102.11600","title":"ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks","created":"2021-02-23","cited_by_count":293},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"2003.02218","title":"The large learning rate phase of deep learning: the catapult mechanism","created":"2020-03-04","cited_by_count":216},{"id":"2110.14503","title":"Simple data balancing achieves competitive worst-group-accuracy","created":"2021-10-27","cited_by_count":178},{"id":"2110.11328","title":"A Fine-Grained Analysis on Distribution Shift","created":"2021-10-21","cited_by_count":171},{"id":"1907.04595","title":"Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks","created":"2019-07-10","cited_by_count":162},{"id":"2002.09572","title":"The Break-Even Point on Optimization Trajectories of Deep Neural Networks","created":"2020-02-21","cited_by_count":150},{"id":"2010.15775","title":"Understanding the Failure Modes of Out-of-Distribution Generalization","created":"2020-10-29","cited_by_count":146},{"id":"2007.02561","title":"Learning from Failure: Training Debiased Classifier from Biased Classifier","created":"2020-07-06","cited_by_count":133},{"id":"2006.04740","title":"The Heavy-Tail Phenomenon in SGD","created":"2020-06-08","cited_by_count":124},{"id":"1901.08276","title":"Traditional and Heavy-Tailed Self Regularization in Neural Network Models","created":"2019-01-24","cited_by_count":105},{"id":"2208.11857","title":"Shortcut Learning of Large Language Models in Natural Language Understanding","created":"2022-08-25","cited_by_count":85},{"id":"2010.16402","title":"Why Do Better Loss Functions Lead to Less Transferable Features?","created":"2020-10-30","cited_by_count":73},{"id":"2111.13171","title":"Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks","created":"2021-11-25","cited_by_count":70},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68},{"id":"2207.12678","title":"Analyzing Sharpness along GD Trajectory: Progressive Sharpening and Edge of Stability","created":"2022-07-26","cited_by_count":63},{"id":"2106.09129","title":"A Winning Hand: Compressing Deep Networks Can Improve Out-Of-Distribution Robustness","created":"2021-06-16","cited_by_count":62},{"id":"1512.04202","title":"Preconditioned Stochastic Gradient Descent","created":"2015-12-14","cited_by_count":50},{"id":"2106.03795","title":"Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks","created":"2021-06-07","cited_by_count":44},{"id":"2305.18761","title":"Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias","created":"2023-05-30","cited_by_count":44},{"id":"2010.09697","title":"Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent","created":"2020-10-19","cited_by_count":40},{"id":"1909.11274","title":"Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network","created":"2019-09-25","cited_by_count":39},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31},{"id":"2308.12553","title":"Don't blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy","created":"2023-08-24","cited_by_count":30},{"id":"2301.13293","title":"Overcoming Simplicity Bias in Deep Networks using a Feature Sieve","created":"2023-01-30","cited_by_count":29},{"id":"2302.05601","title":"Pruning Deep Neural Networks from a Sparsity Perspective","created":"2023-02-11","cited_by_count":25},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24},{"id":"2003.01262","title":"Selectivity considered harmful: evaluating the causal impact of class selectivity in DNNs","created":"2020-03-03","cited_by_count":15},{"id":"2311.04163","title":"Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization","created":"2023-11-07","cited_by_count":13},{"id":"2206.01274","title":"Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares","created":"2022-06-02","cited_by_count":12},{"id":"2403.03375","title":"Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations","created":"2024-03-05","cited_by_count":12},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10},{"id":"2003.00631","title":"Sparsity Meets Robustness: Channel Pruning for the Feynman-Kac Formalism Principled Robust Deep Neural Nets","created":"2020-03-02","cited_by_count":8},{"id":"2305.17409","title":"On the special role of class-selective neurons in early training","created":"2023-05-27","cited_by_count":5}],"next_cursor":null}