{"list":"other","total":77,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1612.01474","title":"Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles","created":"2016-12-05","cited_by_count":3926},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"2301.05217","title":"Progress measures for grokking via mechanistic interpretability","created":"2023-01-12","cited_by_count":839},{"id":"1902.06720","title":"Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descent","created":"2019-02-18","cited_by_count":738},{"id":"1812.07956","title":"On Lazy Training in Differentiable Programming","created":"2018-12-19","cited_by_count":675},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1912.05671","title":"Linear Mode Connectivity and the Lottery Ticket Hypothesis","created":"2019-12-11","cited_by_count":637},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"1802.10026","title":"Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs","created":"2018-02-27","cited_by_count":588},{"id":"1811.03804","title":"Gradient Descent Finds Global Minima of Deep Neural Networks","created":"2018-11-09","cited_by_count":574},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"1407.7722","title":"OpenML: networked science in machine learning","created":"2014-07-29","cited_by_count":526},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"1912.02757","title":"Deep Ensembles: A Loss Landscape Perspective","created":"2019-12-05","cited_by_count":443},{"id":"2008.11687","title":"What is being transferred in transfer learning?","created":"2020-08-26","cited_by_count":368},{"id":"1803.00885","title":"Essentially No Barriers in Neural Network Energy Landscape","created":"2018-03-02","cited_by_count":330},{"id":"2110.06296","title":"The Role of Permutation Invariance in Linear Mode Connectivity of Neural Networks","created":"2021-10-12","cited_by_count":291},{"id":"1710.03667","title":"High-dimensional dynamics of generalization error in neural networks","created":"2017-10-10","cited_by_count":241},{"id":"2205.10343","title":"Towards Understanding Grokking: An Effective Theory of Representation Learning","created":"2022-05-20","cited_by_count":230},{"id":"2305.02997","title":"When Do Neural Nets Outperform Boosted Trees on Tabular Data?","created":"2023-05-04","cited_by_count":223},{"id":"2305.12827","title":"Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Models","created":"2023-05-22","cited_by_count":221},{"id":"1910.05653","title":"Model Fusion via Optimal Transport","created":"2019-10-12","cited_by_count":219},{"id":"1903.07571","title":"Two models of double descent for weak features","created":"2019-03-18","cited_by_count":195},{"id":"2208.05592","title":"Patching open-vocabulary models by interpolating weights","created":"2022-08-10","cited_by_count":190},{"id":"1802.01396","title":"To understand deep learning we need to understand kernel learning","created":"2018-02-05","cited_by_count":187},{"id":"2010.15110","title":"Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel","created":"2020-10-28","cited_by_count":187},{"id":"1905.12173","title":"On the Inductive Bias of Neural Tangent Kernels","created":"2019-05-29","cited_by_count":177},{"id":"2007.15801","title":"Finite Versus Infinite Neural Networks: an Empirical Study","created":"2020-07-31","cited_by_count":157},{"id":"1712.06559","title":"The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning","created":"2017-12-18","cited_by_count":150},{"id":"2205.09739","title":"Diverse Weight Averaging for Out-of-Distribution Generalization","created":"2022-05-19","cited_by_count":148},{"id":"2210.01117","title":"Omnigrok: Grokking Beyond Algorithmic Data","created":"2022-10-03","cited_by_count":146},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132},{"id":"2010.01092","title":"On the linearity of large non-linear models: when and why the tangent kernel is constant","created":"2020-10-02","cited_by_count":129},{"id":"2309.02390","title":"Explaining grokking through circuit efficiency","created":"2023-09-05","cited_by_count":111},{"id":"2204.03044","title":"Fusing finetuned models for better pretraining","created":"2022-04-06","cited_by_count":110},{"id":"2003.01897","title":"Optimal Regularization Can Mitigate Double Descent","created":"2020-03-04","cited_by_count":109},{"id":"2310.06110","title":"Grokking as the Transition from Lazy to Rich Training Dynamics","created":"2023-10-09","cited_by_count":108},{"id":"1611.01540","title":"Topology and Geometry of Half-Rectified Network Optimization","created":"2016-11-04","cited_by_count":102},{"id":"2003.01054","title":"Double Trouble in Double Descent : Bias and Variance(s) in the Lazy Regime","created":"2020-03-02","cited_by_count":95},{"id":"2206.04817","title":"The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon","created":"2022-06-10","cited_by_count":94},{"id":"1906.08899","title":"Limitations of Lazy Training of Two-layers Neural Networks","created":"2019-06-21","cited_by_count":87},{"id":"2004.12019","title":"Finite-sample Analysis of Interpolating Linear Classifiers in the Overparameterized Regime","created":"2020-04-25","cited_by_count":81},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80},{"id":"2011.03321","title":"Understanding Double Descent Requires a Fine-Grained Bias-Variance Decomposition","created":"2020-11-04","cited_by_count":76},{"id":"1810.08591","title":"A Modern Take on the Bias-Variance Tradeoff in Neural Networks","created":"2018-10-19","cited_by_count":65},{"id":"2012.00152","title":"Every Model Learned by Gradient Descent Is Approximately a Kernel Machine","created":"2020-11-30","cited_by_count":55},{"id":"2003.02139","title":"Rethinking Parameter Counting in Deep Models: Effective Dimensionality Revisited","created":"2020-03-04","cited_by_count":51},{"id":"2106.06770","title":"What can linearized neural networks actually say about generalization?","created":"2021-06-12","cited_by_count":49},{"id":"1504.07676","title":"Explaining the Success of AdaBoost and Random Forests as Interpolating Classifiers","created":"2015-04-28","cited_by_count":45},{"id":"2008.01036","title":"Multiple Descent: Design Your Own Generalization Curve","created":"2020-08-03","cited_by_count":45},{"id":"2004.04328","title":"A Brief Prehistory of Double Descent","created":"2020-04-07","cited_by_count":44},{"id":"2303.14151","title":"Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle","created":"2023-03-24","cited_by_count":37},{"id":"1912.04533","title":"Exact expressions for double descent and implicit regularization via surrogate random design","created":"2019-12-10","cited_by_count":35},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34},{"id":"2310.18988","title":"A U-turn on Double Descent: Rethinking Parameter Counting in Statistical Learning","created":"2023-10-29","cited_by_count":33},{"id":"2206.12543","title":"A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel","created":"2022-06-25","cited_by_count":30},{"id":"2010.05170","title":"What causes the test error? Going beyond bias-variance via ANOVA","created":"2020-10-11","cited_by_count":28},{"id":"2206.08684","title":"Sparse Double Descent: Where Network Pruning Aggravates Overfitting","created":"2022-06-17","cited_by_count":26},{"id":"2305.14077","title":"Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension","created":"2023-05-23","cited_by_count":26},{"id":"2011.14439","title":"Scaling Down Deep Learning with MNIST-1D","created":"2020-11-29","cited_by_count":25},{"id":"2310.16441","title":"Grokking in Linear Estimators -- A Solvable Model that Groks without Understanding","created":"2023-10-25","cited_by_count":25},{"id":"2208.13614","title":"Neural Tangent Kernel: A Survey","created":"2022-08-29","cited_by_count":23},{"id":"2209.07509","title":"Random initialisations performing above chance and how to find them","created":"2022-09-15","cited_by_count":23},{"id":"2301.11323","title":"Joint Training of Deep Ensembles Fails Due to Learner Collusion","created":"2023-01-26","cited_by_count":23},{"id":"2302.00704","title":"Pathologies of Predictive Diversity in Deep Ensembles","created":"2023-02-01","cited_by_count":16},{"id":"2402.01502","title":"Why do Random Forests Work? Understanding Tree Ensembles as Self-Regularizing Adaptive Smoothers","created":"2024-02-02","cited_by_count":15},{"id":"2310.17247","title":"Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity","created":"2023-10-26","cited_by_count":13},{"id":"2401.01867","title":"Dataset Difficulty and the Role of Inductive Bias","created":"2024-01-03","cited_by_count":12},{"id":"1912.08286","title":"On the Bias-Variance Tradeoff: Textbooks Need an Update","created":"2019-12-17","cited_by_count":8},{"id":"2312.09832","title":"Disentangling Linear Mode-Connectivity","created":"2023-12-15","cited_by_count":8},{"id":"2409.18842","title":"Classical Statistical (In-Sample) Intuitions Don't Generalize Well: A Note on Bias-Variance Tradeoffs, Overfitting and Moving from Fixed to Random Designs","created":"2024-09-27","cited_by_count":5}],"next_cursor":null}