{"list":"other","total":52,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1607.06450","title":"Layer Normalization","created":"2016-07-21","cited_by_count":5669},{"id":"1801.01290","title":"Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor","created":"2018-01-04","cited_by_count":4885},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2012.07421","title":"WILDS: A Benchmark of in-the-Wild Distribution Shifts","created":"2020-12-14","cited_by_count":1375},{"id":"1911.08265","title":"Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model","created":"2019-11-19","cited_by_count":1353},{"id":"1707.06887","title":"A Distributional Perspective on Reinforcement Learning","created":"2017-07-21","cited_by_count":765},{"id":"2302.05442","title":"Scaling Vision Transformers to 22 Billion Parameters","created":"2023-02-10","cited_by_count":694},{"id":"1711.00165","title":"Deep Neural Networks as Gaussian Processes","created":"2017-11-01","cited_by_count":622},{"id":"1602.07868","title":"Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks","created":"2016-02-25","cited_by_count":543},{"id":"1802.09568","title":"Shampoo: Preconditioned Stochastic Tensor Optimization","created":"2018-02-26","cited_by_count":426},{"id":"1402.1869","title":"On the Number of Linear Regions of Deep Neural Networks","created":"2014-02-08","cited_by_count":381},{"id":"1606.05336","title":"On the Expressive Power of Deep Neural Networks","created":"2016-06-16","cited_by_count":306},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"1606.05340","title":"Exponential expressivity in deep neural networks through transient chaos","created":"2016-06-16","cited_by_count":261},{"id":"2205.07802","title":"The Primacy Bias in Deep Reinforcement Learning","created":"2022-05-16","cited_by_count":247},{"id":"1911.07013","title":"Understanding and Improving Layer Normalization","created":"2019-11-16","cited_by_count":217},{"id":"1611.01232","title":"Deep Information Propagation","created":"2016-11-04","cited_by_count":195},{"id":"2101.12176","title":"On the Origin of Implicit Regularization in Stochastic Gradient Descent","created":"2021-01-28","cited_by_count":184},{"id":"2309.14322","title":"Small-scale proxies for large-scale Transformer training instabilities","created":"2023-09-25","cited_by_count":183},{"id":"1806.05393","title":"Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks","created":"2018-06-14","cited_by_count":176},{"id":"2302.12902","title":"The Dormant Neuron Phenomenon in Deep Reinforcement Learning","created":"2023-02-24","cited_by_count":174},{"id":"2303.01486","title":"Understanding plasticity in neural networks","created":"2023-03-02","cited_by_count":174},{"id":"1702.08591","title":"The Shattered Gradients Problem: If resnets are the answer, then what is the question?","created":"2017-02-28","cited_by_count":157},{"id":"2209.15594","title":"Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability","created":"2022-09-30","cited_by_count":155},{"id":"1910.12478","title":"Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes","created":"2019-10-28","cited_by_count":151},{"id":"2009.11162","title":"Implicit Gradient Regularization","created":"2020-09-23","cited_by_count":146},{"id":"1602.05897","title":"Toward Deeper Understanding of Neural Networks: The Power of Initialization and a Dual View on Expressivity","created":"2016-02-18","cited_by_count":138},{"id":"2010.14498","title":"Implicit Under-Parameterization Inhibits Data-Efficient Deep Reinforcement Learning","created":"2020-10-27","cited_by_count":134},{"id":"2204.09560","title":"Understanding and Preventing Capacity Loss in Reinforcement Learning","created":"2022-04-20","cited_by_count":125},{"id":"2303.07507","title":"Loss of Plasticity in Continual Deep Reinforcement Learning","created":"2023-03-13","cited_by_count":121},{"id":"1909.05989","title":"Finite Depth and Width Corrections to the Neural Tangent Kernel","created":"2019-09-13","cited_by_count":115},{"id":"1902.06853","title":"On the Impact of the Activation Function on Deep Neural Networks Training","created":"2019-02-19","cited_by_count":102},{"id":"1602.07714","title":"Learning values across many orders of magnitude","created":"2016-02-24","cited_by_count":85},{"id":"2102.10330","title":"Decoupling Value and Policy for Generalization in Reinforcement Learning","created":"2021-02-20","cited_by_count":82},{"id":"2108.06325","title":"Continual Backprop: Stochastic Gradient Descent with Persistent Randomness","created":"2021-08-13","cited_by_count":80},{"id":"2006.05826","title":"Transient Non-Stationarity and Generalisation in Deep Reinforcement Learning","created":"2020-06-10","cited_by_count":75},{"id":"2305.15555","title":"Deep Reinforcement Learning with Plasticity Injection","created":"2023-05-24","cited_by_count":74},{"id":"1806.04613","title":"Improving Regression Performance with Distributional Losses","created":"2018-06-12","cited_by_count":67},{"id":"2110.01765","title":"Rapid training of deep neural networks without skip connections or normalization layers using Deep Kernel Shaping","created":"2021-10-05","cited_by_count":52},{"id":"2010.12859","title":"Stable ResNet","created":"2020-10-24","cited_by_count":49},{"id":"2302.10322","title":"Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation","created":"2023-02-20","cited_by_count":45},{"id":"2106.00042","title":"A study on the plasticity of neural networks","created":"2021-05-31","cited_by_count":44},{"id":"2306.10711","title":"PLASTIC: Improving Input and Label Plasticity for Sample Efficient Reinforcement Learning","created":"2023-06-19","cited_by_count":42},{"id":"2010.09697","title":"Effects of Parameter Norm Growth During Transformer Training: Inductive Bias from Gradient Descent","created":"2020-10-19","cited_by_count":40},{"id":"2307.04345","title":"Continual Learning as Computationally Constrained Reinforcement Learning","created":"2023-07-10","cited_by_count":37},{"id":"2211.05641","title":"Regression as Classification: Influence of Task Formulation on Neural Network Features","created":"2022-11-10","cited_by_count":29},{"id":"2203.08120","title":"Deep Learning without Shortcuts: Shaping the Kernel with Tailored Rectifiers","created":"2022-03-15","cited_by_count":28},{"id":"2306.17833","title":"Resetting the Optimizer in Deep RL: An Empirical Study","created":"2023-06-30","cited_by_count":26},{"id":"1511.02580","title":"How far can we go without convolution: Improving fully-connected networks","created":"2015-11-09","cited_by_count":20},{"id":"1605.07154","title":"Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations","created":"2016-05-23","cited_by_count":4}],"next_cursor":null}