{"list":"other","total":62,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1703.03400","title":"Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks","created":"2017-03-09","cited_by_count":4897},{"id":"1708.07747","title":"Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms","created":"2017-08-25","cited_by_count":4349},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"1502.05477","title":"Trust Region Policy Optimization","created":"2015-02-19","cited_by_count":2580},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1706.02677","title":"Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour","created":"2017-06-08","cited_by_count":1492},{"id":"1904.01038","title":"fairseq: A Fast, Extensible Toolkit for Sequence Modeling","created":"2019-04-01","cited_by_count":1488},{"id":"1712.09913","title":"Visualizing the Loss Landscape of Neural Nets","created":"2017-12-28","cited_by_count":1130},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1503.05671","title":"Optimizing Neural Networks with Kronecker-factored Approximate Curvature","created":"2015-03-19","cited_by_count":796},{"id":"1606.04474","title":"Learning to learn by gradient descent by gradient descent","created":"2016-06-14","cited_by_count":620},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"1412.1193","title":"New insights and perspectives on the natural gradient method","created":"2014-12-03","cited_by_count":443},{"id":"1802.09568","title":"Shampoo: Preconditioned Stochastic Tensor Optimization","created":"2018-02-26","cited_by_count":426},{"id":"1707.09835","title":"Meta-SGD: Learning to Learn Quickly for Few-Shot Learning","created":"2017-07-31","cited_by_count":379},{"id":"1711.09846","title":"Population Based Training of Neural Networks","created":"2017-11-27","cited_by_count":367},{"id":"1502.03492","title":"Gradient-based Hyperparameter Optimization through Reversible Learning","created":"2015-02-11","cited_by_count":360},{"id":"1711.00489","title":"Don't Decay the Learning Rate, Increase the Batch Size","created":"2017-11-01","cited_by_count":320},{"id":"1911.02590","title":"Optimizing Millions of Hyperparameters by Implicit Differentiation","created":"2019-11-06","cited_by_count":304},{"id":"1704.04289","title":"Stochastic Gradient Descent as Approximate Bayesian Inference","created":"2017-04-13","cited_by_count":300},{"id":"1406.2572","title":"Identifying and attacking the saddle point problem in high-dimensional non-convex optimization","created":"2014-06-10","cited_by_count":289},{"id":"1502.05700","title":"Scalable Bayesian Optimization Using Deep Neural Networks","created":"2015-02-19","cited_by_count":284},{"id":"1911.03437","title":"SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization","created":"2019-11-08","cited_by_count":254},{"id":"1703.01785","title":"Forward and Reverse Gradient-Based Hyperparameter Optimization","created":"2017-03-06","cited_by_count":234},{"id":"1606.01885","title":"Learning to Optimize","created":"2016-06-06","cited_by_count":195},{"id":"1806.03884","title":"Fast Approximate Natural Gradient Descent in a Kronecker-factored Eigenbasis","created":"2018-06-11","cited_by_count":146},{"id":"1602.01407","title":"A Kronecker-factored approximate Fisher matrix for convolution layers","created":"2016-02-03","cited_by_count":141},{"id":"2002.10542","title":"Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence","created":"2020-02-24","cited_by_count":137},{"id":"1706.05350","title":"L2 Regularization versus Batch and Weight Normalization","created":"2017-06-16","cited_by_count":124},{"id":"1905.09997","title":"Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates","created":"2019-05-24","cited_by_count":119},{"id":"1703.04782","title":"Online Learning Rate Adaptation with Hypergradient Descent","created":"2017-03-14","cited_by_count":118},{"id":"1907.04164","title":"Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model","created":"2019-07-09","cited_by_count":117},{"id":"1703.04813","title":"Learned Optimizers that Scale and Generalize","created":"2017-03-14","cited_by_count":110},{"id":"1805.08289","title":"Measuring and regularizing networks in function space","created":"2018-05-21","cited_by_count":99},{"id":"1909.00025","title":"Meta-Learning with Warped Gradient Descent","created":"2019-08-30","cited_by_count":98},{"id":"1406.3896","title":"Freeze-Thaw Bayesian Optimization","created":"2014-06-16","cited_by_count":90},{"id":"1905.10961","title":"Fast Convergence of Natural Gradient Descent for Overparameterized Neural Networks","created":"2019-05-27","cited_by_count":76},{"id":"1902.03356","title":"Meta-Curvature","created":"2019-02-09","cited_by_count":70},{"id":"1803.02021","title":"Understanding Short-Horizon Bias in Stochastic Meta-Optimization","created":"2018-03-06","cited_by_count":69},{"id":"1812.03981","title":"Theoretical Analysis of Auto Rate-Tuning by Batch Normalization","created":"2018-12-10","cited_by_count":65},{"id":"1803.01814","title":"Norm matters: efficient and accurate normalization schemes in deep networks","created":"2018-03-05","cited_by_count":62},{"id":"1810.05633","title":"Stochastic (Approximate) Proximal Point Methods: Convergence, Optimality, and Adaptivity","created":"2018-10-12","cited_by_count":61},{"id":"1905.00313","title":"Revisiting the Polyak step size","created":"2019-05-01","cited_by_count":55},{"id":"2112.13835","title":"Unbiased Gradient Estimation in Unrolled Computation Graphs with Persistent Evolution Strategies","created":"2021-12-27","cited_by_count":52},{"id":"1702.05043","title":"Unbiased Online Recurrent Optimization","created":"2017-02-16","cited_by_count":47},{"id":"1703.00441","title":"Learning to Optimize Neural Nets","created":"2017-03-01","cited_by_count":41},{"id":"1804.00325","title":"Aggregated Momentum: Stability Through Passive Damping","created":"2018-04-01","cited_by_count":36},{"id":"1811.04504","title":"SLANG: Fast Structured Covariance Approximations for Bayesian Deep Learning with Natural Gradient","created":"2018-11-11","cited_by_count":34},{"id":"1805.10842","title":"Approximating Real-Time Recurrent Learning with Random Kronecker Factors","created":"2018-05-28","cited_by_count":29},{"id":"1802.05074","title":"L4: Practical loss-based stepsize adaptation for deep learning","created":"2018-02-14","cited_by_count":26},{"id":"1902.03993","title":"Optimal Kronecker-Sum Approximation of Real Time Recurrent Learning","created":"2019-02-11","cited_by_count":22},{"id":"2008.07545","title":"Whitening and second order optimization both make information in the dataset unusable during training, and can reduce or prevent generalization","created":"2020-08-17","cited_by_count":15},{"id":"1910.08461","title":"First-Order Preconditioning via Hypergradient Descent","created":"2019-10-18","cited_by_count":8}],"next_cursor":null}