{"list":"other","total":68,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1412.6980","title":"Adam: A Method for Stochastic Optimization","created":"2014-12-22","cited_by_count":37240},{"id":"2006.11239","title":"Denoising Diffusion Probabilistic Models","created":"2020-06-19","cited_by_count":21076},{"id":"2112.10752","title":"High-Resolution Image Synthesis with Latent Diffusion Models","created":"2021-12-20","cited_by_count":18863},{"id":"2010.02502","title":"Denoising Diffusion Implicit Models","created":"2020-10-06","cited_by_count":9781},{"id":"2011.13456","title":"Score-Based Generative Modeling through Stochastic Differential Equations","created":"2020-11-26","cited_by_count":9122},{"id":"1503.03585","title":"Deep Unsupervised Learning using Nonequilibrium Thermodynamics","created":"2015-03-12","cited_by_count":7058},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1608.03983","title":"SGDR: Stochastic Gradient Descent with Warm Restarts","created":"2016-08-13","cited_by_count":5045},{"id":"1907.05600","title":"Generative Modeling by Estimating Gradients of the Data Distribution","created":"2019-07-12","cited_by_count":4101},{"id":"1606.00915","title":"DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs","created":"2016-06-02","cited_by_count":3241},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1612.01105","title":"Pyramid Scene Parsing Network","created":"2016-12-04","cited_by_count":2479},{"id":"1706.05587","title":"Rethinking Atrous Convolution for Semantic Image Segmentation","created":"2017-06-17","cited_by_count":2161},{"id":"1706.02677","title":"Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour","created":"2017-06-08","cited_by_count":1492},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"1606.04838","title":"Optimization Methods for Large-Scale Machine Learning","created":"2016-06-15","cited_by_count":1150},{"id":"1712.09913","title":"Visualizing the Loss Landscape of Neural Nets","created":"2017-12-28","cited_by_count":1130},{"id":"2006.09011","title":"Improved Techniques for Training Score-Based Generative Models","created":"2020-06-16","cited_by_count":1043},{"id":"1309.5549","title":"Stochastic First- and Zeroth-order Methods for Nonconvex Stochastic Programming","created":"2013-09-22","cited_by_count":724},{"id":"1904.00962","title":"Large Batch Optimization for Deep Learning: Training BERT in 76 minutes","created":"2019-04-01","cited_by_count":674},{"id":"1509.01240","title":"Train faster, generalize better: Stability of stochastic gradient descent","created":"2015-09-03","cited_by_count":552},{"id":"1608.04636","title":"Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-\\L{}ojasiewicz Condition","created":"2016-08-16","cited_by_count":539},{"id":"1711.00489","title":"Don't Decay the Learning Rate, Increase the Batch Size","created":"2017-11-01","cited_by_count":320},{"id":"1906.05890","title":"Gradient Descent Maximizes the Margin of Homogeneous Neural Networks","created":"2019-06-13","cited_by_count":320},{"id":"2102.11600","title":"ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks","created":"2021-02-23","cited_by_count":293},{"id":"1703.00887","title":"How to Escape Saddle Points Efficiently","created":"2017-03-02","cited_by_count":285},{"id":"1705.08741","title":"Train longer, generalize better: closing the generalization gap in large batch training of neural networks","created":"2017-05-24","cited_by_count":279},{"id":"1503.02101","title":"Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition","created":"2015-03-06","cited_by_count":243},{"id":"2301.10972","title":"On the Importance of Noise Scheduling for Diffusion Models","created":"2023-01-26","cited_by_count":194},{"id":"1506.04579","title":"ParseNet: Looking Wider to See Better","created":"2015-06-15","cited_by_count":177},{"id":"1806.00900","title":"Algorithmic Regularization in Learning Deep Homogeneous Models: Layers are Automatically Balanced","created":"2018-06-04","cited_by_count":177},{"id":"1808.02941","title":"On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization","created":"2018-08-08","cited_by_count":174},{"id":"1711.07767","title":"Receptive Field Block Net for Accurate and Fast Object Detection","created":"2017-11-21","cited_by_count":141},{"id":"2002.10542","title":"Stochastic Polyak Step-size for SGD: An Adaptive Learning Rate for Fast Convergence","created":"2020-02-24","cited_by_count":137},{"id":"1310.5715","title":"Stochastic Gradient Descent, Weighted Sampling, and the Randomized Kaczmarz algorithm","created":"2013-10-21","cited_by_count":133},{"id":"1811.09358","title":"A Sufficient Condition for Convergences of Adam and RMSProp","created":"2018-11-23","cited_by_count":126},{"id":"2006.04740","title":"The Heavy-Tail Phenomenon in SGD","created":"2020-06-08","cited_by_count":124},{"id":"1506.02617","title":"Path-SGD: Path-Normalized Optimization in Deep Neural Networks","created":"2015-06-08","cited_by_count":120},{"id":"1802.06175","title":"An Alternative View: When Does SGD Escape Local Minima?","created":"2018-02-17","cited_by_count":115},{"id":"2304.13960","title":"Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be","created":"2023-04-27","cited_by_count":114},{"id":"1810.13243","title":"A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation","created":"2018-10-29","cited_by_count":110},{"id":"1711.01530","title":"Fisher-Rao Metric, Geometry, and Complexity of Neural Networks","created":"2017-11-05","cited_by_count":100},{"id":"2210.06366","title":"A Generalist Framework for Panoptic Segmentation of Images and Videos","created":"2022-10-12","cited_by_count":99},{"id":"1909.08605","title":"Graduated Non-Convexity for Robust Spatial Perception: From Non-Minimal Solvers to Global Outlier Rejection","created":"2019-09-18","cited_by_count":94},{"id":"2302.07011","title":"A Modern Look at the Relationship between Sharpness and Generalization","created":"2023-02-14","cited_by_count":92},{"id":"1808.05671","title":"On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization","created":"2018-08-16","cited_by_count":91},{"id":"1806.06763","title":"Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks","created":"2018-06-18","cited_by_count":90},{"id":"2001.00939","title":"Relative Flatness and Generalization","created":"2020-01-03","cited_by_count":88},{"id":"1707.05947","title":"Generalization Bounds of SGLD for Non-convex Learning: Two Theoretical Viewpoints","created":"2017-07-19","cited_by_count":82},{"id":"2106.14343","title":"High-probability Bounds for Non-Convex Stochastic Optimization with Heavy Tails","created":"2021-06-28","cited_by_count":80},{"id":"1702.05575","title":"A Hitting Time Analysis of Stochastic Gradient Langevin Dynamics","created":"2017-02-18","cited_by_count":71},{"id":"1803.05999","title":"Escaping Saddles with Stochastic Gradients","created":"2018-03-15","cited_by_count":66},{"id":"1904.01517","title":"Convergence rates for the stochastic gradient descent method for non-convex objective functions","created":"2019-04-02","cited_by_count":66},{"id":"2302.00999","title":"High-Probability Bounds for Stochastic Optimization and Variational Inequalities: the Case of Unbounded Variance","created":"2023-02-02","cited_by_count":61},{"id":"1901.04653","title":"Normalized Flat Minima: Exploring Scale Invariant Definition of Flat Minima for Neural Networks using PAC-Bayesian Analysis","created":"2019-01-15","cited_by_count":59},{"id":"2202.02831","title":"Anticorrelated Noise Injection for Improved Generalization","created":"2022-02-06","cited_by_count":42},{"id":"1503.03712","title":"On Graduated Optimization for Stochastic Non-Convex Problems","created":"2015-03-12","cited_by_count":34},{"id":"1612.05086","title":"Coupling Adaptive Batch Sizes with Learning Rates","created":"2016-12-15","cited_by_count":30},{"id":"2007.15109","title":"Outlier-Robust Estimation: Hardness, Minimally Tuned Algorithms, and Applications","created":"2020-07-29","cited_by_count":26},{"id":"1903.09900","title":"sharpDARTS: Faster and More Accurate Differentiable Architecture Search","created":"2019-03-23","cited_by_count":19},{"id":"1605.08375","title":"Generalization Properties and Implicit Regularization for Multiple Passes SGM","created":"2016-05-26","cited_by_count":16},{"id":"2002.09647","title":"Appropriate Learning Rates of Adaptive Learning Rate Optimization Algorithms for Training Deep Neural Networks","created":"2020-02-22","cited_by_count":16},{"id":"2203.05717","title":"Single Loop Gaussian Homotopy Method for Non-convex Optimization","created":"2022-03-11","cited_by_count":16},{"id":"2103.12682","title":"How to decay your learning rate","created":"2021-03-23","cited_by_count":11},{"id":"2205.00832","title":"Gradient Descent, Stochastic Optimization, and Other Tales","created":"2022-05-02","cited_by_count":4},{"id":"2308.06775","title":"Stochastic Gradient Descent in the Viewpoint of Graduated Optimization","created":"2023-08-13","cited_by_count":2}],"next_cursor":null}