{"list":"other","total":67,"rows":[{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"1710.09412","title":"mixup: Beyond Empirical Risk Minimization","created":"2017-10-25","cited_by_count":5183},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"1611.01578","title":"Neural Architecture Search with Reinforcement Learning","created":"2016-11-05","cited_by_count":1499},{"id":"2010.01412","title":"Sharpness-Aware Minimization for Efficiently Improving Generalization","created":"2020-10-03","cited_by_count":1417},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1911.08731","title":"Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization","created":"2019-11-20","cited_by_count":1247},{"id":"1901.05555","title":"Class-Balanced Loss Based on Effective Number of Samples","created":"2019-01-16","cited_by_count":1245},{"id":"2101.11986","title":"Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet","created":"2021-01-28","cited_by_count":1101},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1802.03268","title":"Efficient Neural Architecture Search via Parameter Sharing","created":"2018-02-09","cited_by_count":837},{"id":"2107.06499","title":"Deduplicating Training Data Makes Language Models Better","created":"2021-07-14","cited_by_count":714},{"id":"2002.07394","title":"DivideMix: Learning with Noisy Labels as Semi-supervised Learning","created":"2020-02-18","cited_by_count":692},{"id":"1812.05159","title":"An Empirical Study of Example Forgetting during Deep Neural Network Learning","created":"2018-12-12","cited_by_count":678},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"2304.14108","title":"DataComp: In search of the next generation of multimodal datasets","created":"2023-04-27","cited_by_count":644},{"id":"2107.09044","title":"Just Train Twice: Improving Group Robustness without Training Group Information","created":"2021-07-19","cited_by_count":523},{"id":"1712.00559","title":"Progressive Neural Architecture Search","created":"2017-12-02","cited_by_count":487},{"id":"1703.04933","title":"Sharp Minima Can Generalize For Deep Nets","created":"2017-03-15","cited_by_count":466},{"id":"2102.08604","title":"SWAD: Domain Generalization by Seeking Flat Minima","created":"2021-02-17","cited_by_count":434},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381},{"id":"1611.01838","title":"Entropy-SGD: Biasing Gradient Descent Into Wide Valleys","created":"2016-11-06","cited_by_count":359},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"1412.6614","title":"In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning","created":"2014-12-20","cited_by_count":342},{"id":"1803.00942","title":"Not All Samples Are Created Equal: Deep Learning with Importance Sampling","created":"2018-03-02","cited_by_count":328},{"id":"1705.09280","title":"Implicit Regularization in Matrix Factorization","created":"2017-05-25","cited_by_count":322},{"id":"2010.07249","title":"Environment Inference for Invariant Learning","created":"2020-10-14","cited_by_count":306},{"id":"1706.03691","title":"Certified Defenses for Data Poisoning Attacks","created":"2017-06-09","cited_by_count":303},{"id":"2303.09540","title":"SemDeDup: Data-efficient learning at web-scale through semantic deduplication","created":"2023-03-16","cited_by_count":303},{"id":"2012.09816","title":"Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning","created":"2020-12-17","cited_by_count":297},{"id":"2102.11600","title":"ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks","created":"2021-02-23","cited_by_count":293},{"id":"1901.10159","title":"An Investigation into Neural Net Optimization via Hessian Eigenvalue Density","created":"2019-01-29","cited_by_count":292},{"id":"1711.04623","title":"Three Factors Influencing Minima in SGD","created":"2017-11-13","cited_by_count":273},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"2103.10158","title":"TrivialAugment: Tuning-free Yet State-of-the-Art Data Augmentation","created":"2021-03-18","cited_by_count":227},{"id":"1905.11604","title":"SGD on Neural Networks Learns Functions of Increasing Complexity","created":"2019-05-28","cited_by_count":204},{"id":"2006.00719","title":"ADAHESSIAN: An Adaptive Second Order Optimizer for Machine Learning","created":"2020-06-01","cited_by_count":202},{"id":"1805.08522","title":"Deep learning generalizes because the parameter-function map is biased towards simple functions","created":"2018-05-22","cited_by_count":183},{"id":"1309.2388","title":"Minimizing Finite Sums with the Stochastic Average Gradient","created":"2013-09-10","cited_by_count":164},{"id":"1907.04595","title":"Towards Explaining the Regularization Effect of Initial Large Learning Rate in Training Neural Networks","created":"2019-07-10","cited_by_count":162},{"id":"2002.09572","title":"The Break-Even Point on Optimization Trajectories of Deep Neural Networks","created":"2020-02-21","cited_by_count":150},{"id":"2206.06232","title":"Towards Understanding Sharpness-Aware Minimization","created":"2022-06-13","cited_by_count":146},{"id":"2106.09647","title":"Deep Learning Through the Lens of Example Difficulty","created":"2021-06-17","cited_by_count":141},{"id":"2110.03141","title":"Efficient Sharpness-aware Minimization for Improved Training of Neural Networks","created":"2021-10-07","cited_by_count":137},{"id":"2006.12433","title":"What shapes feature representations? Exploring datasets, architectures, and training","created":"2020-06-22","cited_by_count":126},{"id":"2303.10353","title":"Sharpness-Aware Gradient Matching for Domain Generalization","created":"2023-03-18","cited_by_count":102},{"id":"1401.2753","title":"Stochastic Optimization with Importance Sampling","created":"2014-01-13","cited_by_count":91},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91},{"id":"2105.05612","title":"Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization","created":"2021-05-12","cited_by_count":83},{"id":"2010.04925","title":"Regularizing Neural Networks via Adversarial Model Perturbation","created":"2020-10-10","cited_by_count":78},{"id":"2211.05729","title":"How Does Sharpness-Aware Minimization Minimize Sharpness?","created":"2022-11-10","cited_by_count":65},{"id":"2006.14599","title":"The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks","created":"2020-06-25","cited_by_count":58},{"id":"2206.10654","title":"On the Maximum Hessian Eigenvalue and Generalization","created":"2022-06-21","cited_by_count":57},{"id":"2210.01513","title":"The Dynamics of Sharpness-Aware Minimization: Bouncing Across Ravines and Drifting Towards Wide Minima","created":"2022-10-04","cited_by_count":51},{"id":"2305.18761","title":"Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias","created":"2023-05-30","cited_by_count":44},{"id":"2207.05931","title":"Towards understanding how momentum improves generalization in deep learning","created":"2022-07-13","cited_by_count":40},{"id":"2306.04949","title":"Robust Learning with Progressive Data Expansion Against Spurious Correlation","created":"2023-06-08","cited_by_count":39},{"id":"2305.16292","title":"Sharpness-Aware Minimization Leads to Low-Rank Features","created":"2023-05-25","cited_by_count":38},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34},{"id":"2308.12553","title":"Don't blame Dataset Shift! Shortcut Learning due to Gradients and Cross Entropy","created":"2023-08-24","cited_by_count":30},{"id":"2201.12293","title":"Understanding Why Generalized Reweighting Does Not Improve Over ERM","created":"2022-01-28","cited_by_count":29},{"id":"2301.13293","title":"Overcoming Simplicity Bias in Deep Networks using a Feature Sieve","created":"2023-01-30","cited_by_count":29},{"id":"2310.07269","title":"Why Does Sharpness-Aware Minimization Generalize Better Than SGD?","created":"2023-10-11","cited_by_count":28},{"id":"1902.08234","title":"An Empirical Study of Large-Batch Stochastic Gradient Descent with Structured Covariance Noise","created":"2019-02-21","cited_by_count":13},{"id":"2103.12293","title":"Stochastic Reweighted Gradient Descent","created":"2021-03-23","cited_by_count":7}],"next_cursor":null}