{"list":"other","total":77,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2010.11929","title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","created":"2020-10-22","cited_by_count":30186},{"id":"1409.1556","title":"Very Deep Convolutional Networks for Large-Scale Image Recognition","created":"2014-09-04","cited_by_count":15364},{"id":"1409.0575","title":"ImageNet Large Scale Visual Recognition Challenge","created":"2014-09-01","cited_by_count":8498},{"id":"1502.03167","title":"Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift","created":"2015-02-11","cited_by_count":7005},{"id":"1905.11946","title":"EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks","created":"2019-05-28","cited_by_count":6442},{"id":"1710.09412","title":"mixup: Beyond Empirical Risk Minimization","created":"2017-10-25","cited_by_count":5183},{"id":"2012.12877","title":"Training data-efficient image transformers & distillation through attention","created":"2020-12-23","cited_by_count":4586},{"id":"1605.07146","title":"Wide Residual Networks","created":"2016-05-23","cited_by_count":3070},{"id":"1607.00133","title":"Deep Learning with Differential Privacy","created":"2016-07-01","cited_by_count":2728},{"id":"1909.13719","title":"RandAugment: Practical automated data augmentation with a reduced search space","created":"2019-09-30","cited_by_count":2269},{"id":"2012.07805","title":"Extracting Training Data from Large Language Models","created":"2020-12-14","cited_by_count":2189},{"id":"1803.08494","title":"Group Normalization","created":"2018-03-22","cited_by_count":1524},{"id":"1706.02677","title":"Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour","created":"2017-06-08","cited_by_count":1492},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"2106.04560","title":"Scaling Vision Transformers","created":"2021-06-08","cited_by_count":999},{"id":"1707.02968","title":"Revisiting Unreasonable Effectiveness of Data in Deep Learning Era","created":"2017-07-10","cited_by_count":919},{"id":"2112.03570","title":"Membership Inference Attacks From First Principles","created":"2021-12-07","cited_by_count":878},{"id":"1912.11370","title":"Big Transfer (BiT): General Visual Representation Learning","created":"2019-12-24","cited_by_count":769},{"id":"2103.17239","title":"Going deeper with Image Transformers","created":"2021-03-31","cited_by_count":764},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412},{"id":"2110.06500","title":"Differentially Private Fine-tuning of Language Models","created":"2021-10-13","cited_by_count":400},{"id":"2007.14321","title":"Label-Only Membership Inference Attacks","created":"2020-07-28","cited_by_count":388},{"id":"2109.12298","title":"Opacus: User-Friendly Differential Privacy Library in PyTorch","created":"2021-09-25","cited_by_count":383},{"id":"1707.08819","title":"A Downsampled Variant of ImageNet as an Alternative to the CIFAR datasets","created":"2017-07-27","cited_by_count":377},{"id":"2102.06171","title":"High-Performance Large-Scale Image Recognition Without Normalization","created":"2021-02-11","cited_by_count":360},{"id":"1711.00489","title":"Don't Decay the Learning Rate, Increase the Batch Size","created":"2017-11-01","cited_by_count":320},{"id":"1905.12101","title":"Differential Privacy Has Disparate Impact on Model Accuracy","created":"2019-05-28","cited_by_count":316},{"id":"1812.06162","title":"An Empirical Model of Large-Batch Training","created":"2018-12-14","cited_by_count":281},{"id":"1802.08908","title":"Scalable Private Learning with PATE","created":"2018-02-24","cited_by_count":269},{"id":"2006.16923","title":"Large image datasets: A pyrrhic win for computer vision?","created":"2020-06-24","cited_by_count":237},{"id":"2011.11660","title":"Differentially Private Learning Needs Better Features (or Much More Data)","created":"2020-11-23","cited_by_count":235},{"id":"1905.03871","title":"Differentially Private Learning with Adaptive Clipping","created":"2019-05-09","cited_by_count":220},{"id":"2006.07709","title":"Auditing Differentially Private Machine Learning: How Private is Private SGD?","created":"2020-06-13","cited_by_count":218},{"id":"1908.10530","title":"R\\'enyi Differential Privacy of the Sampled Gaussian Mechanism","created":"2019-08-28","cited_by_count":204},{"id":"2101.04535","title":"Adversary Instantiation: Lower Bounds for Differentially Private Machine Learning","created":"2021-01-11","cited_by_count":199},{"id":"1901.09321","title":"Fixup Initialization: Residual Learning Without Normalization","created":"2019-01-27","cited_by_count":198},{"id":"1811.03600","title":"Measuring the Effects of Data Parallelism on Neural Network Training","created":"2018-11-08","cited_by_count":193},{"id":"2005.04763","title":"Private Stochastic Convex Optimization: Optimal Rates in Linear Time","created":"2020-05-10","cited_by_count":153},{"id":"1712.06559","title":"The Power of Interpolation: Understanding the Effectiveness of SGD in Modern Over-parametrized Learning","created":"2017-12-18","cited_by_count":150},{"id":"2201.04845","title":"Reconstructing Training Data with Informed Adversaries","created":"2022-01-13","cited_by_count":148},{"id":"2006.15429","title":"Understanding Gradient Clipping in Private SGD: A Geometric Perspective","created":"2020-06-27","cited_by_count":142},{"id":"2007.14191","title":"Tempered Sigmoid Activations for Deep Learning with Differential Privacy","created":"2020-07-28","cited_by_count":122},{"id":"2108.01624","title":"Large-Scale Differentially Private BERT","created":"2021-08-03","cited_by_count":118},{"id":"2201.08371","title":"Revisiting Weakly Supervised Pre-Training of Visual Perception Models","created":"2022-01-20","cited_by_count":116},{"id":"2110.03620","title":"Hyperparameter Tuning with Renyi Differential Privacy","created":"2021-10-07","cited_by_count":104},{"id":"2012.12803","title":"Hiding Among the Clones: A Simple and Nearly Optimal Analysis of Privacy Amplification by Shuffling","created":"2020-12-23","cited_by_count":96},{"id":"2010.10241","title":"BYOL works even without batch statistics","created":"2020-10-20","cited_by_count":95},{"id":"2007.03813","title":"Bypassing the Ambient Dimension: Private SGD with Gradient Subspace Identification","created":"2020-07-07","cited_by_count":90},{"id":"1511.02513","title":"Algorithmic Stability for Adaptive Data Analysis","created":"2015-11-08","cited_by_count":88},{"id":"2101.08692","title":"Characterizing signal propagation to close the performance gap in unnormalized ResNets","created":"2021-01-21","cited_by_count":88},{"id":"2106.09352","title":"Large Scale Private Learning via Low-rank Reparametrization","created":"2021-06-17","cited_by_count":88},{"id":"2201.12328","title":"Toward Training at ImageNet Scale with Differential Privacy","created":"2022-01-28","cited_by_count":87},{"id":"2102.12677","title":"Do Not Let Privacy Overbill Utility: Gradient Embedding Perturbation for Private Learning","created":"2021-02-25","cited_by_count":86},{"id":"2102.02551","title":"ML-Doctor: Holistic Risk Assessment of Inference Attacks Against Machine Learning Models","created":"2021-02-04","cited_by_count":85},{"id":"1812.06210","title":"A General Approach to Adding Differential Privacy to Iterative Training Procedures","created":"2018-12-15","cited_by_count":84},{"id":"2103.01516","title":"Private Stochastic Convex Optimization: Optimal Rates in $\\ell_1$ Geometry","created":"2021-03-02","cited_by_count":83},{"id":"2006.15081","title":"On the Generalization Benefit of Noise in Stochastic Gradient Descent","created":"2020-06-26","cited_by_count":82},{"id":"2203.11481","title":"Mixed Differential Privacy in Computer Vision","created":"2022-03-22","cited_by_count":54},{"id":"1412.8659","title":"Deep Roto-Translation Scattering for Object Classification","created":"2014-12-30","cited_by_count":50},{"id":"1910.13427","title":"Distribution Density, Tails, and Outliers in Machine Learning: Metrics and Applications","created":"2019-10-29","cited_by_count":43},{"id":"2202.12219","title":"Debugging Differential Privacy: A Case Study for Privacy Auditing","created":"2022-02-24","cited_by_count":40},{"id":"1901.09335","title":"Augment your batch: better training with larger batches","created":"2019-01-27","cited_by_count":37},{"id":"2010.06667","title":"Chasing Your Long Tails: Differentially Private Prediction in Health Care Settings","created":"2020-10-13","cited_by_count":37},{"id":"1909.03577","title":"A New Analysis of Differential Privacy's Generalization Guarantees","created":"2019-09-09","cited_by_count":36},{"id":"2105.13343","title":"Drawing Multiple Augmentation Samples Per Image During Training Efficiently Decreases Test Error","created":"2021-05-27","cited_by_count":33},{"id":"1603.01699","title":"Understanding the Sparse Vector Technique for Differential Privacy","created":"2016-03-05","cited_by_count":27},{"id":"1706.05069","title":"Generalization for Adaptively-chosen Estimators via Stable Median","created":"2017-06-15","cited_by_count":26},{"id":"2203.00324","title":"Differentially private training of residual networks with scale normalisation","created":"2022-03-01","cited_by_count":26},{"id":"2007.05089","title":"The Trade-Offs of Private Prediction","created":"2020-07-09","cited_by_count":22},{"id":"2110.06255","title":"Not all noise is accounted equally: How differentially private learning benefits from large sampling rates","created":"2021-10-12","cited_by_count":21},{"id":"2103.01294","title":"Wide Network Learning with Differential Privacy","created":"2021-03-01","cited_by_count":17},{"id":"2111.13895","title":"Towards Understanding the Impact of Model Size on Differential Private Classification","created":"2021-11-27","cited_by_count":10},{"id":"1806.11311","title":"Guaranteed Deterministic Bounds on the Total Variation Distance between Univariate Mixtures","created":"2018-06-29","cited_by_count":7},{"id":"2106.00477","title":"Tight Accounting in the Shuffle Model of Differential Privacy","created":"2021-06-01","cited_by_count":5}],"next_cursor":null}