{"list":"other","total":67,"rows":[{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2010.11929","title":"An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale","created":"2020-10-22","cited_by_count":30186},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"1412.6572","title":"Explaining and Harnessing Adversarial Examples","created":"2014-12-20","cited_by_count":7364},{"id":"2104.14294","title":"Emerging Properties in Self-Supervised Vision Transformers","created":"2021-04-29","cited_by_count":6968},{"id":"1706.04599","title":"On Calibration of Modern Neural Networks","created":"2017-06-14","cited_by_count":4960},{"id":"1607.00133","title":"Deep Learning with Differential Privacy","created":"2016-07-01","cited_by_count":2728},{"id":"2012.07805","title":"Extracting Training Data from Large Language Models","created":"2020-12-14","cited_by_count":2189},{"id":"1610.02413","title":"Equality of Opportunity in Supervised Learning","created":"2016-10-07","cited_by_count":2007},{"id":"2004.10964","title":"Don't Stop Pretraining: Adapt Language Models to Domains and Tasks","created":"2020-04-23","cited_by_count":1565},{"id":"2010.01412","title":"Sharpness-Aware Minimization for Efficiently Improving Generalization","created":"2020-10-03","cited_by_count":1417},{"id":"1609.04836","title":"On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima","created":"2016-09-15","cited_by_count":1352},{"id":"1707.02968","title":"Revisiting Unreasonable Effectiveness of Data in Deep Learning Era","created":"2017-07-10","cited_by_count":919},{"id":"2112.03570","title":"Membership Inference Attacks From First Principles","created":"2021-12-07","cited_by_count":878},{"id":"2202.07646","title":"Quantifying Memorization Across Neural Language Models","created":"2022-02-15","cited_by_count":763},{"id":"1904.00962","title":"Large Batch Optimization for Deep Learning: Training BERT in 76 minutes","created":"2019-04-01","cited_by_count":674},{"id":"2104.10972","title":"ImageNet-21K Pretraining for the Masses","created":"2021-04-22","cited_by_count":613},{"id":"1802.04434","title":"signSGD: Compressed Optimisation for Non-Convex Problems","created":"2018-02-13","cited_by_count":571},{"id":"2106.10270","title":"How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers","created":"2021-06-18","cited_by_count":569},{"id":"1911.00222","title":"Federated Learning with Differential Privacy: Algorithms and Performance Analysis","created":"2019-11-01","cited_by_count":536},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412},{"id":"2110.06500","title":"Differentially Private Fine-tuning of Language Models","created":"2021-10-13","cited_by_count":400},{"id":"2109.12298","title":"Opacus: User-Friendly Differential Privacy Library in PyTorch","created":"2021-09-25","cited_by_count":383},{"id":"1704.04289","title":"Stochastic Gradient Descent as Approximate Bayesian Inference","created":"2017-04-13","cited_by_count":300},{"id":"2302.00539","title":"Analyzing Leakage of Personally Identifiable Information in Language Models","created":"2023-02-01","cited_by_count":285},{"id":"1812.06162","title":"An Empirical Model of Large-Batch Training","created":"2018-12-14","cited_by_count":281},{"id":"2011.11660","title":"Differentially Private Learning Needs Better Features (or Much More Data)","created":"2020-11-23","cited_by_count":235},{"id":"2204.13650","title":"Unlocking High-Accuracy Differentially Private Image Classification through Scale","created":"2022-04-28","cited_by_count":224},{"id":"2106.02848","title":"Numerical Composition of Differential Privacy","created":"2021-06-05","cited_by_count":180},{"id":"2103.16483","title":"Benchmarking Representation Learning for Natural World Image Collections","created":"2021-03-30","cited_by_count":168},{"id":"2303.00654","title":"How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy","created":"2023-03-01","cited_by_count":153},{"id":"2006.15429","title":"Understanding Gradient Clipping in Private SGD: A Geometric Perspective","created":"2020-06-27","cited_by_count":142},{"id":"2007.14191","title":"Tempered Sigmoid Activations for Deep Learning with Differential Privacy","created":"2020-07-28","cited_by_count":122},{"id":"1907.04164","title":"Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model","created":"2019-07-09","cited_by_count":117},{"id":"1911.11607","title":"Deep Learning with Gaussian Differential Privacy","created":"2019-11-26","cited_by_count":114},{"id":"2010.02194","title":"Self-training Improves Pre-training for Natural Language Understanding","created":"2020-10-05","cited_by_count":96},{"id":"2007.03813","title":"Bypassing the Ambient Dimension: Private SGD with Gradient Subspace Identification","created":"2020-07-07","cited_by_count":90},{"id":"2004.13640","title":"Extending Multilingual BERT to Low-Resource Languages","created":"2020-04-28","cited_by_count":88},{"id":"2206.07136","title":"Automatic Clipping: Differentially Private Deep Learning Made Easier and Stronger","created":"2022-06-14","cited_by_count":88},{"id":"2212.06470","title":"Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining","created":"2022-12-13","cited_by_count":88},{"id":"2201.12328","title":"Toward Training at ImageNet Scale with Differential Privacy","created":"2022-01-28","cited_by_count":87},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84},{"id":"2106.13673","title":"Understanding Clipping for Federated Learning: Convergence and Client-Level Differential Privacy","created":"2021-06-25","cited_by_count":69},{"id":"2210.00038","title":"Differentially Private Optimization on Large Model at Small Cost","created":"2022-09-30","cited_by_count":65},{"id":"2203.11481","title":"Mixed Differential Privacy in Computer Vision","created":"2022-03-22","cited_by_count":54},{"id":"2210.03403","title":"TAN Without a Burn: Scaling Laws of DP-SGD","created":"2022-10-07","cited_by_count":52},{"id":"2212.01539","title":"Exploring the Limits of Differentially Private Deep Learning with Group-wise Clipping","created":"2022-12-03","cited_by_count":52},{"id":"2112.00193","title":"Public Data-Assisted Mirror Descent for Private Model Training","created":"2021-12-01","cited_by_count":49},{"id":"2205.10683","title":"Scalable and Efficient Training of Large Convolutional Neural Networks with Differential Privacy","created":"2022-05-21","cited_by_count":48},{"id":"2207.00160","title":"When Does Differentially Private Learning Not Suffer in High Dimensions?","created":"2022-07-01","cited_by_count":48},{"id":"2210.00036","title":"Differentially Private Bias-Term Fine-tuning of Foundation Models","created":"2022-09-30","cited_by_count":48},{"id":"2205.02973","title":"Large Scale Transfer Learning for Differentially Private Image Classification","created":"2022-05-06","cited_by_count":41},{"id":"2106.07830","title":"On the Convergence and Calibration of Deep Learning with Differential Privacy","created":"2021-06-15","cited_by_count":36},{"id":"2206.13033","title":"Normalized/Clipped SGD with Perturbation for Differentially Private Non-Convex Optimization","created":"2022-06-27","cited_by_count":36},{"id":"2304.10447","title":"Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health","created":"2023-04-20","cited_by_count":25},{"id":"2306.08842","title":"ViP: A Differentially Private Foundation Model for Computer Vision","created":"2023-06-15","cited_by_count":17},{"id":"2308.10888","title":"Unlocking Accuracy and Fairness in Differentially Private Image Classification","created":"2023-08-21","cited_by_count":16},{"id":"2310.20579","title":"Initialization Matters: Privacy-Utility Analysis of Overparameterized Neural Networks","created":"2023-10-31","cited_by_count":10},{"id":"2111.00115","title":"Combining Public and Private Data","created":"2021-10-29","cited_by_count":9},{"id":"2206.01836","title":"Dimension Independent Generalization of DP-SGD for Overparameterized Smooth Convex Optimization","created":"2022-06-03","cited_by_count":9},{"id":"2310.19215","title":"On the accuracy and efficiency of group-wise clipping in differentially private optimization","created":"2023-10-30","cited_by_count":7},{"id":"2311.11822","title":"Zero redundancy distributed learning with differential privacy","created":"2023-11-20","cited_by_count":7},{"id":"2211.08942","title":"Differentially Private Optimizers Can Learn Adversarially Robust Models","created":"2022-11-16","cited_by_count":6},{"id":"2106.07094","title":"On the Convergence of Differentially Private Federated Learning on Non-Lipschitz Objectives, and with Normalized Client Updates","created":"2021-06-13","cited_by_count":5},{"id":"2310.01304","title":"Coupling public and private gradient provably helps optimization","created":"2023-10-02","cited_by_count":3},{"id":"2302.10281","title":"LiT Tuned Models for Efficient Species Detection","created":"2023-02-12","cited_by_count":1}],"next_cursor":null}