{"list":"other","total":102,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"1908.10084","title":"Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks","created":"2019-08-27","cited_by_count":9170},{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"2309.06180","title":"Efficient Memory Management for Large Language Model Serving with PagedAttention","created":"2023-09-12","cited_by_count":5944},{"id":"1910.13461","title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension","created":"2019-10-29","cited_by_count":5893},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"1912.04977","title":"Advances and Open Problems in Federated Learning","created":"2019-12-10","cited_by_count":3046},{"id":"1812.06127","title":"Federated Optimization in Heterogeneous Networks","created":"2018-12-14","cited_by_count":2987},{"id":"1607.00133","title":"Deep Learning with Differential Privacy","created":"2016-07-01","cited_by_count":2728},{"id":"2212.10560","title":"Self-Instruct: Aligning Language Models with Self-Generated Instructions","created":"2022-12-20","cited_by_count":2724},{"id":"2308.12950","title":"Code Llama: Open Foundation Models for Code","created":"2023-08-24","cited_by_count":2139},{"id":"2007.07481","title":"Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization","created":"2020-07-15","cited_by_count":906},{"id":"2006.07242","title":"Ensemble Distillation for Robust Model Fusion in Federated Learning","created":"2020-06-12","cited_by_count":682},{"id":"2306.11644","title":"Textbooks Are All You Need","created":"2023-06-20","cited_by_count":569},{"id":"2006.05929","title":"Dataset Condensation with Gradient Matching","created":"2020-06-10","cited_by_count":516},{"id":"2203.11932","title":"Dataset Distillation by Matching Training Trajectories","created":"2022-03-22","cited_by_count":442},{"id":"2210.01504","title":"Knowledge Unlearning for Mitigating Privacy Risks in Language Models","created":"2022-10-04","cited_by_count":437},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412},{"id":"2110.06500","title":"Differentially Private Fine-tuning of Language Models","created":"2021-10-13","cited_by_count":400},{"id":"2212.09689","title":"Unnatural Instructions: Tuning Language Models with (Almost) No Human Labor","created":"2022-12-19","cited_by_count":397},{"id":"2109.12298","title":"Opacus: User-Friendly Differential Privacy Library in PyTorch","created":"2021-09-25","cited_by_count":383},{"id":"1610.05755","title":"Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data","created":"2016-10-18","cited_by_count":348},{"id":"2107.06917","title":"A Field Guide to Federated Optimization","created":"2021-07-14","cited_by_count":315},{"id":"1802.08908","title":"Scalable Private Learning with PATE","created":"2018-02-24","cited_by_count":269},{"id":"2011.11660","title":"Differentially Private Learning Needs Better Features (or Much More Data)","created":"2020-11-23","cited_by_count":235},{"id":"2310.20150","title":"Unlearn What You Want to Forget: Efficient Unlearning for LLMs","created":"2023-10-31","cited_by_count":215},{"id":"2202.05520","title":"What Does it Mean for a Language Model to Preserve Privacy?","created":"2022-02-11","cited_by_count":195},{"id":"2106.06639","title":"Federated Learning with Buffered Asynchronous Aggregation","created":"2021-06-11","cited_by_count":190},{"id":"2108.13323","title":"FedKD: Communication Efficient Federated Learning via Knowledge Distillation","created":"2021-08-30","cited_by_count":187},{"id":"2305.05644","title":"Towards Building the Federated GPT: Federated Instruction Tuning","created":"2023-05-09","cited_by_count":185},{"id":"1611.04482","title":"Practical Secure Aggregation for Federated Learning on User-Held Data","created":"2016-11-14","cited_by_count":178},{"id":"2103.00039","title":"Practical and Private (Deep) Learning without Sampling or Shuffling","created":"2021-02-26","cited_by_count":170},{"id":"1805.10559","title":"cpSGD: Communication-efficient and differentially-private distributed SGD","created":"2018-05-27","cited_by_count":158},{"id":"2303.00654","title":"How to DP-fy ML: A Practical Guide to Machine Learning with Differential Privacy","created":"2023-03-01","cited_by_count":153},{"id":"2202.09357","title":"ProxSkip: Yes! Local Gradient Steps Provably Lead to Communication Acceleration! Finally!","created":"2022-02-18","cited_by_count":134},{"id":"2208.11625","title":"PromptFL: Let Federated Participants Cooperatively Learn Prompts Instead of Models -- Federated Learning in Age of Foundation Model","created":"2022-08-24","cited_by_count":134},{"id":"2102.06387","title":"The Distributed Discrete Gaussian Mechanism for Federated Learning with Secure Aggregation","created":"2021-02-12","cited_by_count":128},{"id":"2210.09929","title":"Differentially Private Diffusion Models","created":"2022-10-18","cited_by_count":119},{"id":"2402.15159","title":"Machine Unlearning of Pre-trained Large Language Models","created":"2024-02-23","cited_by_count":119},{"id":"2001.09700","title":"DP-CGAN: Differentially Private Synthetic Data and Label Generation","created":"2020-01-27","cited_by_count":118},{"id":"2108.01624","title":"Large-Scale Differentially Private BERT","created":"2021-08-03","cited_by_count":118},{"id":"2210.14348","title":"Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe","created":"2022-10-25","cited_by_count":108},{"id":"2308.08165","title":"Stochastic Controlled Averaging for Federated Learning with Communication Compression","created":"2023-08-16","cited_by_count":101},{"id":"2309.11765","title":"Privacy-Preserving In-Context Learning with Differentially Private Few-Shot Generation","created":"2023-09-21","cited_by_count":96},{"id":"2007.03813","title":"Bypassing the Ambient Dimension: Private SGD with Gradient Subspace Identification","created":"2020-07-07","cited_by_count":90},{"id":"2106.09352","title":"Large Scale Private Learning via Low-rank Reparametrization","created":"2021-06-17","cited_by_count":88},{"id":"2206.07136","title":"Automatic Clipping: Differentially Private Deep Learning Made Easier and Stronger","created":"2022-06-14","cited_by_count":88},{"id":"2212.06470","title":"Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining","created":"2022-12-13","cited_by_count":88},{"id":"1911.06679","title":"Generative Models for Effective ML on Private, Decentralized Datasets","created":"2019-11-15","cited_by_count":85},{"id":"2305.15594","title":"Flocks of Stochastic Parrots: Differentially Private Prompt Learning for Large Language Models","created":"2023-05-24","cited_by_count":83},{"id":"2403.01749","title":"Differentially Private Synthetic Data via Foundation Model APIs 2: Text","created":"2024-03-04","cited_by_count":76},{"id":"2205.08514","title":"Recovering Private Text in Federated Learning of Language Models","created":"2022-05-17","cited_by_count":70},{"id":"2009.10031","title":"Training Production Language Models without Memorizing User Data","created":"2020-09-21","cited_by_count":68},{"id":"2110.04995","title":"The Skellam Mechanism for Differentially Private Federated Learning","created":"2021-10-11","cited_by_count":68},{"id":"2210.13918","title":"Differentially Private Language Models for Secure Data Sharing","created":"2022-10-25","cited_by_count":68},{"id":"2309.06746","title":"DP-Forward: Fine-tuning and Inference on Language Models with Differential Privacy in Forward Pass","created":"2023-09-13","cited_by_count":67},{"id":"2305.18465","title":"Federated Learning of Gboard Language Models with Differential Privacy","created":"2023-05-29","cited_by_count":66},{"id":"2210.00038","title":"Differentially Private Optimization on Large Model at Small Cost","created":"2022-09-30","cited_by_count":65},{"id":"2305.15560","title":"Differentially Private Synthetic Data via Foundation Model APIs 1: Images","created":"2023-05-24","cited_by_count":65},{"id":"2306.01684","title":"Harnessing large-language models to generate private synthetic text","created":"2023-06-02","cited_by_count":65},{"id":"2310.16111","title":"Locally Differentially Private Document Generation Using Zero Shot Prompting","created":"2023-10-24","cited_by_count":63},{"id":"2111.01177","title":"Don't Generate Me: Training Differentially Private Generative Models with Sinkhorn Divergence","created":"2021-11-01","cited_by_count":54},{"id":"2305.01639","title":"Privacy-Preserving In-Context Learning for Large Language Models","created":"2023-05-02","cited_by_count":50},{"id":"2208.11311","title":"Federated Learning via Decentralized Dataset Distillation in Resource-Constrained Edge Environments","created":"2022-08-24","cited_by_count":49},{"id":"2207.00160","title":"When Does Differentially Private Learning Not Suffer in High Dimensions?","created":"2022-07-01","cited_by_count":48},{"id":"2009.05886","title":"Differentially Private Language Models Benefit from Public Pre-training","created":"2020-09-13","cited_by_count":47},{"id":"2305.06212","title":"Privacy-Preserving Parameter-Efficient Fine-Tuning for Large Language Model Services","created":"2023-05-10","cited_by_count":43},{"id":"2401.04343","title":"Private Fine-tuning of Large Language Models with Zeroth-order Optimization","created":"2024-01-09","cited_by_count":41},{"id":"2302.09483","title":"Why Is Public Pretraining Necessary for Private Model Training?","created":"2023-02-19","cited_by_count":37},{"id":"2212.09573","title":"Privacy Adhering Machine Un-learning in NLP","created":"2022-12-19","cited_by_count":36},{"id":"2402.13659","title":"Privacy-Preserving Instructions for Aligning Large Language Models","created":"2024-02-21","cited_by_count":35},{"id":"2211.08025","title":"FedTune: A Deep Dive into Efficient Federated Fine-Tuning with Pre-trained Transformers","created":"2022-11-15","cited_by_count":33},{"id":"2103.07567","title":"Privacy Regularization: Joint Privacy-Utility Optimization in Language Models","created":"2021-03-12","cited_by_count":30},{"id":"2206.02291","title":"Pretrained Models for Multilingual Federated Learning","created":"2022-06-06","cited_by_count":30},{"id":"2305.12132","title":"Can Public Large Language Models Help Private Cross-device Federated Learning?","created":"2023-05-20","cited_by_count":30},{"id":"2307.09619","title":"Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning","created":"2023-07-18","cited_by_count":29},{"id":"2205.10162","title":"FedAdapter: Efficient Federated Learning for Modern NLP","created":"2022-05-20","cited_by_count":25},{"id":"2306.02210","title":"GPT-FL: Generative Pre-trained Model-Assisted Federated Learning","created":"2023-06-03","cited_by_count":24},{"id":"2109.08119","title":"Personalized Federated Learning for Heterogeneous Clients with Clustered Knowledge Transfer","created":"2021-09-16","cited_by_count":23},{"id":"2211.10844","title":"Learning to Generate Image Embeddings with User-level Differential Privacy","created":"2022-11-20","cited_by_count":23},{"id":"2212.14370","title":"Can 5th Generation Local Training Methods Support Client Sampling? Yes!","created":"2022-12-29","cited_by_count":22},{"id":"2007.11934","title":"Private Post-GAN Boosting","created":"2020-07-23","cited_by_count":20},{"id":"2102.06333","title":"Efficient Algorithms for Federated Saddle Point Optimization","created":"2021-02-12","cited_by_count":20},{"id":"2206.02617","title":"Individual Privacy Accounting for Differentially Private Stochastic Gradient Descent","created":"2022-06-06","cited_by_count":20},{"id":"2207.03957","title":"Communication Acceleration of Local Gradient Methods via an Accelerated Primal-Dual Algorithm with Inexact Prox","created":"2022-07-08","cited_by_count":19},{"id":"2104.11838","title":"On a Utilitarian Approach to Privacy Preserving Text Generation","created":"2021-04-23","cited_by_count":17},{"id":"2206.01349","title":"On the Privacy Properties of GAN-generated Samples","created":"2022-06-03","cited_by_count":17},{"id":"2404.04360","title":"Prompt Public Large Language Models to Synthesize Data for Private On-device Applications","created":"2024-04-05","cited_by_count":17},{"id":"2207.08988","title":"Training Large-Vocabulary Neural Language Models by Private Federated Learning for Resource-Constrained Devices","created":"2022-07-18","cited_by_count":16},{"id":"2303.01256","title":"Choosing Public Datasets for Private Machine Learning via Gradient Subspace Distance","created":"2023-03-02","cited_by_count":16},{"id":"2205.01863","title":"Provably Confidential Language Modelling","created":"2022-05-04","cited_by_count":13},{"id":"2302.09042","title":"Privately Customizing Prefinetuning to Better Match User Data in Federated Learning","created":"2023-02-17","cited_by_count":12},{"id":"2108.06869","title":"FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning","created":"2021-08-16","cited_by_count":11},{"id":"2208.09432","title":"Federated Select: A Primitive for Communication- and Memory-Efficient Federated Learning","created":"2022-08-19","cited_by_count":11},{"id":"2008.06570","title":"Fast Dimension Independent Private AdaGrad on Publicly Estimated Subspaces","created":"2020-08-14","cited_by_count":10},{"id":"2111.02356","title":"Towards Sparse Federated Analytics: Location Heatmaps under Distributed Differential Privacy with Secure Aggregation","created":"2021-11-03","cited_by_count":10},{"id":"2310.04627","title":"Profit: Benchmarking Personalization and Robustness Trade-off in Federated Prompt Tuning","created":"2023-10-06","cited_by_count":9}],"next_cursor":"100"}