{"list":"other","total":73,"rows":[{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"1904.09675","title":"BERTScore: Evaluating Text Generation with BERT","created":"2019-04-21","cited_by_count":5512},{"id":"2305.14314","title":"QLoRA: Efficient Finetuning of Quantized LLMs","created":"2023-05-23","cited_by_count":3418},{"id":"2004.05150","title":"Longformer: The Long-Document Transformer","created":"2020-04-10","cited_by_count":3413},{"id":"1912.04977","title":"Advances and Open Problems in Federated Learning","created":"2019-12-10","cited_by_count":3046},{"id":"1607.00133","title":"Deep Learning with Differential Privacy","created":"2016-07-01","cited_by_count":2728},{"id":"2303.18223","title":"A Survey of Large Language Models","created":"2023-03-31","cited_by_count":2576},{"id":"1610.05820","title":"Membership Inference Attacks against Machine Learning Models","created":"2016-10-18","cited_by_count":2281},{"id":"1910.03771","title":"HuggingFace's Transformers: State-of-the-art Natural Language Processing","created":"2019-10-09","cited_by_count":2218},{"id":"2012.07805","title":"Extracting Training Data from Large Language Models","created":"2020-12-14","cited_by_count":2189},{"id":"2212.13138","title":"Large Language Models Encode Clinical Knowledge","created":"2022-12-26","cited_by_count":1830},{"id":"2009.13081","title":"What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams","created":"2020-09-28","cited_by_count":1356},{"id":"2305.13245","title":"GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints","created":"2023-05-22","cited_by_count":1346},{"id":"1909.06146","title":"PubMedQA: A Dataset for Biomedical Research Question Answering","created":"2019-09-13","cited_by_count":1288},{"id":"2303.17564","title":"BloombergGPT: A Large Language Model for Finance","created":"2023-03-30","cited_by_count":939},{"id":"1802.08232","title":"The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks","created":"2018-02-22","cited_by_count":864},{"id":"2202.07646","title":"Quantifying Memorization Across Neural Language Models","created":"2022-02-15","cited_by_count":763},{"id":"2107.06499","title":"Deduplicating Training Data Makes Language Models Better","created":"2021-07-14","cited_by_count":714},{"id":"2012.13255","title":"Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning","created":"2020-12-22","cited_by_count":671},{"id":"1811.03604","title":"Federated Learning for Mobile Keyboard Prediction","created":"2018-11-08","cited_by_count":572},{"id":"1802.04434","title":"signSGD: Compressed Optimisation for Non-Convex Problems","created":"2018-02-13","cited_by_count":571},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"2203.14371","title":"MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering","created":"2022-03-27","cited_by_count":543},{"id":"1906.05271","title":"Does Learning Require Memorization? A Short Tale about a Long Tail","created":"2019-06-12","cited_by_count":460},{"id":"2311.17035","title":"Scalable Extraction of Training Data from (Production) Language Models","created":"2023-11-28","cited_by_count":434},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412},{"id":"1804.08838","title":"Measuring the Intrinsic Dimension of Objective Landscapes","created":"2018-04-24","cited_by_count":370},{"id":"2202.06539","title":"Deduplicating Training Data Mitigates Privacy Risks in Language Models","created":"2022-02-14","cited_by_count":314},{"id":"1901.09847","title":"Error Feedback Fixes SignSGD and other Gradient Compression Schemes","created":"2019-01-28","cited_by_count":310},{"id":"2302.00539","title":"Analyzing Leakage of Personally Identifiable Information in Language Models","created":"2023-02-01","cited_by_count":285},{"id":"2203.03540","title":"GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records","created":"2022-02-02","cited_by_count":238},{"id":"2311.10723","title":"Large Language Models in Finance: A Survey","created":"2023-09-28","cited_by_count":226},{"id":"2205.10770","title":"Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models","created":"2022-05-22","cited_by_count":220},{"id":"1812.03224","title":"A Hybrid Approach to Privacy-Preserving Federated Learning","created":"2018-12-07","cited_by_count":210},{"id":"2112.00059","title":"Evaluating Gradient Inversion Attacks and Defenses in Federated Learning","created":"2021-11-30","cited_by_count":196},{"id":"2202.05520","title":"What Does it Mean for a Language Model to Preserve Privacy?","created":"2022-02-11","cited_by_count":195},{"id":"2111.08834","title":"Federated Learning for Smart Healthcare: A Survey","created":"2021-11-16","cited_by_count":184},{"id":"2203.03929","title":"Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks","created":"2022-03-08","cited_by_count":175},{"id":"2309.00363","title":"FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning","created":"2023-09-01","cited_by_count":149},{"id":"2304.11158","title":"Emergent and Predictable Memorization in Large Language Models","created":"2023-04-21","cited_by_count":148},{"id":"2402.06954","title":"OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning","created":"2024-02-10","cited_by_count":128},{"id":"2306.16092","title":"Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts Architecture","created":"2023-06-28","cited_by_count":122},{"id":"2207.00099","title":"Measuring Forgetting of Memorized Training Examples","created":"2022-06-30","cited_by_count":118},{"id":"2310.17513","title":"The Expressive Power of Low-Rank Adaptation","created":"2023-10-26","cited_by_count":102},{"id":"2404.15146","title":"Rethinking LLM Memorization through the Lens of Adversarial Compression","created":"2024-04-23","cited_by_count":94},{"id":"2104.07762","title":"Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?","created":"2021-04-15","cited_by_count":93},{"id":"2212.06470","title":"Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining","created":"2022-12-13","cited_by_count":88},{"id":"1903.04488","title":"Communication-efficient distributed SGD with Sketching","created":"2019-03-12","cited_by_count":81},{"id":"2009.10031","title":"Training Production Language Models without Memorizing User Data","created":"2020-09-21","cited_by_count":68},{"id":"2305.18465","title":"Federated Learning of Gboard Language Models with Differential Privacy","created":"2023-05-29","cited_by_count":66},{"id":"2209.06015","title":"Black-box Dataset Ownership Verification via Backdoor Watermarking","created":"2022-08-04","cited_by_count":65},{"id":"2406.07925","title":"FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning","created":"2024-06-12","cited_by_count":59},{"id":"2407.17817","title":"Demystifying Verbatim Memorization in Large Language Models","created":"2024-07-25","cited_by_count":56},{"id":"2309.09530","title":"Adapting Large Language Models to Domains via Reading Comprehension","created":"2023-09-18","cited_by_count":50},{"id":"2406.10209","title":"Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs","created":"2024-06-14","cited_by_count":50},{"id":"2206.10883","title":"Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities","created":"2022-06-22","cited_by_count":47},{"id":"2310.06714","title":"Exploring Memorization in Fine-tuned Language Models","created":"2023-10-10","cited_by_count":45},{"id":"2312.17493","title":"Differentially Private Low-Rank Adaptation of Large Language Model Using Federated Learning","created":"2023-12-29","cited_by_count":41},{"id":"2410.19482","title":"Measuring memorization in language models via probabilistic extraction","created":"2024-10-25","cited_by_count":41},{"id":"2310.13283","title":"pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning","created":"2023-10-20","cited_by_count":40},{"id":"2303.11470","title":"Did You Train on My Dataset? Towards Public Dataset Protection with Clean-Label Backdoor Watermarking","created":"2023-03-20","cited_by_count":37},{"id":"2006.07490","title":"Understanding Unintended Memorization in Federated Learning","created":"2020-06-12","cited_by_count":36},{"id":"2302.00543","title":"DoCoFL: Downlink Compression for Cross-Device Federated Learning","created":"2023-02-01","cited_by_count":28},{"id":"2312.14334","title":"DP-AdamBC: Your DP-Adam Is Actually DP-SGD (Unless You Apply Bias Correction)","created":"2023-12-21","cited_by_count":28},{"id":"2409.13745","title":"Context-Aware Membership Inference Attacks against Pre-trained Large Language Models","created":"2024-09-11","cited_by_count":22},{"id":"2501.18914","title":"Scaling Laws for Differentially Private Language Models","created":"2025-01-31","cited_by_count":22},{"id":"2302.14517","title":"Arbitrary Decisions are a Hidden Cost of Differentially Private Training","created":"2023-02-28","cited_by_count":19},{"id":"2310.13033","title":"LASER: Linear Compression in Wireless Distributed Optimization","created":"2023-10-19","cited_by_count":6},{"id":"2302.02971","title":"U-Clip: On-Average Unbiased Stochastic Gradient Clipping","created":"2023-02-06","cited_by_count":2}],"next_cursor":null}