{"list":"other","total":108,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512},{"id":"1607.00133","title":"Deep Learning with Differential Privacy","created":"2016-07-01","cited_by_count":2728},{"id":"2303.18223","title":"A Survey of Large Language Models","created":"2023-03-31","cited_by_count":2576},{"id":"2101.00027","title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling","created":"2020-12-31","cited_by_count":2411},{"id":"1610.05820","title":"Membership Inference Attacks against Machine Learning Models","created":"2016-10-18","cited_by_count":2281},{"id":"2012.07805","title":"Extracting Training Data from Large Language Models","created":"2020-12-14","cited_by_count":2189},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"1703.04730","title":"Understanding Black-box Predictions via Influence Functions","created":"2017-03-14","cited_by_count":1741},{"id":"2307.03109","title":"A Survey on Evaluation of Large Language Models","created":"2023-07-06","cited_by_count":1242},{"id":"2411.15124","title":"Tulu 3: Pushing Frontiers in Open Language Model Post-Training","created":"2024-11-22","cited_by_count":1053},{"id":"2202.07646","title":"Quantifying Memorization Across Neural Language Models","created":"2022-02-15","cited_by_count":763},{"id":"2107.06499","title":"Deduplicating Training Data Makes Language Models Better","created":"2021-07-14","cited_by_count":714},{"id":"2307.06435","title":"A Comprehensive Overview of Large Language Models","created":"2023-07-12","cited_by_count":648},{"id":"1911.04933","title":"Eternal Sunshine of the Spotless Net: Selective Forgetting in Deep Networks","created":"2019-11-12","cited_by_count":618},{"id":"2104.08696","title":"Knowledge Neurons in Pretrained Transformers","created":"2021-04-18","cited_by_count":601},{"id":"2203.14680","title":"Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space","created":"2022-03-28","cited_by_count":532},{"id":"2402.06196","title":"Large Language Models: A Survey","created":"2024-02-09","cited_by_count":525},{"id":"2008.03703","title":"What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation","created":"2020-08-09","cited_by_count":497},{"id":"2402.00159","title":"Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research","created":"2024-01-31","cited_by_count":483},{"id":"2111.01243","title":"Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey","created":"2021-11-01","cited_by_count":463},{"id":"2311.17035","title":"Scalable Extraction of Training Data from (Production) Language Models","created":"2023-11-28","cited_by_count":434},{"id":"2110.05679","title":"Large Language Models Can Be Strong Differentially Private Learners","created":"2021-10-12","cited_by_count":412},{"id":"2110.06500","title":"Differentially Private Fine-tuning of Language Models","created":"2021-10-13","cited_by_count":400},{"id":"2310.16789","title":"Detecting Pretraining Data from Large Language Models","created":"2023-10-25","cited_by_count":387},{"id":"2312.02003","title":"A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly","created":"2023-12-04","cited_by_count":387},{"id":"2309.01029","title":"Explainability for Large Language Models: A Survey","created":"2023-09-02","cited_by_count":333},{"id":"2308.07107","title":"Large Language Models for Information Retrieval: A Survey","created":"2023-08-14","cited_by_count":331},{"id":"2202.06539","title":"Deduplicating Training Data Mitigates Privacy Risks in Language Models","created":"2022-02-14","cited_by_count":314},{"id":"2302.00539","title":"Analyzing Leakage of Personally Identifiable Information in Language Models","created":"2023-02-01","cited_by_count":285},{"id":"2305.18462","title":"Membership Inference Attacks against Language Models via Neighbourhood Comparison","created":"2023-05-29","cited_by_count":258},{"id":"2205.10770","title":"Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models","created":"2022-05-22","cited_by_count":220},{"id":"2505.19590","title":"Learning to Reason without External Rewards","created":"2025-05-26","cited_by_count":210},{"id":"2305.20086","title":"Understanding and Mitigating Copying in Diffusion Models","created":"2023-05-31","cited_by_count":209},{"id":"2310.19736","title":"Evaluating Large Language Models: A Comprehensive Survey","created":"2023-10-30","cited_by_count":202},{"id":"2202.05520","title":"What Does it Mean for a Language Model to Preserve Privacy?","created":"2022-02-11","cited_by_count":195},{"id":"2402.07841","title":"Do Membership Inference Attacks Work on Large Language Models?","created":"2024-02-12","cited_by_count":195},{"id":"2402.00888","title":"Security and Privacy Challenges of Large Language Models: A Survey","created":"2024-01-30","cited_by_count":186},{"id":"2310.07298","title":"Beyond Memorization: Violating Privacy Via Inference with Large Language Models","created":"2023-10-11","cited_by_count":175},{"id":"2112.12938","title":"Counterfactual Memorization in Neural Language Models","created":"2021-12-24","cited_by_count":156},{"id":"2205.10487","title":"Scaling Laws and Interpretability of Learning from Repeated Data","created":"2022-05-21","cited_by_count":152},{"id":"2304.11158","title":"Emergent and Predictable Memorization in Large Language Models","created":"2023-04-21","cited_by_count":148},{"id":"2307.01881","title":"ProPILE: Probing Privacy Leakage in Large Language Models","created":"2023-07-04","cited_by_count":129},{"id":"2207.00099","title":"Measuring Forgetting of Memorized Training Examples","created":"2022-06-30","cited_by_count":118},{"id":"2410.23123","title":"On Memorization of Large Language Models in Logical Reasoning","created":"2024-10-30","cited_by_count":117},{"id":"2303.15715","title":"Foundation Models and Fair Use","created":"2023-03-28","cited_by_count":116},{"id":"1708.05148","title":"Natural Language Processing: State of The Art, Current Trends and Challenges","created":"2017-08-17","cited_by_count":114},{"id":"2310.13771","title":"Copyright Violations and Large Language Models","created":"2023-10-20","cited_by_count":108},{"id":"2210.17546","title":"Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy","created":"2022-10-31","cited_by_count":100},{"id":"2302.10870","title":"On Provable Copyright Protection for Generative Models","created":"2023-02-21","cited_by_count":98},{"id":"2502.06453","title":"MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbations","created":"2025-02-10","cited_by_count":89},{"id":"2106.09352","title":"Large Scale Private Learning via Low-rank Reparametrization","created":"2021-06-17","cited_by_count":88},{"id":"2402.18041","title":"Datasets for Large Language Models: A Comprehensive Survey","created":"2024-02-28","cited_by_count":71},{"id":"2302.04460","title":"Bag of Tricks for Training Data Extraction from Language Models","created":"2023-02-09","cited_by_count":70},{"id":"2505.24832","title":"How much do language models memorize?","created":"2025-05-30","cited_by_count":61},{"id":"2407.17817","title":"Demystifying Verbatim Memorization in Large Language Models","created":"2024-07-25","cited_by_count":56},{"id":"2409.14781","title":"Pretraining Data Detection for Large Language Models: A Divergence-based Calibration Method","created":"2024-09-23","cited_by_count":55},{"id":"2409.19798","title":"Membership Inference Attacks Cannot Prove that a Model Was Trained On Your Data","created":"2024-09-29","cited_by_count":50},{"id":"2310.06714","title":"Exploring Memorization in Fine-tuned Language Models","created":"2023-10-10","cited_by_count":45},{"id":"2408.12787","title":"LLM-PBE: Assessing Data Privacy in Large Language Models","created":"2024-08-23","cited_by_count":41},{"id":"2410.19482","title":"Measuring memorization in language models via probabilistic extraction","created":"2024-10-25","cited_by_count":41},{"id":"2305.11759","title":"Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning","created":"2023-05-19","cited_by_count":40},{"id":"2310.18362","title":"SoK: Memorization in General-Purpose Large Language Models","created":"2023-10-24","cited_by_count":37},{"id":"2403.12503","title":"Securing Large Language Models: Threats, Vulnerabilities and Responsible Practices","created":"2024-03-19","cited_by_count":37},{"id":"2310.15469","title":"The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks","created":"2023-10-24","cited_by_count":36},{"id":"2403.04801","title":"Alpaca against Vicuna: Using LLMs to Uncover Memorization of LLMs","created":"2024-03-05","cited_by_count":33},{"id":"2403.00871","title":"Teach LLMs to Phish: Stealing Private Information from Language Models","created":"2024-03-01","cited_by_count":32},{"id":"2403.19851","title":"Localizing Paragraph Memorization in Language Models","created":"2024-03-28","cited_by_count":31},{"id":"2310.01424","title":"Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey","created":"2023-09-27","cited_by_count":30},{"id":"2110.02782","title":"How BPE Affects Memorization in Transformers","created":"2021-10-06","cited_by_count":29},{"id":"2311.09060","title":"Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks","created":"2023-11-15","cited_by_count":29},{"id":"2410.02650","title":"Undesirable Memorization in Large Language Models: A Survey","created":"2024-10-03","cited_by_count":29},{"id":"2406.14322","title":"Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning","created":"2024-06-20","cited_by_count":24},{"id":"2407.02943","title":"PII-Compass: Guiding LLM training data extraction prompts towards the target PII via grounding","created":"2024-07-03","cited_by_count":24},{"id":"2409.13853","title":"Unlocking Memorization in Large Language Models with Dynamic Soft Prompting","created":"2024-09-20","cited_by_count":21},{"id":"2503.23084","title":"The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction","created":"2025-03-29","cited_by_count":21},{"id":"2308.15727","title":"Quantifying and Analyzing Entity-level Memorization in Large Language Models","created":"2023-08-30","cited_by_count":18},{"id":"2412.06370","title":"Exploring Memorization and Copyright Violation in Frontier LLMs: A Study of the New York Times v. OpenAI 2023 Lawsuit","created":"2024-12-09","cited_by_count":18},{"id":"2405.05990","title":"Special Characters Attack: Toward Scalable Training Data Extraction From Large Language Models","created":"2024-05-09","cited_by_count":17},{"id":"2501.05078","title":"Analyzing Memorization in Large Language Models through the Lens of Model Attribution","created":"2025-01-09","cited_by_count":14},{"id":"2205.01863","title":"Provably Confidential Language Modelling","created":"2022-05-04","cited_by_count":13},{"id":"2311.06477","title":"Report of the 1st Workshop on Generative AI and Law","created":"2023-11-11","cited_by_count":13},{"id":"2406.11715","title":"Measuring memorization in RLHF for code completion","created":"2024-06-17","cited_by_count":13},{"id":"2505.24842","title":"Cascading Adversarial Bias from Injection to Distillation in Language Models","created":"2025-05-30","cited_by_count":9},{"id":"2503.06040","title":"Mitigating Memorization in LLMs using Activation Steering","created":"2025-03-08","cited_by_count":8},{"id":"2412.13475","title":"A Statistical and Multi-Perspective Revisiting of the Membership Inference Attack in Large Language Models","created":"2024-12-18","cited_by_count":6},{"id":"2504.14452","title":"ParaPO: Aligning Language Models to Reduce Verbatim Reproduction of Pre-training Data","created":"2025-04-20","cited_by_count":6},{"id":"2203.07687","title":"Compressing Sentence Representation for Semantic Retrieval via Homomorphic Projective Distillation","created":"2022-03-15","cited_by_count":5},{"id":"2404.06508","title":"On the Effect of (Near) Duplicate Subwords in Language Modelling","created":"2024-04-09","cited_by_count":5},{"id":"2412.17249","title":"EM-MIAs: Enhancing Membership Inference Attacks in Large Language Models through Ensemble Modeling","created":"2024-12-23","cited_by_count":5},{"id":"2412.11302","title":"Sequence-Level Leakage Risk of Training Data in Large Language Models","created":"2024-12-15","cited_by_count":4},{"id":"2504.00638","title":"Impact of Data Duplication on Deep Neural Network-Based Image Classifiers: Robust vs. Standard Models","created":"2025-04-01","cited_by_count":4}],"next_cursor":"100"}