{"list":"other","total":98,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2108.07258","title":"On the Opportunities and Risks of Foundation Models","created":"2021-08-16","cited_by_count":4033},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"1610.05820","title":"Membership Inference Attacks against Machine Learning Models","created":"2016-10-18","cited_by_count":2281},{"id":"2012.07805","title":"Extracting Training Data from Large Language Models","created":"2020-12-14","cited_by_count":2189},{"id":"2304.01373","title":"Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling","created":"2023-04-03","cited_by_count":1786},{"id":"1703.04730","title":"Understanding Black-box Predictions via Influence Functions","created":"2017-03-14","cited_by_count":1741},{"id":"2403.04132","title":"Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference","created":"2024-03-07","cited_by_count":1184},{"id":"2404.06395","title":"MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies","created":"2024-04-09","cited_by_count":723},{"id":"2401.02954","title":"DeepSeek LLM: Scaling Open-Source Language Models with Longtermism","created":"2024-01-05","cited_by_count":642},{"id":"2402.00838","title":"OLMo: Accelerating the Science of Language Models","created":"2024-02-01","cited_by_count":613},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"2401.06121","title":"TOFU: A Task of Fictitious Unlearning for LLMs","created":"2024-01-11","cited_by_count":533},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"2008.03703","title":"What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation","created":"2020-08-09","cited_by_count":497},{"id":"2305.16264","title":"Scaling Data-Constrained Language Models","created":"2023-05-25","cited_by_count":403},{"id":"2111.15366","title":"AI and the Everything in the Whole Wide World Benchmark","created":"2021-11-26","cited_by_count":349},{"id":"2501.00656","title":"2 OLMo 2 Furious","created":"2024-12-31","cited_by_count":340},{"id":"2308.03296","title":"Studying Large Language Model Generalization with Influence Functions","created":"2023-08-07","cited_by_count":326},{"id":"2003.12206","title":"Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)","created":"2020-03-27","cited_by_count":322},{"id":"2402.14992","title":"tinyBenchmarks: evaluating LLMs with fewer examples","created":"2024-02-22","cited_by_count":310},{"id":"1912.05511","title":"Measurement and Fairness","created":"2019-12-11","cited_by_count":308},{"id":"2003.10595","title":"Systematic Evaluation of Privacy Risks of Machine Learning Models","created":"2020-03-24","cited_by_count":292},{"id":"2407.06460","title":"MUSE: Machine Unlearning Six-Way Evaluation for Language Models","created":"2024-07-08","cited_by_count":261},{"id":"2104.02145","title":"What Will it Take to Fix Benchmarking in Natural Language Understanding?","created":"2021-04-05","cited_by_count":203},{"id":"2103.03098","title":"Accounting for Variance in Machine Learning Benchmarks","created":"2021-03-01","cited_by_count":201},{"id":"2405.00332","title":"A Careful Examination of Large Language Model Performance on Grade School Arithmetic","created":"2024-05-01","cited_by_count":191},{"id":"2403.16952","title":"Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance","created":"2024-03-25","cited_by_count":184},{"id":"2112.12938","title":"Counterfactual Memorization in Neural Language Models","created":"2021-12-24","cited_by_count":156},{"id":"2411.00640","title":"Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluations","created":"2024-11-01","cited_by_count":148},{"id":"2209.05364","title":"If Influence Functions are the Answer, Then What is the Question?","created":"2022-09-12","cited_by_count":144},{"id":"2107.07002","title":"The Benchmark Lottery","created":"2021-07-14","cited_by_count":136},{"id":"2405.10938","title":"Observational Scaling Laws and the Predictability of Language Model Performance","created":"2024-05-17","cited_by_count":130},{"id":"2305.08846","title":"Privacy Auditing with One (1) Training Run","created":"2023-05-15","cited_by_count":123},{"id":"2511.04703","title":"Measuring what Matters: Construct Validity in Large Language Model Benchmarks","created":"2025-11-03","cited_by_count":119},{"id":"2207.00099","title":"Measuring Forgetting of Memorized Training Examples","created":"2022-06-30","cited_by_count":118},{"id":"2407.13623","title":"Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies","created":"2024-07-18","cited_by_count":118},{"id":"2411.12990","title":"BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices","created":"2024-11-20","cited_by_count":114},{"id":"2304.03208","title":"Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster","created":"2023-04-06","cited_by_count":109},{"id":"2405.21015","title":"The rising costs of training frontier AI models","created":"2024-05-31","cited_by_count":95},{"id":"2309.08638","title":"Anchor Points: Benchmarking Models with Much Fewer Examples","created":"2023-09-14","cited_by_count":86},{"id":"2506.12618","title":"OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics","created":"2025-06-14","cited_by_count":83},{"id":"2404.07177","title":"Scaling Laws for Data Filtering -- Data Curation cannot be Compute Agnostic","created":"2024-04-10","cited_by_count":77},{"id":"2002.00937","title":"Radioactive data: tracing through training","created":"2020-02-03","cited_by_count":67},{"id":"2504.20879","title":"The Leaderboard Illusion","created":"2025-04-29","cited_by_count":66},{"id":"2502.00561","title":"Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge","created":"2025-02-01","cited_by_count":63},{"id":"2207.14251","title":"Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions","created":"2022-07-28","cited_by_count":57},{"id":"1806.00550","title":"A Swiss Army Infinitesimal Jackknife","created":"2018-06-01","cited_by_count":54},{"id":"2406.10229","title":"Quantifying Variance in Evaluation Benchmarks","created":"2024-06-14","cited_by_count":54},{"id":"2507.09404","title":"Scaling Laws for Optimal Data Mixtures","created":"2025-07-12","cited_by_count":52},{"id":"2409.19798","title":"Membership Inference Attacks Cannot Prove that a Model Was Trained On Your Data","created":"2024-09-29","cited_by_count":50},{"id":"2410.13722","title":"Persistent Pre-Training Poisoning of LLMs","created":"2024-10-17","cited_by_count":48},{"id":"2409.05816","title":"Improving Pretraining Data Using Perplexity Correlations","created":"2024-09-09","cited_by_count":46},{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43},{"id":"2508.06601","title":"Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs","created":"2025-08-08","cited_by_count":42},{"id":"2412.04315","title":"Densing Law of LLMs","created":"2024-12-05","cited_by_count":40},{"id":"2504.11393","title":"DataDecide: How to Predict Best Pretraining Data with Small Experiments","created":"2025-04-15","cited_by_count":40},{"id":"2401.04757","title":"How predictable is language model benchmark performance?","created":"2024-01-09","cited_by_count":37},{"id":"2406.17216","title":"Machine Unlearning Fails to Remove Data Poisoning Attacks","created":"2024-06-25","cited_by_count":37},{"id":"2302.03098","title":"One-shot Empirical Privacy Estimation for Federated Learning","created":"2023-02-06","cited_by_count":36},{"id":"2410.05952","title":"Active Evaluation Acquisition for Efficient LLM Benchmarking","created":"2024-10-08","cited_by_count":35},{"id":"2405.12186","title":"Training Data Attribution via Approximate Unrolled Differentiation","created":"2024-05-20","cited_by_count":34},{"id":"2407.07890","title":"Training on the Test Task Confounds Evaluation and Emergence","created":"2024-07-10","cited_by_count":34},{"id":"2405.16281","title":"ConStat: Performance-Based Contamination Detection in Large Language Models","created":"2024-05-25","cited_by_count":33},{"id":"2403.05812","title":"Algorithmic progress in language models","created":"2024-03-09","cited_by_count":31},{"id":"2305.16971","title":"Theoretical and Practical Perspectives on what Influence Functions Do","created":"2023-05-26","cited_by_count":29},{"id":"2507.00885","title":"Scaling Laws Are Unreliable for Downstream Tasks: A Reality Check","created":"2025-07-01","cited_by_count":29},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29},{"id":"2506.07673","title":"How Benchmark Prediction from Fewer Data Misses the Mark","created":"2025-06-09","cited_by_count":28},{"id":"2410.11840","title":"A Hitchhiker's Guide to Scaling Law Estimation","created":"2024-10-15","cited_by_count":27},{"id":"2409.03563","title":"100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instances","created":"2024-09-05","cited_by_count":24},{"id":"2510.22037","title":"ATLAS: Adaptive Transfer Scaling Laws for Multilingual Pretraining, Finetuning, and Decoding the Curse of Multilinguality","created":"2025-10-24","cited_by_count":22},{"id":"2306.07273","title":"Gaussian Membership Inference Privacy","created":"2023-06-12","cited_by_count":21},{"id":"2406.04327","title":"Causal Estimation of Memorisation Profiles","created":"2024-06-06","cited_by_count":20},{"id":"2409.19998","title":"Do Influence Functions Work on Large Language Models?","created":"2024-09-30","cited_by_count":20},{"id":"2405.02200","title":"Position: Why We Must Rethink Empirical Research in Machine Learning","created":"2024-05-03","cited_by_count":19},{"id":"2205.14055","title":"A Blessing of Dimensionality in Membership Inference through Regularization","created":"2022-05-27","cited_by_count":18},{"id":"2604.24827","title":"Incompressible Knowledge Probes: Estimating Black-Box LLM Parameter Counts via Factual Capacity","created":"2026-04-27","cited_by_count":17},{"id":"2506.03149","title":"Causal Estimation of Tokenisation Bias","created":"2025-06-03","cited_by_count":16},{"id":"2410.18861","title":"Provably Robust Watermarks for Open-Source Language Models","created":"2024-10-24","cited_by_count":13},{"id":"2510.23191","title":"The Benchmarking Epistemology: Validity Theory for Evaluating Machine Learning Models","created":"2025-10-27","cited_by_count":13},{"id":"2503.03862","title":"Not-Just-Scaling Laws: Towards a Better Understanding of the Downstream Impact of Language Model Design Decisions","created":"2025-03-05","cited_by_count":12},{"id":"2507.05195","title":"Train-before-Test Harmonizes Language Model Rankings","created":"2025-07-07","cited_by_count":12},{"id":"2502.10510","title":"MixMin: Finding Data Mixtures via Convex Minimization","created":"2025-02-14","cited_by_count":11},{"id":"2603.15958","title":"Deriving Hyperparameter Scaling Laws via Modern Optimization Theory","created":"2026-03-16","cited_by_count":10},{"id":"2503.07199","title":"How Well Can Differential Privacy Be Audited in One Run?","created":"2025-03-10","cited_by_count":9},{"id":"2410.09101","title":"Data Taggants: Dataset Ownership Verification via Harmless Targeted Data Poisoning","created":"2024-10-09","cited_by_count":8},{"id":"2505.22491","title":"On the Surprising Effectiveness of Large Learning Rates under Standard Width Scaling","created":"2025-05-28","cited_by_count":6},{"id":"2509.23383","title":"Train Once, Answer All: Many Pretraining Experiments for the Cost of One","created":"2025-09-27","cited_by_count":6},{"id":"2512.08894","title":"Revisiting the Scaling Properties of Downstream Metrics in Large Language Model Training","created":"2025-12-09","cited_by_count":6},{"id":"2409.14513","title":"Order of Magnitude Speedups for LLM Membership Inference","created":"2024-09-22","cited_by_count":5},{"id":"2509.21013","title":"Predicting LLM Reasoning Performance with Small Proxy Model","created":"2025-09-25","cited_by_count":5},{"id":"2508.11033","title":"Note on Selection Bias in Observational Estimates of Algorithmic Progress","created":"2025-08-14","cited_by_count":3},{"id":"2512.24503","title":"Can Small Training Runs Reliably Guide Data Curation? Rethinking Proxy-Model Practice","created":"2025-12-30","cited_by_count":3},{"id":"2602.07238","title":"Is there \"Secret Sauce'' in Large Language Model Development?","created":"2026-02-06","cited_by_count":3}],"next_cursor":null}