{"total":105,"rows":[{"id":"2402.00838","title":"OLMo: Accelerating the Science of Language Models","created":"2024-02-01","cited_by_count":613,"area":null},{"id":"2401.17377","title":"Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens","created":"2024-01-30","cited_by_count":153,"area":null},{"id":"2404.01268","title":"Mapping the Increasing Use of LLMs in Scientific Papers","created":"2024-04-01","cited_by_count":118,"area":null},{"id":"2409.19839","title":"ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilities","created":"2024-09-30","cited_by_count":110,"area":null},{"id":"2502.10341","title":"Organize the Web: Constructing Domains Enhances Pre-Training Data Curation","created":"2025-02-14","cited_by_count":76,"area":null},{"id":"2404.04125","title":"No \"Zero-Shot\" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance","created":"2024-04-04","cited_by_count":75,"area":null},{"id":"2312.17120","title":"MathPile: A Billion-Token-Scale Pretraining Corpus for Math","created":"2023-12-28","cited_by_count":67,"area":null},{"id":"2404.10199","title":"CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting","created":"2024-04-16","cited_by_count":55,"area":null},{"id":"2312.10523","title":"Paloma: A Benchmark for Evaluating Language Model Fit","created":"2023-12-16","cited_by_count":54,"area":null},{"id":"2403.12958","title":"Dated Data: Tracing Knowledge Cutoffs in Large Language Models","created":"2024-03-19","cited_by_count":51,"area":null},{"id":"2407.00211","title":"Detection and Measurement of Syntactic Templates in Generated Text","created":"2024-06-28","cited_by_count":44,"area":null},{"id":"2406.18664","title":"Evaluating Copyright Takedown Methods for Language Models","created":"2024-06-26","cited_by_count":43,"area":null},{"id":"2407.16711","title":"Benchmarks as Microscopes: A Call for Model Metrology","created":"2024-07-22","cited_by_count":35,"area":null},{"id":"2407.07565","title":"On Leakage of Code Generation Evaluation Datasets","created":"2024-07-10","cited_by_count":32,"area":null},{"id":"2411.03923","title":"Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?","created":"2024-11-06","cited_by_count":32,"area":null},{"id":"2410.11303","title":"TSDS: Data Selection for Task-Specific Model Finetuning","created":"2024-10-15","cited_by_count":28,"area":null},{"id":"2402.17954","title":"Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps","created":"2024-02-28","cited_by_count":25,"area":null},{"id":"2406.13069","title":"Evaluating $n$-Gram Novelty of Language Models Using Rusty-DAWG","created":"2024-06-18","cited_by_count":25,"area":null},{"id":"2410.05873","title":"MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment","created":"2024-10-08","cited_by_count":25,"area":null},{"id":"2406.14526","title":"Fantastic Copyrighted Beasts and How (Not) to Generate Them","created":"2024-06-20","cited_by_count":24,"area":null},{"id":"2408.14471","title":"A Practitioner's Guide to Continual Multimodal Pretraining","created":"2024-08-26","cited_by_count":23,"area":null},{"id":"2504.12459","title":"On Linear Representations and Pretraining Data Frequency in Language Models","created":"2025-04-16","cited_by_count":23,"area":null},{"id":"2410.20245","title":"Improving Model Evaluation using SMART Filtering of Benchmark Datasets","created":"2024-10-26","cited_by_count":21,"area":null},{"id":"2406.10670","title":"CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-training","created":"2024-06-15","cited_by_count":20,"area":null},{"id":"2407.21530","title":"Data Contamination Report from the 2024 CONDA Shared Task","created":"2024-07-31","cited_by_count":20,"area":null},{"id":"2409.03753","title":"WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild","created":"2024-09-05","cited_by_count":20,"area":null},{"id":"2506.01732","title":"Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training","created":"2025-06-02","cited_by_count":20,"area":null},{"id":"2401.18070","title":"Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners?","created":"2024-01-31","cited_by_count":19,"area":null},{"id":"2406.18906","title":"Sonnet or Not, Bot? Poetry Evaluation for Large Models and Datasets","created":"2024-06-27","cited_by_count":18,"area":null},{"id":"2402.01909","title":"On Catastrophic Inheritance of Large Foundation Models","created":"2024-02-02","cited_by_count":15,"area":null},{"id":"2506.12229","title":"Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Index","created":"2025-06-13","cited_by_count":14,"area":null},{"id":"2407.19638","title":"On the Reliability of Large Language Models for Causal Discovery","created":"2024-07-29","cited_by_count":12,"area":null},{"id":"2410.13502","title":"MathGAP: Out-of-Distribution Evaluation on Problems with Arbitrarily Complex Proofs","created":"2024-10-17","cited_by_count":12,"area":null},{"id":"2410.22906","title":"From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes","created":"2024-10-30","cited_by_count":11,"area":null},{"id":"2502.06604","title":"Do we really have to filter out random noise in pre-training data for language models?","created":"2025-02-10","cited_by_count":11,"area":null},{"id":"2505.14824","title":"Tracing Multilingual Factual Knowledge Acquisition in Pretraining","created":"2025-05-20","cited_by_count":10,"area":null},{"id":"2409.05653","title":"WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case","created":"2024-09-09","cited_by_count":9,"area":null},{"id":"2509.03116","title":"Measuring Scalar Constructs in Social Science with LLMs","created":"2025-09-03","cited_by_count":9,"area":null},{"id":"2510.25771","title":"Gaperon: A Peppered English-French Generative Language Model Suite","created":"2025-10-29","cited_by_count":9,"area":null},{"id":"2402.14880","title":"Automatic Histograms: Leveraging Language Models for Text Dataset Exploration","created":"2024-02-21","cited_by_count":8,"area":null},{"id":"2403.06869","title":"Impact of Noisy Supervision in Foundation Model Learning","created":"2024-03-11","cited_by_count":8,"area":null},{"id":"2405.05938","title":"DOLOMITES: Domain-Specific Long-Form Methodical Tasks","created":"2024-05-09","cited_by_count":8,"area":null},{"id":"2412.20760","title":"Attributing Culture-Conditioned Generations to Pretraining Corpora","created":"2024-12-30","cited_by_count":8,"area":null},{"id":"2503.12072","title":"Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models","created":"2025-03-15","cited_by_count":8,"area":null},{"id":"2504.13416","title":"STAMP Your Content: Proving Dataset Membership via Watermarked Rephrasings","created":"2025-04-18","cited_by_count":8,"area":null},{"id":"2602.12413","title":"Soft Contamination Means Benchmarks Test Shallow Generalization","created":"2026-02-12","cited_by_count":8,"area":null},{"id":"2404.02456","title":"PhonologyBench: Evaluating Phonological Skills of Large Language Models","created":"2024-04-03","cited_by_count":7,"area":null},{"id":"2407.07630","title":"A Review of the Challenges with Massive Web-mined Corpora Used in Large Language Models Pre-Training","created":"2024-07-10","cited_by_count":7,"area":null},{"id":"2408.04556","title":"BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models","created":"2024-08-08","cited_by_count":7,"area":null},{"id":"2508.17416","title":"Data Leakage in Visual Datasets","created":"2025-08-24","cited_by_count":7,"area":null},{"id":"2509.22367","title":"What Is The Political Content in LLMs' Pre- and Post-Training Data?","created":"2025-09-26","cited_by_count":7,"area":null},{"id":"2405.00899","title":"Characterising the Creative Process in Humans and Large Language Models","created":"2024-05-01","cited_by_count":6,"area":null},{"id":"2410.05639","title":"DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models","created":"2024-10-08","cited_by_count":6,"area":null},{"id":"2504.09389","title":"Measuring LLM Novelty As The Frontier Of Original And High-Quality Output","created":"2025-04-13","cited_by_count":6,"area":null},{"id":"2403.05652","title":"\"What is Different Between These Datasets?\" A Framework for Explaining Data Distribution Shifts","created":"2024-03-08","cited_by_count":5,"area":null},{"id":"2411.19240","title":"How far can bias go? Tracing bias from pretraining data to alignment","created":"2024-11-28","cited_by_count":5,"area":null},{"id":"2502.10828","title":"The Vendiscope: An Algorithmic Microscope For Data Collections","created":"2025-02-15","cited_by_count":5,"area":null},{"id":"2508.05525","title":"The World According to LLMs: How Geographic Origin Influences LLMs' Entity Deduction Capabilities","created":"2025-08-07","cited_by_count":5,"area":null},{"id":"2602.06221","title":"BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2502.17355","title":"On Relation-Specific Neurons in Large Language Models","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2510.16713","title":"so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMs","created":"2025-10-19","cited_by_count":4,"area":null},{"id":"2601.10645","title":"Influential Training Data Retrieval for Explaining Verbalized Confidence of LLMs","created":"2026-01-15","cited_by_count":4,"area":null},{"id":"2311.17259","title":"SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata","created":"2023-11-28","cited_by_count":3,"area":null},{"id":"2406.01981","title":"Zyda: A 1.3T Dataset for Open Language Modeling","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2505.01435","title":"AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine","created":"2025-04-23","cited_by_count":3,"area":null},{"id":"2510.06048","title":"BLISS: A Lightweight Bilevel Influence Scoring Method for Data Selection in Language Model Pretraining","created":"2025-10-07","cited_by_count":3,"area":null},{"id":"2510.20860","title":"Data-Centric Lessons To Improve Speech-Language Pretraining","created":"2025-10-22","cited_by_count":3,"area":null},{"id":"2602.20433","title":"Disentangling Geometry, Performance, and Training in Language Models","created":"2026-02-24","cited_by_count":3,"area":null},{"id":"2604.04204","title":"How Does \"English (US)\" Become the Default? Triangulating Structural Bias Towards American English Across the LLM Pipeline","created":"2026-04-05","cited_by_count":3,"area":null},{"id":"2605.10129","title":"Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data","created":"2026-05-11","cited_by_count":3,"area":null},{"id":"2411.00266","title":"A Systematic Review of NeurIPS Dataset Management Practices","created":"2024-10-31","cited_by_count":2,"area":null},{"id":"2411.14478","title":"Why you don't overfit, and don't need Bayes if you only train for one epoch","created":"2024-11-19","cited_by_count":2,"area":null},{"id":"2412.07430","title":"Knowledge Graph Guided Evaluation of Abstention Techniques","created":"2024-12-10","cited_by_count":2,"area":null},{"id":"2502.18282","title":"Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases","created":"2025-02-25","cited_by_count":2,"area":null},{"id":"2505.20264","title":"We Need to Measure Data Diversity in NLP -- Better and Broader","created":"2025-05-26","cited_by_count":2,"area":null},{"id":"2511.07722","title":"Critical Confabulation: Can LLMs Hallucinate for Social Good?","created":"2025-11-11","cited_by_count":2,"area":null},{"id":"2512.21775","title":"Compliance Rating Scheme: A Data Provenance Framework for Generative AI Datasets","created":"2025-12-25","cited_by_count":2,"area":null},{"id":"2410.09448","title":"Solving the Challenge Set without Solving the Task: On Winograd Schemas as a Test of Pronominal Coreference Resolution","created":"2024-10-12","cited_by_count":1,"area":null},{"id":"2410.11647","title":"Measuring Spiritual Values and Bias of Large Language Models","created":"2024-10-15","cited_by_count":1,"area":null},{"id":"2410.14765","title":"What's New in My Data? Novelty Exploration via Contrastive Generation","created":"2024-10-18","cited_by_count":1,"area":null},{"id":"2410.19812","title":"Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models","created":"2024-10-17","cited_by_count":1,"area":null},{"id":"2501.01046","title":"SEDD: Scalable and Efficient Dataset Deduplication with GPUs","created":"2025-01-02","cited_by_count":1,"area":null},{"id":"2501.04316","title":"Small Changes, Large Consequences: Analyzing the Allocational Fairness of LLMs in Hiring Contexts","created":"2025-01-08","cited_by_count":1,"area":null},{"id":"2502.16290","title":"Interrogating LLM design under a fair learning doctrine","created":"2025-02-22","cited_by_count":1,"area":null},{"id":"2503.03702","title":"Developing and Utilizing a Large-Scale Cantonese Dataset for Multi-Tasking in Large Language Models","created":"2025-03-05","cited_by_count":1,"area":null},{"id":"2503.13383","title":"Cream of the Crop: Harvesting Rich, Scalable and Transferable Multi-Modal Data for Instruction Fine-Tuning","created":"2025-03-17","cited_by_count":1,"area":null},{"id":"2505.15024","title":"Diagnosing our datasets: How does my language model learn clinical information?","created":"2025-05-21","cited_by_count":1,"area":null},{"id":"2505.16385","title":"Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models","created":"2025-05-22","cited_by_count":1,"area":null},{"id":"2505.17260","title":"The Rise of Parameter Specialization for Knowledge Storage in Large Language Models","created":"2025-05-22","cited_by_count":1,"area":null},{"id":"2602.09775","title":"Where Do Images Come From? Analyzing Captions to Geographically Profile Datasets","created":"2026-02-10","cited_by_count":1,"area":null},{"id":"2604.17633","title":"Copy First, Translate Later: Interpreting Translation Dynamics in Multilingual Pretraining","created":"2026-04-19","cited_by_count":1,"area":null},{"id":"2608.09093","title":"The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora","created":"2026-08-10","cited_by_count":1,"area":null},{"id":"2405.13386","title":"360Zhinao Technical Report","created":"2024-05-22","cited_by_count":0,"area":null},{"id":"2410.02465","title":"Revealing the Inherent Instructability of Pre-Trained Language Models","created":"2024-10-03","cited_by_count":0,"area":null},{"id":"2505.17841","title":"TEDI: Trustworthy and Ethical Dataset Indicators to Analyze and Compare Dataset Documentation","created":"2025-05-23","cited_by_count":0,"area":null},{"id":"2506.00002","title":"Advancing AI-assisted Hardware Design with Hierarchical Decentralized Training and Personalized Inference-Time Optimization","created":"2025-04-21","cited_by_count":0,"area":null},{"id":"2510.14261","title":"Rewriting History: A Recipe for Interventional Analyses to Study Data Effects on Model Behavior","created":"2025-10-16","cited_by_count":0,"area":null},{"id":"2511.21006","title":"TrackList: Tracing Back Query Linguistic Diversity for Head and Tail Knowledge in Open Large Language Models","created":"2025-11-26","cited_by_count":0,"area":null},{"id":"2602.20580","title":"Personal Information Parroting in Language Models","created":"2026-02-24","cited_by_count":0,"area":null},{"id":"2603.17884","title":"DebugLM: Learning Traceable Training Data Provenance for LLMs","created":"2026-03-18","cited_by_count":0,"area":null}],"next_cursor":"100"}