{"total":129,"rows":[{"id":"2402.00838","title":"OLMo: Accelerating the Science of Language Models","created":"2024-02-01","cited_by_count":613,"area":null},{"id":"2401.06373","title":"How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs","created":"2024-01-12","cited_by_count":573,"area":"lr"},{"id":"2401.17377","title":"Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens","created":"2024-01-30","cited_by_count":153,"area":null},{"id":"2404.01268","title":"Mapping the Increasing Use of LLMs in Scientific Papers","created":"2024-04-01","cited_by_count":118,"area":null},{"id":"2409.19839","title":"ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilities","created":"2024-09-30","cited_by_count":110,"area":null},{"id":"2402.17840","title":"Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems","created":"2024-02-27","cited_by_count":76,"area":"rag"},{"id":"2502.10341","title":"Organize the Web: Constructing Domains Enhances Pre-Training Data Curation","created":"2025-02-14","cited_by_count":76,"area":null},{"id":"2404.04125","title":"No \"Zero-Shot\" Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance","created":"2024-04-04","cited_by_count":75,"area":null},{"id":"2312.17120","title":"MathPile: A Billion-Token-Scale Pretraining Corpus for Math","created":"2023-12-28","cited_by_count":67,"area":null},{"id":"2410.15226","title":"On the Diversity of Synthetic Data and its Impact on Training Large Language Models","created":"2024-10-19","cited_by_count":59,"area":"synth"},{"id":"2406.09750","title":"ControlVAR: Exploring Controllable Visual Autoregressive Modeling","created":"2024-06-14","cited_by_count":58,"area":"diffusion"},{"id":"2404.10199","title":"CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting","created":"2024-04-16","cited_by_count":55,"area":null},{"id":"2312.10523","title":"Paloma: A Benchmark for Evaluating Language Model Fit","created":"2023-12-16","cited_by_count":54,"area":null},{"id":"2403.12958","title":"Dated Data: Tracing Knowledge Cutoffs in Large Language Models","created":"2024-03-19","cited_by_count":51,"area":null},{"id":"2407.00211","title":"Detection and Measurement of Syntactic Templates in Generated Text","created":"2024-06-28","cited_by_count":44,"area":null},{"id":"2406.18664","title":"Evaluating Copyright Takedown Methods for Language Models","created":"2024-06-26","cited_by_count":43,"area":null},{"id":"2402.01771","title":"BlackMamba: Mixture of Experts for State-Space Models","created":"2024-02-01","cited_by_count":37,"area":"moe"},{"id":"2407.16711","title":"Benchmarks as Microscopes: A Call for Model Metrology","created":"2024-07-22","cited_by_count":35,"area":null},{"id":"2407.07565","title":"On Leakage of Code Generation Evaluation Datasets","created":"2024-07-10","cited_by_count":32,"area":null},{"id":"2411.03923","title":"Evaluation data contamination in LLMs: how do we measure it and (when) does it matter?","created":"2024-11-06","cited_by_count":32,"area":null},{"id":"2410.11303","title":"TSDS: Data Selection for Task-Specific Model Finetuning","created":"2024-10-15","cited_by_count":28,"area":null},{"id":"2411.16679","title":"Do Large Language Models Perform Latent Multi-Hop Reasoning without Exploiting Shortcuts?","created":"2024-11-25","cited_by_count":28,"area":"lr"},{"id":"2510.26202","title":"What's In My Human Feedback? Learning Interpretable Descriptions of Preference Data","created":"2025-10-30","cited_by_count":26,"area":"alignment"},{"id":"2402.17954","title":"Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps","created":"2024-02-28","cited_by_count":25,"area":null},{"id":"2406.13069","title":"Evaluating $n$-Gram Novelty of Language Models Using Rusty-DAWG","created":"2024-06-18","cited_by_count":25,"area":null},{"id":"2410.05873","title":"MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment","created":"2024-10-08","cited_by_count":25,"area":null},{"id":"2406.14526","title":"Fantastic Copyrighted Beasts and How (Not) to Generate Them","created":"2024-06-20","cited_by_count":24,"area":null},{"id":"2408.14471","title":"A Practitioner's Guide to Continual Multimodal Pretraining","created":"2024-08-26","cited_by_count":23,"area":null},{"id":"2504.12459","title":"On Linear Representations and Pretraining Data Frequency in Language Models","created":"2025-04-16","cited_by_count":23,"area":null},{"id":"2410.20245","title":"Improving Model Evaluation using SMART Filtering of Benchmark Datasets","created":"2024-10-26","cited_by_count":21,"area":null},{"id":"2508.10858","title":"Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation","created":"2025-08-14","cited_by_count":21,"area":"alignment"},{"id":"2406.10670","title":"CoLoR-Filter: Conditional Loss Reduction Filtering for Targeted Language Model Pre-training","created":"2024-06-15","cited_by_count":20,"area":null},{"id":"2407.21530","title":"Data Contamination Report from the 2024 CONDA Shared Task","created":"2024-07-31","cited_by_count":20,"area":null},{"id":"2409.03753","title":"WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild","created":"2024-09-05","cited_by_count":20,"area":null},{"id":"2506.01732","title":"Common Corpus: The Largest Collection of Ethical Data for LLM Pre-Training","created":"2025-06-02","cited_by_count":20,"area":null},{"id":"2401.18070","title":"Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners?","created":"2024-01-31","cited_by_count":19,"area":null},{"id":"2406.18906","title":"Sonnet or Not, Bot? Poetry Evaluation for Large Models and Datasets","created":"2024-06-27","cited_by_count":18,"area":null},{"id":"2402.01909","title":"On Catastrophic Inheritance of Large Foundation Models","created":"2024-02-02","cited_by_count":15,"area":null},{"id":"2506.12229","title":"Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Index","created":"2025-06-13","cited_by_count":14,"area":null},{"id":"2407.19638","title":"On the Reliability of Large Language Models for Causal Discovery","created":"2024-07-29","cited_by_count":12,"area":null},{"id":"2410.13502","title":"MathGAP: Out-of-Distribution Evaluation on Problems with Arbitrarily Complex Proofs","created":"2024-10-17","cited_by_count":12,"area":null},{"id":"2410.22906","title":"From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes","created":"2024-10-30","cited_by_count":11,"area":null},{"id":"2502.06604","title":"Do we really have to filter out random noise in pre-training data for language models?","created":"2025-02-10","cited_by_count":11,"area":null},{"id":"2505.14824","title":"Tracing Multilingual Factual Knowledge Acquisition in Pretraining","created":"2025-05-20","cited_by_count":10,"area":null},{"id":"2402.01345","title":"Skip \\n: A Simple Method to Reduce Hallucination in Large Vision-Language Models","created":"2024-02-02","cited_by_count":9,"area":"mllm"},{"id":"2405.20494","title":"Slight Corruption in Pre-training Data Makes Better Diffusion Models","created":"2024-05-30","cited_by_count":9,"area":"diffusion"},{"id":"2409.05653","title":"WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case","created":"2024-09-09","cited_by_count":9,"area":null},{"id":"2509.03116","title":"Measuring Scalar Constructs in Social Science with LLMs","created":"2025-09-03","cited_by_count":9,"area":null},{"id":"2510.25771","title":"Gaperon: A Peppered English-French Generative Language Model Suite","created":"2025-10-29","cited_by_count":9,"area":null},{"id":"2402.14880","title":"Automatic Histograms: Leveraging Language Models for Text Dataset Exploration","created":"2024-02-21","cited_by_count":8,"area":null},{"id":"2403.06869","title":"Impact of Noisy Supervision in Foundation Model Learning","created":"2024-03-11","cited_by_count":8,"area":null},{"id":"2405.05938","title":"DOLOMITES: Domain-Specific Long-Form Methodical Tasks","created":"2024-05-09","cited_by_count":8,"area":null},{"id":"2412.20760","title":"Attributing Culture-Conditioned Generations to Pretraining Corpora","created":"2024-12-30","cited_by_count":8,"area":null},{"id":"2503.12072","title":"Information-Guided Identification of Training Data Imprint in (Proprietary) Large Language Models","created":"2025-03-15","cited_by_count":8,"area":null},{"id":"2504.13416","title":"STAMP Your Content: Proving Dataset Membership via Watermarked Rephrasings","created":"2025-04-18","cited_by_count":8,"area":null},{"id":"2602.12413","title":"Soft Contamination Means Benchmarks Test Shallow Generalization","created":"2026-02-12","cited_by_count":8,"area":null},{"id":"2404.02456","title":"PhonologyBench: Evaluating Phonological Skills of Large Language Models","created":"2024-04-03","cited_by_count":7,"area":null},{"id":"2407.07630","title":"A Review of the Challenges with Massive Web-mined Corpora Used in Large Language Models Pre-Training","created":"2024-07-10","cited_by_count":7,"area":null},{"id":"2408.04556","title":"BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models","created":"2024-08-08","cited_by_count":7,"area":null},{"id":"2508.17416","title":"Data Leakage in Visual Datasets","created":"2025-08-24","cited_by_count":7,"area":null},{"id":"2509.22367","title":"What Is The Political Content in LLMs' Pre- and Post-Training Data?","created":"2025-09-26","cited_by_count":7,"area":null},{"id":"2405.00899","title":"Characterising the Creative Process in Humans and Large Language Models","created":"2024-05-01","cited_by_count":6,"area":null},{"id":"2410.05639","title":"DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models","created":"2024-10-08","cited_by_count":6,"area":null},{"id":"2502.03429","title":"On Fairness of Unified Multimodal Large Language Model for Image Generation","created":"2025-02-05","cited_by_count":6,"area":"mllm"},{"id":"2504.09389","title":"Measuring LLM Novelty As The Frontier Of Original And High-Quality Output","created":"2025-04-13","cited_by_count":6,"area":null},{"id":"2403.05652","title":"\"What is Different Between These Datasets?\" A Framework for Explaining Data Distribution Shifts","created":"2024-03-08","cited_by_count":5,"area":null},{"id":"2411.19240","title":"How far can bias go? Tracing bias from pretraining data to alignment","created":"2024-11-28","cited_by_count":5,"area":null},{"id":"2502.10828","title":"The Vendiscope: An Algorithmic Microscope For Data Collections","created":"2025-02-15","cited_by_count":5,"area":null},{"id":"2508.05525","title":"The World According to LLMs: How Geographic Origin Influences LLMs' Entity Deduction Capabilities","created":"2025-08-07","cited_by_count":5,"area":null},{"id":"2602.06221","title":"BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks","created":"2026-02-05","cited_by_count":5,"area":null},{"id":"2502.17355","title":"On Relation-Specific Neurons in Large Language Models","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2510.16713","title":"so much depends / upon / a whitespace: Why Whitespace Matters for Poets and LLMs","created":"2025-10-19","cited_by_count":4,"area":null},{"id":"2601.10645","title":"Influential Training Data Retrieval for Explaining Verbalized Confidence of LLMs","created":"2026-01-15","cited_by_count":4,"area":null},{"id":"2311.17259","title":"SoUnD Framework: Analyzing (So)cial Representation in (Un)structured (D)ata","created":"2023-11-28","cited_by_count":3,"area":null},{"id":"2403.15740","title":"Protecting Copyrighted Material with Unique Identifiers in Large Language Model Training","created":"2024-03-23","cited_by_count":3,"area":"safety"},{"id":"2406.01981","title":"Zyda: A 1.3T Dataset for Open Language Modeling","created":"2024-06-04","cited_by_count":3,"area":null},{"id":"2410.17566","title":"Differentially Private Learning Needs Better Model Initialization and Self-Distillation","created":"2024-10-23","cited_by_count":3,"area":"distill"},{"id":"2505.01435","title":"AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine","created":"2025-04-23","cited_by_count":3,"area":null},{"id":"2509.23219","title":"WirelessMathLM: Teaching Mathematical Reasoning for LLMs in Wireless Communications with Reinforcement Learning","created":"2025-09-27","cited_by_count":3,"area":"lr"},{"id":"2510.06048","title":"BLISS: A Lightweight Bilevel Influence Scoring Method for Data Selection in Language Model Pretraining","created":"2025-10-07","cited_by_count":3,"area":null},{"id":"2510.20860","title":"Data-Centric Lessons To Improve Speech-Language Pretraining","created":"2025-10-22","cited_by_count":3,"area":null},{"id":"2602.20433","title":"Disentangling Geometry, Performance, and Training in Language Models","created":"2026-02-24","cited_by_count":3,"area":null},{"id":"2604.04204","title":"How Does \"English (US)\" Become the Default? Triangulating Structural Bias Towards American English Across the LLM Pipeline","created":"2026-04-05","cited_by_count":3,"area":null},{"id":"2605.10129","title":"Synthetic Pre-Pre-Training Improves Language Model Robustness to Noisy Pre-Training Data","created":"2026-05-11","cited_by_count":3,"area":null},{"id":"2411.00266","title":"A Systematic Review of NeurIPS Dataset Management Practices","created":"2024-10-31","cited_by_count":2,"area":null},{"id":"2411.14478","title":"Why you don't overfit, and don't need Bayes if you only train for one epoch","created":"2024-11-19","cited_by_count":2,"area":null},{"id":"2412.07430","title":"Knowledge Graph Guided Evaluation of Abstention Techniques","created":"2024-12-10","cited_by_count":2,"area":null},{"id":"2502.18282","title":"Better Aligned with Survey Respondents or Training Data? Unveiling Political Leanings of LLMs on U.S. Supreme Court Cases","created":"2025-02-25","cited_by_count":2,"area":null},{"id":"2503.23779","title":"WinoWhat: A Parallel Corpus of Paraphrased WinoGrande Sentences with Common Sense Categorization","created":"2025-03-31","cited_by_count":2,"area":"lr"},{"id":"2505.20264","title":"We Need to Measure Data Diversity in NLP -- Better and Broader","created":"2025-05-26","cited_by_count":2,"area":null},{"id":"2511.07722","title":"Critical Confabulation: Can LLMs Hallucinate for Social Good?","created":"2025-11-11","cited_by_count":2,"area":null},{"id":"2511.08637","title":"How Do Data Owners Say No? A Case Study of Data Consent Mechanisms in Web-Scraped Vision-Language AI Training Datasets","created":"2025-11-10","cited_by_count":2,"area":"safety"},{"id":"2512.21775","title":"Compliance Rating Scheme: A Data Provenance Framework for Generative AI Datasets","created":"2025-12-25","cited_by_count":2,"area":null},{"id":"2604.10480","title":"Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs","created":"2026-04-12","cited_by_count":2,"area":"agents"},{"id":"2608.05141","title":"OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling","created":"2026-08-05","cited_by_count":2,"area":"agents"},{"id":"2410.09448","title":"Solving the Challenge Set without Solving the Task: On Winograd Schemas as a Test of Pronominal Coreference Resolution","created":"2024-10-12","cited_by_count":1,"area":null},{"id":"2410.11647","title":"Measuring Spiritual Values and Bias of Large Language Models","created":"2024-10-15","cited_by_count":1,"area":null},{"id":"2410.14765","title":"What's New in My Data? Novelty Exploration via Contrastive Generation","created":"2024-10-18","cited_by_count":1,"area":null},{"id":"2410.19812","title":"Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models","created":"2024-10-17","cited_by_count":1,"area":null},{"id":"2501.01046","title":"SEDD: Scalable and Efficient Dataset Deduplication with GPUs","created":"2025-01-02","cited_by_count":1,"area":null}],"next_cursor":"100"}