{"list":"other","total":62,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2505.09388","title":"Qwen3 Technical Report","created":"2025-05-14","cited_by_count":8820},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"1904.09751","title":"The Curious Case of Neural Text Degeneration","created":"2019-04-22","cited_by_count":2916},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1805.04833","title":"Hierarchical Neural Story Generation","created":"2018-05-13","cited_by_count":1193},{"id":"2406.17557","title":"The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale","created":"2024-06-25","cited_by_count":1160},{"id":"1506.03099","title":"Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks","created":"2015-06-09","cited_by_count":803},{"id":"2301.11305","title":"DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature","created":"2023-01-26","cited_by_count":726},{"id":"1511.06349","title":"Generating Sentences from a Continuous Space","created":"2015-11-19","cited_by_count":612},{"id":"1511.06732","title":"Sequence Level Training with Recurrent Neural Networks","created":"2015-11-20","cited_by_count":576},{"id":"2306.11644","title":"Textbooks Are All You Need","created":"2023-06-20","cited_by_count":569},{"id":"1911.00359","title":"CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data","created":"2019-11-01","cited_by_count":548},{"id":"1906.04043","title":"GLTR: Statistical Detection and Visualization of Generated Text","created":"2019-06-10","cited_by_count":496},{"id":"2402.00159","title":"Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research","created":"2024-01-31","cited_by_count":483},{"id":"2305.16264","title":"Scaling Data-Constrained Language Models","created":"2023-05-25","cited_by_count":403},{"id":"2305.10429","title":"DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining","created":"2023-05-17","cited_by_count":399},{"id":"2406.11794","title":"DataComp-LM: In search of the next generation of training sets for language models","created":"2024-06-17","cited_by_count":398},{"id":"2502.02737","title":"SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model","created":"2025-02-04","cited_by_count":335},{"id":"2308.03296","title":"Studying Large Language Model Generalization with Influence Functions","created":"2023-08-07","cited_by_count":326},{"id":"2305.13534","title":"How Language Model Hallucinations Can Snowball","created":"2023-05-22","cited_by_count":311},{"id":"2302.08582","title":"Pretraining Language Models with Human Preferences","created":"2023-02-16","cited_by_count":247},{"id":"2206.07137","title":"Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt","created":"2022-06-14","cited_by_count":236},{"id":"2407.01492","title":"RegMix: Data Mixture as Regression for Language Model Pre-training","created":"2024-07-01","cited_by_count":177},{"id":"2401.16380","title":"Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling","created":"2024-01-29","cited_by_count":161},{"id":"2402.09739","title":"QuRating: Selecting High-Quality Data for Training Language Models","created":"2024-02-15","cited_by_count":157},{"id":"2404.01413","title":"Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data","created":"2024-04-01","cited_by_count":151},{"id":"2204.05832","title":"What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?","created":"2022-04-12","cited_by_count":150},{"id":"2404.05405","title":"Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws","created":"2024-04-08","cited_by_count":144},{"id":"2404.07965","title":"Rho-1: Not All Tokens Are What You Need","created":"2024-04-11","cited_by_count":133},{"id":"2402.07043","title":"A Tale of Tails: Model Collapse as a Change of Scaling Laws","created":"2024-02-10","cited_by_count":130},{"id":"1805.04623","title":"Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context","created":"2018-05-12","cited_by_count":113},{"id":"2409.00729","title":"ContextCite: Attributing Model Generation to Context","created":"2024-09-01","cited_by_count":98},{"id":"2405.20541","title":"Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models","created":"2024-05-30","cited_by_count":84},{"id":"1511.05101","title":"How (not) to Train your Generative Model: Scheduled Sampling, Likelihood, Adversary?","created":"2015-11-16","cited_by_count":78},{"id":"1703.02573","title":"Data Noising as Smoothing in Neural Network Language Models","created":"2017-03-07","cited_by_count":78},{"id":"1906.06442","title":"Tagged Back-Translation","created":"2019-06-15","cited_by_count":77},{"id":"2004.14589","title":"Improved Natural Language Generation via Loss Truncation","created":"2020-04-30","cited_by_count":75},{"id":"2410.23771","title":"What is Wrong with Perplexity for Long-context Language Modeling?","created":"2024-10-31","cited_by_count":69},{"id":"2408.16293","title":"Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems","created":"2024-08-29","cited_by_count":50},{"id":"2301.12971","title":"Quantifying Context Mixing in Transformers","created":"2023-01-30","cited_by_count":43},{"id":"2405.14394","title":"Instruction Tuning With Loss Over Instructions","created":"2024-05-23","cited_by_count":40},{"id":"2502.01968","title":"Token Cleaning: Fine-Grained Data Selection for LLM Supervised Fine-Tuning","created":"2025-02-04","cited_by_count":39},{"id":"1905.10617","title":"Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?","created":"2019-05-25","cited_by_count":35},{"id":"2401.13586","title":"Instruction Fine-Tuning: Does Prompt Loss Matter?","created":"2024-01-24","cited_by_count":26},{"id":"2402.04004","title":"Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought","created":"2024-02-06","cited_by_count":19},{"id":"2404.14122","title":"Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice?","created":"2024-04-22","cited_by_count":17},{"id":"2402.11192","title":"I Learn Better If You Speak My Language: Understanding the Superior Performance of Fine-Tuning Large Language Models with LLM-Generated Responses","created":"2024-02-17","cited_by_count":15},{"id":"2502.15654","title":"Machine-generated text detection prevents language model collapse","created":"2025-02-21","cited_by_count":14},{"id":"2503.09202","title":"Token Weighting for Long-Range Language Modeling","created":"2025-03-12","cited_by_count":14},{"id":"2601.21571","title":"Shaping capabilities with token-level data filtering","created":"2026-01-29","cited_by_count":13},{"id":"2502.06604","title":"Do we really have to filter out random noise in pre-training data for language models?","created":"2025-02-10","cited_by_count":11},{"id":"2310.00840","title":"Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models","created":"2023-10-02","cited_by_count":6},{"id":"2606.16246","title":"Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining","created":"2026-06-15","cited_by_count":4},{"id":"2607.01218","title":"The State-Prediction Separation Hypothesis","created":"2026-07-01","cited_by_count":3},{"id":"2505.03052","title":"Teaching Models to Understand (but not Generate) High-risk Data","created":"2025-05-05","cited_by_count":2},{"id":"2512.11912","title":"Robustness of Probabilistic Models to Low-Quality Data: A Multi-Perspective Analysis","created":"2025-12-11","cited_by_count":2},{"id":"2607.18639","title":"Mark, Don't Erase: Token Inoculation for Dual-Use Knowledge in LLMs","created":"2026-07-21","cited_by_count":2},{"id":"2606.01635","title":"AlphaToken: Decoupling Adaptation and Stability for Path-Aware Response Token Valuation in LLM Post-Training","created":"2026-06-01","cited_by_count":1}],"next_cursor":null}