{"list":"other","total":75,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1803.05457","title":"Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge","created":"2018-03-14","cited_by_count":4886},{"id":"2312.00752","title":"Mamba: Linear-Time Sequence Modeling with Selective State Spaces","created":"2023-12-01","cited_by_count":4718},{"id":"1905.07830","title":"HellaSwag: Can a Machine Really Finish Your Sentence?","created":"2019-05-19","cited_by_count":4100},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512},{"id":"1609.07843","title":"Pointer Sentinel Mixture Models","created":"2016-09-26","cited_by_count":3096},{"id":"1911.11641","title":"PIQA: Reasoning about Physical Commonsense in Natural Language","created":"2019-11-26","cited_by_count":2883},{"id":"2202.05262","title":"Locating and Editing Factual Associations in GPT","created":"2022-02-10","cited_by_count":2691},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"2101.00027","title":"The Pile: An 800GB Dataset of Diverse Text for Language Modeling","created":"2020-12-31","cited_by_count":2411},{"id":"2304.01373","title":"Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling","created":"2023-04-03","cited_by_count":1786},{"id":"1607.04606","title":"Enriching Word Vectors with Subword Information","created":"2016-07-15","cited_by_count":1583},{"id":"2406.17557","title":"The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale","created":"2024-06-25","cited_by_count":1160},{"id":"1606.06031","title":"The LAMBADA dataset: Word prediction requiring a broad discourse context","created":"2016-06-20","cited_by_count":992},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2305.13048","title":"RWKV: Reinventing RNNs for the Transformer Era","created":"2023-05-22","cited_by_count":827},{"id":"1811.03962","title":"A Convergence Theory for Deep Learning via Over-Parameterization","created":"2018-11-09","cited_by_count":787},{"id":"1707.06209","title":"Crowdsourcing Multiple Choice Science Questions","created":"2017-07-19","cited_by_count":765},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"1912.00582","title":"BLiMP: The Benchmark of Linguistic Minimal Pairs for English","created":"2019-12-02","cited_by_count":564},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"2402.00159","title":"Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research","created":"2024-01-31","cited_by_count":483},{"id":"1611.01368","title":"Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies","created":"2016-11-04","cited_by_count":354},{"id":"2501.00656","title":"2 OLMo 2 Furious","created":"2024-12-31","cited_by_count":340},{"id":"1808.05326","title":"SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference","created":"2018-08-16","cited_by_count":333},{"id":"1802.06893","title":"Learning Word Vectors for 157 Languages","created":"2018-02-19","cited_by_count":280},{"id":"1911.03343","title":"Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly","created":"2019-11-08","cited_by_count":243},{"id":"2306.09479","title":"Inverse Scaling: When Bigger Isn't Better","created":"2023-06-15","cited_by_count":207},{"id":"2202.08904","title":"SGPT: GPT Sentence Embeddings for Semantic Search","created":"2022-02-17","cited_by_count":204},{"id":"1309.4168","title":"Exploiting Similarities among Languages for Machine Translation","created":"2013-09-17","cited_by_count":191},{"id":"2411.12372","title":"RedPajama: an Open Dataset for Training Large Language Models","created":"2024-11-19","cited_by_count":182},{"id":"2405.14782","title":"Lessons from the Trenches on Reproducible Evaluation of Language Models","created":"2024-05-23","cited_by_count":179},{"id":"2306.00802","title":"Birth of a Transformer: A Memory Viewpoint","created":"2023-06-01","cited_by_count":161},{"id":"1506.02078","title":"Visualizing and Understanding Recurrent Networks","created":"2015-06-05","cited_by_count":160},{"id":"2401.17377","title":"Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens","created":"2024-01-30","cited_by_count":153},{"id":"2304.09151","title":"UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining","created":"2023-04-18","cited_by_count":151},{"id":"2304.11158","title":"Emergent and Predictable Memorization in Large Language Models","created":"2023-04-21","cited_by_count":148},{"id":"2404.05405","title":"Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws","created":"2024-04-08","cited_by_count":144},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124},{"id":"2402.11004","title":"The Evolution of Statistical Induction Heads: In-Context Learning Markov Chains","created":"2024-02-16","cited_by_count":118},{"id":"2403.15796","title":"Understanding Emergent Abilities of Language Models from the Loss Perspective","created":"2024-03-23","cited_by_count":94},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92},{"id":"2401.12973","title":"In-Context Language Learning: Architectures and Algorithms","created":"2024-01-23","cited_by_count":89},{"id":"2309.04827","title":"Neurons in Large Language Models: Dead, N-gram, Positional","created":"2023-09-09","cited_by_count":88},{"id":"1908.02899","title":"Do Neural Language Representations Learn Physical Commonsense?","created":"2019-08-08","cited_by_count":62},{"id":"2109.07020","title":"Frequency Effects on Syntactic Rule Learning in Transformers","created":"2021-09-14","cited_by_count":59},{"id":"2312.10523","title":"Paloma: A Benchmark for Evaluating Language Model Fit","created":"2023-12-16","cited_by_count":54},{"id":"2404.02418","title":"Auxiliary task demands mask the capabilities of smaller language models","created":"2024-04-03","cited_by_count":54},{"id":"2412.06538","title":"Understanding Factual Recall in Transformers via Associative Memories","created":"2024-12-09","cited_by_count":51},{"id":"2409.10559","title":"Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers","created":"2024-09-09","cited_by_count":50},{"id":"2407.07011","title":"Induction Heads as an Essential Mechanism for Pattern Matching in In-context Learning","created":"2024-07-09","cited_by_count":46},{"id":"2212.01488","title":"Event knowledge in large language models: the gap between the impossible and the unlikely","created":"2022-12-02","cited_by_count":45},{"id":"1907.07844","title":"Growing a Brain: Fine-Tuning by Increasing Model Capacity","created":"2019-07-18","cited_by_count":43},{"id":"2010.03010","title":"Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming","created":"2020-10-06","cited_by_count":41},{"id":"2110.02406","title":"Word Acquisition in Neural Language Models","created":"2021-10-05","cited_by_count":41},{"id":"2109.06096","title":"The Grammar-Learning Trajectories of Neural Language Models","created":"2021-09-13","cited_by_count":36},{"id":"2308.15419","title":"Characterizing Learning Curves During Language Model Pre-Training: Learning, Forgetting, and Stability","created":"2023-08-29","cited_by_count":35},{"id":"2412.03782","title":"The broader spectrum of in-context learning","created":"2024-12-05","cited_by_count":35},{"id":"2503.09543","title":"PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs","created":"2025-03-12","cited_by_count":35},{"id":"2402.04362","title":"Neural Networks Learn Statistics of Increasing Complexity","created":"2024-02-06","cited_by_count":31},{"id":"2407.12034","title":"Understanding Transformers via N-gram Statistics","created":"2024-06-30","cited_by_count":26},{"id":"2504.03022","title":"The Dual-Route Model of Induction","created":"2025-04-03","cited_by_count":24},{"id":"2409.08160","title":"On the Role of Context in Reading Time Prediction","created":"2024-09-12","cited_by_count":20},{"id":"2408.06518","title":"Does Liking Yellow Imply Driving a School Bus? Semantic Leakage in Language Models","created":"2024-08-12","cited_by_count":15},{"id":"2107.09648","title":"Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?","created":"2021-07-20","cited_by_count":14},{"id":"2410.11474","title":"How Transformers Get Rich: Approximation and Dynamics Analysis","created":"2024-10-15","cited_by_count":8},{"id":"2305.14681","title":"Emergent inabilities? Inverse scaling over the course of pretraining","created":"2023-05-24","cited_by_count":7},{"id":"2301.08731","title":"Can Peanuts Fall in Love with Distributional Semantics?","created":"2023-01-20","cited_by_count":6},{"id":"2211.05198","title":"Collateral facilitation in humans and language models","created":"2022-11-09","cited_by_count":5},{"id":"2504.15471","title":"Bigram Subnetworks: Mapping to Next Tokens in Transformer Language Models","created":"2025-04-21","cited_by_count":5},{"id":"2205.02724","title":"Implicit N-grams Induced by Recurrence","created":"2022-05-05","cited_by_count":4},{"id":"2506.06808","title":"Not quite Sherlock Holmes: Language model predictions do not reliably differentiate impossible from improbable events","created":"2025-06-07","cited_by_count":2}],"next_cursor":null}