{"list":"other","total":55,"rows":[{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2210.03350","title":"Measuring and Narrowing the Compositionality Gap in Language Models","created":"2022-10-07","cited_by_count":1075},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"1608.04636","title":"Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-\\L{}ojasiewicz Condition","created":"2016-08-16","cited_by_count":539},{"id":"2206.14486","title":"Beyond neural scaling laws: beating power law scaling via data pruning","created":"2022-06-29","cited_by_count":528},{"id":"2010.14701","title":"Scaling Laws for Autoregressive Generative Modeling","created":"2020-10-28","cited_by_count":522},{"id":"2305.14795","title":"MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions","created":"2023-05-24","cited_by_count":300},{"id":"2210.10749","title":"Transformers Learn Shortcuts to Automata","created":"2022-10-19","cited_by_count":268},{"id":"2402.12875","title":"Chain of Thought Empowers Transformers to Solve Inherently Serial Problems","created":"2024-02-20","cited_by_count":260},{"id":"2405.14838","title":"From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Step","created":"2024-05-23","cited_by_count":235},{"id":"2305.12827","title":"Task Arithmetic in the Tangent Space: Improved Editing of Pre-Trained Models","created":"2023-05-22","cited_by_count":221},{"id":"2207.00729","title":"The Parallelism Tradeoff: Limitations of Log-Precision Transformers","created":"2022-07-02","cited_by_count":193},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2402.16837","title":"Do Large Language Models Latently Perform Multi-Hop Reasoning?","created":"2024-02-26","cited_by_count":169},{"id":"2510.25741","title":"Scaling Latent Reasoning via Looped Language Models","created":"2025-10-29","cited_by_count":165},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161},{"id":"2003.10780","title":"Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition from a Domain Adaptation Perspective","created":"2020-03-24","cited_by_count":143},{"id":"2309.14402","title":"Physics of Language Models: Part 3.2, Knowledge Manipulation","created":"2023-09-25","cited_by_count":143},{"id":"2202.08658","title":"The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks","created":"2022-02-17","cited_by_count":142},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138},{"id":"2306.02896","title":"Representational Strengths and Limitations of Transformers","created":"2023-06-05","cited_by_count":133},{"id":"2307.14430","title":"Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models","created":"2023-07-26","cited_by_count":121},{"id":"2307.15936","title":"A Theory for Emergence of Complex Skills in Language Models","created":"2023-07-29","cited_by_count":113},{"id":"2407.20311","title":"Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process","created":"2024-07-29","cited_by_count":108},{"id":"2405.12205","title":"Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving","created":"2024-05-20","cited_by_count":84},{"id":"2405.15071","title":"Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization","created":"2024-05-23","cited_by_count":79},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2406.12775","title":"Hopping Too Late: Exploring the Limitations of Large Language Models on Multi-Hop Queries","created":"2024-06-18","cited_by_count":78},{"id":"2310.17567","title":"Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models","created":"2023-10-26","cited_by_count":64},{"id":"2402.08164","title":"On Limitations of the Transformer Architecture","created":"2024-02-13","cited_by_count":63},{"id":"2108.10573","title":"The staircase property: How hierarchical structure can guide deep learning","created":"2021-08-24","cited_by_count":62},{"id":"2410.08633","title":"Transformers Provably Solve Parity Efficiently with Chain of Thought","created":"2024-10-11","cited_by_count":50},{"id":"2402.14328","title":"Understanding and Patching Compositional Reasoning in LLMs","created":"2024-02-22","cited_by_count":46},{"id":"2412.02975","title":"Theoretical limitations of multi-layer Transformer","created":"2024-12-04","cited_by_count":45},{"id":"2505.23683","title":"Learning Compositional Functions with Transformers from Easy-to-Hard Data","created":"2025-05-29","cited_by_count":36},{"id":"2309.03843","title":"Gradient-Based Feature Learning under Structured Data","created":"2023-09-07","cited_by_count":32},{"id":"2502.21212","title":"Transformers Learn to Implement Multi-step Gradient Descent with Chain of Thought","created":"2025-02-28","cited_by_count":32},{"id":"2410.05459","title":"From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency","created":"2024-10-07","cited_by_count":29},{"id":"2306.16921","title":"Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs","created":"2023-06-29","cited_by_count":22},{"id":"2301.13833","title":"A Mathematical Model for Curriculum Learning for Parities","created":"2023-01-31","cited_by_count":19},{"id":"2409.19808","title":"Can Models Learn Skill Composition from Examples?","created":"2024-09-29","cited_by_count":17},{"id":"2505.23653","title":"How do Transformers Learn Implicit Reasoning?","created":"2025-05-29","cited_by_count":16},{"id":"2402.11900","title":"Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models","created":"2024-02-19","cited_by_count":14},{"id":"2511.07378","title":"Transformers Provably Learn Chain-of-Thought Reasoning with Length Generalization","created":"2025-11-10","cited_by_count":14},{"id":"2306.01707","title":"Learning Multi-Step Reasoning by Solving Arithmetic Tasks","created":"2023-06-02","cited_by_count":12},{"id":"2505.17923","title":"Language models can learn implicit multi-hop reasoning, but only if they have lots of training data","created":"2025-05-23","cited_by_count":11},{"id":"2408.12456","title":"Enhancing Multi-hop Reasoning through Knowledge Erasure in Large Language Model Editing","created":"2024-08-22","cited_by_count":9},{"id":"2410.23438","title":"Learning and Transferring Sparse Contextual Bigrams with Linear Transformers","created":"2024-10-30","cited_by_count":9},{"id":"2503.16356","title":"CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners","created":"2025-03-20","cited_by_count":9},{"id":"2506.02651","title":"Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks","created":"2025-06-03","cited_by_count":9},{"id":"2501.12391","title":"Physics of Skill Learning","created":"2025-01-21","cited_by_count":8},{"id":"2502.06443","title":"Low-dimensional Functions are Efficiently Learnable under Randomly Biased Distributions","created":"2025-02-10","cited_by_count":8},{"id":"2510.25108","title":"Shift is Good: Mismatched Data Mixing Improves Test Performance","created":"2025-10-29","cited_by_count":5},{"id":"2602.08907","title":"Positive Distribution Shift as a Framework for Understanding Tractable Learning","created":"2026-02-09","cited_by_count":3}],"next_cursor":null}