{"list":"other","total":55,"rows":[{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2106.04560","title":"Scaling Vision Transformers","created":"2021-06-08","cited_by_count":999},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"1812.11118","title":"Reconciling modern machine learning practice and the bias-variance trade-off","created":"2018-12-28","cited_by_count":927},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"1712.00409","title":"Deep Learning Scaling is Predictable, Empirically","created":"2017-12-01","cited_by_count":582},{"id":"1906.11300","title":"Benign Overfitting in Linear Regression","created":"2019-06-26","cited_by_count":549},{"id":"2010.14701","title":"Scaling Laws for Autoregressive Generative Modeling","created":"2020-10-28","cited_by_count":522},{"id":"1903.08560","title":"Surprises in High-Dimensional Ridgeless Least Squares Interpolation","created":"2019-03-19","cited_by_count":513},{"id":"1908.05355","title":"The generalization error of random features regression: Precise asymptotics and double descent curve","created":"2019-08-14","cited_by_count":413},{"id":"2305.16264","title":"Scaling Data-Constrained Language Models","created":"2023-05-25","cited_by_count":403},{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363},{"id":"2002.02561","title":"Spectrum Dependent Learning Curves in Kernel Regression and Wide Neural Networks","created":"2020-02-07","cited_by_count":200},{"id":"1903.07571","title":"Two models of double descent for weak features","created":"2019-03-18","cited_by_count":195},{"id":"1905.12173","title":"On the Inductive Bias of Neural Tangent Kernels","created":"2019-05-29","cited_by_count":177},{"id":"2402.07871","title":"Scaling Laws for Fine-Grained Mixture of Experts","created":"2024-02-12","cited_by_count":173},{"id":"2401.00448","title":"Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws","created":"2023-12-31","cited_by_count":159},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"1708.03395","title":"Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models","created":"2017-08-10","cited_by_count":116},{"id":"2210.16859","title":"A Solvable Model of Neural Scaling Laws","created":"2022-10-30","cited_by_count":116},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111},{"id":"2101.10588","title":"Generalization error of random features and kernel methods: hypercontractivity and kernel matrix concentration","created":"2021-01-26","cited_by_count":110},{"id":"2411.04330","title":"Scaling Laws for Precision","created":"2024-11-07","cited_by_count":95},{"id":"2102.13219","title":"Learning with invariances in random features and kernel models","created":"2021-02-25","cited_by_count":89},{"id":"2406.19146","title":"Resolving Discrepancies in Compute-Optimal Scaling of Language Models","created":"2024-06-27","cited_by_count":88},{"id":"1702.05419","title":"A Random Matrix Approach to Neural Networks","created":"2017-02-17","cited_by_count":80},{"id":"2405.15074","title":"4+3 Phases of Compute-Optimal Neural Scaling Laws","created":"2024-05-23","cited_by_count":68},{"id":"1809.09349","title":"The jamming transition as a paradigm to understand the loss landscape of deep neural networks","created":"2018-09-25","cited_by_count":62},{"id":"1806.05451","title":"The committee machine: Computational to statistical gaps in learning a two-layers neural network","created":"2018-06-14","cited_by_count":58},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50},{"id":"2501.12370","title":"Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models","created":"2025-01-21","cited_by_count":50},{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43},{"id":"2504.19983","title":"Emergence and scaling laws in SGD learning of shallow neural networks","created":"2025-04-28","cited_by_count":32},{"id":"2505.10465","title":"Superposition Yields Robust Neural Scaling","created":"2025-05-15","cited_by_count":31},{"id":"2508.03688","title":"Learning quadratic neural networks in high dimensions: SGD dynamics and scaling laws","created":"2025-08-05","cited_by_count":25},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20},{"id":"2509.19189","title":"Functional Scaling Laws in Kernel Regression: Loss Dynamics and Learning Rate Schedules","created":"2025-09-23","cited_by_count":17},{"id":"2511.13421","title":"Larger Datasets Can Be Repeated More: A Theoretical Analysis of Multi-Epoch Scaling in Linear Regression","created":"2025-11-17","cited_by_count":16},{"id":"2601.10684","title":"On the origin of neural scaling laws: from random graphs to natural language","created":"2026-01-15","cited_by_count":14},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11},{"id":"2510.04780","title":"Kernel ridge regression under power-law data: spectrum and generalization","created":"2025-10-06","cited_by_count":10},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9},{"id":"2505.24849","title":"Statistical mechanics of extensive-width Bayesian neural networks near interpolation","created":"2025-05-30","cited_by_count":9},{"id":"2602.04774","title":"Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model","created":"2026-02-04","cited_by_count":7},{"id":"2405.19398","title":"Neural Scaling Laws From Large-N Field Theory: Solvable Model Beyond the Ridgeless Limit","created":"2024-05-29","cited_by_count":5},{"id":"2602.19241","title":"Scaling Laws for Precision in High-Dimensional Linear Regression","created":"2026-02-22","cited_by_count":4},{"id":"2603.14578","title":"Power-Law Spectrum of the Random Feature Model","created":"2026-03-15","cited_by_count":4}],"next_cursor":null}