{"total":116,"rows":[{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780,"area":null},{"id":"2303.13506","title":"The Quantization Model of Neural Scaling","created":"2023-03-23","cited_by_count":138,"area":null},{"id":"2402.07043","title":"A Tale of Tails: Model Collapse as a Change of Scaling Laws","created":"2024-02-10","cited_by_count":130,"area":"synth"},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2406.19146","title":"Resolving Discrepancies in Compute-Optimal Scaling of Language Models","created":"2024-06-27","cited_by_count":88,"area":null},{"id":"2402.07712","title":"Model Collapse Demystified: The Case of Regression","created":"2024-02-12","cited_by_count":82,"area":"synth"},{"id":"2410.04840","title":"Strong Model Collapse","created":"2024-10-07","cited_by_count":65,"area":"synth"},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2303.06173","title":"Unifying Grokking and Double Descent","created":"2023-03-10","cited_by_count":50,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2502.17578","title":"How Do Large Language Monkeys Get Their Power (Laws)?","created":"2025-02-24","cited_by_count":43,"area":"safety"},{"id":"2406.12907","title":"Reconciling Kaplan and Chinchilla Scaling Laws","created":"2024-06-12","cited_by_count":39,"area":null},{"id":"2306.13575","title":"Scaling MLPs: A Tale of Inductive Bias","created":"2023-06-23","cited_by_count":37,"area":null},{"id":"2410.16377","title":"A Simple Model of Inference Scaling Laws","created":"2024-10-21","cited_by_count":36,"area":null},{"id":"2310.02984","title":"Scaling Laws for Associative Memories","created":"2023-10-04","cited_by_count":35,"area":null},{"id":"2505.10465","title":"Superposition Yields Robust Neural Scaling","created":"2025-05-15","cited_by_count":31,"area":"mechinterp"},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23,"area":null},{"id":"2411.04434","title":"Scaling Laws for Pre-training Agents and World Models","created":"2024-11-07","cited_by_count":23,"area":"wm"},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23,"area":null},{"id":"2410.18837","title":"High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws","created":"2024-10-24","cited_by_count":22,"area":"distill"},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2305.18512","title":"A Rainbow in Deep Network Black Boxes","created":"2023-05-29","cited_by_count":18,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2406.01461","title":"Hardness of Learning Neural Networks under the Manifold Hypothesis","created":"2024-06-03","cited_by_count":18,"area":null},{"id":"2505.07067","title":"Learning curves theory for hierarchically compositional data with power-law distributed features","created":"2025-05-11","cited_by_count":17,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2412.07942","title":"Neural Scaling Laws Rooted in the Data Distribution","created":"2024-12-10","cited_by_count":15,"area":null},{"id":"2601.10684","title":"On the origin of neural scaling laws: from random graphs to natural language","created":"2026-01-15","cited_by_count":14,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2502.03009","title":"Scaling Laws for Upcycling Mixture-of-Experts Language Models","created":"2025-02-05","cited_by_count":13,"area":"moe"},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2510.04780","title":"Kernel ridge regression under power-law data: spectrum and generalization","created":"2025-10-06","cited_by_count":10,"area":null},{"id":"2602.03685","title":"Universal One-third Time Scaling in Learning Peaked Distributions","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2302.09049","title":"Multiperiodic Processes: Ergodic Sources with a Sublinear Entropy","created":"2023-02-17","cited_by_count":9,"area":null},{"id":"2306.14975","title":"The Underlying Scaling Laws and Universal Statistical Structure of Complex Datasets","created":"2023-06-26","cited_by_count":9,"area":null},{"id":"2405.17538","title":"Bayesian RG Flow in Neural Network Field Theories","created":"2024-05-27","cited_by_count":9,"area":null},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2602.05846","title":"Optimal scaling laws in learning hierarchical multi-index models","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2602.05970","title":"Inverse Depth Scaling From Most Layers Being Similar","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2406.09366","title":"Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations","created":"2024-06-13","cited_by_count":8,"area":null},{"id":"2408.04607","title":"Risk and cross validation in ridge regression with correlated samples","created":"2024-08-08","cited_by_count":8,"area":null},{"id":"2501.12391","title":"Physics of Skill Learning","created":"2025-01-21","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2304.04234","title":"Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equations","created":"2023-04-09","cited_by_count":7,"area":null},{"id":"2412.11979","title":"AlphaZero Neural Scaling and Zipf's Law: a Tale of Board Games and Power Laws","created":"2024-12-16","cited_by_count":7,"area":null},{"id":"2312.02264","title":"Scaling Laws in Jet Classification","created":"2023-12-04","cited_by_count":6,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2601.03764","title":"Learning Shrinks the Hard Tail: Training-Dependent Inference Scaling in a Solvable Linear Model","created":"2026-01-07","cited_by_count":6,"area":null},{"id":"2601.22652","title":"Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval","created":"2026-01-30","cited_by_count":6,"area":null},{"id":"2302.07828","title":"Over-parametrization via Lifting for Low-rank Matrix Sensing: Conversion of Spurious Solutions to Strict Saddle Points","created":"2023-02-15","cited_by_count":5,"area":null},{"id":"2505.07070","title":"Scaling Laws and Representation Learning in Simple Hierarchical Languages: Transformers vs. Convolutional Architectures","created":"2025-05-11","cited_by_count":5,"area":null},{"id":"2605.05683","title":"Spectral Lens: Activation and Gradient Spectra as Diagnostics of LLM Optimization","created":"2026-05-07","cited_by_count":5,"area":null},{"id":"2606.25008","title":"Neural Scaling Universality: If Exponents Are Fixed, Time to Understand Coefficients","created":"2026-06-23","cited_by_count":5,"area":null},{"id":"2307.09550","title":"The semantic landscape paradigm for neural networks","created":"2023-07-18","cited_by_count":4,"area":null},{"id":"2409.05782","title":"Unified Neural Network Scaling Laws and Scale-time Equivalence","created":"2024-09-09","cited_by_count":4,"area":null},{"id":"2508.11522","title":"Finite-Width Neural Tangent Kernels from Feynman Diagrams","created":"2025-08-15","cited_by_count":4,"area":null},{"id":"2510.09768","title":"Scaling Laws and Symmetry, Evidence from Neural Force Fields","created":"2025-10-10","cited_by_count":4,"area":null},{"id":"2512.19905","title":"Demystifying LLM-as-a-Judge: Analytically Tractable Model for Inference-Time Scaling","created":"2025-12-22","cited_by_count":4,"area":"lr"},{"id":"2603.14578","title":"Power-Law Spectrum of the Random Feature Model","created":"2026-03-15","cited_by_count":4,"area":null},{"id":"2605.05076","title":"High-Dimensional Statistics: Reflections on Progress and Open Problems","created":"2026-05-06","cited_by_count":4,"area":null},{"id":"2304.04664","title":"Inductive biases in deep learning models for weather prediction","created":"2023-04-06","cited_by_count":3,"area":null},{"id":"2505.22813","title":"X-Factor: Quality Is a Dataset-Intrinsic Property","created":"2025-05-28","cited_by_count":3,"area":null},{"id":"2511.18661","title":"Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data","created":"2025-11-24","cited_by_count":3,"area":null},{"id":"2512.13491","title":"From Zipf's Law to Neural Scaling through Heaps' Law and Hilberg's Hypothesis","created":"2025-12-15","cited_by_count":3,"area":null},{"id":"2605.22341","title":"A Boundary-Layer Mechanism for One-Third Scaling in Online Softmax Classification","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2311.01358","title":"The Universal Statistical Structure and Scaling Laws of Chaos and Turbulence","created":"2023-11-02","cited_by_count":2,"area":null},{"id":"2411.17807","title":"A solvable generative model with a linear, one-step denoiser","created":"2024-11-26","cited_by_count":2,"area":"diffusion"},{"id":"2509.23963","title":"Evaluating the Robustness of Chinchilla Compute-Optimal Scaling","created":"2025-09-28","cited_by_count":2,"area":null},{"id":"2510.06548","title":"Reusing Overtrained Language Models Saturates Scaling","created":"2025-10-08","cited_by_count":2,"area":null},{"id":"2605.24316","title":"Scaling Laws for Dynamic Mini-Batch SGD in Sketched Linear Regression","created":"2026-05-23","cited_by_count":2,"area":null},{"id":"2412.05418","title":"No Free Lunch From Random Feature Ensembles: Scaling Laws and Near-Optimality Conditions","created":"2024-12-06","cited_by_count":1,"area":null},{"id":"2509.10000","title":"Neural Scaling Laws for Deep Regression","created":"2025-09-12","cited_by_count":1,"area":null},{"id":"2602.01045","title":"Superposition unifies power-law training dynamics","created":"2026-02-01","cited_by_count":1,"area":"mechinterp"},{"id":"2602.02593","title":"Effective Frontiers: A Unification of Neural Scaling Laws","created":"2026-02-01","cited_by_count":1,"area":null},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2605.29387","title":"On the Optimizer Dependence of Neural Scaling Laws","created":"2026-05-28","cited_by_count":1,"area":null},{"id":"2605.31244","title":"Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2606.08167","title":"Explaining Data Mixing Scaling Laws","created":"2026-06-06","cited_by_count":1,"area":null},{"id":"2606.29858","title":"Smooth Scaling Laws Hide Stepwise Token Learning","created":"2026-06-29","cited_by_count":1,"area":null},{"id":"2608.13335","title":"Neural Quadratic Forms: A Unified Minimal Model for Sudden Learning and Scaling Laws","created":"2026-08-13","cited_by_count":1,"area":null},{"id":"2307.06362","title":"Spectral-Bias and Kernel-Task Alignment in Physically Informed Neural Networks","created":"2023-07-12","cited_by_count":0,"area":null},{"id":"2405.18427","title":"Classifying Overlapping Gaussian Mixtures in High Dimensions: From Optimal Classifiers to Neural Nets","created":"2024-05-28","cited_by_count":0,"area":null},{"id":"2503.05938","title":"Uncertainty Quantification From Scaling Laws in Deep Neural Networks","created":"2025-03-07","cited_by_count":0,"area":null},{"id":"2601.06649","title":"Revisiting Training Scale: An Empirical Study of Token Count, Power Consumption, and Parameter Efficiency","created":"2026-01-10","cited_by_count":0,"area":null},{"id":"2604.24037","title":"A Limit Theory of Foundation Models: A Mathematical Approach to Understanding Emergent Intelligence and Scaling Laws","created":"2026-04-27","cited_by_count":0,"area":null},{"id":"2605.09154","title":"Predicting Large Model Test Losses with a Noisy Quadratic System","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.09189","title":"Practical Scaling Laws: Converting Compute into Performance in a Data-Constrained World","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.14567","title":"Scaling Laws from Sequential Feature Recovery: A Solvable Hierarchical Model","created":"2026-05-14","cited_by_count":0,"area":null},{"id":"2606.20347","title":"Critical Percolation as a Synthetic Data Model for Interpretability","created":"2026-06-18","cited_by_count":0,"area":null},{"id":"2606.26617","title":"Sketched Linear Contrastive Learning: Approximation, Optimization, and Statistical Scaling","created":"2026-06-25","cited_by_count":0,"area":null}],"next_cursor":"100"}