{"total":111,"rows":[{"id":"2411.04330","title":"Scaling Laws for Precision","created":"2024-11-07","cited_by_count":95,"area":null},{"id":"2406.19146","title":"Resolving Discrepancies in Compute-Optimal Scaling of Language Models","created":"2024-06-27","cited_by_count":88,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2404.10102","title":"Chinchilla Scaling: A replication attempt","created":"2024-04-15","cited_by_count":72,"area":null},{"id":"2406.08466","title":"Scaling Laws in Linear Regression: Compute, Parameters, and Data","created":"2024-06-12","cited_by_count":57,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2502.17578","title":"How Do Large Language Monkeys Get Their Power (Laws)?","created":"2025-02-24","cited_by_count":43,"area":"safety"},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39,"area":null},{"id":"2406.00048","title":"Towards a theory of how the structure of language is acquired by deep neural networks","created":"2024-05-28","cited_by_count":39,"area":null},{"id":"2410.12360","title":"Towards Neural Scaling Laws for Time Series Foundation Models","created":"2024-10-16","cited_by_count":33,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2405.15699","title":"Dimension-free deterministic equivalents and scaling laws for random feature regression","created":"2024-05-24","cited_by_count":23,"area":null},{"id":"2409.15156","title":"Rethinking Conventional Wisdom in Machine Learning: From Generalization to Scaling","created":"2024-09-23","cited_by_count":23,"area":"lr"},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23,"area":null},{"id":"2410.18837","title":"High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws","created":"2024-10-24","cited_by_count":22,"area":"distill"},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2505.07067","title":"Learning curves theory for hierarchically compositional data with power-law distributed features","created":"2025-05-11","cited_by_count":17,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2601.10684","title":"On the origin of neural scaling laws: from random graphs to natural language","created":"2026-01-15","cited_by_count":14,"area":null},{"id":"2603.26554","title":"Sharp Capacity Scaling of Spectral Optimizers in Learning Associative Memory","created":"2026-03-27","cited_by_count":14,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2502.03009","title":"Scaling Laws for Upcycling Mixture-of-Experts Language Models","created":"2025-02-05","cited_by_count":13,"area":"moe"},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2510.04780","title":"Kernel ridge regression under power-law data: spectrum and generalization","created":"2025-10-06","cited_by_count":10,"area":null},{"id":"2602.03685","title":"Universal One-third Time Scaling in Learning Peaked Distributions","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2602.03702","title":"Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9,"area":null},{"id":"2502.21009","title":"Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)","created":"2025-02-28","cited_by_count":9,"area":null},{"id":"2503.04725","title":"L$^2$M: Mutual Information Scaling Law for Long-Context Language Modeling","created":"2025-03-06","cited_by_count":9,"area":null},{"id":"2602.05846","title":"Optimal scaling laws in learning hierarchical multi-index models","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2408.04607","title":"Risk and cross validation in ridge regression with correlated samples","created":"2024-08-08","cited_by_count":8,"area":null},{"id":"2501.12391","title":"Physics of Skill Learning","created":"2025-01-21","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2502.05074","title":"Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models","created":"2025-02-07","cited_by_count":7,"area":null},{"id":"2602.04774","title":"Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model","created":"2026-02-04","cited_by_count":7,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2601.03764","title":"Learning Shrinks the Hard Tail: Training-Dependent Inference Scaling in a Solvable Linear Model","created":"2026-01-07","cited_by_count":6,"area":null},{"id":"2601.13308","title":"Scaling laws for amplitude surrogates","created":"2026-01-19","cited_by_count":6,"area":null},{"id":"2601.22652","title":"Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval","created":"2026-01-30","cited_by_count":6,"area":null},{"id":"2602.14208","title":"Fast Catch-Up, Late Switching: Optimal Batch Size Scheduling via Functional Scaling Laws","created":"2026-02-15","cited_by_count":6,"area":null},{"id":"2605.07870","title":"Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer","created":"2026-05-08","cited_by_count":6,"area":null},{"id":"2502.12051","title":"How to Upscale Neural Networks with Scaling Law? A Survey and Practical Guidelines","created":"2025-02-17","cited_by_count":5,"area":null},{"id":"2505.07070","title":"Scaling Laws and Representation Learning in Simple Hierarchical Languages: Transformers vs. Convolutional Architectures","created":"2025-05-11","cited_by_count":5,"area":null},{"id":"2506.05447","title":"Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning","created":"2025-06-05","cited_by_count":5,"area":null},{"id":"2606.25008","title":"Neural Scaling Universality: If Exponents Are Fixed, Time to Understand Coefficients","created":"2026-06-23","cited_by_count":5,"area":null},{"id":"2409.03734","title":"Safety vs. Performance: How Multi-Objective Learning Reduces Barriers to Market Entry","created":"2024-09-05","cited_by_count":4,"area":null},{"id":"2409.05782","title":"Unified Neural Network Scaling Laws and Scale-time Equivalence","created":"2024-09-09","cited_by_count":4,"area":null},{"id":"2410.12119","title":"Scaling Laws for Post Training Quantized Large Language Models","created":"2024-10-15","cited_by_count":4,"area":null},{"id":"2503.01314","title":"Scaling Law Phenomena Across Regression Paradigms: Multiple and Kernel Approaches","created":"2025-03-03","cited_by_count":4,"area":null},{"id":"2510.09768","title":"Scaling Laws and Symmetry, Evidence from Neural Force Fields","created":"2025-10-10","cited_by_count":4,"area":null},{"id":"2606.24998","title":"Internal Data Repetition Destroys Language Models","created":"2026-06-23","cited_by_count":4,"area":null},{"id":"2505.22813","title":"X-Factor: Quality Is a Dataset-Intrinsic Property","created":"2025-05-28","cited_by_count":3,"area":null},{"id":"2507.04448","title":"Transfer Learning in Infinite Width Feature Learning Networks","created":"2025-07-06","cited_by_count":3,"area":null},{"id":"2509.20721","title":"Scaling Laws are Redundancy Laws","created":"2025-09-25","cited_by_count":3,"area":null},{"id":"2511.18661","title":"Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data","created":"2025-11-24","cited_by_count":3,"area":null},{"id":"2512.16292","title":"In-Context Probing for Membership Inference in Fine-Tuned Language Models","created":"2025-12-18","cited_by_count":3,"area":"safety"},{"id":"2512.24503","title":"Can Small Training Runs Reliably Guide Data Curation? Rethinking Proxy-Model Practice","created":"2025-12-30","cited_by_count":3,"area":"lr"},{"id":"2602.05184","title":"Towards Worst-Case Guarantees with Scale-Aware Interpretability","created":"2026-02-05","cited_by_count":3,"area":null},{"id":"2605.22341","title":"A Boundary-Layer Mechanism for One-Third Scaling in Online Softmax Classification","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2407.19353","title":"Spring-block theory of feature learning in deep neural networks","created":"2024-07-28","cited_by_count":2,"area":null},{"id":"2505.13230","title":"Implicit bias produces neural scaling laws in learning curves, from perceptrons to deep networks","created":"2025-05-19","cited_by_count":2,"area":null},{"id":"2509.23963","title":"Evaluating the Robustness of Chinchilla Compute-Optimal Scaling","created":"2025-09-28","cited_by_count":2,"area":null},{"id":"2510.01930","title":"Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory","created":"2025-10-02","cited_by_count":2,"area":null},{"id":"2512.22088","title":"Unifying Learning Dynamics and Generalization in Transformers Scaling Law","created":"2025-12-26","cited_by_count":2,"area":null},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2410.00396","title":"Dynamic neuron approach to deep neural networks: Decoupling neurons for renormalization group analysis","created":"2024-10-01","cited_by_count":1,"area":null},{"id":"2412.05418","title":"No Free Lunch From Random Feature Ensembles: Scaling Laws and Near-Optimality Conditions","created":"2024-12-06","cited_by_count":1,"area":null},{"id":"2506.12932","title":"Complexity Scaling Laws for Neural Models using Combinatorial Optimization","created":"2025-06-15","cited_by_count":1,"area":null},{"id":"2602.02593","title":"Effective Frontiers: A Unification of Neural Scaling Laws","created":"2026-02-01","cited_by_count":1,"area":null},{"id":"2603.24594","title":"Polynomial Speedup in Diffusion Models with the Multilevel Euler-Maruyama Method","created":"2026-03-25","cited_by_count":1,"area":"diffusion"},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2605.29387","title":"On the Optimizer Dependence of Neural Scaling Laws","created":"2026-05-28","cited_by_count":1,"area":null},{"id":"2606.08167","title":"Explaining Data Mixing Scaling Laws","created":"2026-06-06","cited_by_count":1,"area":null},{"id":"2606.29858","title":"Smooth Scaling Laws Hide Stepwise Token Learning","created":"2026-06-29","cited_by_count":1,"area":null},{"id":"2607.04135","title":"Broken Ergodicity and the Violation of the Fluctuation-Dissipation Theorem Lead to Generalization Beyond Overfitting in Machine Learning","created":"2026-07-05","cited_by_count":1,"area":null},{"id":"2609.10657","title":"Quantifying the Memorization-to-Generalization Transition: Scaling Laws and Phase Structure in Grokking","created":"2026-09-09","cited_by_count":1,"area":null},{"id":"2407.06765","title":"A Generalization Bound for Nearly-Linear Networks","created":"2024-07-09","cited_by_count":0,"area":null},{"id":"2503.05938","title":"Uncertainty Quantification From Scaling Laws in Deep Neural Networks","created":"2025-03-07","cited_by_count":0,"area":null},{"id":"2509.18997","title":"Theoretical Foundations of Representation Learning using Unlabeled Data: Statistics and Optimization","created":"2025-09-23","cited_by_count":0,"area":null},{"id":"2510.13665","title":"Axial Neural Networks for Dimension-Free Foundation Models","created":"2025-10-15","cited_by_count":0,"area":null},{"id":"2512.02409","title":"Data Curation Through the Lens of Spectral Dynamics: Static Limits, Dynamic Acceleration, and Practical Oracles","created":"2025-12-02","cited_by_count":0,"area":"alignment"},{"id":"2512.10427","title":"Renormalizable Spectral-Shell Dynamics as the Origin of Neural Scaling Laws","created":"2025-12-11","cited_by_count":0,"area":null},{"id":"2512.18209","title":"When Does Learning Renormalize? Sufficient Conditions for Power Law Spectral Dynamics","created":"2025-12-20","cited_by_count":0,"area":null},{"id":"2602.05702","title":"Broken neural scaling laws in materials science","created":"2026-02-05","cited_by_count":0,"area":null},{"id":"2605.09154","title":"Predicting Large Model Test Losses with a Noisy Quadratic System","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.09189","title":"Practical Scaling Laws: Converting Compute into Performance in a Data-Constrained World","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.10395","title":"Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2606.07247","title":"Theory of learning of high-dimensional controlled non-linear dynamical systems (I): models and methods","created":"2026-06-05","cited_by_count":0,"area":null},{"id":"2606.26617","title":"Sketched Linear Contrastive Learning: Approximation, Optimization, and Statistical Scaling","created":"2026-06-25","cited_by_count":0,"area":null},{"id":"2606.28242","title":"How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2607.15449","title":"Relevant and Irrelevant: A Renormalization Group Analysis of Transformer Attention","created":"2026-07-16","cited_by_count":0,"area":null},{"id":"2608.15239","title":"Learning reshapes power-law anisotropy in internal representations","created":"2026-08-15","cited_by_count":0,"area":null}],"next_cursor":"100"}