{"total":68,"rows":[{"id":"2406.19146","title":"Resolving Discrepancies in Compute-Optimal Scaling of Language Models","created":"2024-06-27","cited_by_count":88,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2502.08606","title":"Distillation Scaling Laws","created":"2025-02-12","cited_by_count":67,"area":"lr"},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2502.17578","title":"How Do Large Language Monkeys Get Their Power (Laws)?","created":"2025-02-24","cited_by_count":43,"area":"safety"},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2409.15156","title":"Rethinking Conventional Wisdom in Machine Learning: From Generalization to Scaling","created":"2024-09-23","cited_by_count":23,"area":"lr"},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23,"area":null},{"id":"2410.18837","title":"High-dimensional Analysis of Knowledge Distillation: Weak-to-Strong Generalization and Scaling Laws","created":"2024-10-24","cited_by_count":22,"area":"distill"},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2509.24882","title":"Scaling Laws and Spectra of Shallow Neural Networks in the Feature Learning Regime","created":"2025-09-29","cited_by_count":20,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2503.02877","title":"Weak-to-Strong Generalization Even in Random Feature Networks, Provably","created":"2025-03-04","cited_by_count":15,"area":null},{"id":"2601.10684","title":"On the origin of neural scaling laws: from random graphs to natural language","created":"2026-01-15","cited_by_count":14,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2502.03009","title":"Scaling Laws for Upcycling Mixture-of-Experts Language Models","created":"2025-02-05","cited_by_count":13,"area":"moe"},{"id":"2506.08415","title":"Improved Scaling Laws in Linear Regression via Data Reuse","created":"2025-06-10","cited_by_count":11,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2510.04780","title":"Kernel ridge regression under power-law data: spectrum and generalization","created":"2025-10-06","cited_by_count":10,"area":null},{"id":"2602.03685","title":"Universal One-third Time Scaling in Learning Peaked Distributions","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2602.03702","title":"Anytime Pretraining: Horizon-Free Learning-Rate Schedules with Weight Averaging","created":"2026-02-03","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9,"area":null},{"id":"2509.22341","title":"Preventing Model Collapse Under Overparametrization: Optimal Mixing Ratios for Interpolation Learning and Ridge Regression","created":"2025-09-26","cited_by_count":9,"area":"synth"},{"id":"2602.05846","title":"Optimal scaling laws in learning hierarchical multi-index models","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2510.00537","title":"Spectral Scaling Laws in Language Models: How Effectively Do Feed-Forward Networks Use Their Latent Space?","created":"2025-10-01","cited_by_count":8,"area":null},{"id":"2602.06797","title":"Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay","created":"2026-02-06","cited_by_count":8,"area":null},{"id":"2412.11979","title":"AlphaZero Neural Scaling and Zipf's Law: a Tale of Board Games and Power Laws","created":"2024-12-16","cited_by_count":7,"area":null},{"id":"2502.05074","title":"Two-Point Deterministic Equivalence for Stochastic Gradient Dynamics in Linear Models","created":"2025-02-07","cited_by_count":7,"area":null},{"id":"2602.04774","title":"Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model","created":"2026-02-04","cited_by_count":7,"area":null},{"id":"2509.24914","title":"Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws","created":"2025-09-29","cited_by_count":6,"area":null},{"id":"2509.25346","title":"SynthPert: Enhancing LLM Biological Reasoning via Synthetic Reasoning Traces for Cellular Perturbation Prediction","created":"2025-09-29","cited_by_count":6,"area":"lr"},{"id":"2601.22652","title":"Spectral Gradient Descent Mitigates Anisotropy-Driven Misalignment: A Case Study in Phase Retrieval","created":"2026-01-30","cited_by_count":6,"area":null},{"id":"2602.14208","title":"Fast Catch-Up, Late Switching: Optimal Batch Size Scheduling via Functional Scaling Laws","created":"2026-02-15","cited_by_count":6,"area":null},{"id":"2606.25008","title":"Neural Scaling Universality: If Exponents Are Fixed, Time to Understand Coefficients","created":"2026-06-23","cited_by_count":5,"area":null},{"id":"2506.15535","title":"A Simplified Analysis of SGD for Linear Regression with Weight Averaging","created":"2025-06-18","cited_by_count":4,"area":null},{"id":"2510.09768","title":"Scaling Laws and Symmetry, Evidence from Neural Force Fields","created":"2025-10-10","cited_by_count":4,"area":null},{"id":"2603.14578","title":"Power-Law Spectrum of the Random Feature Model","created":"2026-03-15","cited_by_count":4,"area":null},{"id":"2507.03404","title":"On the Effectiveness of the z-Transform Method in Quadratic Optimization","created":"2025-07-04","cited_by_count":3,"area":null},{"id":"2509.21049","title":"Physics of Learning: A Lagrangian perspective to different learning paradigms","created":"2025-09-25","cited_by_count":3,"area":null},{"id":"2509.22214","title":"A Law of Data Reconstruction for Random Features (and Beyond)","created":"2025-09-26","cited_by_count":3,"area":null},{"id":"2511.18661","title":"Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data","created":"2025-11-24","cited_by_count":3,"area":null},{"id":"2509.23963","title":"Evaluating the Robustness of Chinchilla Compute-Optimal Scaling","created":"2025-09-28","cited_by_count":2,"area":null},{"id":"2510.06548","title":"Reusing Overtrained Language Models Saturates Scaling","created":"2025-10-08","cited_by_count":2,"area":null},{"id":"2512.22088","title":"Unifying Learning Dynamics and Generalization in Transformers Scaling Law","created":"2025-12-26","cited_by_count":2,"area":null},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2509.10000","title":"Neural Scaling Laws for Deep Regression","created":"2025-09-12","cited_by_count":1,"area":null},{"id":"2602.02593","title":"Effective Frontiers: A Unification of Neural Scaling Laws","created":"2026-02-01","cited_by_count":1,"area":null},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2605.31244","title":"Spectral Reach: Understanding Neural Scaling as Progress into the Spectral Tail","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2606.08167","title":"Explaining Data Mixing Scaling Laws","created":"2026-06-06","cited_by_count":1,"area":null},{"id":"2510.17120","title":"Matricial Free Energy as a Gaussianizing Regularizer: Enhancing Autoencoders for Gaussian Code Generation","created":"2025-10-20","cited_by_count":0,"area":null},{"id":"2605.09154","title":"Predicting Large Model Test Losses with a Noisy Quadratic System","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.10395","title":"Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2605.16913","title":"A Fourier perspective on the learning dynamics of neural networks: from sample complexities to mechanistic insights","created":"2026-05-16","cited_by_count":0,"area":null},{"id":"2606.28242","title":"How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2608.28442","title":"Curvature-Conditioned Multiscale Momentum with Sphere Constraints for LLM Pretraining","created":"2026-08-28","cited_by_count":0,"area":null},{"id":"2609.02728","title":"Momentum in large-batch training: Polyak enlarges the critical batch size, Nesterov improves data efficiency","created":"2026-09-02","cited_by_count":0,"area":null},{"id":"2609.16262","title":"Compute-Optimal Pretrain--Fine-tune in Ridge Gradient Descent","created":"2026-09-14","cited_by_count":0,"area":null},{"id":"2609.32100","title":"Emergent One-Third Scaling Law as Attention Tries to Concentrate","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.37745","title":"Optimizer-dependent training dynamics converge to the same one-third optimal data scaling","created":"2026-09-29","cited_by_count":0,"area":null},{"id":"2609.38768","title":"Learning Under Forgetting: Statistical Support-Selective Retention in Stochastic Training Dynamics","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.00985","title":"Neural scaling laws and evolution of learnable activation functions of Kolmogorov-Arnold networks","created":"2026-10-01","cited_by_count":0,"area":null},{"id":"2610.13524","title":"Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}