{"total":74,"rows":[{"id":"2409.11321","title":"SOAP: Improving and Stabilizing Shampoo using Adam","created":"2024-09-17","cited_by_count":192,"area":null},{"id":"2510.13786","title":"The Art of Scaling Reinforcement Learning Compute for LLMs","created":"2025-10-15","cited_by_count":101,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43,"area":null},{"id":"2407.07972","title":"Deconstructing What Makes a Good Optimizer for Language Models","created":"2024-07-10","cited_by_count":41,"area":null},{"id":"2507.07101","title":"Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful","created":"2025-07-09","cited_by_count":41,"area":null},{"id":"2412.04403","title":"Establishing Task Scaling Laws via Compute-Efficient Model Ladders","created":"2024-12-05","cited_by_count":35,"area":null},{"id":"2502.06042","title":"Scaling Laws for Forgetting during Finetuning with Pretraining Data Injection","created":"2025-02-09","cited_by_count":35,"area":null},{"id":"2502.15938","title":"Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs","created":"2025-02-21","cited_by_count":35,"area":null},{"id":"2503.04715","title":"Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining","created":"2025-03-06","cited_by_count":34,"area":null},{"id":"2410.11840","title":"A Hitchhiker's Guide to Scaling Law Estimation","created":"2024-10-15","cited_by_count":27,"area":null},{"id":"2502.18969","title":"(Mis)Fitting: A Survey of Scaling Laws","created":"2025-02-26","cited_by_count":26,"area":null},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23,"area":null},{"id":"2412.01505","title":"Scaling Law for Language Models Training Considering Batch Size","created":"2024-12-02","cited_by_count":22,"area":null},{"id":"2502.06857","title":"Gemstones: A Model Suite for Multi-Faceted Scaling Laws","created":"2025-02-07","cited_by_count":20,"area":null},{"id":"2510.05197","title":"Efficient Prediction of Pass@k Scaling in Large Language Models","created":"2025-10-06","cited_by_count":16,"area":null},{"id":"2411.12925","title":"Loss-to-Loss Prediction: Scaling Laws for All Datasets","created":"2024-11-19","cited_by_count":15,"area":null},{"id":"2601.10684","title":"On the origin of neural scaling laws: from random graphs to natural language","created":"2026-01-15","cited_by_count":14,"area":null},{"id":"2410.09005","title":"Analyzing Neural Scaling Laws in Two-Layer Networks with Power-Law Data Spectra","created":"2024-10-11","cited_by_count":9,"area":null},{"id":"2509.25087","title":"Scaling with Collapse: Efficient and Predictable Training of LLM Families","created":"2025-09-29","cited_by_count":9,"area":null},{"id":"2411.13055","title":"Hardware Scaling Trends and Diminishing Returns in Large-Scale Distributed Training","created":"2024-11-20","cited_by_count":8,"area":null},{"id":"2506.04598","title":"Scaling Laws for Robust Comparison of Open Foundation Language-Vision Models and Datasets","created":"2025-06-05","cited_by_count":8,"area":null},{"id":"2510.03871","title":"Optimal Scaling Needs Optimal Norm","created":"2025-10-04","cited_by_count":8,"area":null},{"id":"2505.22014","title":"Learning in Compact Spaces with Approximately Normalized Transformer","created":"2025-05-28","cited_by_count":6,"area":null},{"id":"2510.24626","title":"Relative Scaling Laws for LLMs","created":"2025-10-28","cited_by_count":6,"area":null},{"id":"2511.21622","title":"On the Origin of Algorithmic Progress in AI","created":"2025-11-26","cited_by_count":6,"area":null},{"id":"2601.13308","title":"Scaling laws for amplitude surrogates","created":"2026-01-19","cited_by_count":6,"area":null},{"id":"2605.12715","title":"Scaling Laws for Mixture Pretraining Under Data Constraints","created":"2026-05-12","cited_by_count":6,"area":null},{"id":"2509.24012","title":"Pretraining Scaling Laws for Generative Evaluations of Language Models","created":"2025-09-28","cited_by_count":5,"area":null},{"id":"2601.12186","title":"Aletheia: What Makes RLVR For Code Verifiers Tick?","created":"2026-01-17","cited_by_count":5,"area":null},{"id":"2506.20752","title":"Characterization and Mitigation of Training Instabilities in Microscaling Formats","created":"2025-06-25","cited_by_count":4,"area":null},{"id":"2509.25049","title":"Efficient Hyperparameter Tuning via Trajectory Invariance Principle","created":"2025-09-29","cited_by_count":4,"area":null},{"id":"2601.02031","title":"Output Embedding Centering for Stable LLM Pretraining","created":"2026-01-05","cited_by_count":4,"area":null},{"id":"2602.01642","title":"The Effect of Mini-Batch Noise on the Implicit Bias of Adam","created":"2026-02-02","cited_by_count":4,"area":null},{"id":"2603.06603","title":"Scale Dependent Data Duplication","created":"2026-02-18","cited_by_count":4,"area":null},{"id":"2605.01188","title":"Compute Optimal Tokenization","created":"2026-05-02","cited_by_count":4,"area":null},{"id":"2606.24998","title":"Internal Data Repetition Destroys Language Models","created":"2026-06-23","cited_by_count":4,"area":null},{"id":"2510.02228","title":"xLSTM Scaling Laws: Competitive Performance with Linear Time-Complexity","created":"2025-10-02","cited_by_count":3,"area":null},{"id":"2512.23407","title":"Theoretical Foundations of Scaling Law in Familial Models","created":"2025-12-29","cited_by_count":3,"area":null},{"id":"2602.07145","title":"Convex Dominance in Deep Learning I: A Scaling Law of Loss and Learning Rate","created":"2026-02-06","cited_by_count":3,"area":null},{"id":"2604.22753","title":"Spend Less, Fit Better: Budget-Efficient Scaling Law Fitting via Active Experiment Selection","created":"2026-04-24","cited_by_count":3,"area":null},{"id":"2607.08077","title":"Modular Pretraining Enables Access Control","created":"2026-07-09","cited_by_count":3,"area":null},{"id":"2608.07222","title":"Skaling: Chinchilla's Exponents Meet Kaplan's Coupling","created":"2026-08-07","cited_by_count":3,"area":null},{"id":"2504.10735","title":"Frozen Layers: Memory-efficient Many-fidelity Hyperparameter Optimization","created":"2025-04-14","cited_by_count":2,"area":null},{"id":"2507.10613","title":"Sub-Scaling Laws: On the Role of Data Density and Training Strategies in LLMs","created":"2025-07-13","cited_by_count":2,"area":null},{"id":"2509.23963","title":"Evaluating the Robustness of Chinchilla Compute-Optimal Scaling","created":"2025-09-28","cited_by_count":2,"area":null},{"id":"2509.25380","title":"Predicting Training Re-evaluation Curves Enables Effective Data Curriculums for LLMs","created":"2025-09-29","cited_by_count":2,"area":null},{"id":"2510.06548","title":"Reusing Overtrained Language Models Saturates Scaling","created":"2025-10-08","cited_by_count":2,"area":null},{"id":"2510.26064","title":"Towards Scaling Laws for Symbolic Regression","created":"2025-10-30","cited_by_count":2,"area":null},{"id":"2601.04301","title":"Quantifying the Effect of Test Set Contamination on Generative Evaluations","created":"2026-01-07","cited_by_count":2,"area":null},{"id":"2602.10300","title":"Configuration-to-Performance Scaling Law with Neural Ansatz","created":"2026-02-10","cited_by_count":2,"area":null},{"id":"2605.21486","title":"Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate","created":"2026-05-20","cited_by_count":2,"area":null},{"id":"2606.29158","title":"On the Nonlinearity of Learning Rate Scaling for LLM Training","created":"2026-06-28","cited_by_count":2,"area":null},{"id":"2608.11859","title":"Small-Scale Experiments: Are We There Yet?","created":"2026-08-12","cited_by_count":2,"area":null},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2606.29858","title":"Smooth Scaling Laws Hide Stepwise Token Learning","created":"2026-06-29","cited_by_count":1,"area":null},{"id":"2607.01487","title":"How to Allocate Your Tokens? Scaling Laws with Training Steps and Batch Size","created":"2026-07-01","cited_by_count":1,"area":null},{"id":"2608.28308","title":"Deriving Scaling Laws for OpenEuroLLM Models: Learning Rate, Batch Size and Loss","created":"2026-08-28","cited_by_count":1,"area":null},{"id":"2609.32534","title":"DepthBench: Measuring How Residual Connections Enable More Computational Depth","created":"2026-09-26","cited_by_count":1,"area":null},{"id":"2505.09329","title":"BioVFM-21M: Benchmarking and Scaling Self-Supervised Vision Foundation Models for Biomedical Image Analysis","created":"2025-05-14","cited_by_count":0,"area":null},{"id":"2509.18771","title":"Experience Scaling: Post-Deployment Evolution For Large Language Models","created":"2025-09-23","cited_by_count":0,"area":null},{"id":"2601.22614","title":"Stabilizing Transformer Training Through Consensus","created":"2026-01-30","cited_by_count":0,"area":null},{"id":"2605.08541","title":"Tokens-per-Parameter Coverage Is Critical for Robust LLM Scaling Law Extrapolation","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2605.09189","title":"Practical Scaling Laws: Converting Compute into Performance in a Data-Constrained World","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2605.13225","title":"Mix, Don't Tune: Bilingual Pre-Training Outperforms Hyperparameter Search in Data-Constrained Settings","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.13405","title":"When is Warmstarting Effective for Scaling Language Models?","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2605.29448","title":"How Much Is a Dataset Worth? Scaling Laws, the Vendi Score, and Matrix Spectral Functions","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2606.02078","title":"Beyond $\\ell_2$-norm and $\\ell_\\infty$-norm: A Curvature-Inspired $\\ell_p$-Norm Scheme for Deep Neural Networks","created":"2026-06-01","cited_by_count":0,"area":null},{"id":"2608.16760","title":"On the Principles Behind Neural Network Optimizers","created":"2026-08-17","cited_by_count":0,"area":null},{"id":"2609.05016","title":"Amortizing Scaling Law Construction Costs","created":"2026-09-04","cited_by_count":0,"area":null},{"id":"2609.33041","title":"Balancing Early Performance Sacrifices with Long-Term Gains: Scaling Learning-Rate Warmup Duration Across Training Horizons","created":"2026-09-27","cited_by_count":0,"area":null},{"id":"2609.35707","title":"ScAn-Bench: Evaluating Scaling Analysis Methodology","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.06784","title":"How to scale your HEP ML models: A recipe for robust architecture comparisons at scale","created":"2026-10-05","cited_by_count":0,"area":null}],"next_cursor":null}