{"total":35,"rows":[{"id":"2512.22382","title":"Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration","created":"2025-12-26","cited_by_count":27,"area":null},{"id":"2505.23971","title":"Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training","created":"2025-05-29","cited_by_count":23,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2512.05620","title":"Hyperparameter Transfer Enables Consistent Gains of Matrix-Preconditioned Optimizers Across Scales","created":"2025-12-05","cited_by_count":21,"area":null},{"id":"2510.19093","title":"Weight Decay may matter more than muP for Learning Rate Transfer in Practice","created":"2025-10-21","cited_by_count":20,"area":null},{"id":"2505.23725","title":"MuLoCo: Muon is a practical inner optimizer for DiLoCo","created":"2025-05-29","cited_by_count":18,"area":null},{"id":"2603.15958","title":"Deriving Hyperparameter Scaling Laws via Modern Optimization Theory","created":"2026-03-16","cited_by_count":10,"area":null},{"id":"2509.25087","title":"Scaling with Collapse: Efficient and Predictable Training of LLM Families","created":"2025-09-29","cited_by_count":9,"area":null},{"id":"2510.03871","title":"Optimal Scaling Needs Optimal Norm","created":"2025-10-04","cited_by_count":8,"area":null},{"id":"2603.21191","title":"On the Role of Batch Size in Stochastic Conditional Gradient Methods","created":"2026-03-22","cited_by_count":7,"area":null},{"id":"2510.14717","title":"Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling","created":"2025-10-16","cited_by_count":6,"area":null},{"id":"2512.08894","title":"Revisiting the Scaling Properties of Downstream Metrics in Large Language Model Training","created":"2025-12-09","cited_by_count":6,"area":null},{"id":"2606.25008","title":"Neural Scaling Universality: If Exponents Are Fixed, Time to Understand Coefficients","created":"2026-06-23","cited_by_count":5,"area":null},{"id":"2509.25049","title":"Efficient Hyperparameter Tuning via Trajectory Invariance Principle","created":"2025-09-29","cited_by_count":4,"area":null},{"id":"2602.11137","title":"Weight Decay Improves Language Model Plasticity","created":"2026-02-11","cited_by_count":4,"area":null},{"id":"2607.22444","title":"Hyperball May Not Be a Free Lunch","created":"2026-07-24","cited_by_count":4,"area":null},{"id":"2509.25380","title":"Predicting Training Re-evaluation Curves Enables Effective Data Curriculums for LLMs","created":"2025-09-29","cited_by_count":2,"area":null},{"id":"2602.10300","title":"Configuration-to-Performance Scaling Law with Neural Ansatz","created":"2026-02-10","cited_by_count":2,"area":null},{"id":"2605.21486","title":"Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate","created":"2026-05-20","cited_by_count":2,"area":null},{"id":"2606.29158","title":"On the Nonlinearity of Learning Rate Scaling for LLM Training","created":"2026-06-28","cited_by_count":2,"area":null},{"id":"2608.11859","title":"Small-Scale Experiments: Are We There Yet?","created":"2026-08-12","cited_by_count":2,"area":null},{"id":"2605.15290","title":"GQA-{\\mu}P: The maximal parameterization update for grouped query attention","created":"2026-05-14","cited_by_count":1,"area":null},{"id":"2605.23591","title":"Asymmetric Scaling Laws from Sparse Features","created":"2026-05-22","cited_by_count":1,"area":null},{"id":"2605.29387","title":"On the Optimizer Dependence of Neural Scaling Laws","created":"2026-05-28","cited_by_count":1,"area":null},{"id":"2606.06418","title":"Double Preconditioning (DoPr): Optimization for Test-Time Performance, not Validation Loss","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2607.01487","title":"How to Allocate Your Tokens? Scaling Laws with Training Steps and Batch Size","created":"2026-07-01","cited_by_count":1,"area":null},{"id":"2607.27731","title":"Towards joint scaling laws with optimal batch size schedules","created":"2026-07-30","cited_by_count":1,"area":null},{"id":"2608.28308","title":"Deriving Scaling Laws for OpenEuroLLM Models: Learning Rate, Batch Size and Loss","created":"2026-08-28","cited_by_count":1,"area":null},{"id":"2605.08541","title":"Tokens-per-Parameter Coverage Is Critical for Robust LLM Scaling Law Extrapolation","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2605.09154","title":"Predicting Large Model Test Losses with a Noisy Quadratic System","created":"2026-05-09","cited_by_count":0,"area":null},{"id":"2606.05029","title":"Validity Threats for Foundation Model Research","created":"2026-06-03","cited_by_count":0,"area":null},{"id":"2609.05016","title":"Amortizing Scaling Law Construction Costs","created":"2026-09-04","cited_by_count":0,"area":null},{"id":"2609.32100","title":"Emergent One-Third Scaling Law as Attention Tries to Concentrate","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.33041","title":"Balancing Early Performance Sacrifices with Long-Term Gains: Scaling Learning-Rate Warmup Duration Across Training Horizons","created":"2026-09-27","cited_by_count":0,"area":null},{"id":"2609.37745","title":"Optimizer-dependent training dynamics converge to the same one-third optimal data scaling","created":"2026-09-29","cited_by_count":0,"area":null}],"next_cursor":null}