{"total":39,"rows":[{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39,"area":null},{"id":"2509.14786","title":"Pre-training under infinite compute","created":"2025-09-18","cited_by_count":29,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2512.05620","title":"Hyperparameter Transfer Enables Consistent Gains of Matrix-Preconditioned Optimizers Across Scales","created":"2025-12-05","cited_by_count":21,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2312.12226","title":"On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width","created":"2023-12-19","cited_by_count":15,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2410.08194","title":"Features are fate: a theory of transfer learning in high-dimensional regression","created":"2024-10-10","cited_by_count":13,"area":null},{"id":"2502.07998","title":"Adaptive kernel predictors from feature-learning infinite limits of neural networks","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2502.03210","title":"From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning","created":"2025-02-05","cited_by_count":10,"area":null},{"id":"2605.29548","title":"Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention","created":"2026-05-28","cited_by_count":10,"area":null},{"id":"2509.25087","title":"Scaling with Collapse: Efficient and Predictable Training of LLM Families","created":"2025-09-29","cited_by_count":9,"area":null},{"id":"2502.09863","title":"Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models","created":"2025-02-14","cited_by_count":8,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2605.07870","title":"Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer","created":"2026-05-08","cited_by_count":6,"area":null},{"id":"2411.02001","title":"Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation","created":"2024-11-04","cited_by_count":4,"area":null},{"id":"2510.07554","title":"Phase Diagram of Dropout for Two-Layer Neural Networks in the Mean-Field Regime","created":"2025-10-08","cited_by_count":3,"area":null},{"id":"2511.07892","title":"A Generalized Spectral Framework to Expain Neural Scaling and Compression Dynamics","created":"2025-11-11","cited_by_count":3,"area":null},{"id":"2404.19719","title":"The lazy (NTK) and rich ($\\mu$P) regimes: a gentle tutorial","created":"2024-04-30","cited_by_count":2,"area":null},{"id":"2405.14650","title":"PhiNets: Brain-inspired Non-contrastive Learning Based on Temporal Prediction Hypothesis","created":"2024-05-23","cited_by_count":2,"area":null},{"id":"2410.17998","title":"Estimating the Spectral Moments of the Kernel Integral Operator from Finite Sample Matrices","created":"2024-10-23","cited_by_count":2,"area":null},{"id":"2509.25380","title":"Predicting Training Re-evaluation Curves Enables Effective Data Curriculums for LLMs","created":"2025-09-29","cited_by_count":2,"area":null},{"id":"2407.18807","title":"When narrower is better: the narrow width limit of Bayesian parallel branching neural networks","created":"2024-07-26","cited_by_count":1,"area":null},{"id":"2412.05418","title":"No Free Lunch From Random Feature Ensembles: Scaling Laws and Near-Optimality Conditions","created":"2024-12-06","cited_by_count":1,"area":null},{"id":"2505.16260","title":"Small-to-Large Generalization: Data Influences Models Consistently Across Scale","created":"2025-05-22","cited_by_count":1,"area":null},{"id":"2402.06525","title":"Flexible Infinite-Width Graph Convolutional Neural Networks","created":"2024-02-09","cited_by_count":0,"area":null},{"id":"2503.02057","title":"Hebbian learning the local structure of language","created":"2025-03-03","cited_by_count":0,"area":null},{"id":"2509.12581","title":"Exploring Training Data Attribution under Limited Access Constraints","created":"2025-09-16","cited_by_count":0,"area":null},{"id":"2512.10427","title":"Renormalizable Spectral-Shell Dynamics as the Origin of Neural Scaling Laws","created":"2025-12-11","cited_by_count":0,"area":null},{"id":"2605.13405","title":"When is Warmstarting Effective for Scaling Language Models?","created":"2026-05-13","cited_by_count":0,"area":null},{"id":"2609.03117","title":"Kernel Reboot: Breaking the Boundaries of Neural Tangent Kernels for Neural Fields","created":"2026-09-02","cited_by_count":0,"area":null}],"next_cursor":null}