{"total":62,"rows":[{"id":"2402.12354","title":"LoRA+: Efficient Low Rank Adaptation of Large Models","created":"2024-02-19","cited_by_count":377,"area":null},{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2411.04330","title":"Scaling Laws for Precision","created":"2024-11-07","cited_by_count":95,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2405.14813","title":"Scalable Optimization in the Modular Norm","created":"2024-05-23","cited_by_count":68,"area":null},{"id":"2502.05795","title":"The Curse of Depth in Large Language Models","created":"2025-02-09","cited_by_count":62,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2506.07900","title":"MiniCPM4: Ultra-Efficient LLMs on End Devices","created":"2025-06-09","cited_by_count":52,"area":null},{"id":"2405.13698","title":"How to set AdamW's weight decay as you scale model and dataset size","created":"2024-05-22","cited_by_count":43,"area":null},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39,"area":null},{"id":"2503.04715","title":"Predictable Scale: Part I, Step Law -- Optimal Hyperparameter Scaling Law in Large Language Model Pretraining","created":"2025-03-06","cited_by_count":34,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2505.19227","title":"Scaling Laws for Gradient Descent and Sign Descent for Linear Bigram Models under Zipf's Law","created":"2025-05-25","cited_by_count":24,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2512.05620","title":"Hyperparameter Transfer Enables Consistent Gains of Matrix-Preconditioned Optimizers Across Scales","created":"2025-12-05","cited_by_count":21,"area":null},{"id":"2502.06857","title":"Gemstones: A Model Suite for Multi-Faceted Scaling Laws","created":"2025-02-07","cited_by_count":20,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2509.10167","title":"The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram","created":"2025-09-12","cited_by_count":17,"area":null},{"id":"2405.15743","title":"Sparse maximal update parameterization: A holistic approach to sparse training dynamics","created":"2024-05-24","cited_by_count":16,"area":null},{"id":"2505.23194","title":"Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics","created":"2025-05-29","cited_by_count":16,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2606.18524","title":"On the Residual Scaling of Looped Transformers: Stability and Transferability","created":"2026-06-16","cited_by_count":10,"area":null},{"id":"2410.05838","title":"Time Transfer: On Optimal Learning Rate and Batch Size In The Infinite Data Limit","created":"2024-10-08","cited_by_count":9,"area":null},{"id":"2509.25087","title":"Scaling with Collapse: Efficient and Predictable Training of LLM Families","created":"2025-09-29","cited_by_count":9,"area":null},{"id":"2602.21341","title":"Scaling View Synthesis Transformers","created":"2026-02-24","cited_by_count":9,"area":null},{"id":"2510.03871","title":"Optimal Scaling Needs Optimal Norm","created":"2025-10-04","cited_by_count":8,"area":null},{"id":"2407.04117","title":"Predictive Coding Networks and Inference Learning: Tutorial and Survey","created":"2024-07-04","cited_by_count":7,"area":null},{"id":"2512.22768","title":"Understanding the Mechanisms of Fast Hyperparameter Transfer","created":"2025-12-28","cited_by_count":7,"area":null},{"id":"2602.04774","title":"Theory of Optimal Learning Rate Schedules and Scaling Laws for a Random Feature Model","created":"2026-02-04","cited_by_count":7,"area":null},{"id":"2607.13491","title":"DeepLoop: Depth Scaling for Looped Transformers","created":"2026-07-15","cited_by_count":7,"area":null},{"id":"2506.15025","title":"Optimal Embedding Learning Rate in LLMs: The Effect of Vocabulary Size","created":"2025-06-17","cited_by_count":6,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2601.13308","title":"Scaling laws for amplitude surrogates","created":"2026-01-19","cited_by_count":6,"area":null},{"id":"2502.17405","title":"Function-Space Learning Rates","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2512.04165","title":"Mitigating the Curse of Detail: Scaling Arguments for Feature Learning and Sample Complexity","created":"2025-12-03","cited_by_count":4,"area":null},{"id":"2511.01734","title":"A Proof of Learning Rate Transfer under $\\mu$P","created":"2025-11-03","cited_by_count":3,"area":null},{"id":"2604.27077","title":"Learning Rate Transfer in Normalized Transformers","created":"2026-04-29","cited_by_count":3,"area":null},{"id":"2602.07697","title":"On the Infinite Width and Depth Limits of Predictive Coding Networks","created":"2026-02-07","cited_by_count":2,"area":null},{"id":"2602.10300","title":"Configuration-to-Performance Scaling Law with Neural Ansatz","created":"2026-02-10","cited_by_count":2,"area":null},{"id":"2605.21486","title":"Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate","created":"2026-05-20","cited_by_count":2,"area":null},{"id":"2606.20299","title":"Statistical Properties of Training & Generalization","created":"2026-06-18","cited_by_count":2,"area":null},{"id":"2606.29158","title":"On the Nonlinearity of Learning Rate Scaling for LLM Training","created":"2026-06-28","cited_by_count":2,"area":null},{"id":"2607.14018","title":"Transforming Rank: How Architecture Navigates the Spectral Pathologies of Depth","created":"2026-07-15","cited_by_count":2,"area":null},{"id":"2506.19396","title":"Maximal Update Parametrization and Zero-Shot Hyperparameter Transfer for Fourier Neural Operators","created":"2025-06-24","cited_by_count":1,"area":null},{"id":"2602.07494","title":"Hyperparameter Transfer Laws for Non-Recurrent Multi-Path Neural Networks","created":"2026-02-07","cited_by_count":1,"area":null},{"id":"2403.05532","title":"Twin: Tuning Learning Rate and Weight Decay of Deep Homogeneous Classifiers without Validation","created":"2024-03-08","cited_by_count":0,"area":null},{"id":"2503.23982","title":"Deep Neural Nets as Hamiltonians","created":"2025-03-31","cited_by_count":0,"area":null},{"id":"2512.21075","title":"Feature Learning Dynamics in Infinite-Depth Neural Networks","created":"2025-12-24","cited_by_count":0,"area":null},{"id":"2606.28242","title":"How Width and Data Shape Generalization Scaling Laws in Quadratic Neural Networks","created":"2026-06-26","cited_by_count":0,"area":null},{"id":"2606.30831","title":"Geometric Dyson Brownian Motions and the Free Log-Normal Limit for a Non-Square Gaussian Matrix Product","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2607.05019","title":"Beyond Modality Fusion: Deep Ensembles for Multimodal Classification","created":"2026-07-06","cited_by_count":0,"area":null},{"id":"2607.07884","title":"Optimal Learning Rate Scaling Depends on Data in Deep Scalar Linear Networks","created":"2026-07-08","cited_by_count":0,"area":null},{"id":"2608.15239","title":"Learning reshapes power-law anisotropy in internal representations","created":"2026-08-15","cited_by_count":0,"area":null},{"id":"2609.32060","title":"Depth Laws for the Precision Floor of Trained Neural Networks: Amplification, Residual Scaling, and a Quantization-Aware Training Paradox","created":"2026-09-25","cited_by_count":0,"area":null},{"id":"2609.34493","title":"LLN: Learnable Lens Networks for Parameter-Efficient Long-Horizon Dynamical Prediction","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2610.14344","title":"On the Depth Transfer of Neural Optimizers via L-Smoothness","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}