{"total":105,"rows":[{"id":"2402.01092","title":"A Dynamical Model of Neural Scaling Laws","created":"2024-02-02","cited_by_count":111,"area":null},{"id":"2310.17813","title":"A Spectral Condition for Feature Learning","created":"2023-10-26","cited_by_count":109,"area":null},{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2410.21676","title":"How Does Critical Batch Size Scale in Pre-training?","created":"2024-10-29","cited_by_count":73,"area":null},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66,"area":null},{"id":"2409.17858","title":"How Feature Learning Can Improve Neural Scaling Laws","created":"2024-09-26","cited_by_count":56,"area":null},{"id":"2310.03789","title":"Grokking as a First Order Phase Transition in Two Layer Networks","created":"2023-10-05","cited_by_count":48,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40,"area":null},{"id":"2405.15712","title":"Infinite Limits of Multi-head Transformer Dynamics","created":"2024-05-24","cited_by_count":39,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2504.12532","title":"Generalization through variance: how noise shapes inductive biases in diffusion models","created":"2025-04-16","cited_by_count":23,"area":"diffusion"},{"id":"2311.02076","title":"Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos","created":"2023-11-03","cited_by_count":22,"area":null},{"id":"2507.02119","title":"Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks","created":"2025-07-02","cited_by_count":22,"area":null},{"id":"2512.05620","title":"Hyperparameter Transfer Enables Consistent Gains of Matrix-Preconditioned Optimizers Across Scales","created":"2025-12-05","cited_by_count":21,"area":null},{"id":"2211.16980","title":"Infinite-width limit of deep linear neural networks","created":"2022-11-29","cited_by_count":20,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2210.02157","title":"The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks","created":"2022-10-05","cited_by_count":19,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2405.17580","title":"Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes","created":"2024-05-27","cited_by_count":18,"area":null},{"id":"2509.10167","title":"The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram","created":"2025-09-12","cited_by_count":17,"area":null},{"id":"2510.01098","title":"Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time","created":"2025-10-01","cited_by_count":16,"area":null},{"id":"2312.12226","title":"On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width","created":"2023-12-19","cited_by_count":15,"area":null},{"id":"2407.10315","title":"Order parameters and phase transitions of continual learning in deep neural networks","created":"2024-07-14","cited_by_count":14,"area":null},{"id":"2409.18061","title":"Optimal Protocols for Continual Learning via Statistical Physics and Control Theory","created":"2024-09-26","cited_by_count":14,"area":null},{"id":"2506.06489","title":"Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks","created":"2025-06-06","cited_by_count":14,"area":null},{"id":"2402.05173","title":"Towards Understanding Inductive Bias in Transformers: A View From Infinity","created":"2024-02-07","cited_by_count":13,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2502.07998","title":"Adaptive kernel predictors from feature-learning infinite limits of neural networks","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2601.20205","title":"Hyperparameter Transfer with Mixture-of-Expert Layers","created":"2026-01-28","cited_by_count":13,"area":"moe"},{"id":"2406.03260","title":"Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers","created":"2024-06-05","cited_by_count":12,"area":null},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12,"area":null},{"id":"2406.16689","title":"Coding schemes in neural networks learning classification tasks","created":"2024-06-24","cited_by_count":11,"area":null},{"id":"2505.17958","title":"The Nuclear Route: Sharp Asymptotics of ERM in Overparameterized Quadratic Networks","created":"2025-05-23","cited_by_count":11,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2502.03210","title":"From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning","created":"2025-02-05","cited_by_count":10,"area":null},{"id":"2405.15926","title":"Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers","created":"2024-05-24","cited_by_count":9,"area":null},{"id":"2405.17538","title":"Bayesian RG Flow in Neural Network Field Theories","created":"2024-05-27","cited_by_count":9,"area":null},{"id":"2510.15262","title":"Robust Layerwise Scaling Rules by Proper Weight Decay Tuning","created":"2025-10-17","cited_by_count":8,"area":null},{"id":"2305.07715","title":"Field theory for optimal signal propagation in ResNets","created":"2023-05-12","cited_by_count":6,"area":null},{"id":"2305.08459","title":"Introduction to dynamical mean-field theory of randomly connected neural networks with bidirectionally correlated couplings","created":"2023-05-15","cited_by_count":6,"area":null},{"id":"2309.04522","title":"Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics","created":"2023-09-08","cited_by_count":6,"area":null},{"id":"2503.02526","title":"A Theory of Initialisation's Impact on Specialisation","created":"2025-03-04","cited_by_count":6,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2605.07870","title":"Spectral Dynamics in Deep Networks: Feature Learning, Outlier Escape, and Learning Rate Transfer","created":"2026-05-08","cited_by_count":6,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2408.00082","title":"TASI Lectures on Physics for Machine Learning","created":"2024-07-31","cited_by_count":5,"area":null},{"id":"2305.19394","title":"Synaptic Weight Distributions Depend on the Geometry of Plasticity","created":"2023-05-30","cited_by_count":4,"area":null},{"id":"2310.19919","title":"Meta-Learning Strategies through Value Maximization in Neural Networks","created":"2023-10-30","cited_by_count":4,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2404.11754","title":"Differentiated Aggregation to Improve Generalization in Federated Learning","created":"2024-04-17","cited_by_count":4,"area":null},{"id":"2411.02001","title":"Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation","created":"2024-11-04","cited_by_count":4,"area":null},{"id":"2502.17405","title":"Function-Space Learning Rates","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2505.21722","title":"Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape","created":"2025-05-27","cited_by_count":4,"area":null},{"id":"2510.09816","title":"A mathematical theory for understanding when abstract representations emerge in neural networks","created":"2025-10-10","cited_by_count":4,"area":null},{"id":"2512.04165","title":"Mitigating the Curse of Detail: Scaling Arguments for Feature Learning and Sample Complexity","created":"2025-12-03","cited_by_count":4,"area":null},{"id":"2402.04751","title":"Asymptotic Dynamics of Alternating Minimization for Bilinear Regression","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2507.04448","title":"Transfer Learning in Infinite Width Feature Learning Networks","created":"2025-07-06","cited_by_count":3,"area":null},{"id":"2507.07907","title":"A statistical physics framework for optimal learning","created":"2025-07-10","cited_by_count":3,"area":null},{"id":"2602.05184","title":"Towards Worst-Case Guarantees with Scale-Aware Interpretability","created":"2026-02-05","cited_by_count":3,"area":null},{"id":"2604.27077","title":"Learning Rate Transfer in Normalized Transformers","created":"2026-04-29","cited_by_count":3,"area":null},{"id":"2404.19719","title":"The lazy (NTK) and rich ($\\mu$P) regimes: a gentle tutorial","created":"2024-04-30","cited_by_count":2,"area":null},{"id":"2407.19353","title":"Spring-block theory of feature learning in deep neural networks","created":"2024-07-28","cited_by_count":2,"area":null},{"id":"2410.17998","title":"Estimating the Spectral Moments of the Kernel Integral Operator from Finite Sample Matrices","created":"2024-10-23","cited_by_count":2,"area":null},{"id":"2411.17807","title":"A solvable generative model with a linear, one-step denoiser","created":"2024-11-26","cited_by_count":2,"area":"diffusion"},{"id":"2503.09781","title":"Learning richness modulates equality reasoning in neural networks","created":"2025-03-12","cited_by_count":2,"area":null},{"id":"2507.05035","title":"Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens","created":"2025-07-07","cited_by_count":2,"area":null},{"id":"2510.01930","title":"Precise Dynamics of Diagonal Linear Networks: A Unifying Analysis by Dynamical Mean-Field Theory","created":"2025-10-02","cited_by_count":2,"area":null},{"id":"2602.07697","title":"On the Infinite Width and Depth Limits of Predictive Coding Networks","created":"2026-02-07","cited_by_count":2,"area":null},{"id":"2602.15593","title":"A unified theory of feature learning in RNNs and DNNs","created":"2026-02-17","cited_by_count":2,"area":null},{"id":"2605.21486","title":"Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate","created":"2026-05-20","cited_by_count":2,"area":null},{"id":"2310.01683","title":"Commutative Width and Depth Scaling in Deep Neural Networks","created":"2023-10-02","cited_by_count":1,"area":null},{"id":"2407.18807","title":"When narrower is better: the narrow width limit of Bayesian parallel branching neural networks","created":"2024-07-26","cited_by_count":1,"area":null},{"id":"2506.24120","title":"Data Uniformity Improves Training Efficiency and More, with a Convergence Framework Beyond the NTK Regime","created":"2025-06-30","cited_by_count":1,"area":null},{"id":"2605.01107","title":"Diffusion Operator Geometry of Feedforward Representations","created":"2026-05-01","cited_by_count":1,"area":null},{"id":"2605.29684","title":"Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regime","created":"2026-05-28","cited_by_count":1,"area":null},{"id":"2307.04841","title":"Loss Dynamics of Temporal Difference Reinforcement Learning","created":"2023-07-10","cited_by_count":0,"area":null},{"id":"2402.06525","title":"Flexible Infinite-Width Graph Convolutional Neural Networks","created":"2024-02-09","cited_by_count":0,"area":null},{"id":"2410.03972","title":"Measuring and Controlling Solution Degeneracy across Task-Trained Recurrent Neural Networks","created":"2024-10-04","cited_by_count":0,"area":null},{"id":"2411.03541","title":"Do Mice Grok? Glimpses of Hidden Progress During Overtraining in Sensory Cortex","created":"2024-11-05","cited_by_count":0,"area":null},{"id":"2412.18756","title":"Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories","created":"2024-12-25","cited_by_count":0,"area":null},{"id":"2501.09659","title":"Fokker-Planck to Callan-Symanzik: evolution of weight matrices under training","created":"2025-01-16","cited_by_count":0,"area":null},{"id":"2502.05407","title":"Dictionary Learning: The Complexity of Learning Sparse Superposed Features with Feedback","created":"2025-02-08","cited_by_count":0,"area":null},{"id":"2503.23982","title":"Deep Neural Nets as Hamiltonians","created":"2025-03-31","cited_by_count":0,"area":null},{"id":"2504.19657","title":"Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networks","created":"2025-04-28","cited_by_count":0,"area":null},{"id":"2510.15174","title":"A simple mean field model of feature learning","created":"2025-10-16","cited_by_count":0,"area":null},{"id":"2602.00827","title":"Over-Alignment vs Over-Fitting: The Role of Feature Learning Strength in Generalization","created":"2026-01-31","cited_by_count":0,"area":null},{"id":"2602.03066","title":"Shortcut Features as Top Eigenfunctions of NTK: A Linear Neural Network Case and More","created":"2026-02-03","cited_by_count":0,"area":null},{"id":"2602.07378","title":"Dichotomy of Feature Learning and Unlearning: Fast-Slow Analysis on Neural Networks with Stochastic Gradient Descent","created":"2026-02-07","cited_by_count":0,"area":"safety"},{"id":"2603.09310","title":"A Gaussian Comparison Theorem for Training Dynamics in Machine Learning","created":"2026-03-10","cited_by_count":0,"area":null},{"id":"2605.21648","title":"Dropout Universality: Scaling Laws and Optimal Scheduling at the Edge-of-Chaos","created":"2026-05-20","cited_by_count":0,"area":null}],"next_cursor":"100"}