{"total":115,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2102.11535","title":"Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective","created":"2021-02-23","cited_by_count":169,"area":null},{"id":"2105.06868","title":"Priors in Bayesian Deep Learning: A Review","created":"2021-05-14","cited_by_count":101,"area":null},{"id":"2402.18762","title":"Disentangling the Causes of Plasticity Loss in Neural Networks","created":"2024-02-29","cited_by_count":86,"area":"deeprl"},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66,"area":null},{"id":"2206.08720","title":"Fast Finite Width Neural Tangent Kernel","created":"2022-06-17","cited_by_count":62,"area":null},{"id":"2301.11300","title":"ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients","created":"2023-01-26","cited_by_count":58,"area":null},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57,"area":null},{"id":"2106.09017","title":"Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation","created":"2021-06-16","cited_by_count":50,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2302.06755","title":"Dataset Distillation with Convexified Implicit Gradients","created":"2023-02-13","cited_by_count":46,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2402.04980","title":"Asymptotics of feature learning in two-layer networks after one gradient-step","created":"2024-02-07","cited_by_count":38,"area":null},{"id":"2302.00401","title":"Deterministic equivalent and error universality of deep random features learning","created":"2023-02-01","cited_by_count":35,"area":null},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2110.08611","title":"Deep Active Learning by Leveraging Training Dynamics","created":"2021-10-16","cited_by_count":32,"area":null},{"id":"2202.00553","title":"Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization","created":"2022-02-01","cited_by_count":30,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2111.13807","title":"Offline Neural Contextual Bandits: Pessimism, Optimization and Generalization","created":"2021-11-27","cited_by_count":25,"area":"offlinerl"},{"id":"2212.12147","title":"The Onset of Variance-Limited Behavior for Networks in the Lazy and Rich Regimes","created":"2022-12-23","cited_by_count":25,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2210.00688","title":"On the infinite-depth limit of finite-width neural networks","created":"2022-10-03","cited_by_count":22,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2302.00453","title":"Width and Depth Limits Commute in Residual Networks","created":"2023-02-01","cited_by_count":21,"area":null},{"id":"2304.02034","title":"Effective Theory of Transformers at Initialization","created":"2023-04-04","cited_by_count":21,"area":null},{"id":"2406.19827","title":"Towards Stable and Storage-efficient Dataset Distillation: Matching Convexified Trajectory","created":"2024-06-28","cited_by_count":21,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19,"area":null},{"id":"2502.02531","title":"Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer","created":"2025-02-04","cited_by_count":19,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2102.10492","title":"Deep ReLU Networks Preserve Expected Length","created":"2021-02-21","cited_by_count":17,"area":null},{"id":"2205.15809","title":"Feature Learning in $L_{2}$-regularized DNNs: Attraction/Repulsion and Sparsity","created":"2022-05-31","cited_by_count":17,"area":null},{"id":"2110.08084","title":"Gradient Descent on Infinitely Wide Neural Networks: Global Convergence and Generalization","created":"2021-10-15","cited_by_count":16,"area":null},{"id":"2107.12530","title":"Convergence of Deep ReLU Networks","created":"2021-07-27","cited_by_count":15,"area":null},{"id":"2108.13097","title":"A theory of representation learning gives a deep generalisation of kernel methods","created":"2021-08-30","cited_by_count":15,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2302.01428","title":"Understanding Reconstruction Attacks with the Neural Tangent Kernel and Dataset Distillation","created":"2023-02-02","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2210.14019","title":"The Curious Case of Benign Memorization","created":"2022-10-25","cited_by_count":12,"area":null},{"id":"2301.00008","title":"Effects of Data Geometry in Early Deep Learning","created":"2022-12-29","cited_by_count":12,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2203.14328","title":"On the Neural Tangent Kernel Analysis of Randomly Pruned Neural Networks","created":"2022-03-27","cited_by_count":9,"area":null},{"id":"2205.12379","title":"Gaussian Pre-Activations in Neural Networks: Myth or Reality?","created":"2022-05-24","cited_by_count":9,"area":null},{"id":"2103.06671","title":"Sample Complexity of Offline Reinforcement Learning with Deep ReLU Networks","created":"2021-03-11","cited_by_count":8,"area":"offlinerl"},{"id":"2104.09023","title":"Unsupervised Shape Completion via Deep Prior in the Neural Tangent Kernel Perspective","created":"2021-04-19","cited_by_count":8,"area":null},{"id":"2207.09432","title":"Deep equilibrium networks are sensitive to initialization statistics","created":"2022-07-19","cited_by_count":8,"area":null},{"id":"2108.11939","title":"Understanding and Accelerating Neural Architecture Search with Training-Free and Theory-Grounded Metrics","created":"2021-08-26","cited_by_count":7,"area":null},{"id":"2209.08399","title":"Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$","created":"2022-09-17","cited_by_count":7,"area":null},{"id":"2302.03519","title":"Efficient Parametric Approximations of Neural Network Function Space Distance","created":"2023-02-07","cited_by_count":7,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2306.01692","title":"Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths","created":"2023-06-02","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2310.07765","title":"Feature Learning and Generalization in Deep Networks with Orthogonal Weights","created":"2023-10-11","cited_by_count":5,"area":null},{"id":"2108.00259","title":"How much pre-training is enough to discover a good subnetwork?","created":"2021-07-31","cited_by_count":4,"area":null},{"id":"2205.05662","title":"Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis","created":"2022-05-11","cited_by_count":4,"area":null},{"id":"2205.11786","title":"Transition to Linearity of General Neural Networks with Directed Acyclic Graph Architecture","created":"2022-05-24","cited_by_count":4,"area":null},{"id":"2310.12079","title":"Differential Equation Scaling Limits of Shaped and Unshaped Neural Networks","created":"2023-10-18","cited_by_count":4,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2406.02105","title":"Can Kernel Methods Explain How the Data Affects Neural Collapse?","created":"2024-06-04","cited_by_count":4,"area":null},{"id":"2508.11522","title":"Finite-Width Neural Tangent Kernels from Feynman Diagrams","created":"2025-08-15","cited_by_count":4,"area":null},{"id":"2110.02333","title":"On the Impact of Stable Ranks in Deep Nets","created":"2021-10-05","cited_by_count":3,"area":null},{"id":"2302.12780","title":"VIPeR: Provably Efficient Algorithm for Offline RL with Neural Function Approximation","created":"2023-02-24","cited_by_count":3,"area":"offlinerl"},{"id":"2309.09814","title":"Convolutional Deep Kernel Machines","created":"2023-09-18","cited_by_count":3,"area":null},{"id":"2507.14559","title":"LEAD: Exploring Logit Space Evolution for Model Selection","created":"2025-07-19","cited_by_count":3,"area":null},{"id":"2507.20853","title":"Geometry of Neural Reinforcement Learning in Continuous State and Action Spaces","created":"2025-07-28","cited_by_count":3,"area":"deeprl"},{"id":"2205.13076","title":"On Bridging the Gap between Mean Field and Finite Width in Deep Random Neural Networks with Batch Normalization","created":"2022-05-25","cited_by_count":2,"area":null},{"id":"2309.04860","title":"Approximation Results for Gradient Descent trained Neural Networks","created":"2023-09-09","cited_by_count":2,"area":null},{"id":"2312.17007","title":"On the rate of convergence of an over-parametrized Transformer classifier learned by gradient descent","created":"2023-12-28","cited_by_count":2,"area":null},{"id":"2505.19827","title":"Revisiting Glorot Initialization for Long-Range Linear Recurrences","created":"2025-05-26","cited_by_count":2,"area":null},{"id":"2605.08746","title":"The Global Empirical NTK: Self-Referential Bias and Dimensionality of Gradient Descent Learning","created":"2026-05-09","cited_by_count":2,"area":null},{"id":"2103.11558","title":"Weighted Neural Tangent Kernel: A Generalized and Improved Network-Induced Kernel","created":"2021-03-22","cited_by_count":1,"area":null},{"id":"2202.12297","title":"Embedded Ensembles: Infinite Width Limit and Operating Regimes","created":"2022-02-24","cited_by_count":1,"area":null},{"id":"2203.07411","title":"On Connecting Deep Trigonometric Networks with Deep Gaussian Processes: Covariance, Expressivity, and Neural Tangent Kernel","created":"2022-03-14","cited_by_count":1,"area":null},{"id":"2212.04580","title":"Effective Dynamics of Generative Adversarial Networks","created":"2022-12-08","cited_by_count":1,"area":null},{"id":"2301.06956","title":"Expected Gradients of Maxout Networks and Consequences to Parameter Initialization","created":"2023-01-17","cited_by_count":1,"area":null},{"id":"2303.02859","title":"Bayesian inference with finitely wide neural networks","created":"2023-03-06","cited_by_count":1,"area":null},{"id":"2309.01592","title":"Les Houches Lectures on Deep Learning at Large & Infinite Width","created":"2023-09-04","cited_by_count":1,"area":null},{"id":"2309.15096","title":"Fixing the NTK: From Neural Network Linearizations to Exact Convex Programs","created":"2023-09-26","cited_by_count":1,"area":null},{"id":"2310.01683","title":"Commutative Width and Depth Scaling in Deep Neural Networks","created":"2023-10-02","cited_by_count":1,"area":null},{"id":"2503.16708","title":"NeuroSep-CP-LCB: A Deep Learning-based Contextual Multi-armed Bandit Algorithm with Uncertainty Quantification for Early Sepsis Prediction","created":"2025-03-20","cited_by_count":1,"area":null},{"id":"2510.25800","title":"FreIE: Low-Frequency Spectral Bias in Neural Networks for Time-Series Tasks","created":"2025-10-29","cited_by_count":1,"area":null},{"id":"2601.13048","title":"Analysis of Long Range Dependency Understanding in State Space Models","created":"2026-01-19","cited_by_count":1,"area":null},{"id":"2605.03373","title":"Learning Dynamics of Zeroth-Order Optimization: A Kernel Perspective","created":"2026-05-05","cited_by_count":1,"area":null},{"id":"2605.09861","title":"Flag Varieties: A Geometric Framework for Deep Network Alignment","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2605.29684","title":"Kernel Renormalization in Bayesian Deep Neural Networks: the Equivalent Wishart Ansatz in the Proportional Regime","created":"2026-05-28","cited_by_count":1,"area":null},{"id":"2605.30860","title":"Bayesian Inference with Shaped Deep Non-linear MLPs","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2106.06097","title":"Neural Optimization Kernel: Towards Robust Deep Learning","created":"2021-06-11","cited_by_count":0,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null}],"next_cursor":"100"}