{"total":48,"rows":[{"id":"2505.01618","title":"Don't be lazy: CompleteP enables compute-efficient deep transformers","created":"2025-05-02","cited_by_count":78,"area":null},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2106.06615","title":"Precise characterization of the prior predictive distribution of deep ReLU networks","created":"2021-06-11","cited_by_count":28,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2302.00453","title":"Width and Depth Limits Commute in Residual Networks","created":"2023-02-01","cited_by_count":21,"area":null},{"id":"2211.16980","title":"Infinite-width limit of deep linear neural networks","created":"2022-11-29","cited_by_count":20,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2102.10492","title":"Deep ReLU Networks Preserve Expected Length","created":"2021-02-21","cited_by_count":17,"area":null},{"id":"2505.02809","title":"Towards Quantifying the Hessian Structure of Neural Networks","created":"2025-05-05","cited_by_count":13,"area":null},{"id":"2301.00008","title":"Effects of Data Geometry in Early Deep Learning","created":"2022-12-29","cited_by_count":12,"area":null},{"id":"2212.07295","title":"Maximal Initial Learning Rates in Deep ReLU Networks","created":"2022-12-14","cited_by_count":11,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2302.14112","title":"Injectivity of ReLU networks: perspectives from statistical physics","created":"2023-02-27","cited_by_count":10,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2210.12497","title":"Deep Linear Networks for Matrix Completion -- An Infinite Depth Limit","created":"2022-10-22","cited_by_count":8,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2103.13466","title":"Asymptotic Freeness of Layerwise Jacobians Caused by Invariance of Multilayer Perceptron: The Haar Orthogonal Case","created":"2021-03-24","cited_by_count":5,"area":null},{"id":"2312.17306","title":"Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians","created":"2023-12-28","cited_by_count":5,"area":null},{"id":"2310.12079","title":"Differential Equation Scaling Limits of Shaped and Unshaped Neural Networks","created":"2023-10-18","cited_by_count":4,"area":null},{"id":"2406.11666","title":"ROTI-GCV: Generalized Cross-Validation for right-ROTationally Invariant Data","created":"2024-06-17","cited_by_count":4,"area":null},{"id":"2106.03763","title":"Vanishing Curvature and the Power of Adaptive Methods in Randomly Initialized Deep Networks","created":"2021-06-07","cited_by_count":3,"area":null},{"id":"2111.00841","title":"Free Probability for predicting the performance of feed-forward fully connected neural networks","created":"2021-11-01","cited_by_count":3,"area":null},{"id":"2306.11668","title":"Principles for Initialization and Architecture Selection in Graph Neural Networks with ReLU Activations","created":"2023-06-20","cited_by_count":3,"area":null},{"id":"2506.08764","title":"On the Stability of the Jacobian Matrix in Deep Neural Networks","created":"2025-06-10","cited_by_count":3,"area":null},{"id":"2206.07483","title":"Blind Estimation of a Doubly Selective OFDM Channel: A Deep Learning Algorithm and Theory","created":"2022-05-30","cited_by_count":2,"area":null},{"id":"2311.01356","title":"Upper and lower bounds for the Lipschitz constant of random neural networks","created":"2023-11-02","cited_by_count":2,"area":null},{"id":"2505.19827","title":"Revisiting Glorot Initialization for Long-Range Linear Recurrences","created":"2025-05-26","cited_by_count":2,"area":null},{"id":"2301.06956","title":"Expected Gradients of Maxout Networks and Consequences to Parameter Initialization","created":"2023-01-17","cited_by_count":1,"area":null},{"id":"2309.01592","title":"Les Houches Lectures on Deep Learning at Large & Infinite Width","created":"2023-09-04","cited_by_count":1,"area":null},{"id":"2310.01683","title":"Commutative Width and Depth Scaling in Deep Neural Networks","created":"2023-10-02","cited_by_count":1,"area":null},{"id":"2605.30860","title":"Bayesian Inference with Shaped Deep Non-linear MLPs","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2206.05200","title":"Dynamic mean field programming","created":"2022-06-10","cited_by_count":0,"area":null},{"id":"2503.23982","title":"Deep Neural Nets as Hamiltonians","created":"2025-03-31","cited_by_count":0,"area":null},{"id":"2605.05113","title":"How Long Does Infinite Width Last? Signal Propagation in Long-Range Linear Recurrences","created":"2026-05-06","cited_by_count":0,"area":null},{"id":"2606.02596","title":"Spectral Asymptotics of Neural Network Loss Landscapes: An Exact Decomposition of the Curvature Exponent","created":"2026-05-22","cited_by_count":0,"area":null},{"id":"2606.17013","title":"Exploding and vanishing gradients in deep neural networks: the effect of residual connections","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2606.30831","title":"Geometric Dyson Brownian Motions and the Free Log-Normal Limit for a Non-Square Gaussian Matrix Product","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2608.14638","title":"Randomly initialized autoencoders: fixed points and edge-of-chaos","created":"2026-07-28","cited_by_count":0,"area":null},{"id":"2608.26526","title":"High Probability Derivative Bounds for Random tanh Neural Networks on a Hypercube","created":"2026-08-27","cited_by_count":0,"area":null},{"id":"2609.02155","title":"Exact Limits of Random Projections for Preserving Geometry: Distance Recovery, Nearest-Neighbor Rankings, and Covariance Shape in Gaussian Models","created":"2026-09-02","cited_by_count":0,"area":null},{"id":"2609.32195","title":"High-Probability Guarantees for SGD under $\\beta$-Heavy-Tailed Gradient Noise","created":"2026-09-26","cited_by_count":0,"area":null}],"next_cursor":null}