{"total":47,"rows":[{"id":"2203.03466","title":"Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer","created":"2022-03-07","cited_by_count":288,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2105.06868","title":"Priors in Bayesian Deep Learning: A Review","created":"2021-05-14","cited_by_count":101,"area":null},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57,"area":null},{"id":"2406.08447","title":"The Impact of Initialization on LoRA Finetuning Dynamics","created":"2024-06-12","cited_by_count":54,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2310.04064","title":"How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation","created":"2023-10-06","cited_by_count":44,"area":null},{"id":"2407.17465","title":"u-$\\mu$P: The Unit-Scaled Maximal Update Parametrization","created":"2024-07-24","cited_by_count":29,"area":null},{"id":"2108.01403","title":"Nonperturbative renormalization for the neural network-QFT correspondence","created":"2021-08-03","cited_by_count":24,"area":null},{"id":"2208.13614","title":"Neural Tangent Kernel: A Survey","created":"2022-08-29","cited_by_count":23,"area":null},{"id":"2210.00688","title":"On the infinite-depth limit of finite-width neural networks","created":"2022-10-03","cited_by_count":22,"area":null},{"id":"2302.00453","title":"Width and Depth Limits Commute in Residual Networks","created":"2023-02-01","cited_by_count":21,"area":null},{"id":"2110.11749","title":"Feature Learning and Signal Propagation in Deep Neural Networks","created":"2021-10-22","cited_by_count":18,"area":null},{"id":"2509.10167","title":"The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram","created":"2025-09-12","cited_by_count":17,"area":null},{"id":"2505.23194","title":"Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics","created":"2025-05-29","cited_by_count":16,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2202.11104","title":"A duality connecting neural network and cosmological dynamics","created":"2022-02-22","cited_by_count":10,"area":null},{"id":"2205.13814","title":"Global Convergence of Over-parameterized Deep Equilibrium Models","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2206.07673","title":"Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling","created":"2022-06-15","cited_by_count":9,"area":null},{"id":"2509.17196","title":"Evolution of Concepts in Language Model Pre-Training","created":"2025-09-21","cited_by_count":8,"area":null},{"id":"2106.03091","title":"Regularization in ResNet with Stochastic Depth","created":"2021-06-06","cited_by_count":7,"area":null},{"id":"2110.15596","title":"Training Integrable Parameterizations of Deep Neural Networks in the Infinite-Width Limit","created":"2021-10-29","cited_by_count":7,"area":null},{"id":"2406.00153","title":"$\\mu$LO: Compute-Efficient Meta-Generalization of Learned Optimizers","created":"2024-05-31","cited_by_count":7,"area":null},{"id":"2103.13466","title":"Asymptotic Freeness of Layerwise Jacobians Caused by Invariance of Multilayer Perceptron: The Haar Orthogonal Case","created":"2021-03-24","cited_by_count":5,"area":null},{"id":"2506.00846","title":"Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2602.18308","title":"JPmHC Dynamical Isometry via Orthogonal Hyper-Connections","created":"2026-02-20","cited_by_count":5,"area":null},{"id":"2201.04543","title":"Eigenvalue Distribution of Large Random Matrices Arising in Deep Neural Networks: Orthogonal Case","created":"2022-01-12","cited_by_count":4,"area":null},{"id":"2502.17405","title":"Function-Space Learning Rates","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2511.07380","title":"Mining Useful General Data for Low-Resource Domain Adaptation","created":"2025-11-10","cited_by_count":4,"area":null},{"id":"2604.27077","title":"Learning Rate Transfer in Normalized Transformers","created":"2026-04-29","cited_by_count":3,"area":null},{"id":"2107.00364","title":"Implicit Acceleration and Feature Learning in Infinitely Wide Neural Networks with Bottlenecks","created":"2021-07-01","cited_by_count":2,"area":null},{"id":"2505.14512","title":"Just One Layer Norm Guarantees Stable Extrapolation","created":"2025-05-20","cited_by_count":2,"area":null},{"id":"2206.04316","title":"Adversarial Noises Are Linearly Separable for (Nearly) Random Neural Networks","created":"2022-06-09","cited_by_count":1,"area":null},{"id":"2310.01683","title":"Commutative Width and Depth Scaling in Deep Neural Networks","created":"2023-10-02","cited_by_count":1,"area":null},{"id":"2501.04182","title":"Random weights of DNNs and emergence of fixed points","created":"2025-01-07","cited_by_count":1,"area":null},{"id":"2602.04396","title":"LoRDO: Distributed Low-Rank Optimization with Infrequent Communication","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2605.15290","title":"GQA-{\\mu}P: The maximal parameterization update for grouped query attention","created":"2026-05-14","cited_by_count":1,"area":null},{"id":"2605.30860","title":"Bayesian Inference with Shaped Deep Non-linear MLPs","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2607.06290","title":"Quantitative Gaussian-Process limits of Tensor Programs","created":"2026-07-07","cited_by_count":1,"area":null},{"id":"2512.21075","title":"Feature Learning Dynamics in Infinite-Depth Neural Networks","created":"2025-12-24","cited_by_count":0,"area":null},{"id":"2605.05113","title":"How Long Does Infinite Width Last? Signal Propagation in Long-Range Linear Recurrences","created":"2026-05-06","cited_by_count":0,"area":null},{"id":"2605.18180","title":"Canonical Regularisation of Wide Feature-Learning Neural Networks","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2608.08350","title":"Correlation flow governs learning at criticality","created":"2026-08-08","cited_by_count":0,"area":null},{"id":"2610.11668","title":"$\\sigma$Transfer: Uncertainty Transfer from Small to Large Networks under $\\mu\\mathrm{P}$","created":"2026-10-08","cited_by_count":0,"area":null},{"id":"2610.14344","title":"On the Depth Transfer of Neural Optimizers via L-Smoothness","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}