{"total":143,"rows":[{"id":"2203.03466","title":"Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer","created":"2022-03-07","cited_by_count":288,"area":null},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2305.19420","title":"What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization","created":"2023-05-30","cited_by_count":118,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2105.06868","title":"Priors in Bayesian Deep Learning: A Review","created":"2021-05-14","cited_by_count":101,"area":null},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77,"area":null},{"id":"2309.16620","title":"Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit","created":"2023-09-28","cited_by_count":66,"area":null},{"id":"2206.08720","title":"Fast Finite Width Neural Tangent Kernel","created":"2022-06-17","cited_by_count":62,"area":null},{"id":"2306.13596","title":"Max-Margin Token Selection in Attention Mechanism","created":"2023-06-23","cited_by_count":58,"area":null},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2310.04064","title":"How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation","created":"2023-10-06","cited_by_count":44,"area":null},{"id":"2406.06158","title":"Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning","created":"2024-06-10","cited_by_count":42,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2403.05171","title":"Overcoming Reward Overoptimization via Adversarial Policy Optimization with Lightweight Uncertainty Estimation","created":"2024-03-08","cited_by_count":33,"area":"alignment"},{"id":"2202.00553","title":"Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization","created":"2022-02-01","cited_by_count":30,"area":null},{"id":"2206.12543","title":"A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel","created":"2022-06-25","cited_by_count":30,"area":null},{"id":"2407.17465","title":"u-$\\mu$P: The Unit-Scaled Maximal Update Parametrization","created":"2024-07-24","cited_by_count":29,"area":null},{"id":"2206.12569","title":"Making Look-Ahead Active Learning Strategies Feasible with Neural Tangent Kernels","created":"2022-06-25","cited_by_count":25,"area":null},{"id":"2303.17671","title":"Neural signature kernels as infinite-width-depth-limits of controlled ResNets","created":"2023-03-30","cited_by_count":25,"area":null},{"id":"2108.01403","title":"Nonperturbative renormalization for the neural network-QFT correspondence","created":"2021-08-03","cited_by_count":24,"area":null},{"id":"2208.13614","title":"Neural Tangent Kernel: A Survey","created":"2022-08-29","cited_by_count":23,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2307.03223","title":"Neural Network Field Theories: Non-Gaussianity, Actions, and Locality","created":"2023-07-06","cited_by_count":22,"area":null},{"id":"2106.05566","title":"A Neural Tangent Kernel Perspective of GANs","created":"2021-06-10","cited_by_count":21,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2302.00453","title":"Width and Depth Limits Commute in Residual Networks","created":"2023-02-01","cited_by_count":21,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2206.04672","title":"Overcoming the Spectral Bias of Neural Value Approximation","created":"2022-06-09","cited_by_count":19,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2405.17580","title":"Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes","created":"2024-05-27","cited_by_count":18,"area":null},{"id":"2205.12101","title":"Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2103.02695","title":"Shift Invariance Can Reduce Adversarial Robustness","created":"2021-03-03","cited_by_count":16,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2202.11921","title":"Auto-scaling Vision Transformers without Training","created":"2022-02-24","cited_by_count":15,"area":null},{"id":"2210.05929","title":"Few-shot Backdoor Attacks via Neural Tangent Kernels","created":"2022-10-12","cited_by_count":15,"area":null},{"id":"2310.08513","title":"How connectivity structure shapes rich and lazy learning in neural circuits","created":"2023-10-12","cited_by_count":15,"area":null},{"id":"2312.12226","title":"On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width","created":"2023-12-19","cited_by_count":15,"area":null},{"id":"2103.03113","title":"Towards Deepening Graph Neural Networks: A GNTK-based Optimization Perspective","created":"2021-03-03","cited_by_count":14,"area":null},{"id":"2303.15484","title":"Regularize implicit neural representation by itself","created":"2023-03-27","cited_by_count":13,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2211.14810","title":"A Kernel Perspective of Skip Connections in Convolutional Networks","created":"2022-11-27","cited_by_count":12,"area":null},{"id":"2402.13321","title":"Rigor with Machine Learning from Field Theory to the Poincar\\'e Conjecture","created":"2024-02-20","cited_by_count":12,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2110.12122","title":"Quantifying Epistemic Uncertainty in Deep Learning","created":"2021-10-23","cited_by_count":10,"area":null},{"id":"2202.11104","title":"A duality connecting neural network and cosmological dynamics","created":"2022-02-22","cited_by_count":10,"area":null},{"id":"2203.03443","title":"Generalization Through The Lens Of Leave-One-Out Error","created":"2022-03-07","cited_by_count":10,"area":null},{"id":"2205.13814","title":"Global Convergence of Over-parameterized Deep Equilibrium Models","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2306.05674","title":"Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural Networks","created":"2023-06-09","cited_by_count":10,"area":null},{"id":"2505.19241","title":"ActiveDPO: Active Direct Preference Optimization for Sample-Efficient Alignment","created":"2025-05-25","cited_by_count":10,"area":"lr"},{"id":"2303.05420","title":"Kernel Regression with Infinite-Width Neural Networks on Millions of Examples","created":"2023-03-09","cited_by_count":9,"area":null},{"id":"2307.14531","title":"Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum","created":"2023-07-26","cited_by_count":9,"area":null},{"id":"2310.19870","title":"Metric Flows with Neural Networks","created":"2023-10-30","cited_by_count":9,"area":null},{"id":"2410.10075","title":"RoCoFT: Efficient Finetuning of Large Language Models with Row-Column Updates","created":"2024-10-14","cited_by_count":8,"area":null},{"id":"2107.09200","title":"A quantum algorithm for training wide and deep classical neural networks","created":"2021-07-19","cited_by_count":7,"area":null},{"id":"2110.15596","title":"Training Integrable Parameterizations of Deep Neural Networks in the Infinite-Width Limit","created":"2021-10-29","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null},{"id":"2311.04965","title":"Expressibility-induced Concentration of Quantum Neural Tangent Kernels","created":"2023-11-08","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2406.00153","title":"$\\mu$LO: Compute-Efficient Meta-Generalization of Learned Optimizers","created":"2024-05-31","cited_by_count":7,"area":null},{"id":"2401.08808","title":"lpNTK: Better Generalisation with Less Data via Sample Interaction During Learning","created":"2024-01-16","cited_by_count":6,"area":null},{"id":"2505.15270","title":"Scaling Diffusion Transformers Efficiently via $\\mu$P","created":"2025-05-21","cited_by_count":6,"area":"diffusion"},{"id":"2506.15690","title":"LLM Web Dynamics: Tracing Model Collapse in a Network of LLMs","created":"2025-05-26","cited_by_count":6,"area":"synth"},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2511.16741","title":"Fermions and Supersymmetry in Neural Network Field Theories","created":"2025-11-20","cited_by_count":6,"area":null},{"id":"2405.16630","title":"Bayesian Inference with Deep Weakly Nonlinear Networks","created":"2024-05-26","cited_by_count":5,"area":null},{"id":"2411.02139","title":"Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks","created":"2024-11-04","cited_by_count":5,"area":null},{"id":"2502.01556","title":"A Gaussian Process View on Observation Noise and Initialization in Wide Neural Networks","created":"2025-02-03","cited_by_count":5,"area":null},{"id":"2506.00846","title":"Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2112.00723","title":"Infinite Neural Network Quantum States: Entanglement and Training Dynamics","created":"2021-12-01","cited_by_count":4,"area":null},{"id":"2210.09818","title":"Disentangling the Predictive Variance of Deep Ensembles through the Neural Tangent Kernel","created":"2022-10-18","cited_by_count":4,"area":null},{"id":"2409.05800","title":"Input Space Mode Connectivity in Deep Neural Networks","created":"2024-09-09","cited_by_count":4,"area":null},{"id":"2411.02001","title":"Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation","created":"2024-11-04","cited_by_count":4,"area":null},{"id":"2502.16763","title":"Learning to Add, Multiply, and Execute Algorithmic Instructions Exactly with Neural Networks","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2502.17405","title":"Function-Space Learning Rates","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2503.04424","title":"Determinant Estimation under Memory Constraints and Neural Scaling Laws","created":"2025-03-06","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2510.09816","title":"A mathematical theory for understanding when abstract representations emerge in neural networks","created":"2025-10-10","cited_by_count":4,"area":null},{"id":"2511.07380","title":"Mining Useful General Data for Low-Resource Domain Adaptation","created":"2025-11-10","cited_by_count":4,"area":null},{"id":"2603.28964","title":"Spectral Edge Dynamics: An Analytical-Empirical Study of Phase Transitions in Neural Network Training","created":"2026-03-30","cited_by_count":4,"area":null},{"id":"2103.04557","title":"Asymptotics of Ridge Regression in Convolutional Models","created":"2021-03-08","cited_by_count":3,"area":null},{"id":"2312.03386","title":"An Infinite-Width Analysis on the Jacobian-Regularised Training of a Neural Network","created":"2023-12-06","cited_by_count":3,"area":null},{"id":"2407.17120","title":"Parameter-Efficient Fine-Tuning for Continual Learning: A Neural Tangent Kernel Perspective","created":"2024-07-24","cited_by_count":3,"area":null},{"id":"2506.22429","title":"Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks","created":"2025-06-27","cited_by_count":3,"area":null},{"id":"2511.07318","title":"When Bias Pretends to Be Truth: How Spurious Correlations Undermine Hallucination Detection in LLMs","created":"2025-11-10","cited_by_count":3,"area":null},{"id":"2511.10796","title":"Fast Generalized Neural Tangent Kernel Statistics via Trace Estimation","created":"2025-11-13","cited_by_count":3,"area":null},{"id":"2604.27077","title":"Learning Rate Transfer in Normalized Transformers","created":"2026-04-29","cited_by_count":3,"area":null},{"id":"2107.00364","title":"Implicit Acceleration and Feature Learning in Infinitely Wide Neural Networks with Bottlenecks","created":"2021-07-01","cited_by_count":2,"area":null},{"id":"2303.15948","title":"Sparse Gaussian Processes with Spherical Harmonic Features Revisited","created":"2023-03-28","cited_by_count":2,"area":null},{"id":"2404.19719","title":"The lazy (NTK) and rich ($\\mu$P) regimes: a gentle tutorial","created":"2024-04-30","cited_by_count":2,"area":null}],"next_cursor":"100"}