{"total":151,"rows":[{"id":"2203.03466","title":"Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer","created":"2022-03-07","cited_by_count":288,"area":null},{"id":"2107.13034","title":"Dataset Distillation with Infinitely Wide Convolutional Networks","created":"2021-07-27","cited_by_count":218,"area":null},{"id":"2006.13198","title":"Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks","created":"2020-06-23","cited_by_count":166,"area":"alignment"},{"id":"2102.06571","title":"Bayesian Neural Network Priors Revisited","created":"2021-02-12","cited_by_count":121,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2210.12067","title":"Efficient Dataset Distillation Using Random Feature Approximation","created":"2022-10-21","cited_by_count":111,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2105.06868","title":"Priors in Bayesian Deep Learning: A Review","created":"2021-05-14","cited_by_count":101,"area":null},{"id":"2402.18762","title":"Disentangling the Causes of Plasticity Loss in Neural Networks","created":"2024-02-29","cited_by_count":86,"area":"deeprl"},{"id":"2407.01800","title":"Normalization and effective learning rates in reinforcement learning","created":"2024-07-01","cited_by_count":58,"area":"deeprl"},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57,"area":null},{"id":"2311.00636","title":"Kronecker-Factored Approximate Curvature for Modern Neural Network Architectures","created":"2023-11-01","cited_by_count":49,"area":null},{"id":"2302.10322","title":"Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation","created":"2023-02-20","cited_by_count":45,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2310.04064","title":"How to Capture Higher-order Correlations? Generalizing Matrix Softmax Attention to Kronecker Computation","created":"2023-10-06","cited_by_count":44,"area":null},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2311.01906","title":"Simplifying Transformer Blocks","created":"2023-11-03","cited_by_count":37,"area":null},{"id":"2303.15438","title":"On the Stepwise Nature of Self-Supervised Learning","created":"2023-03-27","cited_by_count":36,"area":null},{"id":"2311.01723","title":"Towards Calibrated Robust Fine-Tuning of Vision-Language Models","created":"2023-11-03","cited_by_count":35,"area":"mllm"},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2206.12543","title":"A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel","created":"2022-06-25","cited_by_count":30,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2106.00694","title":"Symmetry-via-Duality: Invariant Neural Network Densities from Parameter-Space Correlators","created":"2021-06-01","cited_by_count":29,"area":null},{"id":"2407.17465","title":"u-$\\mu$P: The Unit-Scaled Maximal Update Parametrization","created":"2024-07-24","cited_by_count":29,"area":null},{"id":"2106.06615","title":"Precise characterization of the prior predictive distribution of deep ReLU networks","created":"2021-06-11","cited_by_count":28,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2105.04504","title":"Deep Neural Networks as Point Estimates for Deep Gaussian Processes","created":"2021-05-10","cited_by_count":26,"area":null},{"id":"2203.07379","title":"Quantitative Gaussian Approximation of Randomly Initialized Deep Neural Networks","created":"2022-03-14","cited_by_count":25,"area":null},{"id":"2303.17671","title":"Neural signature kernels as infinite-width-depth-limits of controlled ResNets","created":"2023-03-30","cited_by_count":25,"area":null},{"id":"2108.01403","title":"Nonperturbative renormalization for the neural network-QFT correspondence","created":"2021-08-03","cited_by_count":24,"area":null},{"id":"2208.13614","title":"Neural Tangent Kernel: A Survey","created":"2022-08-29","cited_by_count":23,"area":null},{"id":"2307.03223","title":"Neural Network Field Theories: Non-Gaussianity, Actions, and Locality","created":"2023-07-06","cited_by_count":22,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2302.00453","title":"Width and Depth Limits Commute in Residual Networks","created":"2023-02-01","cited_by_count":21,"area":null},{"id":"2309.17310","title":"Leave-one-out Distinguishability in Machine Learning","created":"2023-09-29","cited_by_count":20,"area":null},{"id":"2102.08668","title":"Non-asymptotic approximations of neural networks by Gaussian processes","created":"2021-02-17","cited_by_count":19,"area":null},{"id":"2206.04672","title":"Overcoming the Spectral Bias of Neural Value Approximation","created":"2022-06-09","cited_by_count":19,"area":null},{"id":"2110.11749","title":"Feature Learning and Signal Propagation in Deep Neural Networks","created":"2021-10-22","cited_by_count":18,"area":null},{"id":"2102.10307","title":"Large-width functional asymptotics for deep Gaussian neural networks","created":"2021-02-20","cited_by_count":15,"area":null},{"id":"2110.12231","title":"Learning curves for Gaussian process regression with power-law priors and targets","created":"2021-10-23","cited_by_count":15,"area":null},{"id":"2303.01687","title":"Differentially Private Neural Tangent Kernels for Privacy-Preserving Data Generation","created":"2023-03-03","cited_by_count":15,"area":null},{"id":"2409.02628","title":"(Implicit) Ensembles of Ensembles: Epistemic Uncertainty Collapse in Large Models","created":"2024-09-04","cited_by_count":15,"area":null},{"id":"2305.18806","title":"Prediction Error-based Classification for Class-Incremental Learning","created":"2023-05-30","cited_by_count":14,"area":null},{"id":"2310.10767","title":"Wide Neural Networks as Gaussian Processes: Lessons from Deep Equilibrium Models","created":"2023-10-16","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2103.06219","title":"Why flatness does and does not correlate with generalization for deep neural networks","created":"2021-03-10","cited_by_count":13,"area":null},{"id":"2205.08187","title":"Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility","created":"2022-05-17","cited_by_count":13,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12,"area":null},{"id":"2305.09957","title":"Quantum neural networks form Gaussian processes","created":"2023-05-17","cited_by_count":12,"area":null},{"id":"2402.13321","title":"Rigor with Machine Learning from Field Theory to the Poincar\\'e Conjecture","created":"2024-02-20","cited_by_count":12,"area":null},{"id":"2101.07833","title":"Implicit Bias of Linear RNNs","created":"2021-01-19","cited_by_count":11,"area":null},{"id":"2304.04010","title":"Non-asymptotic approximations of Gaussian neural networks via second-order Poincar\\'e inequalities","created":"2023-04-08","cited_by_count":11,"area":null},{"id":"2306.16308","title":"Gaussian random field approximation via Stein's method with applications to wide random neural networks","created":"2023-06-28","cited_by_count":11,"area":null},{"id":"2406.16689","title":"Coding schemes in neural networks learning classification tasks","created":"2024-06-24","cited_by_count":11,"area":null},{"id":"2106.09798","title":"Wide stochastic networks: Gaussian limit and PAC-Bayesian training","created":"2021-06-17","cited_by_count":10,"area":null},{"id":"2202.11104","title":"A duality connecting neural network and cosmological dynamics","created":"2022-02-22","cited_by_count":10,"area":null},{"id":"2205.13814","title":"Global Convergence of Over-parameterized Deep Equilibrium Models","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2410.21212","title":"On learning higher-order cumulants in diffusion models","created":"2024-10-28","cited_by_count":10,"area":"diffusion"},{"id":"2405.17538","title":"Bayesian RG Flow in Neural Network Field Theories","created":"2024-05-27","cited_by_count":9,"area":null},{"id":"2108.02316","title":"Deep Stable neural networks: large-width asymptotics and convergence rates","created":"2021-08-02","cited_by_count":8,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2207.09432","title":"Deep equilibrium networks are sensitive to initialization statistics","created":"2022-07-19","cited_by_count":8,"area":null},{"id":"2507.20057","title":"What Can Grokking Teach Us About Learning Under Nonstationarity?","created":"2025-07-26","cited_by_count":8,"area":null},{"id":"2205.15008","title":"Efficient Transformed Gaussian Processes for Non-Stationary Dependent Multi-class Classification","created":"2022-05-30","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2212.11811","title":"Renormalization in the neural network-quantum field theory correspondence","created":"2022-12-22","cited_by_count":7,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null},{"id":"2406.00153","title":"$\\mu$LO: Compute-Efficient Meta-Generalization of Learned Optimizers","created":"2024-05-31","cited_by_count":7,"area":null},{"id":"2302.05828","title":"Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning","created":"2023-02-12","cited_by_count":6,"area":null},{"id":"2309.04522","title":"Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics","created":"2023-09-08","cited_by_count":6,"area":null},{"id":"2401.08808","title":"lpNTK: Better Generalisation with Less Data via Sample Interaction During Learning","created":"2024-01-16","cited_by_count":6,"area":null},{"id":"2505.15270","title":"Scaling Diffusion Transformers Efficiently via $\\mu$P","created":"2025-05-21","cited_by_count":6,"area":"diffusion"},{"id":"2511.16741","title":"Fermions and Supersymmetry in Neural Network Field Theories","created":"2025-11-20","cited_by_count":6,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2106.11064","title":"$\\alpha$-Stable convergence of heavy-tailed infinitely-wide neural networks","created":"2021-06-18","cited_by_count":5,"area":null},{"id":"2107.01408","title":"Scale Mixtures of Neural Network Gaussian Processes","created":"2021-07-03","cited_by_count":5,"area":null},{"id":"2405.16630","title":"Bayesian Inference with Deep Weakly Nonlinear Networks","created":"2024-05-26","cited_by_count":5,"area":null},{"id":"2408.00082","title":"TASI Lectures on Physics for Machine Learning","created":"2024-07-31","cited_by_count":5,"area":null},{"id":"2506.00846","title":"Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2108.12862","title":"Neural Network Gaussian Processes by Increasing Depth","created":"2021-08-29","cited_by_count":4,"area":null},{"id":"2112.00723","title":"Infinite Neural Network Quantum States: Entanglement and Training Dynamics","created":"2021-12-01","cited_by_count":4,"area":null},{"id":"2310.12079","title":"Differential Equation Scaling Limits of Shaped and Unshaped Neural Networks","created":"2023-10-18","cited_by_count":4,"area":null},{"id":"2409.05800","title":"Input Space Mode Connectivity in Deep Neural Networks","created":"2024-09-09","cited_by_count":4,"area":null},{"id":"2410.01922","title":"NTK-DFL: Enhancing Decentralized Federated Learning in Heterogeneous Settings via Neural Tangent Kernel","created":"2024-10-02","cited_by_count":4,"area":null},{"id":"2502.17405","title":"Function-Space Learning Rates","created":"2025-02-24","cited_by_count":4,"area":null},{"id":"2503.09565","title":"Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $\\mu$P Parametrization","created":"2025-03-12","cited_by_count":4,"area":null},{"id":"2505.12519","title":"Efficient Implementation of Gaussian Process Regression Accelerated Saddle Point Searches with Application to Molecular Reactions","created":"2025-05-18","cited_by_count":4,"area":null},{"id":"2101.04097","title":"Correlated Weights in Infinite Limits of Deep Convolutional Neural Networks","created":"2021-01-11","cited_by_count":3,"area":null},{"id":"2202.12637","title":"Do autoencoders need a bottleneck for anomaly detection?","created":"2022-02-25","cited_by_count":3,"area":null},{"id":"2206.13568","title":"AutoInit: Automatic Initialization via Jacobian Tuning","created":"2022-06-27","cited_by_count":3,"area":null},{"id":"2302.01002","title":"Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning","created":"2023-02-02","cited_by_count":3,"area":null},{"id":"2305.10664","title":"Posterior Inference on Shallow Infinitely Wide Bayesian Neural Networks under Weights with Unbounded Variance","created":"2023-05-18","cited_by_count":3,"area":null},{"id":"2405.10229","title":"Random ReLU Neural Networks as Non-Gaussian Processes","created":"2024-05-16","cited_by_count":3,"area":null},{"id":"2502.04247","title":"Student-t processes as infinite-width limits of posterior Bayesian neural networks","created":"2025-02-06","cited_by_count":3,"area":null},{"id":"2506.08764","title":"On the Stability of the Jacobian Matrix in Deep Neural Networks","created":"2025-06-10","cited_by_count":3,"area":null},{"id":"2506.22429","title":"Beyond ReLU: How Activations Affect Neural Kernels and Random Wide Networks","created":"2025-06-27","cited_by_count":3,"area":null}],"next_cursor":"100"}