{"total":167,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2105.03404","title":"ResMLP: Feedforward networks for image classification with data-efficient training","created":"2021-05-07","cited_by_count":339,"area":null},{"id":"2104.14421","title":"What Are Bayesian Neural Network Posteriors Really Like?","created":"2021-04-29","cited_by_count":308,"area":null},{"id":"2107.13034","title":"Dataset Distillation with Infinitely Wide Convolutional Networks","created":"2021-07-27","cited_by_count":218,"area":null},{"id":"2102.06571","title":"Bayesian Neural Network Priors Revisited","created":"2021-02-12","cited_by_count":121,"area":null},{"id":"2210.12067","title":"Efficient Dataset Distillation Using Random Feature Approximation","created":"2022-10-21","cited_by_count":111,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2105.06868","title":"Priors in Bayesian Deep Learning: A Review","created":"2021-05-14","cited_by_count":101,"area":null},{"id":"2206.08720","title":"Fast Finite Width Neural Tangent Kernel","created":"2022-06-17","cited_by_count":62,"area":null},{"id":"2105.03703","title":"Tensor Programs IIb: Architectural Universality of Neural Tangent Kernel Training Dynamics","created":"2021-05-08","cited_by_count":57,"area":null},{"id":"2110.01765","title":"Rapid training of deep neural networks without skip connections or normalization layers using Deep Kernel Shaping","created":"2021-10-05","cited_by_count":52,"area":null},{"id":"2106.09017","title":"Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation","created":"2021-06-16","cited_by_count":50,"area":null},{"id":"2310.03789","title":"Grokking as a First Order Phase Transition in Two Layer Networks","created":"2023-10-05","cited_by_count":48,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2106.04013","title":"The Future is Log-Gaussian: ResNets and Their Infinite-Depth-and-Width Limit at Initialization","created":"2021-06-07","cited_by_count":33,"area":null},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33,"area":null},{"id":"2104.04244","title":"How rotational invariance of common kernels prevents generalization in high dimensions","created":"2021-04-09","cited_by_count":32,"area":null},{"id":"2106.07880","title":"Scaling Neural Tangent Kernels via Sketching and Random Features","created":"2021-06-15","cited_by_count":32,"area":null},{"id":"2102.10032","title":"Approximation and Learning with Deep Convolutional Models: a Kernel Perspective","created":"2021-02-19","cited_by_count":31,"area":null},{"id":"2206.12543","title":"A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel","created":"2022-06-25","cited_by_count":30,"area":null},{"id":"2106.06615","title":"Precise characterization of the prior predictive distribution of deep ReLU networks","created":"2021-06-11","cited_by_count":28,"area":null},{"id":"2205.00165","title":"NeuralEF: Deconstructing Kernels by Deep Neural Networks","created":"2022-04-30","cited_by_count":27,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2105.04504","title":"Deep Neural Networks as Point Estimates for Deep Gaussian Processes","created":"2021-05-10","cited_by_count":26,"area":null},{"id":"2106.08619","title":"Locality defeats the curse of dimensionality in convolutional teacher-student scenarios","created":"2021-06-16","cited_by_count":26,"area":"distill"},{"id":"2403.08160","title":"Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime","created":"2024-03-13","cited_by_count":26,"area":null},{"id":"2303.17671","title":"Neural signature kernels as infinite-width-depth-limits of controlled ResNets","created":"2023-03-30","cited_by_count":25,"area":null},{"id":"2108.01403","title":"Nonperturbative renormalization for the neural network-QFT correspondence","created":"2021-08-03","cited_by_count":24,"area":null},{"id":"2205.14846","title":"Precise Learning Curves and Higher-Order Scaling Limits for Dot Product Kernel Regression","created":"2022-05-30","cited_by_count":22,"area":null},{"id":"2211.07844","title":"Characterizing the Spectrum of the NTK via a Power Series Expansion","created":"2022-11-15","cited_by_count":22,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2206.02626","title":"Infinite Recommendation Networks: A Data-Centric Approach","created":"2022-06-03","cited_by_count":20,"area":null},{"id":"2207.07235","title":"Single Model Uncertainty Estimation via Stochastic Data Centering","created":"2022-07-14","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2309.17310","title":"Leave-one-out Distinguishability in Machine Learning","created":"2023-09-29","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2102.08668","title":"Non-asymptotic approximations of neural networks by Gaussian processes","created":"2021-02-17","cited_by_count":19,"area":null},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19,"area":null},{"id":"2209.04121","title":"Fast Neural Kernel Embeddings for General Activations","created":"2022-09-09","cited_by_count":18,"area":null},{"id":"2112.05611","title":"Eigenspace Restructuring: a Principle of Space and Frequency in Neural Networks","created":"2021-12-10","cited_by_count":17,"area":null},{"id":"2102.09449","title":"Quantum field-theoretic machine learning","created":"2021-02-18","cited_by_count":16,"area":null},{"id":"2203.09255","title":"On the Spectral Bias of Convolutional Neural Tangent and Gaussian Process Kernels","created":"2022-03-17","cited_by_count":16,"area":null},{"id":"2208.01003","title":"What Can Be Learnt With Wide Convolutional Neural Networks?","created":"2022-08-01","cited_by_count":16,"area":null},{"id":"2102.03909","title":"Meta-Learning with Neural Tangent Kernels","created":"2021-02-07","cited_by_count":15,"area":null},{"id":"2108.13097","title":"A theory of representation learning gives a deep generalisation of kernel methods","created":"2021-08-30","cited_by_count":15,"area":null},{"id":"2110.12231","title":"Learning curves for Gaussian process regression with power-law priors and targets","created":"2021-10-23","cited_by_count":15,"area":null},{"id":"2109.01545","title":"Large-Scale Learning with Fourier Features and Tensor Decompositions","created":"2021-09-03","cited_by_count":14,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2211.13491","title":"Spatial Mixture-of-Experts","created":"2022-11-24","cited_by_count":14,"area":"moe"},{"id":"2310.10767","title":"Wide Neural Networks as Gaussian Processes: Lessons from Deep Equilibrium Models","created":"2023-10-16","cited_by_count":14,"area":null},{"id":"2403.06925","title":"Transformers Learn Low Sensitivity Functions: Investigations and Implications","created":"2024-03-11","cited_by_count":14,"area":null},{"id":"2103.06219","title":"Why flatness does and does not correlate with generalization for deep neural networks","created":"2021-03-10","cited_by_count":13,"area":null},{"id":"2106.08453","title":"How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective","created":"2021-06-15","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2402.05173","title":"Towards Understanding Inductive Bias in Transformers: A View From Infinity","created":"2024-02-07","cited_by_count":13,"area":null},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12,"area":null},{"id":"2202.06438","title":"Learning from Randomly Initialized Neural Network Features","created":"2022-02-13","cited_by_count":12,"area":null},{"id":"2207.06154","title":"On the Robustness of Bayesian Neural Networks to Adversarial Attacks","created":"2022-07-13","cited_by_count":12,"area":null},{"id":"2305.09957","title":"Quantum neural networks form Gaussian processes","created":"2023-05-17","cited_by_count":12,"area":null},{"id":"2305.13552","title":"Squared Neural Families: A New Class of Tractable Density Models","created":"2023-05-22","cited_by_count":12,"area":null},{"id":"2406.03260","title":"Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers","created":"2024-06-05","cited_by_count":12,"area":null},{"id":"2101.07833","title":"Implicit Bias of Linear RNNs","created":"2021-01-19","cited_by_count":11,"area":null},{"id":"2304.04010","title":"Non-asymptotic approximations of Gaussian neural networks via second-order Poincar\\'e inequalities","created":"2023-04-08","cited_by_count":11,"area":null},{"id":"2202.11104","title":"A duality connecting neural network and cosmological dynamics","created":"2022-02-22","cited_by_count":10,"area":null},{"id":"2203.00479","title":"Uncertainty Estimation for Computed Tomography with a Linearised Deep Image Prior","created":"2022-02-28","cited_by_count":10,"area":null},{"id":"2206.07673","title":"Wide Bayesian neural networks have a simple weight posterior: theory and accelerated sampling","created":"2022-06-15","cited_by_count":9,"area":null},{"id":"2303.05420","title":"Kernel Regression with Infinite-Width Neural Networks on Millions of Examples","created":"2023-03-09","cited_by_count":9,"area":null},{"id":"2310.06112","title":"Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach","created":"2023-10-09","cited_by_count":9,"area":null},{"id":"2405.17538","title":"Bayesian RG Flow in Neural Network Field Theories","created":"2024-05-27","cited_by_count":9,"area":null},{"id":"2108.02316","title":"Deep Stable neural networks: large-width asymptotics and convergence rates","created":"2021-08-02","cited_by_count":8,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2405.06008","title":"Wilsonian Renormalization of Neural Network Gaussian Processes","created":"2024-05-09","cited_by_count":8,"area":null},{"id":"2110.01899","title":"Random matrices in service of ML footprint: ternary random features with no performance loss","created":"2021-10-05","cited_by_count":7,"area":null},{"id":"2303.18059","title":"Inferring networks from time series: a neural approach","created":"2023-03-30","cited_by_count":7,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null},{"id":"2310.18612","title":"Efficient kernel surrogates for neural network-based regression","created":"2023-10-28","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2407.21176","title":"DKL-KAN: Scalable Deep Kernel Learning using Kolmogorov-Arnold Networks","created":"2024-07-30","cited_by_count":7,"area":null},{"id":"2107.10125","title":"A variational approximate posterior for the deep Wishart process","created":"2021-07-21","cited_by_count":6,"area":null},{"id":"2107.14324","title":"Deep Networks Provably Classify Data on Curves","created":"2021-07-29","cited_by_count":6,"area":null},{"id":"2207.04612","title":"Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm","created":"2022-07-11","cited_by_count":6,"area":null},{"id":"2207.10939","title":"Statistical Hypothesis Testing Based on Machine Learning: Large Deviations Analysis","created":"2022-07-22","cited_by_count":6,"area":null},{"id":"2302.05828","title":"Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning","created":"2023-02-12","cited_by_count":6,"area":null},{"id":"2302.09574","title":"Guided Deep Kernel Learning","created":"2023-02-19","cited_by_count":6,"area":null},{"id":"2309.04522","title":"Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics","created":"2023-09-08","cited_by_count":6,"area":null},{"id":"2101.11751","title":"Faster Kernel Interpolation for Gaussian Processes","created":"2021-01-28","cited_by_count":5,"area":null},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2106.11064","title":"$\\alpha$-Stable convergence of heavy-tailed infinitely-wide neural networks","created":"2021-06-18","cited_by_count":5,"area":null},{"id":"2107.01408","title":"Scale Mixtures of Neural Network Gaussian Processes","created":"2021-07-03","cited_by_count":5,"area":null},{"id":"2208.06028","title":"Gaussian Process Surrogate Models for Neural Networks","created":"2022-08-11","cited_by_count":5,"area":null},{"id":"2306.00809","title":"Initial Guessing Bias: How Untrained Networks Favor Some Classes","created":"2023-06-01","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2405.16630","title":"Bayesian Inference with Deep Weakly Nonlinear Networks","created":"2024-05-26","cited_by_count":5,"area":null},{"id":"2506.00846","title":"Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2104.05878","title":"On the validity of kernel approximations for orthogonally-initialized neural networks","created":"2021-04-13","cited_by_count":4,"area":null},{"id":"2108.12862","title":"Neural Network Gaussian Processes by Increasing Depth","created":"2021-08-29","cited_by_count":4,"area":null},{"id":"2112.00723","title":"Infinite Neural Network Quantum States: Entanglement and Training Dynamics","created":"2021-12-01","cited_by_count":4,"area":null},{"id":"2206.01332","title":"Optimal Activation Functions for the Random Features Regression Model","created":"2022-05-31","cited_by_count":4,"area":null},{"id":"2101.04097","title":"Correlated Weights in Infinite Limits of Deep Convolutional Neural Networks","created":"2021-01-11","cited_by_count":3,"area":null}],"next_cursor":"100"}