{"total":157,"rows":[{"id":"2102.06701","title":"Explaining Neural Scaling Laws","created":"2021-02-12","cited_by_count":363,"area":null},{"id":"2107.13034","title":"Dataset Distillation with Infinitely Wide Convolutional Networks","created":"2021-07-27","cited_by_count":218,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2105.12221","title":"Geometry of the Loss Landscape in Overparameterized Neural Networks: Symmetries and Invariances","created":"2021-05-25","cited_by_count":127,"area":null},{"id":"2301.07014","title":"Dataset Distillation: A Comprehensive Review","created":"2023-01-17","cited_by_count":127,"area":null},{"id":"2210.12067","title":"Efficient Dataset Distillation Using Random Feature Approximation","created":"2022-10-21","cited_by_count":111,"area":null},{"id":"2310.17813","title":"A Spectral Condition for Feature Learning","created":"2023-10-26","cited_by_count":109,"area":null},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106,"area":null},{"id":"2203.06176","title":"More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize","created":"2022-03-11","cited_by_count":91,"area":null},{"id":"2301.04272","title":"Data Distillation: A Survey","created":"2023-01-11","cited_by_count":87,"area":null},{"id":"2206.08720","title":"Fast Finite Width Neural Tangent Kernel","created":"2022-06-17","cited_by_count":62,"area":null},{"id":"2302.06755","title":"Dataset Distillation with Convexified Implicit Gradients","created":"2023-02-13","cited_by_count":46,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41,"area":null},{"id":"2305.18411","title":"Feature-Learning Networks Are Consistent Across Widths At Realistic Scales","created":"2023-05-28","cited_by_count":41,"area":null},{"id":"2206.10012","title":"Limitations of the NTK for Understanding Generalization in Deep Learning","created":"2022-06-20","cited_by_count":35,"area":null},{"id":"2106.04110","title":"A self consistent theory of Gaussian Processes captures feature learning effects in finite CNNs","created":"2021-06-08","cited_by_count":33,"area":null},{"id":"2110.08611","title":"Deep Active Learning by Leveraging Training Dynamics","created":"2021-10-16","cited_by_count":32,"area":null},{"id":"2207.06503","title":"Randomly pivoted Cholesky: Practical approximation of a kernel matrix with few entry evaluations","created":"2022-07-13","cited_by_count":32,"area":null},{"id":"2102.10032","title":"Approximation and Learning with Deep Convolutional Models: a Kernel Perspective","created":"2021-02-19","cited_by_count":31,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2202.00553","title":"Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization","created":"2022-02-01","cited_by_count":30,"area":null},{"id":"2206.12543","title":"A Fast, Well-Founded Approximation to the Empirical Neural Tangent Kernel","created":"2022-06-25","cited_by_count":30,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2304.06670","title":"Deep neural networks have an inbuilt Occam's razor","created":"2023-04-13","cited_by_count":28,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2110.03922","title":"The Eigenlearning Framework: A Conservation Law Perspective on Kernel Regression and Wide Neural Networks","created":"2021-10-08","cited_by_count":26,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2302.10886","title":"Some Fundamental Aspects about Lipschitz Continuity of Neural Networks","created":"2023-02-21","cited_by_count":26,"area":null},{"id":"2105.14301","title":"A Theory of Neural Tangent Kernel Alignment and Its Influence on Training","created":"2021-05-29","cited_by_count":25,"area":null},{"id":"2203.00573","title":"Contrasting random and learned features in deep Bayesian linear regression","created":"2022-03-01","cited_by_count":24,"area":null},{"id":"2206.12314","title":"Learning sparse features can lead to overfitting in neural networks","created":"2022-06-24","cited_by_count":23,"area":null},{"id":"2203.03597","title":"Fast Rates for Noisy Interpolation Require Rethinking the Effects of Inductive Bias","created":"2022-03-07","cited_by_count":22,"area":null},{"id":"2211.07844","title":"Characterizing the Spectrum of the NTK via a Power Series Expansion","created":"2022-11-15","cited_by_count":22,"area":null},{"id":"2104.03093","title":"Spectral Analysis of the Neural Tangent Kernel for Deep Residual Networks","created":"2021-04-07","cited_by_count":21,"area":null},{"id":"2106.05566","title":"A Neural Tangent Kernel Perspective of GANs","created":"2021-06-10","cited_by_count":21,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2206.02626","title":"Infinite Recommendation Networks: A Data-Centric Approach","created":"2022-06-03","cited_by_count":20,"area":null},{"id":"2210.02157","title":"The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks","created":"2022-10-05","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2307.11807","title":"Local Kernel Renormalization as a mechanism for feature learning in overparametrized Convolutional Neural Networks","created":"2023-07-21","cited_by_count":19,"area":null},{"id":"2110.11749","title":"Feature Learning and Signal Propagation in Deep Neural Networks","created":"2021-10-22","cited_by_count":18,"area":null},{"id":"2207.13676","title":"Open Source Vizier: Distributed Infrastructure and API for Reliable and Flexible Blackbox Optimization","created":"2022-07-27","cited_by_count":18,"area":null},{"id":"2209.04121","title":"Fast Neural Kernel Embeddings for General Activations","created":"2022-09-09","cited_by_count":18,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2305.18512","title":"A Rainbow in Deep Network Black Boxes","created":"2023-05-29","cited_by_count":18,"area":null},{"id":"2311.14646","title":"More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory","created":"2023-11-24","cited_by_count":18,"area":null},{"id":"2108.00131","title":"Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks","created":"2021-07-31","cited_by_count":17,"area":null},{"id":"2202.05808","title":"Investigating Power laws in Deep Representation Learning","created":"2022-02-11","cited_by_count":17,"area":null},{"id":"2205.14775","title":"An Optimization-based Algorithm for Non-stationary Kernel Bandits without Prior Knowledge","created":"2022-05-29","cited_by_count":17,"area":null},{"id":"2102.10307","title":"Large-width functional asymptotics for deep Gaussian neural networks","created":"2021-02-20","cited_by_count":15,"area":null},{"id":"2110.03681","title":"Neural Tangent Kernel Empowered Federated Learning","created":"2021-10-07","cited_by_count":15,"area":null},{"id":"2110.12231","title":"Learning curves for Gaussian process regression with power-law priors and targets","created":"2021-10-23","cited_by_count":15,"area":null},{"id":"2210.05929","title":"Few-shot Backdoor Attacks via Neural Tangent Kernels","created":"2022-10-12","cited_by_count":15,"area":null},{"id":"2206.02126","title":"Learning Dynamics and Generalization in Reinforcement Learning","created":"2022-06-05","cited_by_count":14,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2106.08453","title":"How to Train Your Wide Neural Network Without Backprop: An Input-Weight Alignment Perspective","created":"2021-06-15","cited_by_count":13,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2302.02605","title":"Toward Large Kernel Models","created":"2023-02-06","cited_by_count":13,"area":null},{"id":"2303.00564","title":"Learning curves for deep structured Gaussian feature models","created":"2023-03-01","cited_by_count":13,"area":null},{"id":"2405.14630","title":"Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension","created":"2024-05-23","cited_by_count":13,"area":null},{"id":"2410.04642","title":"The Optimization Landscape of SGD Across the Feature Learning Strength","created":"2024-10-06","cited_by_count":13,"area":null},{"id":"2105.02468","title":"Relative stability toward diffeomorphisms indicates performance in deep nets","created":"2021-05-06","cited_by_count":12,"area":null},{"id":"2106.03186","title":"Reverse Engineering the Neural Tangent Kernel","created":"2021-06-06","cited_by_count":12,"area":null},{"id":"2204.14126","title":"Wide and Deep Neural Networks Achieve Optimality for Classification","created":"2022-04-29","cited_by_count":12,"area":null},{"id":"2209.14884","title":"Joint Embedding Self-Supervised Learning in the Kernel Regime","created":"2022-09-29","cited_by_count":12,"area":null},{"id":"2211.14810","title":"A Kernel Perspective of Skip Connections in Convolutional Networks","created":"2022-11-27","cited_by_count":12,"area":null},{"id":"2206.11124","title":"A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta","created":"2022-06-22","cited_by_count":11,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2502.03210","title":"From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning","created":"2025-02-05","cited_by_count":10,"area":null},{"id":"2202.00992","title":"Tight Convergence Rate Bounds for Optimization Under Power Law Spectral Conditions","created":"2022-02-02","cited_by_count":9,"area":null},{"id":"2303.05420","title":"Kernel Regression with Infinite-Width Neural Networks on Millions of Examples","created":"2023-03-09","cited_by_count":9,"area":null},{"id":"2307.14531","title":"Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum","created":"2023-07-26","cited_by_count":9,"area":null},{"id":"2310.19870","title":"Metric Flows with Neural Networks","created":"2023-10-30","cited_by_count":9,"area":null},{"id":"2311.13774","title":"Learning Hierarchical Polynomials with Three-Layer Neural Networks","created":"2023-11-23","cited_by_count":9,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2108.02316","title":"Deep Stable neural networks: large-width asymptotics and convergence rates","created":"2021-08-02","cited_by_count":8,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2405.06008","title":"Wilsonian Renormalization of Neural Network Gaussian Processes","created":"2024-05-09","cited_by_count":8,"area":null},{"id":"2104.03525","title":"A Neural Pre-Conditioning Active Learning Algorithm to Reduce Label Complexity","created":"2021-04-08","cited_by_count":7,"area":null},{"id":"2107.01832","title":"Provable Convergence of Nesterov's Accelerated Gradient Method for Over-Parameterized Neural Networks","created":"2021-07-05","cited_by_count":7,"area":null},{"id":"2111.11954","title":"Depth induces scale-averaging in overparameterized linear Bayesian neural networks","created":"2021-11-23","cited_by_count":7,"area":null},{"id":"2207.05714","title":"Bayesian Experimental Design for Computed Tomography with the Linearised Deep Image Prior","created":"2022-07-11","cited_by_count":7,"area":null},{"id":"2209.08399","title":"Approximation results for Gradient Descent trained Shallow Neural Networks in $1d$","created":"2022-09-17","cited_by_count":7,"area":null},{"id":"2209.15208","title":"Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel","created":"2022-09-30","cited_by_count":7,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2207.04612","title":"Synergy and Symmetry in Deep Learning: Interactions between the Data, Model, and Inference Algorithm","created":"2022-07-11","cited_by_count":6,"area":null},{"id":"2309.04522","title":"Connecting NTK and NNGP: A Unified Theoretical Framework for Wide Neural Network Learning Dynamics","created":"2023-09-08","cited_by_count":6,"area":null},{"id":"2310.00137","title":"On the Disconnect Between Theory and Practice of Neural Networks: Limits of the NTK Perspective","created":"2023-09-29","cited_by_count":6,"area":null},{"id":"2410.16201","title":"Theoretical Limitations of Ensembles in the Age of Overparameterization","created":"2024-10-21","cited_by_count":6,"area":null},{"id":"2505.15270","title":"Scaling Diffusion Transformers Efficiently via $\\mu$P","created":"2025-05-21","cited_by_count":6,"area":"diffusion"},{"id":"2102.07238","title":"Double-descent curves in neural networks: a new perspective using Gaussian processes","created":"2021-02-14","cited_by_count":5,"area":null},{"id":"2106.11064","title":"$\\alpha$-Stable convergence of heavy-tailed infinitely-wide neural networks","created":"2021-06-18","cited_by_count":5,"area":null},{"id":"2110.02885","title":"Bayesian neural network unit priors and generalized Weibull-tail property","created":"2021-10-06","cited_by_count":5,"area":null},{"id":"2211.00227","title":"Transfer Learning with Kernel Methods","created":"2022-11-01","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null}],"next_cursor":"100"}