{"total":96,"rows":[{"id":"2303.14186","title":"TRAK: Attributing Model Behavior at Scale","created":"2023-03-24","cited_by_count":283,"area":null},{"id":"2107.13034","title":"Dataset Distillation with Infinitely Wide Convolutional Networks","created":"2021-07-27","cited_by_count":218,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2402.16363","title":"LLM Inference Unveiled: Survey and Roofline Model Insights","created":"2024-02-26","cited_by_count":152,"area":"inference"},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105,"area":null},{"id":"2106.15933","title":"Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity","created":"2021-06-30","cited_by_count":85,"area":null},{"id":"2105.04550","title":"Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth","created":"2021-05-10","cited_by_count":55,"area":null},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53,"area":null},{"id":"2107.05544","title":"Meta-learning PINN loss functions","created":"2021-07-12","cited_by_count":51,"area":null},{"id":"2310.07891","title":"A Theory of Non-Linear Feature Learning with One Gradient Step in Two-Layer Neural Networks","created":"2023-10-11","cited_by_count":49,"area":null},{"id":"2101.09612","title":"On the Proof of Global Convergence of Gradient Descent for Deep ReLU Networks with Linear Widths","created":"2021-01-24","cited_by_count":44,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2304.03408","title":"Dynamics of Finite Width Kernel and Prediction Fluctuations in Mean Field Neural Networks","created":"2023-04-06","cited_by_count":43,"area":null},{"id":"2210.04860","title":"Second-order regression models exhibit progressive sharpening to the edge of stability","created":"2022-10-10","cited_by_count":40,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2202.00553","title":"Neural Tangent Kernel Beyond the Infinite-Width Limit: Effects of Depth and Initialization","created":"2022-02-01","cited_by_count":30,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2105.14301","title":"A Theory of Neural Tangent Kernel Alignment and Its Influence on Training","created":"2021-05-29","cited_by_count":25,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2208.13614","title":"Neural Tangent Kernel: A Survey","created":"2022-08-29","cited_by_count":23,"area":null},{"id":"2307.03223","title":"Neural Network Field Theories: Non-Gaussianity, Actions, and Locality","created":"2023-07-06","cited_by_count":22,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2210.04909","title":"Meta-Principled Family of Hyperparameter Scaling Strategies","created":"2022-10-10","cited_by_count":19,"area":null},{"id":"2305.16427","title":"Neural (Tangent Kernel) Collapse","created":"2023-05-25","cited_by_count":18,"area":null},{"id":"2403.03103","title":"Emergent Equivariance in Deep Ensembles","created":"2024-03-05","cited_by_count":18,"area":null},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2303.06561","title":"Phase Diagram of Initial Condensation for Two-layer Neural Networks","created":"2023-03-12","cited_by_count":16,"area":null},{"id":"2107.12530","title":"Convergence of Deep ReLU Networks","created":"2021-07-27","cited_by_count":15,"area":null},{"id":"2206.12802","title":"Bounding the Width of Neural Networks via Coupled Initialization -- A Worst Case Analysis","created":"2022-06-26","cited_by_count":15,"area":null},{"id":"2103.03113","title":"Towards Deepening Graph Neural Networks: A GNTK-based Optimization Perspective","created":"2021-03-03","cited_by_count":14,"area":null},{"id":"2210.12030","title":"Evolution of Neural Tangent Kernels under Benign and Adversarial Training","created":"2022-10-21","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2105.05001","title":"FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis","created":"2021-05-11","cited_by_count":13,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2305.02334","title":"Structures of Neural Network Effective Theories","created":"2023-05-03","cited_by_count":13,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2403.19205","title":"From Activation to Initialization: Scaling Insights for Optimizing Neural Fields","created":"2024-03-28","cited_by_count":11,"area":null},{"id":"2502.03210","title":"From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning","created":"2025-02-05","cited_by_count":10,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2301.07737","title":"Catapult Dynamics and Phase Transitions in Quadratic Nets","created":"2023-01-18","cited_by_count":8,"area":null},{"id":"2502.09863","title":"Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models","created":"2025-02-14","cited_by_count":8,"area":null},{"id":"2209.15106","title":"Restricted Strong Convexity of Deep Learning Models with Smooth Activations","created":"2022-09-29","cited_by_count":7,"area":null},{"id":"2302.03519","title":"Efficient Parametric Approximations of Neural Network Function Space Distance","created":"2023-02-07","cited_by_count":7,"area":null},{"id":"2310.00137","title":"On the Disconnect Between Theory and Practice of Neural Networks: Limits of the NTK Perspective","created":"2023-09-29","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2205.07463","title":"Gradient Descent Optimizes Infinite-Depth ReLU Implicit Networks with Linear Widths","created":"2022-05-16","cited_by_count":5,"area":null},{"id":"2208.05640","title":"Adaptive and Implicit Regularization for Matrix Completion","created":"2022-08-11","cited_by_count":5,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2306.01692","title":"Uniform Convergence of Deep Neural Networks with Lipschitz Continuous Activation Functions and Variable Widths","created":"2023-06-02","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2307.02284","title":"Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks","created":"2023-07-05","cited_by_count":4,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2406.06504","title":"Equivariant Neural Tangent Kernels","created":"2024-06-10","cited_by_count":4,"area":null},{"id":"2302.01002","title":"Over-parameterised Shallow Neural Networks with Asymmetrical Node Scaling: Global Convergence Guarantees and Feature Learning","created":"2023-02-02","cited_by_count":3,"area":null},{"id":"2304.03385","title":"Wide neural networks: From non-gaussian random fields at initialization to the NTK geometry of training","created":"2023-04-06","cited_by_count":3,"area":null},{"id":"2310.12977","title":"Training Dynamics of Deep Network Linear Regions","created":"2023-10-19","cited_by_count":3,"area":null},{"id":"2402.15958","title":"On the dynamics of three-layer neural networks: initial condensation","created":"2024-02-25","cited_by_count":3,"area":null},{"id":"2403.00258","title":"\"Lossless\" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach","created":"2024-03-01","cited_by_count":3,"area":null},{"id":"2106.05710","title":"DNN-Based Topology Optimisation: Spatial Invariance and Neural Tangent Kernel","created":"2021-06-10","cited_by_count":2,"area":null},{"id":"2312.06887","title":"Understanding and Leveraging the Learning Phases of Neural Networks","created":"2023-12-11","cited_by_count":2,"area":null},{"id":"2404.19719","title":"The lazy (NTK) and rich ($\\mu$P) regimes: a gentle tutorial","created":"2024-04-30","cited_by_count":2,"area":null},{"id":"2501.02364","title":"Linearly Separable Features in Shallow Nonlinear Networks: Width Scales Polynomially with Intrinsic Data Dimension","created":"2025-01-04","cited_by_count":2,"area":null},{"id":"2506.00620","title":"Model Reprogramming Demystified: A Neural Tangent Kernel Perspective","created":"2025-05-31","cited_by_count":2,"area":null},{"id":"2507.05035","title":"Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens","created":"2025-07-07","cited_by_count":2,"area":null},{"id":"2507.06367","title":"The Riemannian Geometry Associated to Gradient Flows of Linear Convolutional Networks","created":"2025-07-08","cited_by_count":2,"area":null},{"id":"2510.09210","title":"Provable Watermarking for Data Poisoning Attacks","created":"2025-10-10","cited_by_count":2,"area":null},{"id":"2103.11558","title":"Weighted Neural Tangent Kernel: A Generalized and Improved Network-Induced Kernel","created":"2021-03-22","cited_by_count":1,"area":null},{"id":"2202.12297","title":"Embedded Ensembles: Infinite Width Limit and Operating Regimes","created":"2022-02-24","cited_by_count":1,"area":null},{"id":"2212.02323","title":"Improved Convergence Guarantees for Shallow Neural Networks","created":"2022-12-05","cited_by_count":1,"area":null},{"id":"2309.01592","title":"Les Houches Lectures on Deep Learning at Large & Infinite Width","created":"2023-09-04","cited_by_count":1,"area":null},{"id":"2410.20119","title":"On Multi-Stage Loss Dynamics in Neural Networks: Mechanisms of Plateau and Descent Stages","created":"2024-10-26","cited_by_count":1,"area":null},{"id":"2505.13196","title":"A Physics-Inspired Optimizer: Velocity Regularized Adam","created":"2025-05-19","cited_by_count":1,"area":null},{"id":"2509.24544","title":"Quantitative convergence of trained single layer neural networks to Gaussian processes","created":"2025-09-29","cited_by_count":1,"area":null},{"id":"2511.05585","title":"Depth-induced NTK: Bridging Over-parameterized Neural Networks and Deep Neural Kernels","created":"2025-11-05","cited_by_count":1,"area":null},{"id":"2601.03162","title":"On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime","created":"2026-01-06","cited_by_count":1,"area":null},{"id":"2602.04548","title":"Gradient Flow Through Diagram Expansions: Learning Regimes and Explicit Solutions","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.11161","title":"Algorithmic Task Capture, Computational Complexity, and Inductive Bias of Infinite Transformers","created":"2026-03-11","cited_by_count":1,"area":null},{"id":"2110.07557","title":"AIR-Net: Adaptive and Implicit Regularization Neural Network for Matrix Completion","created":"2021-10-12","cited_by_count":0,"area":null},{"id":"2111.01166","title":"Dynamics of Local Elasticity During Training of Neural Nets","created":"2021-11-01","cited_by_count":0,"area":null},{"id":"2303.09216","title":"Controlled Descent Training","created":"2023-03-16","cited_by_count":0,"area":null},{"id":"2401.04013","title":"Weak Correlations as the Underlying Principle for Linearization of Gradient-Based Learning Systems","created":"2024-01-08","cited_by_count":0,"area":null},{"id":"2404.04859","title":"Demystifying Lazy Training of Neural Networks from a Macroscopic Viewpoint","created":"2024-04-07","cited_by_count":0,"area":null},{"id":"2412.18756","title":"Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories","created":"2024-12-25","cited_by_count":0,"area":null},{"id":"2507.03863","title":"Enhanced accuracy through ensembling of randomly initialized auto-regressive models for time-dependent PDEs","created":"2025-07-05","cited_by_count":0,"area":null},{"id":"2604.12827","title":"Loop Corrections in Random Feature Models: Training Error and Generalization Gap","created":"2026-04-14","cited_by_count":0,"area":null},{"id":"2605.17767","title":"Feature Learning in Linear-Width Two-Layer Networks: Two vs. One Step of Gradient Descent","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2608.27748","title":"The role of parameter Jacobians in the stability of network outputs","created":"2026-08-27","cited_by_count":0,"area":null},{"id":"2609.26679","title":"A Spectral Theory of Grokking: Weight Decay induces Feature Learning","created":"2026-09-22","cited_by_count":0,"area":null}],"next_cursor":null}