{"total":129,"rows":[{"id":"2202.06709","title":"How Do Vision Transformers Work?","created":"2022-02-14","cited_by_count":307,"area":null},{"id":"2105.14368","title":"Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation","created":"2021-05-29","cited_by_count":132,"area":null},{"id":"2402.01868","title":"Challenges in Training PINNs: A Loss Landscape Perspective","created":"2024-02-02","cited_by_count":113,"area":null},{"id":"2111.00034","title":"Neural Networks as Kernel Learners: The Silent Alignment Effect","created":"2021-10-29","cited_by_count":106,"area":null},{"id":"2407.04811","title":"Simplifying Deep Temporal Difference Learning","created":"2024-07-05","cited_by_count":78,"area":"deeprl"},{"id":"2405.14813","title":"Scalable Optimization in the Modular Norm","created":"2024-05-23","cited_by_count":68,"area":null},{"id":"2112.07628","title":"Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time","created":"2021-12-14","cited_by_count":62,"area":null},{"id":"2110.03237","title":"Score-based Generative Neural Networks for Large-Scale Optimal Transport","created":"2021-10-07","cited_by_count":60,"area":null},{"id":"2105.04550","title":"Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth","created":"2021-05-10","cited_by_count":55,"area":null},{"id":"2405.00592","title":"Scaling and renormalization in high-dimensional regression","created":"2024-05-01","cited_by_count":50,"area":null},{"id":"2106.06770","title":"What can linearized neural networks actually say about generalization?","created":"2021-06-12","cited_by_count":49,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2112.06074","title":"Early Stopping for Deep Image Prior","created":"2021-12-11","cited_by_count":44,"area":null},{"id":"2212.09034","title":"Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPs","created":"2022-12-18","cited_by_count":42,"area":null},{"id":"2402.10926","title":"Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning","created":"2024-01-30","cited_by_count":39,"area":null},{"id":"2310.12680","title":"On the Optimization and Generalization of Multi-head Attention","created":"2023-10-19","cited_by_count":37,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2104.11044","title":"Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes","created":"2021-04-22","cited_by_count":28,"area":null},{"id":"2205.14612","title":"Do Residual Neural Networks discretize Neural Ordinary Differential Equations?","created":"2022-05-29","cited_by_count":27,"area":null},{"id":"2310.05801","title":"An operator preconditioning perspective on training in physics-informed machine learning","created":"2023-10-09","cited_by_count":27,"area":null},{"id":"2107.12723","title":"Stability & Generalisation of Gradient Descent for Shallow Neural Networks without the Neural Tangent Kernel","created":"2021-07-27","cited_by_count":26,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2306.02601","title":"Aiming towards the minimizers: fast convergence of SGD for overparametrized problems","created":"2023-06-05","cited_by_count":22,"area":null},{"id":"2106.05566","title":"A Neural Tangent Kernel Perspective of GANs","created":"2021-06-10","cited_by_count":21,"area":null},{"id":"2109.06099","title":"Uniform Generalization Bounds for Overparameterized Neural Networks","created":"2021-09-13","cited_by_count":21,"area":null},{"id":"2210.05577","title":"What Can the Neural Tangent Kernel Tell Us About Adversarial Robustness?","created":"2022-10-11","cited_by_count":21,"area":null},{"id":"2305.16150","title":"Unifying GANs and Score-Based Diffusion as Generative Particle Models","created":"2023-05-25","cited_by_count":21,"area":"diffusion"},{"id":"2402.03864","title":"The Challenges of the Nonlinear Regime for Physics-Informed Neural Networks","created":"2024-02-06","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2203.14577","title":"Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training?","created":"2022-03-28","cited_by_count":18,"area":null},{"id":"2111.06063","title":"On the Equivalence between Neural Network and Support Vector Machine","created":"2021-11-11","cited_by_count":17,"area":null},{"id":"2205.11787","title":"Quadratic models for understanding catapult dynamics of neural networks","created":"2022-05-24","cited_by_count":17,"area":null},{"id":"2406.03334","title":"Reparameterization invariance in approximate Bayesian inference","created":"2024-06-05","cited_by_count":17,"area":null},{"id":"2101.04968","title":"Learning with Gradient Descent and Weakly Convex Losses","created":"2021-01-13","cited_by_count":16,"area":null},{"id":"2301.10808","title":"Graph Neural Tangent Kernel: Convergence on Large Graphs","created":"2023-01-25","cited_by_count":16,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2405.14630","title":"Bounds for the smallest eigenvalue of the NTK for arbitrary spherical data of arbitrary dimension","created":"2024-05-23","cited_by_count":13,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2204.14126","title":"Wide and Deep Neural Networks Achieve Optimality for Classification","created":"2022-04-29","cited_by_count":12,"area":null},{"id":"2206.02927","title":"Spectral Bias Outside the Training Set for Deep Networks in the Kernel Regime","created":"2022-06-06","cited_by_count":11,"area":null},{"id":"2309.02028","title":"Non-Parametric Representation Learning with Kernels","created":"2023-09-05","cited_by_count":11,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2411.00247","title":"Deep Learning Through A Telescoping Lens: A Simple Model Provides Empirical Insights On Grokking, Gradient Boosting & Beyond","created":"2024-10-31","cited_by_count":9,"area":null},{"id":"2201.08082","title":"Kernel Methods and Multi-layer Perceptrons Learn Linear Models in High Dimensions","created":"2022-01-20","cited_by_count":8,"area":null},{"id":"2210.09809","title":"Analysis of Convolutions, Non-linearity and Depth in Graph Neural Networks using Neural Tangent Kernel","created":"2022-10-18","cited_by_count":8,"area":null},{"id":"2403.12887","title":"Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport","created":"2024-03-19","cited_by_count":8,"area":null},{"id":"2409.15267","title":"Peer-to-Peer Learning Dynamics of Wide Neural Networks","created":"2024-09-23","cited_by_count":8,"area":null},{"id":"2502.07209","title":"Enhancing Physics-Informed Neural Networks Through Feature Engineering","created":"2025-02-11","cited_by_count":8,"area":null},{"id":"2209.15106","title":"Restricted Strong Convexity of Deep Learning Models with Smooth Activations","created":"2022-09-29","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2310.18612","title":"Efficient kernel surrogates for neural network-based regression","created":"2023-10-28","cited_by_count":7,"area":null},{"id":"2410.10024","title":"Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods","created":"2024-10-13","cited_by_count":7,"area":null},{"id":"2203.05104","title":"Transition to Linearity of Wide Neural Networks is an Emerging Property of Assembling Weak Models","created":"2022-03-10","cited_by_count":6,"area":null},{"id":"2206.00099","title":"Provably and Practically Efficient Neural Contextual Bandits","created":"2022-05-31","cited_by_count":6,"area":null},{"id":"2305.08813","title":"Better NTK Conditioning: A Free Lunch from (ReLU) Nonlinear Activation in Wide Neural Networks","created":"2023-05-15","cited_by_count":6,"area":null},{"id":"2312.05397","title":"On the Performance of Temporal Difference Learning With Neural Networks","created":"2023-12-08","cited_by_count":6,"area":null},{"id":"2409.06142","title":"Variational Search Distributions","created":"2024-09-10","cited_by_count":6,"area":null},{"id":"2412.00537","title":"Exact Certification of (Graph) Neural Networks Against Label Poisoning","created":"2024-11-30","cited_by_count":6,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2211.00227","title":"Transfer Learning with Kernel Methods","created":"2022-11-01","cited_by_count":5,"area":null},{"id":"2301.08117","title":"Convergence beyond the over-parameterized regime using Rayleigh quotients","created":"2023-01-19","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2407.10867","title":"Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks","created":"2024-07-15","cited_by_count":5,"area":null},{"id":"2502.01556","title":"A Gaussian Process View on Observation Noise and Initialization in Wide Neural Networks","created":"2025-02-03","cited_by_count":5,"area":null},{"id":"2504.18208","title":"Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime","created":"2025-04-25","cited_by_count":5,"area":null},{"id":"2105.00507","title":"Universal scaling laws in the gradient descent training of neural networks","created":"2021-05-02","cited_by_count":4,"area":null},{"id":"2205.11786","title":"Transition to Linearity of General Neural Networks with Directed Acyclic Graph Architecture","created":"2022-05-24","cited_by_count":4,"area":null},{"id":"2206.14862","title":"Momentum Diminishes the Effect of Spectral Bias in Physics-Informed Neural Networks","created":"2022-06-29","cited_by_count":4,"area":null},{"id":"2210.01881","title":"Tractable Uncertainty-Aware Meta-Learning","created":"2022-10-04","cited_by_count":4,"area":null},{"id":"2212.11826","title":"The Quantum Path Kernel: a Generalized Quantum Neural Tangent Kernel for Deep Quantum Machine Learning","created":"2022-12-22","cited_by_count":4,"area":null},{"id":"2309.06195","title":"Optimization Guarantees of Unfolded ISTA and ADMM Networks With Smooth Soft-Thresholding","created":"2023-09-12","cited_by_count":4,"area":null},{"id":"2401.07085","title":"Three Mechanisms of Feature Learning in a Linear Network","created":"2024-01-13","cited_by_count":4,"area":null},{"id":"2405.01680","title":"Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations","created":"2024-05-02","cited_by_count":4,"area":null},{"id":"2405.04017","title":"An Improved Finite-time Analysis of Temporal Difference Learning with Deep Neural Networks","created":"2024-05-07","cited_by_count":4,"area":"deeprl"},{"id":"2408.17394","title":"Continual learning with the neural tangent ensemble","created":"2024-08-30","cited_by_count":4,"area":null},{"id":"2410.01922","title":"NTK-DFL: Enhancing Decentralized Federated Learning in Heterogeneous Settings via Neural Tangent Kernel","created":"2024-10-02","cited_by_count":4,"area":null},{"id":"2411.11176","title":"Infinite Width Limits of Self Supervised Neural Networks","created":"2024-11-17","cited_by_count":4,"area":null},{"id":"2510.01303","title":"Low Rank Gradients and Where to Find Them","created":"2025-10-01","cited_by_count":4,"area":null},{"id":"2209.15265","title":"Overparameterized ReLU Neural Networks Learn the Simplest Models: Neural Isometry and Exact Recovery","created":"2022-09-30","cited_by_count":3,"area":null},{"id":"2304.03385","title":"Wide neural networks: From non-gaussian random fields at initialization to the NTK geometry of training","created":"2023-04-06","cited_by_count":3,"area":null},{"id":"2306.02533","title":"On Emergence of Clean-Priority Learning in Early Stopped Neural Networks","created":"2023-06-05","cited_by_count":3,"area":null},{"id":"2309.02011","title":"Representation Learning Dynamics of Self-Supervised Models","created":"2023-09-05","cited_by_count":3,"area":null},{"id":"2403.00258","title":"\"Lossless\" Compression of Deep Neural Networks: A High-dimensional Neural Tangent Kernel Approach","created":"2024-03-01","cited_by_count":3,"area":null},{"id":"2504.11130","title":"Divergence of Empirical Neural Tangent Kernel in Classification Problems","created":"2025-04-15","cited_by_count":3,"area":null},{"id":"2510.02779","title":"Optimal Rates for Generalization of Gradient Descent for Deep ReLU Classification","created":"2025-10-03","cited_by_count":3,"area":null},{"id":"2404.19719","title":"The lazy (NTK) and rich ($\\mu$P) regimes: a gentle tutorial","created":"2024-04-30","cited_by_count":2,"area":null},{"id":"2406.13041","title":"Accelerated Stochastic Min-Max Optimization Based on Bias-corrected Momentum","created":"2024-06-18","cited_by_count":2,"area":null},{"id":"2507.05035","title":"Beyond Scaling Curves: Internal Dynamics of Neural Networks Through the NTK Lens","created":"2025-07-07","cited_by_count":2,"area":null},{"id":"2110.03403","title":"Disentangling deep neural networks with rectified linear units using duality","created":"2021-10-06","cited_by_count":1,"area":null},{"id":"2110.11402","title":"On the Regularization of Autoencoders","created":"2021-10-21","cited_by_count":1,"area":null},{"id":"2202.05236","title":"Learnable Nonlinear Compression for Robust Speaker Verification","created":"2022-02-10","cited_by_count":1,"area":null},{"id":"2202.12297","title":"Embedded Ensembles: Infinite Width Limit and Operating Regimes","created":"2022-02-24","cited_by_count":1,"area":null},{"id":"2203.16455","title":"Explicitising The Implicit Intrepretability of Deep Neural Networks Via Duality","created":"2022-03-01","cited_by_count":1,"area":null},{"id":"2206.10886","title":"Optical Flow Regularization of Implicit Neural Representations for Video Frame Interpolation","created":"2022-06-22","cited_by_count":1,"area":null},{"id":"2206.15058","title":"A note on Linear Bottleneck networks and their Transition to Multilinearity","created":"2022-06-30","cited_by_count":1,"area":null},{"id":"2311.01762","title":"Changing the Kernel During Training Leads to Double Descent in Kernel Regression","created":"2023-11-03","cited_by_count":1,"area":null}],"next_cursor":"100"}