{"total":222,"rows":[{"id":"2106.15590","title":"The Values Encoded in Machine Learning Research","created":"2021-06-29","cited_by_count":172,"area":null},{"id":"2210.05643","title":"A Kernel-Based View of Language Model Fine-Tuning","created":"2022-10-11","cited_by_count":121,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2311.18817","title":"Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking","created":"2023-11-30","cited_by_count":80,"area":null},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77,"area":null},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69,"area":null},{"id":"2112.07628","title":"Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time","created":"2021-12-14","cited_by_count":62,"area":null},{"id":"2106.01606","title":"Exploring Memorization in Adversarial Training","created":"2021-06-03","cited_by_count":55,"area":null},{"id":"2208.02813","title":"Towards Understanding Mixture of Experts in Deep Learning","created":"2022-08-04","cited_by_count":52,"area":"moe"},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2102.02410","title":"A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network","created":"2021-02-04","cited_by_count":47,"area":null},{"id":"2201.00217","title":"Deep Nonparametric Estimation of Operators between Infinite Dimensional Spaces","created":"2022-01-01","cited_by_count":45,"area":null},{"id":"2110.03177","title":"EE-Net: Exploitation-Exploration Neural Networks in Contextual Bandits","created":"2021-10-07","cited_by_count":44,"area":null},{"id":"2107.14702","title":"Towards General Function Approximation in Zero-Sum Markov Games","created":"2021-07-30","cited_by_count":43,"area":null},{"id":"2212.09034","title":"Graph Neural Networks are Inherently Good Generalizers: Insights by Bridging GNNs and MLPs","created":"2022-12-18","cited_by_count":42,"area":null},{"id":"2107.03144","title":"Neural Contextual Bandits without Regret","created":"2021-07-07","cited_by_count":40,"area":null},{"id":"2310.12680","title":"On the Optimization and Generalization of Multi-head Attention","created":"2023-10-19","cited_by_count":37,"area":null},{"id":"2402.15607","title":"How Do Nonlinear Transformers Learn and Generalize in In-Context Learning?","created":"2024-02-23","cited_by_count":35,"area":null},{"id":"2106.05932","title":"Early-stopped neural networks are consistent","created":"2021-06-10","cited_by_count":34,"area":null},{"id":"2106.07880","title":"Scaling Neural Tangent Kernels via Sketching and Random Features","created":"2021-06-15","cited_by_count":32,"area":null},{"id":"2110.04622","title":"Does Preprocessing Help Training Over-parameterized Neural Networks?","created":"2021-10-09","cited_by_count":32,"area":null},{"id":"2110.08611","title":"Deep Active Learning by Leveraging Training Dynamics","created":"2021-10-16","cited_by_count":32,"area":null},{"id":"2204.08200","title":"Understanding Gradual Domain Adaptation: Improved Analysis, Optimal Path and Beyond","created":"2022-04-18","cited_by_count":32,"area":null},{"id":"2404.07662","title":"PINNACLE: PINN Adaptive ColLocation and Experimental points selection","created":"2024-04-11","cited_by_count":32,"area":null},{"id":"2402.05738","title":"Implicit Bias and Fast Convergence Rates for Self-attention","created":"2024-02-08","cited_by_count":31,"area":null},{"id":"2211.14227","title":"Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing","created":"2022-11-25","cited_by_count":29,"area":null},{"id":"2205.09797","title":"Improving Multi-Task Generalization via Regularizing Spurious Correlation","created":"2022-05-19","cited_by_count":28,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2112.08297","title":"Rethinking Influence Functions of Neural Networks in the Over-parameterized Regime","created":"2021-12-15","cited_by_count":26,"area":null},{"id":"2305.14077","title":"Mind the spikes: Benign overfitting of kernels and neural networks in fixed dimension","created":"2023-05-23","cited_by_count":26,"area":null},{"id":"2308.12247","title":"How to Protect Copyright Data in Optimization of Large Language Models?","created":"2023-08-23","cited_by_count":26,"area":null},{"id":"2106.03314","title":"Measuring Generalization with Optimal Transport","created":"2021-06-07","cited_by_count":25,"area":null},{"id":"2111.13807","title":"Offline Neural Contextual Bandits: Pessimism, Optimization and Generalization","created":"2021-11-27","cited_by_count":25,"area":"offlinerl"},{"id":"2210.06850","title":"Sample-Then-Optimize Batch Neural Thompson Sampling","created":"2022-10-13","cited_by_count":25,"area":null},{"id":"2302.10034","title":"Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron","created":"2023-02-20","cited_by_count":25,"area":null},{"id":"2203.16462","title":"Convergence of gradient descent for deep neural networks","created":"2022-03-30","cited_by_count":24,"area":null},{"id":"2106.03243","title":"Neural Active Learning with Performance Guarantees","created":"2021-06-06","cited_by_count":22,"area":null},{"id":"2203.09137","title":"Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning","created":"2022-03-17","cited_by_count":22,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2209.09298","title":"Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks","created":"2022-09-19","cited_by_count":21,"area":null},{"id":"2302.09235","title":"Generalization and Stability of Interpolating Neural Networks with Minimal Width","created":"2023-02-18","cited_by_count":21,"area":null},{"id":"2408.06526","title":"Operator Learning Using Random Features: A Tool for Scientific Computing","created":"2024-08-12","cited_by_count":21,"area":null},{"id":"2106.03039","title":"Multi-facet Contextual Bandits: A Neural Network Perspective","created":"2021-06-06","cited_by_count":20,"area":null},{"id":"2308.10808","title":"Graph Neural Bandits","created":"2023-08-21","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2101.02533","title":"Towards Understanding Learning in Neural Networks with Linear Teachers","created":"2021-01-07","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2209.04121","title":"Fast Neural Kernel Embeddings for General Activations","created":"2022-09-09","cited_by_count":18,"area":null},{"id":"2209.07263","title":"Robustness in deep learning: The good (width), the bad (depth), and the ugly (initialization)","created":"2022-09-15","cited_by_count":18,"area":null},{"id":"2310.13852","title":"Gradual Domain Adaptation: Theory and Algorithms","created":"2023-10-20","cited_by_count":18,"area":null},{"id":"2101.01152","title":"Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise","created":"2021-01-04","cited_by_count":17,"area":null},{"id":"2111.06063","title":"On the Equivalence between Neural Network and Support Vector Machine","created":"2021-11-11","cited_by_count":17,"area":null},{"id":"2201.09910","title":"Learning Neural Contextual Bandits Through Perturbed Rewards","created":"2022-01-24","cited_by_count":17,"area":null},{"id":"2402.04672","title":"G-NAS: Generalizable Neural Architecture Search for Single Domain Generalization Object Detection","created":"2024-02-07","cited_by_count":17,"area":null},{"id":"2101.04968","title":"Learning with Gradient Descent and Weakly Convex Losses","created":"2021-01-13","cited_by_count":16,"area":null},{"id":"2208.13219","title":"Visualizing high-dimensional loss landscapes with Hessian directions","created":"2022-08-28","cited_by_count":16,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2301.10808","title":"Graph Neural Tangent Kernel: Convergence on Large Graphs","created":"2023-01-25","cited_by_count":16,"area":null},{"id":"2306.00242","title":"Combinatorial Neural Bandits","created":"2023-05-31","cited_by_count":16,"area":null},{"id":"2206.12802","title":"Bounding the Width of Neural Networks via Coupled Initialization -- A Worst Case Analysis","created":"2022-06-26","cited_by_count":15,"area":null},{"id":"2301.11885","title":"Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions","created":"2023-01-27","cited_by_count":15,"area":null},{"id":"2104.14132","title":"Generalization Guarantees for Neural Architecture Search with Train-Validation Split","created":"2021-04-29","cited_by_count":14,"area":null},{"id":"2108.00207","title":"The Separation Capacity of Random Neural Networks","created":"2021-07-31","cited_by_count":14,"area":null},{"id":"2112.03657","title":"Understanding Square Loss in Training Overparametrized Neural Network Classifiers","created":"2021-12-07","cited_by_count":14,"area":null},{"id":"2206.01367","title":"Adversarial Unlearning: Reducing Confidence Along Adversarial Directions","created":"2022-06-03","cited_by_count":14,"area":"safety"},{"id":"2209.07238","title":"Generalization Properties of NAS under Activation and Skip Connection Search","created":"2022-09-15","cited_by_count":14,"area":null},{"id":"2406.01977","title":"What Improves the Generalization of Graph Transformers? A Theoretical Dive into the Self-attention and Positional Encoding","created":"2024-06-04","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2411.01410","title":"PageRank Bandits for Link Prediction","created":"2024-11-03","cited_by_count":14,"area":null},{"id":"2103.04554","title":"Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models","created":"2021-03-08","cited_by_count":13,"area":null},{"id":"2106.12034","title":"Pure Exploration in Kernel and Neural Bandits","created":"2021-06-22","cited_by_count":13,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2404.12928","title":"The Positivity of the Neural Tangent Kernel","created":"2024-04-19","cited_by_count":13,"area":null},{"id":"2202.06438","title":"Learning from Randomly Initialized Neural Network Features","created":"2022-02-13","cited_by_count":12,"area":null},{"id":"2406.06838","title":"Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes","created":"2024-06-10","cited_by_count":12,"area":null},{"id":"2205.07331","title":"Sobolev Acceleration and Statistical Optimality for Learning Elliptic Equations via Gradient Descent","created":"2022-05-15","cited_by_count":11,"area":null},{"id":"2210.00423","title":"Improved Algorithms for Neural Active Learning","created":"2022-10-02","cited_by_count":11,"area":null},{"id":"2210.01476","title":"Learning-based Design of Luenberger Observers for Autonomous Nonlinear Systems","created":"2022-10-04","cited_by_count":11,"area":null},{"id":"2307.06565","title":"Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification","created":"2023-07-13","cited_by_count":11,"area":null},{"id":"2406.00588","title":"Generalization Bound and New Algorithm for Clean-Label Backdoor Attack","created":"2024-06-02","cited_by_count":11,"area":null},{"id":"2110.12122","title":"Quantifying Epistemic Uncertainty in Deep Learning","created":"2021-10-23","cited_by_count":10,"area":null},{"id":"2207.06456","title":"Graph Neural Network Bandits","created":"2022-07-13","cited_by_count":10,"area":null},{"id":"2304.12216","title":"More Communication Does Not Result in Smaller Generalization Error in Federated Learning","created":"2023-04-24","cited_by_count":10,"area":null},{"id":"2305.19377","title":"Benign Overfitting in Deep Neural Networks under Lazy Training","created":"2023-05-30","cited_by_count":10,"area":null},{"id":"2306.05674","title":"Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural Networks","created":"2023-06-09","cited_by_count":10,"area":null},{"id":"2309.08044","title":"How many Neurons do we need? A refined Analysis for Shallow Networks trained with Gradient Descent","created":"2023-09-14","cited_by_count":10,"area":null},{"id":"2310.08425","title":"Differentially Private Non-convex Learning for Multi-layer Neural Networks","created":"2023-10-12","cited_by_count":10,"area":null},{"id":"2310.20579","title":"Initialization Matters: Privacy-Utility Analysis of Overparameterized Neural Networks","created":"2023-10-31","cited_by_count":10,"area":null},{"id":"2404.12522","title":"Neural Active Learning Beyond Bandits","created":"2024-04-18","cited_by_count":10,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2202.08070","title":"On Measuring Excess Capacity in Neural Networks","created":"2022-02-16","cited_by_count":9,"area":null},{"id":"2203.14328","title":"On the Neural Tangent Kernel Analysis of Randomly Pruned Neural Networks","created":"2022-03-27","cited_by_count":9,"area":null},{"id":"2305.16891","title":"Generalization Guarantees of Gradient Descent for Multi-Layer Neural Networks","created":"2023-05-26","cited_by_count":9,"area":null},{"id":"2310.06112","title":"Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach","created":"2023-10-09","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2401.12236","title":"The Surprising Harmfulness of Benign Overfitting for Adversarial Robustness","created":"2024-01-19","cited_by_count":9,"area":null},{"id":"2103.06671","title":"Sample Complexity of Offline Reinforcement Learning with Deep ReLU Networks","created":"2021-03-11","cited_by_count":8,"area":"offlinerl"}],"next_cursor":"100"}