{"total":88,"rows":[{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380,"area":null},{"id":"2310.17157","title":"Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time","created":"2023-10-26","cited_by_count":252,"area":null},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187,"area":null},{"id":"2206.15144","title":"Neural Networks can Learn Representations with Gradient Descent","created":"2022-06-30","cited_by_count":161,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2302.11055","title":"SGD learning on neural networks: leap complexity and saddle-to-saddle dynamics","created":"2023-02-21","cited_by_count":143,"area":null},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119,"area":null},{"id":"2402.01868","title":"Challenges in Training PINNs: A Loss Landscape Perspective","created":"2024-02-02","cited_by_count":113,"area":null},{"id":"2302.06015","title":"A Theoretical Understanding of Shallow Vision Transformers: Learning, Generalization, and Sample Complexity","created":"2023-02-12","cited_by_count":77,"area":null},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63,"area":null},{"id":"2108.10573","title":"The staircase property: How hierarchical structure can guide deep learning","created":"2021-08-24","cited_by_count":62,"area":null},{"id":"2106.06770","title":"What can linearized neural networks actually say about generalization?","created":"2021-06-12","cited_by_count":49,"area":null},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2206.01717","title":"A Theoretical Analysis on Feature Learning in Neural Networks: Emergence from Inputs and Advantage over Fixed Features","created":"2022-06-03","cited_by_count":49,"area":null},{"id":"2406.01581","title":"Neural network learns low-dimensional polynomials with SGD near the information-theoretic limit","created":"2024-06-03","cited_by_count":46,"area":null},{"id":"2103.01210","title":"Quantifying the Benefit of Using Differentiable Learning over Tangent Kernels","created":"2021-03-01","cited_by_count":41,"area":null},{"id":"2307.11353","title":"What can a Single Attention Layer Learn? A Study Through the Random Features Lens","created":"2023-07-21","cited_by_count":40,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2202.07626","title":"Random Feature Amplification: Feature Learning and Generalization in Neural Networks","created":"2022-02-15","cited_by_count":35,"area":null},{"id":"2108.04190","title":"On the Power of Differentiable Learning versus PAC and SQ Learning","created":"2021-08-09","cited_by_count":28,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2306.17798","title":"Masked Contrastive Graph Representation Learning for Age Estimation","created":"2023-06-16","cited_by_count":27,"area":null},{"id":"2210.06850","title":"Sample-Then-Optimize Batch Neural Thompson Sampling","created":"2022-10-13","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2106.06529","title":"The Limitations of Large Width in Neural Networks: A Deep Gaussian Process Perspective","created":"2021-06-11","cited_by_count":21,"area":null},{"id":"2106.06573","title":"Understanding Deflation Process in Over-parametrized Tensor Decomposition","created":"2021-06-11","cited_by_count":20,"area":null},{"id":"2306.16361","title":"Beyond NTK with Vanilla Gradient Descent: A Mean-Field Analysis of Neural Networks with Polynomial Width, Samples, and Time","created":"2023-06-28","cited_by_count":20,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2401.07187","title":"A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models","created":"2024-01-14","cited_by_count":20,"area":null},{"id":"2101.02533","title":"Towards Understanding Learning in Neural Networks with Linear Teachers","created":"2021-01-07","cited_by_count":19,"area":null},{"id":"2102.00434","title":"The Connection Between Approximation, Depth Separation and Learnability in Neural Networks","created":"2021-01-31","cited_by_count":19,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2305.06986","title":"Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks","created":"2023-05-11","cited_by_count":19,"area":null},{"id":"2208.03113","title":"On the non-universality of deep learning: quantifying the cost of symmetry","created":"2022-08-05","cited_by_count":18,"area":null},{"id":"2101.01152","title":"Provable Generalization of SGD-trained Neural Networks of Any Width in the Presence of Adversarial Label Noise","created":"2021-01-04","cited_by_count":17,"area":null},{"id":"2112.03257","title":"Functional Regularization for Reinforcement Learning via Learned Fourier Features","created":"2021-12-06","cited_by_count":17,"area":null},{"id":"2107.04518","title":"Optimal Gradient-based Algorithms for Non-concave Bandit Optimization","created":"2021-07-09","cited_by_count":15,"area":null},{"id":"2112.00195","title":"Efficient Online Bayesian Inference for Neural Bandits","created":"2021-12-01","cited_by_count":15,"area":null},{"id":"2207.12258","title":"Equivariance and Invariance Inductive Bias for Learning from Insufficient Data","created":"2022-07-25","cited_by_count":14,"area":null},{"id":"2310.12408","title":"Provable Guarantees for Neural Networks via Gradient Feature Learning","created":"2023-10-19","cited_by_count":14,"area":null},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2210.14019","title":"The Curious Case of Benign Memorization","created":"2022-10-25","cited_by_count":12,"area":null},{"id":"2204.09664","title":"Deep Learning meets Nonparametric Regression: Are Weight-Decayed DNNs Locally Adaptive?","created":"2022-04-20","cited_by_count":10,"area":null},{"id":"2402.05271","title":"Feature learning as alignment: a structural property of gradient descent in non-linear neural networks","created":"2024-02-07","cited_by_count":10,"area":null},{"id":"2107.06466","title":"Going Beyond Linear RL: Sample Efficient Neural Function Approximation","created":"2021-07-14","cited_by_count":9,"area":null},{"id":"2109.14213","title":"On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization","created":"2021-09-29","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2311.13774","title":"Learning Hierarchical Polynomials with Three-Layer Neural Networks","created":"2023-11-23","cited_by_count":9,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2106.07814","title":"Sample Efficient Reinforcement Learning In Continuous State Spaces: A Perspective Beyond Linearity","created":"2021-06-15","cited_by_count":6,"area":null},{"id":"2109.14142","title":"On the Provable Generalization of Recurrent Neural Networks","created":"2021-09-29","cited_by_count":6,"area":null},{"id":"2112.07441","title":"An Interpretive Constrained Linear Model for ResNet and MgNet","created":"2021-12-14","cited_by_count":6,"area":null},{"id":"2601.19756","title":"Provable Learning of Random Hierarchy Models and Hierarchical Shallow-to-Deep Chaining","created":"2026-01-27","cited_by_count":6,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2602.10867","title":"Deep Learning of Compositional Targets with Hierarchical Spectral Methods","created":"2026-02-11","cited_by_count":5,"area":null},{"id":"2310.10171","title":"On permutation symmetries in Bayesian neural network posteriors: a variational perspective","created":"2023-10-16","cited_by_count":4,"area":null},{"id":"2402.07025","title":"Generalization Error of Graph Neural Networks in the Mean-field Regime","created":"2024-02-10","cited_by_count":4,"area":null},{"id":"2105.00262","title":"One-pass Stochastic Gradient Descent in Overparametrized Two-layer Neural Networks","created":"2021-05-01","cited_by_count":3,"area":null},{"id":"2309.09258","title":"Global Convergence of SGD For Logistic Loss on Two Layer Neural Nets","created":"2023-09-17","cited_by_count":3,"area":null},{"id":"2311.03115","title":"RELand: Risk Estimation of Landmines via Interpretable Invariant Risk Minimization","created":"2023-11-06","cited_by_count":3,"area":null},{"id":"2311.06749","title":"Aggregate, Decompose, and Fine-Tune: A Simple Yet Effective Factor-Tuning Method for Vision Transformer","created":"2023-11-12","cited_by_count":3,"area":null},{"id":"2605.25608","title":"Learning Sparse Compositional Functions with Norm-Constrained Neural Networks","created":"2026-05-25","cited_by_count":3,"area":null},{"id":"2606.09658","title":"Muon Learns More Robust and Transferable Features than Adam","created":"2026-06-08","cited_by_count":3,"area":null},{"id":"2305.16508","title":"Most Neural Networks Are Almost Learnable","created":"2023-05-25","cited_by_count":2,"area":null},{"id":"2502.16331","title":"A Gap Between the Gaussian RKHS and Neural Networks: An Infinite-Center Asymptotic Analysis","created":"2025-02-22","cited_by_count":2,"area":null},{"id":"2203.05417","title":"Deep Regression Ensembles","created":"2022-03-10","cited_by_count":1,"area":null},{"id":"2205.06571","title":"Convergence Analysis of Deep Residual Networks","created":"2022-05-13","cited_by_count":1,"area":null},{"id":"2205.14553","title":"Long-Tailed Learning Requires Feature Learning","created":"2022-05-29","cited_by_count":1,"area":null},{"id":"2302.06939","title":"Underwater target detection based on improved YOLOv7","created":"2023-02-14","cited_by_count":1,"area":null},{"id":"2305.13141","title":"Tight conditions for when the NTK approximation is valid","created":"2023-05-22","cited_by_count":1,"area":null},{"id":"2410.01239","title":"Replacement Learning: Training Vision Tasks with Fewer Learnable Parameters","created":"2024-10-02","cited_by_count":1,"area":null},{"id":"2503.10428","title":"Langevin Monte-Carlo Provably Learns Depth Two Neural Nets at Any Size and Data","created":"2025-03-13","cited_by_count":1,"area":null},{"id":"2507.19680","title":"Feature learning is decoupled from generalization in high capacity neural networks","created":"2025-07-25","cited_by_count":1,"area":null},{"id":"2102.09322","title":"Harnessing Tensor Structures -- Multi-Mode Reservoir Computing and Its Application in Massive MIMO","created":"2021-01-25","cited_by_count":0,"area":null},{"id":"2103.05109","title":"Highly Efficient Representation and Active Learning Framework and Its Application to Imbalanced Medical Image Classification","created":"2021-02-25","cited_by_count":0,"area":null},{"id":"2106.06097","title":"Neural Optimization Kernel: Towards Robust Deep Learning","created":"2021-06-11","cited_by_count":0,"area":null},{"id":"2111.01166","title":"Dynamics of Local Elasticity During Training of Neural Nets","created":"2021-11-01","cited_by_count":0,"area":null},{"id":"2111.03861","title":"What augmentations are sensitive to hyper-parameters and why?","created":"2021-11-06","cited_by_count":0,"area":null},{"id":"2411.19819","title":"GradAlign for Training-free Model Performance Inference","created":"2024-11-29","cited_by_count":0,"area":null},{"id":"2507.05533","title":"Theoretical Learning Performance of Graph Neural Networks: The Impact of Jumping Connections and Layer-wise Sparsification","created":"2025-07-07","cited_by_count":0,"area":null},{"id":"2510.08060","title":"A class-driven hierarchical ResNet for classification of multispectral remote sensing images","created":"2025-10-09","cited_by_count":0,"area":null},{"id":"2510.22667","title":"Block Coordinate Descent for Neural Networks Provably Finds Global Minima","created":"2025-10-26","cited_by_count":0,"area":null},{"id":"2603.09310","title":"A Gaussian Comparison Theorem for Training Dynamics in Machine Learning","created":"2026-03-10","cited_by_count":0,"area":null},{"id":"2605.19533","title":"Replacement Learning: Training Neural Networks with Fewer Parameters","created":"2026-05-19","cited_by_count":0,"area":null},{"id":"2606.17013","title":"Exploding and vanishing gradients in deep neural networks: the effect of residual connections","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2607.23397","title":"A Statistical Difference between Single-Layer Learning and Hierarchical Learning in Wide Neural Networks","created":"2026-07-26","cited_by_count":0,"area":null},{"id":"2607.25200","title":"Algorithmic Separation between Constant-Depth and Logarithmic-Depth Neural Networks","created":"2026-07-28","cited_by_count":0,"area":null}],"next_cursor":null}