{"total":82,"rows":[{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119,"area":null},{"id":"2102.13219","title":"Learning with invariances in random features and kernel models","created":"2021-02-25","cited_by_count":89,"area":null},{"id":"2112.00029","title":"Pixelated Butterfly: Simple and Efficient Sparse training for Neural Network Models","created":"2021-11-30","cited_by_count":76,"area":null},{"id":"2112.07628","title":"Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time","created":"2021-12-14","cited_by_count":62,"area":null},{"id":"2108.11371","title":"Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization","created":"2021-08-25","cited_by_count":49,"area":null},{"id":"2304.10411","title":"Attention Scheme Inspired Softmax Regression","created":"2023-04-20","cited_by_count":49,"area":null},{"id":"2402.11867","title":"LoRA Training in the NTK Regime has No Spurious Local Minima","created":"2024-02-19","cited_by_count":48,"area":null},{"id":"2204.10425","title":"Spectrum of inner-product kernel matrices in the polynomial regime and multiple descent phenomenon in kernel ridge regression","created":"2022-04-21","cited_by_count":45,"area":null},{"id":"2303.16504","title":"An Over-parameterized Exponential Regression","created":"2023-03-29","cited_by_count":45,"area":null},{"id":"2204.02892","title":"Sub-Task Decomposition Enables Learning in Sequence to Sequence Tasks","created":"2022-04-06","cited_by_count":41,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2305.00660","title":"An Iterative Algorithm for Rescaled Hyperbolic Functions Regression","created":"2023-05-01","cited_by_count":35,"area":null},{"id":"2108.09420","title":"Fast Sketching of Polynomial Kernels of Polynomial Degree","created":"2021-08-21","cited_by_count":33,"area":null},{"id":"2110.04622","title":"Does Preprocessing Help Training Over-parameterized Neural Networks?","created":"2021-10-09","cited_by_count":32,"area":null},{"id":"2111.14482","title":"High Quality Segmentation for Ultra High-resolution Images","created":"2021-11-29","cited_by_count":31,"area":null},{"id":"2305.02657","title":"On the Eigenvalue Decay Rates of a Class of Neural-Network Related Kernel Functions Defined on General Domains","created":"2023-05-04","cited_by_count":31,"area":null},{"id":"2306.04933","title":"InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding","created":"2023-06-08","cited_by_count":30,"area":null},{"id":"2309.07418","title":"A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time","created":"2023-09-14","cited_by_count":30,"area":null},{"id":"2211.14227","title":"Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing","created":"2022-11-25","cited_by_count":29,"area":null},{"id":"2108.07686","title":"Scaling Laws for Deep Learning","created":"2021-08-17","cited_by_count":26,"area":null},{"id":"2308.12247","title":"How to Protect Copyright Data in Optimization of Large Language Models?","created":"2023-08-23","cited_by_count":26,"area":null},{"id":"2406.12839","title":"Evaluating the design space of diffusion-based generative models","created":"2024-06-18","cited_by_count":26,"area":"diffusion"},{"id":"2107.05074","title":"SGD: The Role of Implicit Regularization, Batch-size and Multiple-epochs","created":"2021-07-11","cited_by_count":22,"area":null},{"id":"2208.04508","title":"Training Overparametrized Neural Networks in Sublinear Time","created":"2022-08-09","cited_by_count":22,"area":null},{"id":"2208.05395","title":"A Sublinear Adversarial Training Algorithm","created":"2022-08-10","cited_by_count":22,"area":null},{"id":"2111.08308","title":"Learning with convolution and pooling operations in kernel methods","created":"2021-11-16","cited_by_count":21,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2106.04759","title":"Communication-efficient SGD: From Local SGD to One-Shot Averaging","created":"2021-06-09","cited_by_count":19,"area":null},{"id":"2105.11558","title":"Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systems","created":"2021-05-24","cited_by_count":17,"area":null},{"id":"2208.03635","title":"Federated Adversarial Learning: A Framework with Convergence Analysis","created":"2022-08-07","cited_by_count":17,"area":null},{"id":"2502.00896","title":"LoR-VP: Low-Rank Visual Prompting for Efficient Vision Model Adaptation","created":"2025-02-02","cited_by_count":17,"area":null},{"id":"2212.14852","title":"An Analysis of Attention via the Lens of Exchangeability and Latent Variable Models","created":"2022-12-30","cited_by_count":16,"area":null},{"id":"2206.12802","title":"Bounding the Width of Neural Networks via Coupled Initialization -- A Worst Case Analysis","created":"2022-06-26","cited_by_count":15,"area":null},{"id":"2302.13752","title":"A Brief Survey on the Approximation Theory for Sequence Modelling","created":"2023-02-27","cited_by_count":15,"area":null},{"id":"2310.11685","title":"Why Softmax Attention Outperforms Linear Attention","created":"2023-10-18","cited_by_count":15,"area":null},{"id":"2103.11488","title":"The Discovery of Dynamics via Linear Multistep Methods and Deep Learning: Error Estimation","created":"2021-03-21","cited_by_count":14,"area":null},{"id":"2407.13621","title":"Differential Privacy Mechanisms in Neural Tangent Kernel Regression","created":"2024-07-18","cited_by_count":14,"area":null},{"id":"2105.05001","title":"FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis","created":"2021-05-11","cited_by_count":13,"area":null},{"id":"2311.01575","title":"On the Convergence of Encoder-only Shallow Transformers","created":"2023-11-02","cited_by_count":13,"area":null},{"id":"2404.04876","title":"HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Models","created":"2024-04-07","cited_by_count":13,"area":null},{"id":"2307.06565","title":"Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification","created":"2023-07-13","cited_by_count":11,"area":null},{"id":"2110.12122","title":"Quantifying Epistemic Uncertainty in Deep Learning","created":"2021-10-23","cited_by_count":10,"area":null},{"id":"2205.13814","title":"Global Convergence of Over-parameterized Deep Equilibrium Models","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2305.09779","title":"A Scalable Walsh-Hadamard Regularizer to Overcome the Low-degree Spectral Bias of Neural Networks","created":"2023-05-16","cited_by_count":10,"area":null},{"id":"2306.05674","title":"Efficient Uncertainty Quantification and Reduction for Over-Parameterized Neural Networks","created":"2023-06-09","cited_by_count":10,"area":null},{"id":"2309.08044","title":"How many Neurons do we need? A refined Analysis for Shallow Networks trained with Gradient Descent","created":"2023-09-14","cited_by_count":10,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2309.07452","title":"Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?","created":"2023-09-14","cited_by_count":8,"area":null},{"id":"2402.12241","title":"Convergence of Gradient Descent for Recurrent Neural Networks: A Nonasymptotic Analysis","created":"2024-02-19","cited_by_count":8,"area":null},{"id":"2410.06300","title":"SHAP values via sparse Fourier representation","created":"2024-10-08","cited_by_count":8,"area":null},{"id":"2210.14064","title":"Learning Low Dimensional State Spaces with Overparameterized Recurrent Neural Nets","created":"2022-10-25","cited_by_count":7,"area":null},{"id":"2109.14142","title":"On the Provable Generalization of Recurrent Neural Networks","created":"2021-09-29","cited_by_count":6,"area":null},{"id":"2308.08358","title":"Convergence of Two-Layer Regression with Nonlinear Units","created":"2023-08-16","cited_by_count":6,"area":null},{"id":"2210.11452","title":"Global Convergence of SGD On Two Layer Neural Nets","created":"2022-10-20","cited_by_count":5,"area":null},{"id":"2305.08001","title":"Structured and Fast Optimization: The Kronecker SGD Algorithm","created":"2023-05-13","cited_by_count":5,"area":null},{"id":"2306.03356","title":"Query Complexity of Active Learning for Function Family With Nearly Orthogonal Basis","created":"2023-06-06","cited_by_count":4,"area":null},{"id":"2404.01964","title":"CAM-Based Methods Can See through Walls","created":"2024-04-02","cited_by_count":4,"area":null},{"id":"2407.07670","title":"Generalization Analysis of Online Stochastic Gradient Descent for Overparameterized Two-Layer Neural Networks","created":"2024-07-10","cited_by_count":4,"area":null},{"id":"2503.01314","title":"Scaling Law Phenomena Across Regression Paradigms: Multiple and Kernel Approaches","created":"2025-03-03","cited_by_count":4,"area":null},{"id":"2105.00262","title":"One-pass Stochastic Gradient Descent in Overparametrized Two-layer Neural Networks","created":"2021-05-01","cited_by_count":3,"area":null},{"id":"2111.06027","title":"Theoretical Exploration of Flexible Transmitter Model","created":"2021-11-11","cited_by_count":3,"area":null},{"id":"2210.05212","title":"On Scrambling Phenomena for Randomly Initialized Recurrent Networks","created":"2022-10-11","cited_by_count":3,"area":null},{"id":"2306.17184","title":"State space models can express n-gram languages","created":"2023-06-20","cited_by_count":3,"area":null},{"id":"2112.02446","title":"Fast Graph Neural Tangent Kernel via Kronecker Sketching","created":"2021-12-04","cited_by_count":2,"area":null},{"id":"2411.02784","title":"Generalization and Risk Bounds for Recurrent Neural Networks","created":"2024-11-05","cited_by_count":2,"area":null},{"id":"2205.04678","title":"Real-time Forecasting of Time Series in Financial Markets Using Sequentially Trained Many-to-one LSTMs","created":"2022-05-10","cited_by_count":1,"area":null},{"id":"2307.15679","title":"Dynamic Analysis and an Eigen Initializer for Recurrent Neural Networks","created":"2023-07-28","cited_by_count":1,"area":null},{"id":"2311.14658","title":"Convergence Analysis for Learning Orthonormal Deep Linear Neural Networks","created":"2023-11-24","cited_by_count":1,"area":null},{"id":"2405.11451","title":"Error Analysis of Three-Layer Neural Network Trained with PGD for Deep Ritz Method","created":"2024-05-19","cited_by_count":1,"area":null},{"id":"2602.10911","title":"Tuning the burn-in phase in training recurrent neural networks improves their performance","created":"2026-02-11","cited_by_count":1,"area":null},{"id":"2606.06861","title":"Modeling Nonlinear Feature Interactions with Product-Unit Residual Networks","created":"2026-06-05","cited_by_count":1,"area":null},{"id":"2102.11736","title":"Recurrent Model Predictive Control","created":"2021-02-23","cited_by_count":0,"area":null},{"id":"2106.00047","title":"Learning and Generalization in RNNs","created":"2021-05-31","cited_by_count":0,"area":null},{"id":"2106.15128","title":"Regularized OFU: an Efficient UCB Estimator forNon-linear Contextual Bandit","created":"2021-06-29","cited_by_count":0,"area":null},{"id":"2111.01166","title":"Dynamics of Local Elasticity During Training of Neural Nets","created":"2021-11-01","cited_by_count":0,"area":null},{"id":"2211.10582","title":"Linear RNNs Provably Learn Linear Dynamic Systems","created":"2022-11-19","cited_by_count":0,"area":null},{"id":"2307.15088","title":"Equitable Time-Varying Pricing Tariff Design: A Joint Learning and Optimization Approach","created":"2023-07-26","cited_by_count":0,"area":null},{"id":"2501.18092","title":"Learning Provably Improves the Convergence of Gradient Descent","created":"2025-01-30","cited_by_count":0,"area":null},{"id":"2606.00243","title":"Dynamics and Representation Structure of Local Approximations to Gradient-Based Learning in Linear Recurrent Neural Networks","created":"2026-05-29","cited_by_count":0,"area":null},{"id":"2608.21194","title":"ES-VP : Energy-Shaped Dynamic Visual Prompting for Efficient Model Adaptation","created":"2026-08-21","cited_by_count":0,"area":null}],"next_cursor":null}