{"total":129,"rows":[{"id":"2208.06677","title":"Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models","created":"2022-08-13","cited_by_count":174,"area":null},{"id":"2105.15134","title":"Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning","created":"2021-05-31","cited_by_count":119,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2209.14863","title":"Neural Networks Efficiently Learn Low-Dimensional Representations with SGD","created":"2022-09-29","cited_by_count":63,"area":null},{"id":"2107.00052","title":"Stochastic Gradient Descent-Ascent and Consensus Optimization for Smooth Games: Convergence Analysis under Expected Co-coercivity","created":"2021-06-30","cited_by_count":43,"area":null},{"id":"2102.13152","title":"Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency","created":"2021-02-25","cited_by_count":40,"area":null},{"id":"2201.08025","title":"Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape","created":"2022-01-20","cited_by_count":39,"area":null},{"id":"2205.06226","title":"The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning","created":"2022-05-12","cited_by_count":38,"area":null},{"id":"2203.04850","title":"Federated Minimax Optimization: Improved Convergence Analyses and Algorithms","created":"2022-03-09","cited_by_count":37,"area":null},{"id":"2211.16327","title":"On the Power of Foundation Models","created":"2022-11-29","cited_by_count":37,"area":null},{"id":"2306.13575","title":"Scaling MLPs: A Tale of Inductive Bias","created":"2023-06-23","cited_by_count":37,"area":null},{"id":"2307.01217","title":"FedCP: Separating Feature Information for Personalized Federated Learning via Conditional Policy","created":"2023-07-01","cited_by_count":36,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2202.05258","title":"Hardness of Noise-Free Learning for Two-Hidden-Layer Neural Networks","created":"2022-02-10","cited_by_count":28,"area":null},{"id":"2209.03525","title":"Implicit Full Waveform Inversion with Deep Neural Representation","created":"2022-09-08","cited_by_count":26,"area":null},{"id":"2106.08315","title":"Decentralized Local Stochastic Extra-Gradient for Variational Inequalities","created":"2021-06-15","cited_by_count":25,"area":null},{"id":"2302.10034","title":"Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron","created":"2023-02-20","cited_by_count":25,"area":null},{"id":"2101.08303","title":"From Local Pseudorandom Generators to Hardness of Learning","created":"2021-01-20","cited_by_count":24,"area":null},{"id":"2112.12982","title":"Parameter identifiability of a deep feedforward ReLU neural network","created":"2021-12-24","cited_by_count":24,"area":null},{"id":"2405.13796","title":"Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modeling","created":"2024-05-22","cited_by_count":23,"area":null},{"id":"2402.04084","title":"Provably learning a multi-head attention layer","created":"2024-02-06","cited_by_count":21,"area":null},{"id":"2205.12856","title":"Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function","created":"2022-05-25","cited_by_count":20,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2110.08616","title":"GradSign: Model Performance Inference with Theoretical Insights","created":"2021-10-16","cited_by_count":19,"area":null},{"id":"2201.08514","title":"How does unlabeled data improve generalization in self-training? A one-hidden-layer theoretical analysis","created":"2022-01-21","cited_by_count":19,"area":null},{"id":"2206.01342","title":"Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning","created":"2022-06-02","cited_by_count":19,"area":null},{"id":"2308.10279","title":"GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning","created":"2023-08-20","cited_by_count":18,"area":null},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2206.12802","title":"Bounding the Width of Neural Networks via Coupled Initialization -- A Worst Case Analysis","created":"2022-06-26","cited_by_count":15,"area":null},{"id":"2304.10524","title":"Learning Narrow One-Hidden-Layer ReLU Networks","created":"2023-04-20","cited_by_count":14,"area":null},{"id":"2310.11428","title":"Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression","created":"2023-10-17","cited_by_count":14,"area":null},{"id":"2307.05635","title":"Fundamental limits of overparametrized shallow neural networks for supervised learning","created":"2023-07-11","cited_by_count":13,"area":null},{"id":"2302.11962","title":"Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods","created":"2023-02-23","cited_by_count":12,"area":null},{"id":"2404.08602","title":"Sliding down the stairs: how correlated latent variables accelerate learning with neural networks","created":"2024-04-12","cited_by_count":12,"area":null},{"id":"2210.05956","title":"Towards Theoretically Inspired Neural Initialization Optimization","created":"2022-10-12","cited_by_count":11,"area":null},{"id":"2402.03625","title":"Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time","created":"2024-02-06","cited_by_count":11,"area":null},{"id":"2503.01901","title":"Identifying Sensitive Weights via Post-quantization Integral","created":"2025-02-28","cited_by_count":11,"area":null},{"id":"2107.10868","title":"Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time","created":"2021-07-22","cited_by_count":10,"area":null},{"id":"2409.01832","title":"Beyond Unconstrained Features: Neural Collapse for Shallow Neural Networks with General Data","created":"2024-09-03","cited_by_count":10,"area":null},{"id":"2103.13805","title":"Model Order Reduction based on Runge-Kutta Neural Network","created":"2021-03-25","cited_by_count":9,"area":null},{"id":"2106.06075","title":"A Decentralized Adaptive Momentum Method for Solving a Class of Min-Max Optimization Problems","created":"2021-06-10","cited_by_count":9,"area":null},{"id":"2109.14213","title":"On the One-sided Convergence of Adam-type Algorithms in Non-convex Non-concave Min-max Optimization","created":"2021-09-29","cited_by_count":9,"area":null},{"id":"2111.10489","title":"Modeling Design and Control Problems Involving Neural Network Surrogates","created":"2021-11-20","cited_by_count":9,"area":null},{"id":"2208.07951","title":"On the generalization of learning algorithms that do not converge","created":"2022-08-16","cited_by_count":9,"area":null},{"id":"2210.06088","title":"Annihilation of Spurious Minima in Two-Layer ReLU Networks","created":"2022-10-12","cited_by_count":9,"area":null},{"id":"2101.07150","title":"Stable Recovery of Entangled Weights: Towards Robust Identification of Deep Neural Networks from Minimal Samples","created":"2021-01-18","cited_by_count":8,"area":null},{"id":"2104.03969","title":"Detecting of a Patient's Condition From Clinical Narratives Using Natural Language Representation","created":"2021-04-08","cited_by_count":8,"area":null},{"id":"2207.03615","title":"Learning and generalization of one-hidden-layer neural networks, going beyond standard Gaussian data","created":"2022-07-07","cited_by_count":8,"area":null},{"id":"2302.11085","title":"Learning to Generalize Provably in Learning to Optimize","created":"2023-02-22","cited_by_count":8,"area":null},{"id":"2309.07452","title":"Is Solving Graph Neural Tangent Kernel Equivalent to Training Graph Neural Network?","created":"2023-09-14","cited_by_count":8,"area":null},{"id":"2403.12887","title":"Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport","created":"2024-03-19","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2209.10100","title":"Flashlight: Scalable Link Prediction with Effective Decoders","created":"2022-09-17","cited_by_count":7,"area":null},{"id":"2307.12496","title":"A faster and simpler algorithm for learning shallow networks","created":"2023-07-24","cited_by_count":7,"area":null},{"id":"2409.09099","title":"S-STE: Continuous Pruning Function for Efficient 2:4 Sparse Pre-training","created":"2024-09-13","cited_by_count":7,"area":null},{"id":"2111.05496","title":"ResNEsts and DenseNEsts: Block-based DNN Models with Improved Representation Guarantees","created":"2021-11-10","cited_by_count":6,"area":null},{"id":"2210.13983","title":"Optimization for Amortized Inverse Problems","created":"2022-10-25","cited_by_count":6,"area":null},{"id":"2302.07851","title":"Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization","created":"2023-02-15","cited_by_count":6,"area":null},{"id":"2403.07310","title":"How does promoting the minority fraction affect generalization? A theoretical study of the one-hidden-layer neural network on group imbalance","created":"2024-03-12","cited_by_count":6,"area":null},{"id":"2501.06386","title":"Using Pre-trained LLMs for Multivariate Time Series Forecasting","created":"2025-01-10","cited_by_count":6,"area":null},{"id":"2505.03577","title":"Information-theoretic reduction of deep neural networks to linear models in the overparametrized proportional regime","created":"2025-05-06","cited_by_count":6,"area":null},{"id":"2106.04186","title":"What training reveals about neural network complexity","created":"2021-06-08","cited_by_count":5,"area":null},{"id":"2205.03202","title":"Perseus: A Simple and Optimal High-Order Method for Variational Inequalities","created":"2022-05-06","cited_by_count":5,"area":null},{"id":"2206.02139","title":"Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks","created":"2022-06-05","cited_by_count":5,"area":null},{"id":"2211.04589","title":"Finite Sample Identification of Wide Shallow Neural Networks with Biases","created":"2022-11-08","cited_by_count":5,"area":null},{"id":"2410.11206","title":"Towards Understanding Why FixMatch Generalizes Better Than Supervised Learning","created":"2024-10-15","cited_by_count":5,"area":null},{"id":"2101.04243","title":"A Convergence Theory Towards Practical Over-parameterized Deep Neural Networks","created":"2021-01-12","cited_by_count":4,"area":null},{"id":"2102.02837","title":"Escaping Saddle Points for Nonsmooth Weakly Convex Functions via Perturbed Proximal Algorithms","created":"2021-02-04","cited_by_count":4,"area":null},{"id":"2108.00259","title":"How much pre-training is enough to discover a good subnetwork?","created":"2021-07-31","cited_by_count":4,"area":null},{"id":"2204.08306","title":"A Convergence Analysis of Nesterov's Accelerated Gradient Method in Training Deep Linear Neural Networks","created":"2022-04-18","cited_by_count":4,"area":null},{"id":"2211.01588","title":"A Convergence Theory for Federated Average: Beyond Smoothness","created":"2022-11-03","cited_by_count":4,"area":null},{"id":"2303.00039","title":"M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptation","created":"2023-02-28","cited_by_count":4,"area":null},{"id":"2303.11526","title":"PRISE: Demystifying Deep Lucas-Kanade with Strongly Star-Convex Constraints for Multimodel Image Alignment","created":"2023-03-21","cited_by_count":4,"area":null},{"id":"2407.07670","title":"Generalization Analysis of Online Stochastic Gradient Descent for Overparameterized Two-Layer Neural Networks","created":"2024-07-10","cited_by_count":4,"area":null},{"id":"2502.16021","title":"Learning Neural Networks with Distribution Shift: Efficiently Certifiable Guarantees","created":"2025-02-22","cited_by_count":4,"area":null},{"id":"2507.03004","title":"CLUES: Collaborative High-Quality Data Selection for LLMs via Training Dynamics","created":"2025-07-02","cited_by_count":4,"area":null},{"id":"2104.11895","title":"Achieving Small Test Error in Mildly Overparameterized Neural Networks","created":"2021-04-24","cited_by_count":3,"area":null},{"id":"2105.12823","title":"UAV-Assisted Communication in Remote Disaster Areas using Imitation Learning","created":"2021-04-02","cited_by_count":3,"area":null},{"id":"2204.10536","title":"Sharper Utility Bounds for Differentially Private Models","created":"2022-04-22","cited_by_count":3,"area":null},{"id":"2206.03727","title":"Wavelet Regularization Benefits Adversarial Training","created":"2022-06-08","cited_by_count":3,"area":null},{"id":"2209.15265","title":"Overparameterized ReLU Neural Networks Learn the Simplest Models: Neural Isometry and Exact Recovery","created":"2022-09-30","cited_by_count":3,"area":null},{"id":"2302.06086","title":"Reliability Assurance for Deep Neural Network Architectures Against Numerical Defects","created":"2023-02-13","cited_by_count":3,"area":null},{"id":"2312.14922","title":"Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks","created":"2023-12-22","cited_by_count":3,"area":null},{"id":"2411.10649","title":"Deep Loss Convexification for Learning Iterative Models","created":"2024-11-16","cited_by_count":3,"area":null},{"id":"2509.19773","title":"Sobolev acceleration for neural networks","created":"2025-09-24","cited_by_count":3,"area":null},{"id":"2104.03934","title":"Machine Learning Based on Natural Language Processing to Detect Cardiac Failure in Clinical Narratives","created":"2021-04-08","cited_by_count":2,"area":null},{"id":"2305.14122","title":"Transferring Learning Trajectories of Neural Networks","created":"2023-05-23","cited_by_count":2,"area":null},{"id":"2312.16819","title":"Hidden Minima in Two-Layer ReLU Networks","created":"2023-12-28","cited_by_count":2,"area":null},{"id":"2401.03214","title":"Understanding Representation Learnability of Nonlinear Self-Supervised Learning","created":"2024-01-06","cited_by_count":2,"area":null},{"id":"2501.08501","title":"Scalable Bayesian Physics-Informed Kolmogorov-Arnold Networks","created":"2025-01-15","cited_by_count":2,"area":null},{"id":"2506.18588","title":"Optimization-Induced Dynamics of Lipschitz Continuity in Neural Networks","created":"2025-06-23","cited_by_count":2,"area":null},{"id":"2602.05600","title":"On the Superlinear Relationship between SGD Noise Covariance and Loss Landscape Curvature","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2104.09872","title":"Robust Sensor Fusion Algorithms Against Voice Command Attacks in Autonomous Vehicles","created":"2021-04-20","cited_by_count":1,"area":null},{"id":"2203.16455","title":"Explicitising The Implicit Intrepretability of Deep Neural Networks Via Duality","created":"2022-03-01","cited_by_count":1,"area":null},{"id":"2205.08426","title":"Can You Still See Me?: Reconstructing Robot Operations Over End-to-End Encrypted Channels","created":"2022-05-17","cited_by_count":1,"area":null},{"id":"2205.12022","title":"Improving Human Image Synthesis with Residual Fast Fourier Transformation and Wasserstein Distance","created":"2022-05-24","cited_by_count":1,"area":null},{"id":"2206.05562","title":"Parameter Convex Neural Networks","created":"2022-06-11","cited_by_count":1,"area":null},{"id":"2209.15278","title":"Rethinking skip connection model as a learnable Markov chain","created":"2022-09-30","cited_by_count":1,"area":null},{"id":"2311.15221","title":"The Local Landscape of Phase Retrieval Under Limited Samples","created":"2023-11-26","cited_by_count":1,"area":null},{"id":"2511.21325","title":"SONAR: Spectral-Contrastive Audio Residuals for Generalizable Deepfake Detection","created":"2025-11-26","cited_by_count":1,"area":null}],"next_cursor":"100"}