{"total":70,"rows":[{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166,"area":null},{"id":"2402.16788","title":"Why Transformers Need Adam: A Hessian Perspective","created":"2024-02-26","cited_by_count":124,"area":null},{"id":"2102.07845","title":"MARINA: Faster Non-Convex Distributed Learning with Compression","created":"2021-02-15","cited_by_count":78,"area":null},{"id":"2103.05127","title":"Model Complexity of Deep Learning: A Survey","created":"2021-03-08","cited_by_count":65,"area":null},{"id":"2102.01168","title":"Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges","created":"2021-01-27","cited_by_count":50,"area":null},{"id":"2301.11500","title":"Understanding Incremental Learning of Gradient Descent: A Fine-grained Analysis of Matrix Sensing","created":"2023-01-27","cited_by_count":42,"area":null},{"id":"2104.11044","title":"Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes","created":"2021-04-22","cited_by_count":28,"area":null},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24,"area":null},{"id":"2203.16462","title":"Convergence of gradient descent for deep neural networks","created":"2022-03-30","cited_by_count":24,"area":null},{"id":"2102.07227","title":"Learning by Turning: Neural Architecture Aware Optimisation","created":"2021-02-14","cited_by_count":23,"area":null},{"id":"2206.10451","title":"Winning the Lottery Ahead of Time: Efficient Early Network Pruning","created":"2022-06-21","cited_by_count":21,"area":null},{"id":"2105.03588","title":"Facial Emotion Recognition: State of the Art Performance on FER2013","created":"2021-05-08","cited_by_count":20,"area":null},{"id":"2106.04975","title":"The dilemma of quantum neural networks","created":"2021-06-09","cited_by_count":20,"area":null},{"id":"2203.06578","title":"Symbolic Learning to Optimize: Towards Interpretability and Scalability","created":"2022-03-13","cited_by_count":16,"area":null},{"id":"2105.10065","title":"A Probabilistic Approach to Neural Network Pruning","created":"2021-05-20","cited_by_count":15,"area":null},{"id":"2407.08100","title":"Non-convergence of Adam and other adaptive stochastic gradient descent optimization methods for non-vanishing learning rates","created":"2024-07-11","cited_by_count":15,"area":null},{"id":"2407.21078","title":"Convergence rates for the Adam optimizer","created":"2024-07-29","cited_by_count":15,"area":null},{"id":"2505.02809","title":"Towards Quantifying the Hessian Structure of Neural Networks","created":"2025-05-05","cited_by_count":13,"area":null},{"id":"2111.00856","title":"Large-Scale Deep Learning Optimizations: A Comprehensive Survey","created":"2021-11-01","cited_by_count":10,"area":null},{"id":"2408.11979","title":"Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?","created":"2024-08-21","cited_by_count":10,"area":null},{"id":"2209.14501","title":"On Quantum Speedups for Nonconvex Optimization via Quantum Tunneling Walks","created":"2022-09-29","cited_by_count":9,"area":null},{"id":"2402.05155","title":"Non-convergence to global minimizers for Adam and stochastic gradient descent optimization and constructions of local minimizers in the training of artificial neural networks","created":"2024-02-07","cited_by_count":9,"area":null},{"id":"2101.07150","title":"Stable Recovery of Entangled Weights: Towards Robust Identification of Deep Neural Networks from Minimal Samples","created":"2021-01-18","cited_by_count":8,"area":null},{"id":"2202.12262","title":"On the Omnipresence of Spurious Local Minima in Certain Neural Network Training Problems","created":"2022-02-23","cited_by_count":8,"area":null},{"id":"2305.06472","title":"ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps","created":"2023-05-10","cited_by_count":8,"area":null},{"id":"2504.19426","title":"Sharp higher order convergence rates for the Adam optimizer","created":"2025-04-28","cited_by_count":8,"area":null},{"id":"2203.09413","title":"Stability and Risk Bounds of Iterative Hard Thresholding","created":"2022-03-17","cited_by_count":7,"area":null},{"id":"2210.00973","title":"NCVX: A General-Purpose Optimization Solver for Constrained Machine and Deep Learning","created":"2022-10-03","cited_by_count":7,"area":null},{"id":"2302.03952","title":"Cut your Losses with Squentropy","created":"2023-02-08","cited_by_count":6,"area":null},{"id":"2111.13984","title":"NCVX: A User-Friendly and Scalable Package for Nonconvex Optimization in Machine Learning","created":"2021-11-27","cited_by_count":5,"area":null},{"id":"2202.05750","title":"Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning","created":"2022-02-11","cited_by_count":5,"area":null},{"id":"2101.00935","title":"First-Order Methods for Convex Optimization","created":"2021-01-04","cited_by_count":4,"area":null},{"id":"2106.12819","title":"Accelerating variational quantum algorithms with multiple quantum processors","created":"2021-06-24","cited_by_count":4,"area":null},{"id":"2110.05454","title":"Momentum Centering and Asynchronous Update for Adaptive Gradient Methods","created":"2021-10-11","cited_by_count":4,"area":null},{"id":"2208.06537","title":"Defense against Backdoor Attacks via Identifying and Purifying Bad Neurons","created":"2022-08-13","cited_by_count":4,"area":null},{"id":"2402.05696","title":"Fixed width treelike neural networks capacity analysis -- generic activations","created":"2024-02-08","cited_by_count":4,"area":null},{"id":"2105.09477","title":"Deep learning for solution and inversion of structural mechanics and vibrations","created":"2021-05-18","cited_by_count":3,"area":null},{"id":"2201.08314","title":"Adaptive neighborhood Metric learning","created":"2022-01-20","cited_by_count":3,"area":null},{"id":"2312.08244","title":"Capacity of the treelike sign perceptrons neural networks with one hidden layer -- RDT based upper bounds","created":"2023-12-13","cited_by_count":3,"area":null},{"id":"2312.08257","title":"\\emph{Lifted} RDT based capacity analysis of the 1-hidden layer treelike \\emph{sign} perceptrons neural networks","created":"2023-12-13","cited_by_count":3,"area":null},{"id":"2407.03125","title":"Foundations and Frontiers of Graph Learning Theory","created":"2024-07-03","cited_by_count":3,"area":null},{"id":"2105.14035","title":"DeepMoM: Robust Deep Learning With Median-of-Means","created":"2021-05-28","cited_by_count":2,"area":null},{"id":"2106.13064","title":"Advancing biological super-resolution microscopy through deep learning: a brief review","created":"2021-06-24","cited_by_count":2,"area":null},{"id":"2111.12963","title":"Error Bounds for a Matrix-Vector Product Approximation with Deep ReLU Neural Networks","created":"2021-11-25","cited_by_count":2,"area":null},{"id":"2202.10244","title":"Stochastic Modeling of Inhomogeneities in the Aortic Wall and Uncertainty Quantification using a Bayesian Encoder-Decoder Surrogate","created":"2022-02-21","cited_by_count":2,"area":null},{"id":"2206.07483","title":"Blind Estimation of a Doubly Selective OFDM Channel: A Deep Learning Algorithm and Theory","created":"2022-05-30","cited_by_count":2,"area":null},{"id":"2302.10963","title":"Can Learning Be Explained By Local Optimality In Robust Low-rank Matrix Recovery?","created":"2023-02-21","cited_by_count":2,"area":null},{"id":"2310.15976","title":"Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization","created":"2023-10-24","cited_by_count":2,"area":null},{"id":"2509.18396","title":"Development of Deep Learning Optimizers: Approaches, Concepts, and Update Rules","created":"2025-09-22","cited_by_count":2,"area":null},{"id":"2601.21624","title":"Training Memory in Deep Neural Networks: Mechanisms, Evidence, and Measurement Gaps","created":"2026-01-29","cited_by_count":2,"area":null},{"id":"2110.05976","title":"Early Melanoma Diagnosis with Sequential Dermoscopic Images","created":"2021-10-12","cited_by_count":1,"area":null},{"id":"2202.06658","title":"PFGE: Parsimonious Fast Geometric Ensembling of DNNs","created":"2022-02-14","cited_by_count":1,"area":null},{"id":"2301.06956","title":"Expected Gradients of Maxout Networks and Consequences to Parameter Initialization","created":"2023-01-17","cited_by_count":1,"area":null},{"id":"2410.11444","title":"A Theoretical Survey on Foundation Models","created":"2024-10-15","cited_by_count":1,"area":null},{"id":"2105.07222","title":"On the Distributional Properties of Adaptive Gradients","created":"2021-05-15","cited_by_count":0,"area":null},{"id":"2109.10664","title":"A deep neural network for multi-species fish detection using multiple acoustic cameras","created":"2021-09-22","cited_by_count":0,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2203.01758","title":"On Practical Reinforcement Learning: Provable Robustness, Scalability, and Statistical Efficiency","created":"2022-03-03","cited_by_count":0,"area":"offlinerl"},{"id":"2203.10973","title":"A Local Convergence Theory for the Stochastic Gradient Descent Method in Non-Convex Optimization With Non-isolated Local Minima","created":"2022-03-21","cited_by_count":0,"area":null},{"id":"2306.09338","title":"Understanding Optimization of Deep Learning via Jacobian Matrix and Lipschitz Constant","created":"2023-06-15","cited_by_count":0,"area":null},{"id":"2309.06774","title":"Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss","created":"2023-09-13","cited_by_count":0,"area":null},{"id":"2310.10368","title":"Machine learning in physics: a short guide","created":"2023-10-16","cited_by_count":0,"area":null},{"id":"2405.04074","title":"A simple theory for training response of deep neural networks","created":"2024-05-07","cited_by_count":0,"area":null},{"id":"2405.15895","title":"Manifold Metric: A Loss Landscape Approach for Predicting Model Performance","created":"2024-05-24","cited_by_count":0,"area":null},{"id":"2408.02678","title":"Convergence rates of stochastic gradient method with independent sequences of step-size and momentum weight","created":"2024-07-31","cited_by_count":0,"area":null},{"id":"2502.17794","title":"PVBF: A Framework for Mitigating Parameter Variation Imbalance in Online Continual Learning","created":"2025-02-25","cited_by_count":0,"area":null},{"id":"2506.04613","title":"DeePoly: A High-Order Accuracy Scientific Machine Learning Framework for Function Approximation and Solving PDEs","created":"2025-06-05","cited_by_count":0,"area":null},{"id":"2608.11479","title":"Convergence Guarantees of Gradient Descent for Neural Networks via Generalized Lipschitz Smoothness","created":"2026-08-11","cited_by_count":0,"area":null},{"id":"2609.25013","title":"Do Existing Preconditioners Improve Biomedical Tabular Foundation Learning? An Empirical Study on TabPFN Optimization","created":"2026-08-01","cited_by_count":0,"area":null},{"id":"2609.34549","title":"On Parameter Symmetries and Conservation Laws in Gradient Flow","created":"2026-09-28","cited_by_count":0,"area":null}],"next_cursor":null}