{"total":40,"rows":[{"id":"2110.01654","title":"Improved architectures and training algorithms for deep operator networks","created":"2021-10-04","cited_by_count":86,"area":null},{"id":"2112.07628","title":"Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time","created":"2021-12-14","cited_by_count":62,"area":null},{"id":"2110.01765","title":"Rapid training of deep neural networks without skip connections or normalization layers using Deep Kernel Shaping","created":"2021-10-05","cited_by_count":52,"area":null},{"id":"2303.16504","title":"An Over-parameterized Exponential Regression","created":"2023-03-29","cited_by_count":45,"area":null},{"id":"2303.15725","title":"Solving Regularized Exp, Cosh and Sinh Regression Problems","created":"2023-03-28","cited_by_count":44,"area":null},{"id":"2110.04622","title":"Does Preprocessing Help Training Over-parameterized Neural Networks?","created":"2021-10-09","cited_by_count":32,"area":null},{"id":"2309.07418","title":"A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time","created":"2023-09-14","cited_by_count":30,"area":null},{"id":"2106.07887","title":"Credit Assignment in Neural Networks through Deep Feedback Control","created":"2021-06-15","cited_by_count":29,"area":null},{"id":"2211.14227","title":"Bypass Exponential Time Preprocessing: Fast Neural Network Training via Weight-Data Correlation Preprocessing","created":"2022-11-25","cited_by_count":29,"area":null},{"id":"2306.02295","title":"A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models","created":"2023-06-04","cited_by_count":29,"area":null},{"id":"2308.12247","title":"How to Protect Copyright Data in Optimization of Large Language Models?","created":"2023-08-23","cited_by_count":26,"area":null},{"id":"2208.04508","title":"Training Overparametrized Neural Networks in Sublinear Time","created":"2022-08-09","cited_by_count":22,"area":null},{"id":"2312.12226","title":"On the Parameterization of Second-Order Optimization Effective Towards the Infinite Width","created":"2023-12-19","cited_by_count":15,"area":null},{"id":"2302.00248","title":"A Nearly-Optimal Bound for Fast Regression with $\\ell_\\infty$ Guarantee","created":"2023-02-01","cited_by_count":14,"area":null},{"id":"2309.13482","title":"A Unified Scheme of ResNet and Softmax","created":"2023-09-23","cited_by_count":12,"area":null},{"id":"2310.12462","title":"Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights","created":"2023-10-19","cited_by_count":12,"area":null},{"id":"2302.13163","title":"Achieving High Accuracy with PINNs via Energy Natural Gradients","created":"2023-02-25","cited_by_count":10,"area":null},{"id":"2307.14531","title":"Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum","created":"2023-07-26","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2311.15390","title":"Local Convergence of Approximate Newton Method for Two Layer Nonlinear Regression","created":"2023-11-26","cited_by_count":9,"area":null},{"id":"2102.06740","title":"Appearance of Random Matrix Theory in Deep Learning","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2106.03947","title":"TENGraD: Time-Efficient Natural Gradient Descent with Exact Fisher-Block Inversion","created":"2021-06-07","cited_by_count":7,"area":null},{"id":"2412.10782","title":"ANaGRAM: A Natural Gradient Relative to Adapted Model for efficient PINNs learning","created":"2024-12-14","cited_by_count":7,"area":null},{"id":"2110.07807","title":"Provable Regret Bounds for Deep Online Learning and Control","created":"2021-10-15","cited_by_count":6,"area":null},{"id":"2302.02904","title":"Rethinking Gauss-Newton for learning over-parameterized models","created":"2023-02-06","cited_by_count":6,"area":null},{"id":"2308.08358","title":"Convergence of Two-Layer Regression with Nonlinear Units","created":"2023-08-16","cited_by_count":6,"area":null},{"id":"2311.13624","title":"A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer","created":"2023-11-22","cited_by_count":6,"area":null},{"id":"2112.07344","title":"SCORE: Approximating Curvature Information under Self-Concordant Regularization","created":"2021-12-14","cited_by_count":3,"area":null},{"id":"2206.04663","title":"Provably efficient variational generative modeling of quantum many-body systems via quantum-probabilistic information geometry","created":"2022-06-09","cited_by_count":3,"area":null},{"id":"2404.14875","title":"Regularized Gauss-Newton for Optimizing Overparameterized Neural Networks","created":"2024-04-23","cited_by_count":3,"area":null},{"id":"2412.14031","title":"A Riemannian Optimization Perspective of the Gauss-Newton Method for Feedforward Neural Networks","created":"2024-12-18","cited_by_count":3,"area":null},{"id":"2508.21022","title":"A Sketch-and-Project Analysis of Subsampled Natural Gradient Algorithms","created":"2025-08-28","cited_by_count":2,"area":null},{"id":"2601.03162","title":"On the Convergence Behavior of Preconditioned Gradient Descent Toward the Rich Learning Regime","created":"2026-01-06","cited_by_count":1,"area":null},{"id":"2103.16764","title":"Research of Damped Newton Stochastic Gradient Descent Method for Neural Network Training","created":"2021-03-31","cited_by_count":0,"area":null},{"id":"2210.05268","title":"Component-Wise Natural Gradient Descent -- An Efficient Neural Network Optimization","created":"2022-10-11","cited_by_count":0,"area":null},{"id":"2506.08428","title":"Sharper Convergence Rates for Nonconvex Optimisation via Reduction Mappings","created":"2025-06-10","cited_by_count":0,"area":null},{"id":"2511.03972","title":"Non-Asymptotic Optimization and Generalization Bounds for Stochastic Gauss-Newton in Overparameterized Models","created":"2025-11-06","cited_by_count":0,"area":null},{"id":"2605.08352","title":"Convergence Analysis of Newton's Method for Neural Networks in the Overparameterized Limit","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2605.18180","title":"Canonical Regularisation of Wide Feature-Learning Neural Networks","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2607.22004","title":"Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solvers","created":"2026-07-24","cited_by_count":0,"area":null}],"next_cursor":null}