{"total":72,"rows":[{"id":"2309.06497","title":"A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale","created":"2023-09-12","cited_by_count":77,"area":null},{"id":"2112.07628","title":"Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time","created":"2021-12-14","cited_by_count":62,"area":null},{"id":"2107.07480","title":"Newton-LESS: Sparsification without Trade-offs for the Sketched Newton Update","created":"2021-07-15","cited_by_count":23,"area":null},{"id":"2105.07320","title":"LocalNewton: Reducing Communication Bottleneck for Distributed Learning","created":"2021-05-16","cited_by_count":15,"area":null},{"id":"2105.07291","title":"Adaptive Newton Sketch: Linear-time Optimization with Quadratic Convergence and Effective Hessian Dimensionality","created":"2021-05-15","cited_by_count":14,"area":null},{"id":"2203.15260","title":"Efficient Convex Optimization Requires Superlinear Memory","created":"2022-03-29","cited_by_count":14,"area":null},{"id":"2204.09266","title":"Hessian Averaging in Stochastic Newton Methods Achieves Superlinear Convergence","created":"2022-04-20","cited_by_count":14,"area":null},{"id":"2111.08190","title":"Learning Augmentation Distributions using Transformed Risk Minimization","created":"2021-11-16","cited_by_count":13,"area":null},{"id":"2207.08171","title":"SP2: A Second Order Stochastic Polyak Method","created":"2022-07-17","cited_by_count":13,"area":null},{"id":"2406.11151","title":"Recent and Upcoming Developments in Randomized Numerical Linear Algebra for Machine Learning","created":"2024-06-17","cited_by_count":11,"area":null},{"id":"2205.13687","title":"Statistical Inference of Constrained Stochastic Optimization via Sketched Sequential Quadratic Programming","created":"2022-05-27","cited_by_count":10,"area":null},{"id":"2206.02702","title":"Stochastic Variance-Reduced Newton: Accelerating Finite-Sum Minimization with Large Batches","created":"2022-06-06","cited_by_count":9,"area":null},{"id":"2304.12465","title":"Robust, randomized preconditioning for kernel ridge regression","created":"2023-04-24","cited_by_count":9,"area":null},{"id":"2211.08597","title":"SketchySGD: Reliable Stochastic Optimization via Randomized Curvature Estimates","created":"2022-11-16","cited_by_count":8,"area":null},{"id":"2311.05116","title":"Covering Number of Real Algebraic Varieties and Beyond: Improved Bounds and Applications","created":"2023-11-09","cited_by_count":8,"area":null},{"id":"2107.12102","title":"Global optimization using random embeddings","created":"2021-07-26","cited_by_count":6,"area":null},{"id":"2203.09755","title":"Distributed Sketching for Randomized Optimization: Exact Characterization, Concentration and Lower Bounds","created":"2022-03-18","cited_by_count":6,"area":null},{"id":"2305.00604","title":"ISAAC Newton: Input-based Approximate Curvature for Newton's Method","created":"2023-05-01","cited_by_count":6,"area":null},{"id":"2404.05318","title":"Stochastic Online Optimization for Cyber-Physical and Robotic Systems","created":"2024-04-08","cited_by_count":6,"area":null},{"id":"2207.07287","title":"Riemannian Natural Gradient Methods","created":"2022-07-15","cited_by_count":5,"area":null},{"id":"2305.18379","title":"Constrained Optimization via Exact Augmented Lagrangian and Randomized Iterative Sketching","created":"2023-05-28","cited_by_count":5,"area":null},{"id":"2110.08577","title":"Nys-Newton: Nystr\\\"om-Approximated Curvature for Stochastic Optimization","created":"2021-10-16","cited_by_count":4,"area":null},{"id":"2306.12534","title":"Memory-Query Tradeoffs for Randomized Convex Optimization","created":"2023-06-21","cited_by_count":4,"area":null},{"id":"2411.01088","title":"CRONOS: Enhancing Deep Learning with Scalable GPU Accelerated Convex Neural Networks","created":"2024-11-02","cited_by_count":4,"area":null},{"id":"2501.15941","title":"SAPPHIRE: Preconditioned Stochastic Variance Reduction for Faster Large-Scale Statistical Learning","created":"2025-01-27","cited_by_count":4,"area":null},{"id":"2103.13909","title":"Regularization by Denoising Sub-sampled Newton Method for Spectral CT Multi-Material Decomposition","created":"2021-03-25","cited_by_count":3,"area":null},{"id":"2104.14101","title":"Fast Convex Quadratic Optimization Solvers with Adaptive Sketching-based Preconditioners","created":"2021-04-29","cited_by_count":3,"area":null},{"id":"2201.00228","title":"The Complexity of Dynamic Least-Squares Regression","created":"2022-01-01","cited_by_count":3,"area":null},{"id":"2401.02734","title":"FedNS: A Fast Sketching Newton-Type Algorithm for Federated Learning","created":"2024-01-05","cited_by_count":3,"area":null},{"id":"2401.10923","title":"Online estimation of the inverse of the Hessian for stochastic optimization with application to universal stochastic Newton algorithms","created":"2024-01-15","cited_by_count":3,"area":null},{"id":"2404.14758","title":"Second-order Information Promotes Mini-Batch Robustness in Variance-Reduced Gradients","created":"2024-04-23","cited_by_count":3,"area":null},{"id":"2605.01082","title":"Networked Information Aggregation for Binary Classification","created":"2026-05-01","cited_by_count":3,"area":null},{"id":"2106.07454","title":"NG+ : A Multi-Step Matrix-Product Natural Gradient Method for Deep Learning","created":"2021-06-14","cited_by_count":2,"area":null},{"id":"2109.02703","title":"Large-Scale System Identification Using a Randomized SVD","created":"2021-09-06","cited_by_count":2,"area":null},{"id":"2203.07308","title":"Accelerating Plug-and-Play Image Reconstruction via Multi-Stage Sketched Gradients","created":"2022-03-14","cited_by_count":2,"area":null},{"id":"2211.05727","title":"A Randomised Subspace Gauss-Newton Method for Nonlinear Least-Squares","created":"2022-11-10","cited_by_count":2,"area":null},{"id":"2308.03096","title":"Gradient Coding with Iterative Block Leverage Score Sampling","created":"2023-08-06","cited_by_count":2,"area":null},{"id":"2410.19055","title":"Newton Losses: Using Curvature Information for Learning with Differentiable Algorithms","created":"2024-10-24","cited_by_count":2,"area":null},{"id":"2502.13583","title":"Fundamental Bias in Inverting Random Sampling Matrices with Application to Sub-sampled Newton","created":"2025-02-19","cited_by_count":2,"area":null},{"id":"2102.12317","title":"Learning-Augmented Sketches for Hessians","created":"2021-02-24","cited_by_count":1,"area":null},{"id":"2106.01092","title":"Statistical optimality conditions for compressive ensembles","created":"2021-06-02","cited_by_count":1,"area":null},{"id":"2205.11033","title":"Augmented Newton Method for Optimization: Global Linear Rate and Momentum Interpretation","created":"2022-05-23","cited_by_count":1,"area":null},{"id":"2305.17283","title":"Sharpened Lazy Incremental Quasi-Newton Method","created":"2023-05-26","cited_by_count":1,"area":null},{"id":"2309.13307","title":"CORE: Common Random Reconstruction for Distributed Optimization with Provable Low Communication Complexity","created":"2023-09-23","cited_by_count":1,"area":null},{"id":"2404.06720","title":"Gradient Descent is Pareto-Optimal in the Oracle Complexity and Memory Tradeoff for Feasibility Problems","created":"2024-04-10","cited_by_count":1,"area":null},{"id":"2406.01478","title":"Stochastic Newton Proximal Extragradient Method","created":"2024-06-03","cited_by_count":1,"area":null},{"id":"2410.01374","title":"Newton Meets Marchenko-Pastur: Massively Parallel Second-Order Optimization with Hessian Sketching and Debiasing","created":"2024-10-02","cited_by_count":1,"area":null},{"id":"2601.07545","title":"Near-Optimal Private Linear Regression via Iterative Hessian Mixing","created":"2026-01-12","cited_by_count":1,"area":null},{"id":"2607.02194","title":"An Optimisation Framework for the Well-Conditioned Training of Physics-Informed Neural Networks","created":"2026-07-02","cited_by_count":1,"area":null},{"id":"2104.12949","title":"Discriminative Bayesian filtering lends momentum to the stochastic Newton method for minimizing log-convex functions","created":"2021-04-27","cited_by_count":0,"area":null},{"id":"2106.08544","title":"Non-PSD Matrix Sketching with Applications to Regression and Optimization","created":"2021-06-16","cited_by_count":0,"area":null},{"id":"2112.04101","title":"Learning Linear Models Using Distributed Iterative Hessian Sketching","created":"2021-12-08","cited_by_count":0,"area":null},{"id":"2202.02650","title":"Efficient Privacy Preserving Logistic Regression for Horizontally Distributed Data","created":"2022-02-05","cited_by_count":0,"area":null},{"id":"2203.11156","title":"Operator Sketching for Deep Unrolling Networks","created":"2022-03-21","cited_by_count":0,"area":null},{"id":"2208.00208","title":"DRSOM: A Dimension Reduced Second-Order Method","created":"2022-07-30","cited_by_count":0,"area":null},{"id":"2210.12860","title":"Explicit Second-Order Min-Max Optimization: Practical Algorithms and Complexity Analysis","created":"2022-10-23","cited_by_count":0,"area":null},{"id":"2306.15444","title":"Limited-Memory Greedy Quasi-Newton Method with Non-asymptotic Superlinear Convergence Rate","created":"2023-06-27","cited_by_count":0,"area":null},{"id":"2407.03195","title":"Incremental Gauss--Newton Methods with Superlinear Convergence Rates","created":"2024-07-03","cited_by_count":0,"area":null},{"id":"2409.15216","title":"FLeNS: Federated Learning with Enhanced Nesterov-Newton Sketch","created":"2024-09-23","cited_by_count":0,"area":null},{"id":"2411.05771","title":"Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems","created":"2024-11-08","cited_by_count":0,"area":null},{"id":"2502.07993","title":"What is a Sketch-and-Precondition Derivation for Low-Rank Approximation? Inverse Power Error or Inverse Power Estimation?","created":"2025-02-11","cited_by_count":0,"area":null},{"id":"2505.18327","title":"Online Statistical Inference of Constrained Stochastic Optimization via Random Scaling","created":"2025-05-23","cited_by_count":0,"area":null},{"id":"2508.19712","title":"Simple Stepsize for Quasi-Newton Methods with Global Convergence Guarantees","created":"2025-08-27","cited_by_count":0,"area":null},{"id":"2509.06856","title":"Sequential Least-Squares Estimators with Fast Randomized Sketching for Linear Statistical Models","created":"2025-09-08","cited_by_count":0,"area":null},{"id":"2511.00434","title":"Trust-Region Methods with Low-Fidelity Objective Models","created":"2025-11-01","cited_by_count":0,"area":null},{"id":"2511.03972","title":"Non-Asymptotic Optimization and Generalization Bounds for Stochastic Gauss-Newton in Overparameterized Models","created":"2025-11-06","cited_by_count":0,"area":null},{"id":"2603.25976","title":"Second-Order, First-Class: A Composable Stack for Curvature-Aware Training","created":"2026-03-26","cited_by_count":0,"area":null},{"id":"2605.18004","title":"RL4RLA: Teaching ML to Discover Randomized Linear Algebra Algorithms Through Curriculum Design and Graph-Based Search","created":"2026-05-18","cited_by_count":0,"area":null},{"id":"2605.30600","title":"The Fast Mixing Mechanism for Differential Privacy","created":"2026-05-28","cited_by_count":0,"area":null},{"id":"2607.24827","title":"Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memory","created":"2026-07-21","cited_by_count":0,"area":null},{"id":"2609.19539","title":"Compressed Active Subspaces for Scalable Bayesian Inference","created":"2026-09-17","cited_by_count":0,"area":null},{"id":"2609.38901","title":"Certified Approximation for Interpretable Representer Landmarks","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}