On Solving L-SR1 Trust-Region Subproblems
Not on the map. Why?
Abstract (arXiv)
In this article, we consider solvers for large-scale trust-region subproblems when the quadratic model is defined by a limited-memory symmetric rank-one (L-SR1) quasi-Newton matrix. We propose a solver that exploits the compact representation of L-SR1 matrices. Our approach makes use of both an orthonormal basis for the eigenspace of the L-SR1 matrix and the Sherman-Morrison-Woodbury formula to compute global solutions to trust-region subproblems. To compute the optimal Lagrange multiplier for the trust-region constraint, we use Newton's method with a judicious initial guess that does not require safeguarding. A crucial property of this solver is that it is able to compute high-accuracy solutions even in the so-called hard case. Additionally, the optimal solution is determined directly by formula, not iteratively. Numerical experiments demonstrate the effectiveness of this solver.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 1.
6 papers.
- 2021Globally Convergent Multilevel Training of Deep Residual Networkscited by 11
- 2023Parallel Trust-Region Approaches in Neural Network Training: Beyond Traditional Methodscited by 2
- 2021A machine learning analysis of the relationship between some underlying medical conditions and COVID-19 susceptibilitycited by 1
- 2022Artificial Intelligence-Based Analytics for Impacts of COVID-19 and Online Learning on College Students' Mental Healthcited by 1
- 2022A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimizationcited by 1
- 2022On the efficiency of Stochastic Quasi-Newton Methods for Deep Learningcited by 1
- 2023Parallel Trust-Region Approaches in Neural Network Training: Beyond Traditional Methods21 Dec 2023
- 2022On the efficiency of Stochastic Quasi-Newton Methods for Deep Learning18 May 2022
- 2022A Novel Fast Exact Subproblem Solver for Stochastic Quasi-Newton Cubic Regularized Optimization19 Apr 2022
- 2022Artificial Intelligence-Based Analytics for Impacts of COVID-19 and Online Learning on College Students' Mental Health7 Feb 2022
- 2021A machine learning analysis of the relationship between some underlying medical conditions and COVID-19 susceptibility24 Dec 2021
- 2021Globally Convergent Multilevel Training of Deep Residual Networks15 Jul 2021