Minimizing Uniformly Convex Functions by Cubic Regularization of Newton Method
(2021) Journal of Optimization Theory and Applications — Vol. 189, n° 1, p. 317-339 (2021)
Files
CORE_RP_3235.pdf
Open Access - Adobe PDF
- 700.4 KB
Details
- Authors
Doikov, Nikita 
Nesterov, Yurii
- Abstract
- In this paper, we study the iteration complexity of cubic regularization of Newton method for solving composite minimization problems with uniformly convex objective. We introduce the notion of second-order condition number of a certain degree and justify the linear rate of convergence in a nondegenerate case for the method with an adaptive estimate of the regularization parameter. The algorithm automatically achieves the best possible global complexity bound among different problem classes of uniformly convex objective functions with Hölder continuous Hessian of the smooth part of the objective. As a byproduct of our developments, we justify an intuitively plausible result that the global iteration complexity of the Newton method is always better than that of the gradient method on the class of strongly convex functions with uniformly bounded second derivative.
- Affiliations
Citations
Doikov, N., & Nesterov, Y. (2021). Minimizing Uniformly Convex Functions by Cubic Regularization of Newton Method. Journal of Optimization Theory and Applications, 189(1), 317-339. https://doi.org/10.1007/s10957-021-01838-7 (Original work published 2021)