Regularized Newton methods for minimizing functions with Hölder continuous Hessians

Nunes Grapiglia, Geovani;Nesterov, Yurii
(2017) SIAM Journal on Optimization — Vol. 27, n° 1, p. 478-506 (2017)

Files

Rep2846.pdf
  • Closed Access
  • Adobe PDF
  • 889.49 KB
Request a copy

Details

Authors
Abstract
In this paper, we study the regularized second-order methods for unconstrained minimization of a twice-differentiable (convex or nonconvex) objective function. For the current function, these methods automatically achieve the best possible global complexity estimates among different Hölder classes containing the Hessian of the objective. We show that such methods for functional residual and for the norm of the gradient must be different. For development of the latter methods, we introduced two new line-search acceptance criteria, which can be seen as generalizations of the Armijo condition.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Nunes Grapiglia, G., & Nesterov, Y. (2017). Regularized Newton methods for minimizing functions with Hölder continuous Hessians. SIAM Journal on Optimization, 27(1), 478-506. https://doi.org/10.1137/16M1087801 (Original work published 2017)