Primal Subgradient Methods with Predefined Step Sizes

Nesterov, Yurii
(2024) Journal of Optimization Theory and Applications — (2024)

Files

CORE_RP_3314.pdf
  • Open Access
  • Adobe PDF
  • 793.67 KB
Download

Details

Authors
  • Nesterov, YuriiUCLouvain
    Author
Abstract
In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on knowledge of the optimal value of the objective function, need corrections when they are applied to optimization problems with constraints. Their proper modifications allow a significant acceleration of these schemes when the objective function has favorable properties (smoothness, strong convexity). We show how the new methods can be used for solving optimization problems with functional constraints with a possibility to approximate the optimal Lagrange multipliers. One of our primal-dual methods works also for unbounded feasible set.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Nesterov, Y. (2024). Primal Subgradient Methods with Predefined Step Sizes. Journal of Optimization Theory and Applications. Accepted/in-press. https://doi.org/10.1007/s10957-024-02456-9 (Original work published 2024)