Showing 1–1 of 1 results for author: Zink, D

Conditional Accelerated Lazy Stochastic Gradient Descent

Authors: Guanghui Lan, Sebastian Pokutta, Yi Zhou, Daniel Zink

Abstract: In this work we introduce a conditional accelerated lazy stochastic gradient descent algorithm with optimal number of calls to a stochastic first-order oracle and convergence rate $O\left(\frac{1}{\varepsilon^2}\right)$ improving over the projection-free, Online Frank-Wolfe based stochastic gradient descent of Hazan and Kale [2012] with convergence rate $O\left(\frac{1}{\varepsilon^4}\right)$. In this work we introduce a conditional accelerated lazy stochastic gradient descent algorithm with optimal number of calls to a stochastic first-order oracle and convergence rate $O\left(\frac{1}{\varepsilon^2}\right)$ improving over the projection-free, Online Frank-Wolfe based stochastic gradient descent of Hazan and Kale [2012] with convergence rate $O\left(\frac{1}{\varepsilon^4}\right)$. △ Less

Submitted 15 February, 2018; v1 submitted 16 March, 2017; originally announced March 2017.

Comments: 37 pages, 9 figures

MSC Class: 90C25 ACM Class: G.1.6