Showing 1–8 of 8 results for author: Lagunovskaya, A

Algorithmic models of human behavior and stochastic optimization

Authors: Maktagali Bektemessov, Alexander Gasnikov, Anastasia Lagunovskaya, Zhanna Ordabayeva

Abstract: In this article we describe the solutions of three problems posed at different time by Yurii Nesterov. First problem is 'Mage vs Experts': Assume that we live in some enviroment that characterized by unobservable convex function $f(x)$. Each day we can observe only the stochastic gradient of $f(x)$ (with heavy tails). We want to know where is a minimum of $f(x)$. What is better to live one long li… ▽ More In this article we describe the solutions of three problems posed at different time by Yurii Nesterov. First problem is 'Mage vs Experts': Assume that we live in some enviroment that characterized by unobservable convex function $f(x)$. Each day we can observe only the stochastic gradient of $f(x)$ (with heavy tails). We want to know where is a minimum of $f(x)$. What is better to live one long live or to live in parallel many short lives? The second problem is a variant of the previous one (we'd like to find the minimum of convex function $f(x)$) but we can observe only the (noise) value of the function at each day. The additional difficulties here is $f(x)$ isn't necessarily smooth and $x$ belongs to unit simplex. The third problem is to interprete equillibrium in Stable dynamic traffic assignment model (Nesterov-dePalma, 2000) as atractor of the best response dynamic. All these problems required proper generalizations of mirror descent (MD) algorithm. In this paper we collect different special versions of MD to solve the described problems. △ Less

Submitted 12 November, 2018; originally announced November 2018.

Comments: in Russian, 23 pages

Gradient-free two-points optimal method for non smooth stochastic convex optimization problem with additional small noise

Authors: Anastasia Bayandina, Alexander Gasnikov, Fariman Guliev, Anastasia Lagunovskaya

Abstract: Using double-smoothing technique and stochastic mirror descent with inexact oracle we built an optimal algorithm (up to a multiplicative factor) for two-points gradient-free non-smooth stochastic convex programming. We investigate how much can be the level of noise (the nature of this noise isn't necessary stochastic) for the rate of convergence to be maintained (up to a multiplicative factor). Using double-smoothing technique and stochastic mirror descent with inexact oracle we built an optimal algorithm (up to a multiplicative factor) for two-points gradient-free non-smooth stochastic convex programming. We investigate how much can be the level of noise (the nature of this noise isn't necessary stochastic) for the rate of convergence to be maintained (up to a multiplicative factor). △ Less

Submitted 13 August, 2017; v1 submitted 13 January, 2017; originally announced January 2017.

Comments: in Russian, 13 pages; Automatic and Remote Control, 2018

Universal similar triangulars method for searching equilibriums in traffic flow distribution models

Authors: Dilyara Baimurzina, Alexander Gasnikov, Evgenia Gasnikova, Pavel Dvurechensky, Egor Ershov, Meruza Kubentaeva, Anastasia Lagunovskaya

Abstract: We describe how primal-dual version of Nesterov's Universal Method (with one projection) can be applied to solve the dual problem for the problem of searching equilibrium traffic flow distribution in transport networks (BMW-model, Stable Dynamic model). We observe that although the dual problem isn't smooth Universal Methods works as it is Mirror Prox method and we consider saddle-point type probl… ▽ More We describe how primal-dual version of Nesterov's Universal Method (with one projection) can be applied to solve the dual problem for the problem of searching equilibrium traffic flow distribution in transport networks (BMW-model, Stable Dynamic model). We observe that although the dual problem isn't smooth Universal Methods works as it is Mirror Prox method and we consider saddle-point type problem. △ Less

Submitted 3 December, 2017; v1 submitted 10 January, 2017; originally announced January 2017.

Comments: in Russian, 22 pages; Comp. Math. & Math. Phys., 2018. V. 58

Parallel algorithms and probability of large deviation for stochastic optimization problems

Authors: Pavel Dvurechensky, Alexander Gasnikov, Anastasia Lagunovskaya

Abstract: We consider convex stochastic optimization problems under different assumptions on the properties of available stochastic subgradient. It is known that, if the value of the objective function is available, one can obtain, in parallel, several independent approximate solutions in terms of the objective residual expectation. Then, choosing the solution with the minimum function value, one can contro… ▽ More We consider convex stochastic optimization problems under different assumptions on the properties of available stochastic subgradient. It is known that, if the value of the objective function is available, one can obtain, in parallel, several independent approximate solutions in terms of the objective residual expectation. Then, choosing the solution with the minimum function value, one can control the probability of large deviation of the objective residual. On the contrary, in this short paper, we address the situation, when the value of the objective function is unavailable or is too expensive to calculate. Under "`light-tail"' assumption for stochastic subgradient and in general case with moderate large deviation probability, we show that parallelization combined with averaging gives bounds for probability of large deviation similar to a serial method. Thus, in these cases, one can benefit from parallel computations and reduce the computational time without loss in the solution quality. △ Less

Submitted 18 January, 2017; v1 submitted 7 January, 2017; originally announced January 2017.

Comments: Submitted to Siberian Journal of Numerical Mathematics/Numerical Analysis and Applications, 2017

MSC Class: 90C15; 90C25 ACM Class: G.1.6

On the relationship between imitative logit dynamics in the population game theory and mirror descent method in the online optimization using the example of the Shortest Path Problem

Authors: Alexander Gasnikov, Anastasia Lagunovskaya, Larisa Morozova

Abstract: In this paper we describe how imitative logit dynamic (rather popular in population games theory) can be interpreted in terms of mirror descent method (well known in convex optimization). We demonstrate the connection of this two type dynamics on the Shortest Path Problem. In this paper we describe how imitative logit dynamic (rather popular in population games theory) can be interpreted in terms of mirror descent method (well known in convex optimization). We demonstrate the connection of this two type dynamics on the Shortest Path Problem. △ Less

Submitted 1 May, 2016; v1 submitted 7 November, 2015; originally announced November 2015.

Comments: 9 pages, in Russian

Journal ref: TRUDY MIPT. 2015. V. 7. no. 4. P. 104-113

Nonlinear stochastic multiarmed bandit problems with inexact oracle

Authors: Alexander Gasnikov, Ekaterina Krymova, Anastasia Lagunovskaya, Ilnura Usmanova, Fedor Fedorenko

Abstract: In the paper we consider one point and two point multiarmed bamdit problems. In other words we consider the online stochastic convex optimization problems with oracle that return the value (realization) of the function at one point or at two points. We allow these values to be inexact, but the level of noise should be small enough. We generalize well known results for inexact oracle case. And we a… ▽ More In the paper we consider one point and two point multiarmed bamdit problems. In other words we consider the online stochastic convex optimization problems with oracle that return the value (realization) of the function at one point or at two points. We allow these values to be inexact, but the level of noise should be small enough. We generalize well known results for inexact oracle case. And we also generalize classical results to prox-structures differ from euclidian. △ Less

Submitted 17 March, 2017; v1 submitted 5 September, 2015; originally announced September 2015.

Comments: 12 pages, in Russia, Avtomatika i Telemekhanika. 2017

Efficient calculation of stochastic equilibriums in the Beckmann's and stable dynamic models

Authors: Alexander Gasnikov, Evgenia Gasnikova, Pavel Dvurechensky, Egor Ershov, Anastasia Lagunovskaya

Abstract: We propose composite approache to the special sum-type convex optimization problem with affine restriction and special entropy type regularization. Since the fuctional has a penalty type form, we reformulate initial conditional optimization problem in a special unconstrained form that allows us to put the penalty type functional into the composite term. We also describe the characteristic function… ▽ More We propose composite approache to the special sum-type convex optimization problem with affine restriction and special entropy type regularization. Since the fuctional has a penalty type form, we reformulate initial conditional optimization problem in a special unconstrained form that allows us to put the penalty type functional into the composite term. We also describe the characteristic functions on graphs technique (Yu. Nesterov, 2007) in application to the dual problem. △ Less

Submitted 1 May, 2016; v1 submitted 27 May, 2015; originally announced May 2015.

Comments: 16 pages, in Russian

Journal ref: TRUDY MIPT. 2015. V. 7. no. 4. P. 114-128

Gradient-free prox-methods with inexact oracle for stochastic convex optimization problems on a simplex

Authors: Alexander Gasnikov, Anastasia Lagunovskaya, Ilnura Usmanova, Fedor Fedorenko

Abstract: In the paper we show that euclidian randomization in some situations (i.e. for gradient-free method on a simplex) can be as good as the randomization on the unit sphere in 1-norm. That is on the simplex example we show that for gradient-free methods the choise of the prox-structure and the choise of a way of randomization have to be connected to each other. We demonstrate how it can be done in an… ▽ More In the paper we show that euclidian randomization in some situations (i.e. for gradient-free method on a simplex) can be as good as the randomization on the unit sphere in 1-norm. That is on the simplex example we show that for gradient-free methods the choise of the prox-structure and the choise of a way of randomization have to be connected to each other. We demonstrate how it can be done in an optimal way. It is important that we consider inexact oracle. △ Less

Submitted 17 April, 2016; v1 submitted 12 December, 2014; originally announced December 2014.

Comments: 26 pages, in Russian, Avtomatika i Telemekhanika. 2016