Showing 1–44 of 44 results for author: Djehiche, B

Discrete time stochastic impulse control with delay

Authors: Said Hamadène, Boualem Djehiche

Abstract: We study a class of infinite-horizon impulse control problems with execution delay in discrete time. Using probabilistic methods, particularly the notion of the Snell envelope of processes, we construct an optimal strategy among all admissible strategies for both risk-neutral and risk-sensitive utility functions. Furthermore, we establish the existence of bounded $ε$-optimal strategies. This frame… ▽ More We study a class of infinite-horizon impulse control problems with execution delay in discrete time. Using probabilistic methods, particularly the notion of the Snell envelope of processes, we construct an optimal strategy among all admissible strategies for both risk-neutral and risk-sensitive utility functions. Furthermore, we establish the existence of bounded $ε$-optimal strategies. This framework provides a robust approach to handling execution delays in discrete-time stochastic systems. △ Less

Submitted 14 January, 2025; originally announced January 2025.

Convergence rate for random walk approximations of mean field BSDEs

Authors: Boualem Djehiche, Hannah Geiss, Stefan Geiss, Céline Labart, Jani Nykänen

Abstract: We study the rate of convergence w.r.t.~a Wasserstein type distance for random walk approximations of mean field BSDEs. Our method does not use the particle method but instead a freezing technique. We extend results by Briand, Ch. Geiss, S. Geiss, and Labart [Bernoulli, 27(2) 2021] about the rate of convergence of a Donsker-type theorem for BSDEs from the classical setting to the mean field settin… ▽ More We study the rate of convergence w.r.t.~a Wasserstein type distance for random walk approximations of mean field BSDEs. Our method does not use the particle method but instead a freezing technique. We extend results by Briand, Ch. Geiss, S. Geiss, and Labart [Bernoulli, 27(2) 2021] about the rate of convergence of a Donsker-type theorem for BSDEs from the classical setting to the mean field setting. In this connection the mean field setting leads to new phenomena and requires new techniques that should be of independent interest: The Hölder continuous terminal condition causes a singularity in time of the generator when seen as a generator in the non-mean field setting. To handle this singularity we introduce a concept of modified Hölder continuity by which we are able to achieve, up to a logarithmic term, the same polynomial approximation rates as in the classical non-mean field setting (in fact, already when approximating the Brownian motion itself a logarithmic term is necessary). Moreover, the exploited freezing technique of the mean field terms yields to the problem to handle the quantitative behavior of several different generators. Using BMO-techniques we obtain the rate of convergence for the integrated gradient process in the scale of Lorentz (type) spaces of exponential type. △ Less

Submitted 20 May, 2025; v1 submitted 21 September, 2024; originally announced September 2024.

Comments: Improvement of presentation

MSC Class: 60H10; 60G50; 65C30; 60H35; 65G99

Continuous time Stochastic optimal control under discrete time partial observations

Authors: Christian Bayer, Boualem Djehiche, Eliza Rezvanova, Raul Fidel Tempone

Abstract: This work addresses stochastic optimal control problems where the unknown state evolves in continuous time while partial, noisy, and possibly controllable measurements are only available in discrete time. We develop a framework for controlling such systems, focusing on the measure-valued process of the system's state and the control actions that depend on noisy and incomplete data. Our approach us… ▽ More This work addresses stochastic optimal control problems where the unknown state evolves in continuous time while partial, noisy, and possibly controllable measurements are only available in discrete time. We develop a framework for controlling such systems, focusing on the measure-valued process of the system's state and the control actions that depend on noisy and incomplete data. Our approach uses a stochastic optimal control framework with a probability measure-valued state, which accommodates noisy measurements and integrates them into control decisions through a Bayesian update mechanism. We characterize the control optimality in terms of a sequence of interlaced Hamilton Jacobi Bellman (HJB) equations coupled with controlled impulse steps at the measurement times. For the case of Gaussian-controlled processes, we derive an equivalent HJB equation whose state variable is finite-dimensional, namely the state's mean and covariance. We demonstrate the effectiveness of our methods through numerical examples. These include control under perfect observations, control under no observations, and control under noisy observations. Our numerical results highlight significant differences in the control strategies and their performance, emphasizing the challenges and computational demands of dealing with uncertainty in state observation. △ Less

Submitted 25 July, 2024; originally announced July 2024.

MSC Class: 93E20; 93E35; 49N30; 93C41

Stability Via Adversarial Training of Neural Network Stochastic Control of Mean-Field Type

Authors: Julian Barreiro-Gomez, Salah Eddine Choutri, Boualem Djehiche

Abstract: In this paper, we present an approach to neural network mean-field-type control and its stochastic stability analysis by means of adversarial inputs (aka adversarial attacks). This is a class of data-driven mean-field-type control where the distribution of the variables such as the system states and control inputs are incorporated into the problem. Besides, we present a methodology to validate the… ▽ More In this paper, we present an approach to neural network mean-field-type control and its stochastic stability analysis by means of adversarial inputs (aka adversarial attacks). This is a class of data-driven mean-field-type control where the distribution of the variables such as the system states and control inputs are incorporated into the problem. Besides, we present a methodology to validate the feasibility of the approximations of the solutions via neural networks and evaluate their stability. Moreover, we enhance the stability by enlarging the training set with adversarial inputs to obtain a more robust neural network. Finally, a worked-out example based on the linear-quadratic mean-field type control problem (LQ-MTC) is presented to illustrate our methodology. △ Less

Submitted 27 September, 2022; originally announced October 2022.

MSC Class: 68T07; 93E20; 91A16

Time-inconsistent mean-field optimal stopping: A limit approach

Authors: Boualem Djehiche, Mattia Martini

Abstract: We provide a characterization of an optimal stopping time for a class of finite horizon time-inconsistent optimal stopping problems (OSPs) of mean-field type, adapted to the Brownian filtration, including those related to mean-field diffusion processes and recursive utility functions. Despite the time-inconsistency of the OSP, we show that it is optimal to stop when the value-process hits the rewa… ▽ More We provide a characterization of an optimal stopping time for a class of finite horizon time-inconsistent optimal stopping problems (OSPs) of mean-field type, adapted to the Brownian filtration, including those related to mean-field diffusion processes and recursive utility functions. Despite the time-inconsistency of the OSP, we show that it is optimal to stop when the value-process hits the reward process for the first time, as is the case for the standard time-consistent OSP. We solve the problem by approximating the corresponding value-process with a sequence of Snell envelopes of processes, for which a sequence of optimal stopping times is constituted of the hitting times of each of the reward processes by the associated value-process. Then, under mild assumptions, we show that this sequence of hitting times converges in probability to the hitting time for the mean-field OSP and that the limit is optimal. △ Less

Submitted 19 July, 2023; v1 submitted 9 September, 2022; originally announced September 2022.

Comments: Further comments and details have been added, and some misprints have been corrected

Journal ref: Vol. 528, Issue 1, 2023

Zero-sum mean-field Dynkin games: characterization and convergence

Authors: Boualem Djehiche, Roxana Dumitrescu

Abstract: We introduce a zero-sum game problem of mean-field type as an extension of the classical zero-sum Dynkin game problem to the case where the payoff processes might depend on the value of the game and its probability law. We establish sufficient conditions under which such a game admits a value and a saddle point. Furthermore, we provide a characterization of the value of the game in terms of a spec… ▽ More We introduce a zero-sum game problem of mean-field type as an extension of the classical zero-sum Dynkin game problem to the case where the payoff processes might depend on the value of the game and its probability law. We establish sufficient conditions under which such a game admits a value and a saddle point. Furthermore, we provide a characterization of the value of the game in terms of a specific class of doubly reflected backward stochastic differential equations (BSDEs) of mean-field type, for which we derive an existence and uniqueness result. We then introduce a corresponding system of weakly interacting zero-sum Dynkin games and show its well-posedness. Finally, we provide a propagation of chaos result for the value of the zero-sum mean-field Dynkin game. △ Less

Submitted 4 May, 2022; v1 submitted 4 February, 2022; originally announced February 2022.

Comments: arXiv admin note: text overlap with arXiv:2111.14315

Efficient learning of hidden state LTI state space models of unknown order

Authors: Boualem Djehiche, Othmane Mazhar

Abstract: The aim of this paper is to address two related estimation problems arising in the setup of hidden state linear time invariant (LTI) state space systems when the dimension of the hidden state is unknown. Namely, the estimation of any finite number of the system's Markov parameters and the estimation of a minimal realization for the system, both from the partial observation of a single trajectory.… ▽ More The aim of this paper is to address two related estimation problems arising in the setup of hidden state linear time invariant (LTI) state space systems when the dimension of the hidden state is unknown. Namely, the estimation of any finite number of the system's Markov parameters and the estimation of a minimal realization for the system, both from the partial observation of a single trajectory. For both problems, we provide statistical guarantees in the form of various estimation error upper bounds, $\rank$ recovery conditions, and sample complexity estimates. Specifically, we first show that the low $\rank$ solution of the Hankel penalized least square estimator satisfies an estimation error in $S_p$-norms for $p \in [1,2]$ that captures the effect of the system order better than the existing operator norm upper bound for the simple least square. We then provide a stability analysis for an estimation procedure based on a variant of the Ho-Kalman algorithm that improves both the dependence on the dimension and the least singular value of the Hankel matrix of the Markov parameters. Finally, we propose an estimation algorithm for the minimal realization that uses both the Hankel penalized least square estimator and the Ho-Kalman based estimation procedure and guarantees with high probability that we recover the correct order of the system and satisfies a new fast rate in the $S_2$-norm with a polynomial reduction in the dependence on the dimension and other parameters of the problem. △ Less

Submitted 3 February, 2022; originally announced February 2022.

Comments: 47 pages

MSC Class: 62J07; 62M05; 62M10; 62M15; 60E15; 62C20; 62F10

A propagation of chaos result for weakly interacting nonlinear Snell envelopes

Authors: Boualem Djehiche, Roxana Dumitrescu, Jia Zeng

Abstract: In this article, we establish a propagation of chaos result for weakly interacting nonlinear Snell envelopes which converge to a class of mean-field reflected backward stochastic differential equations (BSDEs) with jumps and right-continuous and left-limited obstacle, where the mean-field interaction in terms of the distribution of the $Y$-component of the solution enters both the driver and the l… ▽ More In this article, we establish a propagation of chaos result for weakly interacting nonlinear Snell envelopes which converge to a class of mean-field reflected backward stochastic differential equations (BSDEs) with jumps and right-continuous and left-limited obstacle, where the mean-field interaction in terms of the distribution of the $Y$-component of the solution enters both the driver and the lower obstacle. Under mild Lipschitz and integrability conditions on the coefficients, we prove existence and uniqueness of the solution to both the mean-field reflected BSDEs with jumps and the corresponding system of weakly interacting particles and provide a propagation of chaos result for the whole solution $(Y,Z,U,K)$, which requires new technical results due to the dependence of the obstacle on the solution and the presence of jumps. △ Less

Submitted 7 May, 2022; v1 submitted 28 November, 2021; originally announced November 2021.

Comments: 33 pages

Non asymptotic estimation lower bounds for LTI state space models with Cramér-Rao and van Trees

Authors: Boualem Djehiche, Othmane Mazhar

Abstract: We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean square estimation risk of the least square estimator, and the minimax mean square estimation risk. These bounds are sharp with explicit constants when the matrix of the dynamics ha… ▽ More We study the estimation problem for linear time-invariant (LTI) state-space models with Gaussian excitation of an unknown covariance. We provide non asymptotic lower bounds for the expected estimation error and the mean square estimation risk of the least square estimator, and the minimax mean square estimation risk. These bounds are sharp with explicit constants when the matrix of the dynamics has no eigenvalues on the unit circle and are rate-optimal when they do. Our results extend and improve existing lower bounds to lower bounds in expectation of the mean square estimation risk and to systems with a general noise covariance. Instrumental to our derivation are new concentration results for rescaled sample covariances and deviation results for the corresponding multiplication processes of the covariates, a differential geometric construction of a prior on the unit operator ball of small Fisher information, and an extension of the Cramér-Rao and van Treesinequalities to matrix-valued estimators. △ Less

Submitted 17 September, 2021; originally announced September 2021.

Comments: 41 pages

MSC Class: 62J05; 62M10; 60B20; 60E15; 62C20; 62B11

Optimal portfolio choice with path dependent benchmarked labor income: a mean field model

Authors: Boualem Djehiche, Fausto Gozzi, Giovanni Zanco, Margherita Zanella

Abstract: We consider the life-cycle optimal portfolio choice problem faced by an agent receiving labor income and allocating her wealth to risky assets and a riskless bond subject to a borrowing constraint. In this paper, to reflect a realistic economic setting, we propose a model where the dynamics of the labor income has two main features. First, labor income adjust slowly to financial market shocks, a f… ▽ More We consider the life-cycle optimal portfolio choice problem faced by an agent receiving labor income and allocating her wealth to risky assets and a riskless bond subject to a borrowing constraint. In this paper, to reflect a realistic economic setting, we propose a model where the dynamics of the labor income has two main features. First, labor income adjust slowly to financial market shocks, a feature already considered in Biffis, E., Gozzi, F. and Prosdocimi, C. (2020) - "Optimal portfolio choice with path dependent labor income: the infinite horizon case". Second, the labor income $y_i$ of an agent $i$ is benchmarked against the labor incomes of a population $y^n:=(y_1,y_2,\ldots,y_n)$ of $n$ agents with comparable tasks and/or ranks. This last feature has not been considered yet in the literature and is faced taking the limit when $n\to +\infty$ so that the problem falls into the family of optimal control of infinite dimensional McKean-Vlasov Dynamics, which is a completely new and challenging research field. We study the problem in a simplified case where, adding a suitable new variable, we are able to find explicitly the solution of the associated HJB equation and find the optimal feedback controls. △ Less

Submitted 8 September, 2020; originally announced September 2020.

Comments: 34 pages

Reflected Backward Stochastic Volterra Integral Equations and related time-inconsistent optimal stopping problems

Authors: Nacira Agram, Boualem Djehiche

Abstract: We study solutions of a class of one-dimensional continuous reflected backward stochastic Volterra integral equations driven by Brownian motion, where the reflection keeps the solution above a given stochastic process (lower obstacle). We prove existence and uniqueness by a fixed point argument and we derive a comparison result. Moreover, we show how the solution of our problem is related to a tim… ▽ More We study solutions of a class of one-dimensional continuous reflected backward stochastic Volterra integral equations driven by Brownian motion, where the reflection keeps the solution above a given stochastic process (lower obstacle). We prove existence and uniqueness by a fixed point argument and we derive a comparison result. Moreover, we show how the solution of our problem is related to a time-inconsistent optimal stopping problem and derive an optimal strategy. △ Less

Submitted 24 April, 2020; originally announced April 2020.

Comments: 17 pages

Finite impulse response models: A non-asymptotic analysis of the least squares estimator

Authors: Boualem Djehiche, Othmane Mazhar, Cristian R. Rojas

Abstract: We consider a finite impulse response system with centered independent sub-Gaussian design covariates and noise components that are not necessarily identically distributed. We derive non-asymptotic near-optimal estimation and prediction bounds for the least-squares estimator of the parameters. Our results are based on two concentration inequalities on the norm of sums of dependent covariate vector… ▽ More We consider a finite impulse response system with centered independent sub-Gaussian design covariates and noise components that are not necessarily identically distributed. We derive non-asymptotic near-optimal estimation and prediction bounds for the least-squares estimator of the parameters. Our results are based on two concentration inequalities on the norm of sums of dependent covariate vectors and on the singular values of their covariance operator that are of independent value on their own and where the dependence arises from the time shift structure of the time series. These results generalize the known bounds for the independent case. △ Less

Submitted 28 November, 2019; originally announced November 2019.

Comments: 23 pages

Mean-field reflected backward stochastic differential equations

Authors: Boualem Djehiche, Romuald Elie, Said Hamadène

Abstract: In this paper, we study a class of reflected backward stochastic differential equations (BSDEs) of mean-field type, where the mean-field interaction in terms of the distribution of the $Y$-component of the solution enters in both the driver and the lower obstacle. We consider in details the case where the lower obstacle is a deterministic function of $(Y,\E[Y])$ and discuss the more general depend… ▽ More In this paper, we study a class of reflected backward stochastic differential equations (BSDEs) of mean-field type, where the mean-field interaction in terms of the distribution of the $Y$-component of the solution enters in both the driver and the lower obstacle. We consider in details the case where the lower obstacle is a deterministic function of $(Y,\E[Y])$ and discuss the more general dependence on the distribution of $Y$. Under mild Lipschitz and integrability conditions on the coefficients, we obtain the well-posedness of such a class of equations. Under further monotonicity conditions, we show convergence of the standard penalization scheme to the solution of the equation, which hence satisfies a minimality property. This class of equations is motivated by applications in pricing life insurance contracts with surrender options. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Behavior near walls in the mean-field approach to crowd dynamics

Authors: Alexander Aurell, Boualem Djehiche

Abstract: This paper introduces a system of stochastic differential equations (SDE) of mean-field type that models pedestrian motion. The system lets the pedestrians spend time at, and move along, walls, by means of sticky boundaries and boundary diffusion. As an alternative to Neumann-type boundary conditions, sticky boundaries and boundary diffusion have a 'smoothing' effect on pedestrian motion. When the… ▽ More This paper introduces a system of stochastic differential equations (SDE) of mean-field type that models pedestrian motion. The system lets the pedestrians spend time at, and move along, walls, by means of sticky boundaries and boundary diffusion. As an alternative to Neumann-type boundary conditions, sticky boundaries and boundary diffusion have a 'smoothing' effect on pedestrian motion. When these effects are active, the pedestrian paths are semimartingales with first-variation part absolutely continuous with respect to the Lebesgue measure $dt$, rather than an increasing processes (which in general induces a measure singular with respect to $dt$) as is the case under Neumann boundary conditions. We show that the proposed mean-field model for pedestrian motion admits a unique weak solution and that it is possible to control the system in the weak sense, using a Pontryagin-type maximum principle. We also relate the mean-field type control problem to the social cost minimization in an interacting particle system. We study the novel model features numerically and we confirm empirical findings on pedestrian crowd motion in congested corridors. △ Less

Submitted 5 March, 2020; v1 submitted 17 July, 2019; originally announced July 2019.

Comments: 27 pages, 2 figures

MSC Class: 49N90; 60H10; 60K35; 93E20

Infinite Horizon Stochastic Impulse Control with Delay and Random Coefficients

Authors: Boualem Djehiche, Said Hamadene, Ibtissem Hdhiri, Helmi Zaatra

Abstract: We study a class of infinite horizon impulse control problems with execution delay when the dynamics of the system is described by a general adapted stochastic process. The problem is solved by means of probabilistic tools relying on the notion of Snell envelope and infinite horizon reflected backward stochastic differential equations. This allows us to establish the existence of an optimal strate… ▽ More We study a class of infinite horizon impulse control problems with execution delay when the dynamics of the system is described by a general adapted stochastic process. The problem is solved by means of probabilistic tools relying on the notion of Snell envelope and infinite horizon reflected backward stochastic differential equations. This allows us to establish the existence of an optimal strategy over all admissible strategies. △ Less

Submitted 20 May, 2019; v1 submitted 26 April, 2019; originally announced April 2019.

Comments: 29 pages

MSC Class: 60G40; 60H10; 62L15; 93E20

Mean-field backward-forward stochastic differential equations and nonzero sum stochastic differential games

Authors: Yinggu Chen, Boualem Djehiche, Said Hamadene

Abstract: We study a general class of fully coupled backward-forward stochastic differential equations of mean-field type (MF-BFSDE). We derive existence and uniqueness results for such a system under weak monotonicity assumptions and without the non-degeneracy condition on the forward equation. This is achieved by suggesting an implicit approximation scheme that is shown to converge to the solution of the… ▽ More We study a general class of fully coupled backward-forward stochastic differential equations of mean-field type (MF-BFSDE). We derive existence and uniqueness results for such a system under weak monotonicity assumptions and without the non-degeneracy condition on the forward equation. This is achieved by suggesting an implicit approximation scheme that is shown to converge to the solution of the system of MF-BFSDE. We apply these results to derive an explicit form of open-loop Nash equilibrium strategies for nonzero sum mean-field linear-quadratic stochastic differential games with random coefficients. These strategies are valid for any time horizon of the game. △ Less

Submitted 1 March, 2020; v1 submitted 12 April, 2019; originally announced April 2019.

Comments: 22 pages

MSC Class: 60H10; 60H07; 49N90

Hamilton-Jacobi equations for optimal control on multidimensional junctions with entry costs

Authors: Manh-Khang Dao, Boualem Djehiche

Abstract: We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that the value function of the optimal control problem is the unique viscosity solution of the HJ system. This is done under the usual strong controllability assumpti… ▽ More We consider an infinite horizon control problem for dynamics constrained to remain on a multidimensional junction with entry costs. We derive the associated system of Hamilton-Jacobi equations (HJ), prove the comparison principle and that the value function of the optimal control problem is the unique viscosity solution of the HJ system. This is done under the usual strong controllability assumption and also under a weaker condition, coined 'moderate controllability assumption'. △ Less

Submitted 24 February, 2020; v1 submitted 20 March, 2019; originally announced March 2019.

MSC Class: 34H05; 35F21; 49L25; 49J15; 49L20; 93C30

Modeling tagged pedestrian motion: a mean-field type game approach

Authors: Alexander Aurell, Boualem Djehiche

Abstract: This paper suggests a model for the motion of tagged pedestrians: pedestrians moving towards a specified targeted destination, which they are forced to reach. It aims to be a decision-making tool for the positioning of fire fighters, security personnel, and other services in a pedestrian environment. Taking interaction with the surrounding crowd into account leads to a differential nonzero-sum gam… ▽ More This paper suggests a model for the motion of tagged pedestrians: pedestrians moving towards a specified targeted destination, which they are forced to reach. It aims to be a decision-making tool for the positioning of fire fighters, security personnel, and other services in a pedestrian environment. Taking interaction with the surrounding crowd into account leads to a differential nonzero-sum game model where the tagged pedestrians compete with the surrounding crowd of ordinary pedestrians. When deciding how to act, pedestrians consider crowd distribution-dependent effects, like congestion and crowd aversion. Including such effects in the parameters of the game, makes it a mean-field type game. The equilibrium control is characterized, and special cases are discussed. Behavior in the model is studied by numerical simulations. △ Less

Submitted 22 February, 2019; v1 submitted 26 January, 2018; originally announced January 2018.

MSC Class: 49N90; 49J55; 60H10; 60K30; 91A80; 93E20

Mean-field risk sensitive control and zero-sum games for Markov chains

Authors: Salah Eddine Choutri, Boualem Djehiche

Abstract: We establish existence of controlled Markov chain of mean-field type with unbounded jump intensities by means of a fixed point argument using the Wasserstein distance. Using a Markov chain entropic backward SDE approach, we further suggest conditions for existence of an optimal control and a saddle-point for respectively a control problem and a zero-sum differential game associated with risk sensi… ▽ More We establish existence of controlled Markov chain of mean-field type with unbounded jump intensities by means of a fixed point argument using the Wasserstein distance. Using a Markov chain entropic backward SDE approach, we further suggest conditions for existence of an optimal control and a saddle-point for respectively a control problem and a zero-sum differential game associated with risk sensitive payoff functionals of mean-field type. △ Less

Submitted 23 January, 2018; originally announced January 2018.

Comments: arXiv admin note: text overlap with arXiv:1606.04244

MSC Class: 60H10; 60H07; 49N90

Quenched mass transport of particles towards a target

Authors: Bruno Bouchard, Boualem Djehiche, Idris Kharroubi

Abstract: We consider the stochastic target problem of finding the collection of initial laws of a mean-field stochastic differential equation such that we can control its evolution to ensure that it reaches a prescribed set of terminal probability distributions, at a fixed time horizon. Here, laws are considered conditionally to the path of the Brownian motion that drives the system. We establish a version… ▽ More We consider the stochastic target problem of finding the collection of initial laws of a mean-field stochastic differential equation such that we can control its evolution to ensure that it reaches a prescribed set of terminal probability distributions, at a fixed time horizon. Here, laws are considered conditionally to the path of the Brownian motion that drives the system. We establish a version of the geometric dynamic programming principle for the associated reachability sets and prove that the corresponding value function is a viscosity solution of a geometric partial differential equation. This provides a characterization of the initial masses that can be almost-surely transported towards a given target, along the paths of a stochastic differential equation. Our results extend [16] to our setting. △ Less

Submitted 31 October, 2018; v1 submitted 25 July, 2017; originally announced July 2017.

Risk-Sensitive Mean-Field-Type Control

Authors: Alain Bensoussan, Boualem Djehiche, Hamidou Tembine, Phillip Yam

Abstract: We study risk-sensitive optimal control of a stochastic differential equation (SDE) of mean-field type, where the coefficients are allowed to depend on some functional of the law as well as the state and control processes. Moreover the risk-sensitive cost functional is also of mean-field type. We derive optimality equations in infinite dimensions connecting dual functions associated with Bellman f… ▽ More We study risk-sensitive optimal control of a stochastic differential equation (SDE) of mean-field type, where the coefficients are allowed to depend on some functional of the law as well as the state and control processes. Moreover the risk-sensitive cost functional is also of mean-field type. We derive optimality equations in infinite dimensions connecting dual functions associated with Bellman functional to the adjoint process of the Pontryagin maximum principle. The case of linear-exponentiated quadratic cost and its connection with the risk-neutral solution is discussed. △ Less

Submitted 4 February, 2017; originally announced February 2017.

Comments: 14 pages

Mean-field type modeling of nonlocal crowd aversion in pedestrian crowd dynamics

Authors: Alexander Aurell, Boualem Djehiche

Abstract: We extend the class of pedestrian crowd models introduced by Lachapelle and Wolfram (2011) to allow for nonlocal crowd aversion and arbitrarily but finitely many interacting crowds. The new crowd aversion feature grants pedestrians a "personal space" where crowding is undesirable. We derive the model from a particle picture and treat it as a mean-field type game. Solutions to the mean-field type g… ▽ More We extend the class of pedestrian crowd models introduced by Lachapelle and Wolfram (2011) to allow for nonlocal crowd aversion and arbitrarily but finitely many interacting crowds. The new crowd aversion feature grants pedestrians a "personal space" where crowding is undesirable. We derive the model from a particle picture and treat it as a mean-field type game. Solutions to the mean-field type game are characterized via a Pontryagin-type Maximum Principle. The behavior of pedestrians acting under nonlocal crowd aversion is illustrated by a numerical simulation. △ Less

Submitted 26 January, 2018; v1 submitted 31 January, 2017; originally announced January 2017.

Comments: 25 pages, 4 figures

MSC Class: 49N90; 60G09; 60H10; 60H30; 60K35

Importance sampling for a simple Markovian intensity model using subsolutions

Authors: Boualem Djehiche, Henrik Hult, Pierre Nyquist

Abstract: This paper considers importance sampling for estimation of rare-event probabilities in a specific collection of Markovian jump processes used for e.g. modelling of credit risk. Previous attempts at designing importance sampling algorithms have resulted in poor performance and the main contribution of the paper is the design of efficient importance sampling algorithms using subsolutions. The dynami… ▽ More This paper considers importance sampling for estimation of rare-event probabilities in a specific collection of Markovian jump processes used for e.g. modelling of credit risk. Previous attempts at designing importance sampling algorithms have resulted in poor performance and the main contribution of the paper is the design of efficient importance sampling algorithms using subsolutions. The dynamics of the jump processes causes the corresponding Hamilton-Jacobi equations to have an intricate state-dependence, which makes the design of efficient algorithms difficult. We provide theoretical results that quantify the performance of importance sampling algorithms in general and construct asymptotically optimal algorithms for some examples. The computational gain compared to standard Monte Carlo is illustrated by numerical examples. △ Less

Submitted 1 December, 2021; v1 submitted 20 October, 2016; originally announced October 2016.

Comments: 25 pages; to appear in ACM TOMACS

MSC Class: Primary 65C05; 60J75; secondary 91G40; 91G60

Optimal control and zero-sum games for Markov chains of mean-field type

Authors: Salah Eddine Choutri, Boualem Djehiche, Hamidou Tembine

Abstract: We establish existence of Markov chains of mean-field type with unbounded jump intensities by means of a fixed point argument using the Total Variation distance. We further show existence of nearly-optimal controls and, using a Markov chain backward SDE approach, we suggest conditions for existence of an optimal control and a saddle-point for respectively a control problem and a zero-sum different… ▽ More We establish existence of Markov chains of mean-field type with unbounded jump intensities by means of a fixed point argument using the Total Variation distance. We further show existence of nearly-optimal controls and, using a Markov chain backward SDE approach, we suggest conditions for existence of an optimal control and a saddle-point for respectively a control problem and a zero-sum differential game associated with payoff functionals of mean-field type, under dynamics driven by such Markov chains of mean-field type. △ Less

Submitted 27 August, 2017; v1 submitted 14 June, 2016; originally announced June 2016.

Comments: arXiv admin note: text overlap with arXiv:1603.06071

Mean-Field-Type Games in Engineering

Authors: Boualem Djehiche, Alain Tcheukam, Hamidou Tembine

Abstract: A mean-field-type game is a game in which the instantaneous payoffs and/or the state dynamics functions involve not only the state and the action profile but also the joint distributions of state-action pairs. This article presents some engineering applications of mean-field-type games including road traffic networks, multi-level building evacuation, millimeter wave wireless communications, distri… ▽ More A mean-field-type game is a game in which the instantaneous payoffs and/or the state dynamics functions involve not only the state and the action profile but also the joint distributions of state-action pairs. This article presents some engineering applications of mean-field-type games including road traffic networks, multi-level building evacuation, millimeter wave wireless communications, distributed power networks, virus spread over networks, virtual machine resource management in cloud networks, synchronization of oscillators, energy-efficient buildings, online meeting and mobile crowdsensing. △ Less

Submitted 29 November, 2017; v1 submitted 11 May, 2016; originally announced May 2016.

Comments: 84 pages, 24 figures, 183 references. to appear in AIMS 2017

Optimal control and zero-sum stochastic differential game problems of mean-field type

Authors: Boualem Djehiche, Said Hamadène

Abstract: We establish existence of nearly-optimal controls, conditions for existence of an optimal control and a saddle-point for respectively a control problem and zero-sum differential game associated with payoff functionals of mean-field type, under dynamics driven by weak solutions of stochastic differential equations of mean-field type. We establish existence of nearly-optimal controls, conditions for existence of an optimal control and a saddle-point for respectively a control problem and zero-sum differential game associated with payoff functionals of mean-field type, under dynamics driven by weak solutions of stochastic differential equations of mean-field type. △ Less

Submitted 22 July, 2017; v1 submitted 19 March, 2016; originally announced March 2016.

Comments: 20 pages

MSC Class: 60H10; 60H07; 49N90

The Principal-Agent Problem With Time Inconsistent Utility Functions

Authors: Boualem Djehiche, Peter Helgesson

Abstract: In this paper we study a generalization of the continuous time Principal-Agent problem allowing for time inconsistent utility functions, for instance of mean-variance type. Using recent results on the Pontryagin maximum principle for FBSDEs we suggest a method of characterizing optimal contracts for such models. To illustrate this we consider a fully solved explicit example in the linear quadratic… ▽ More In this paper we study a generalization of the continuous time Principal-Agent problem allowing for time inconsistent utility functions, for instance of mean-variance type. Using recent results on the Pontryagin maximum principle for FBSDEs we suggest a method of characterizing optimal contracts for such models. To illustrate this we consider a fully solved explicit example in the linear quadratic setting. △ Less

Submitted 18 March, 2015; originally announced March 2015.

Comments: arXiv admin note: substantial text overlap with arXiv:1410.6392

Risk-Sensitive Mean-Field Type Control under Partial Observation

Authors: Boualem Djehiche, Hamidou Tembine

Abstract: We establish a stochastic maximum principle (SMP) for control problems of partially observed diffusions of mean-field type with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for control problems of partially observed diffusions of mean-field type with risk-sensitive performance functionals. △ Less

Submitted 26 November, 2014; originally announced November 2014.

Comments: arXiv admin note: text overlap with arXiv:1404.1441

A Full Balance Sheet Two-modes Optimal Switching problem

Authors: Boualem Djehiche, Ali Hamdi

Abstract: We formulate and solve a finite horizon full balance sheet two-modes optimal switching problem related to trade-off strategies between expected profit and cost yields. Given the current mode, this model allows for either a switch to the other mode or termination of the project, and this happens for both sides of the balance sheet. A novelty in this model is that the related obstacles are nonlinear… ▽ More We formulate and solve a finite horizon full balance sheet two-modes optimal switching problem related to trade-off strategies between expected profit and cost yields. Given the current mode, this model allows for either a switch to the other mode or termination of the project, and this happens for both sides of the balance sheet. A novelty in this model is that the related obstacles are nonlinear in the underlying yields, whereas, they are linear in the standard optimal switching problem. The optimal switching problem is formulated in terms of a system of Snell envelopes for the profit and cost yields which act as obstacles to each other. We prove existence of a continuous minimal solution of this system using an approximation scheme and fully characterize the optimal switching strategy. △ Less

Submitted 21 November, 2014; originally announced November 2014.

Comments: 23 pages. To appear in Stochastics

The Principal-Agent Problem; A Stochastic Maximum Principle Approach

Authors: Boualem Djehiche, Peter Helgesson

Abstract: We study a general class of Principal-Agent problems in continuous time under hidden action. By formulating the model as a coupled stochastic optimal control problem we are able to find a set of necessary conditions characterizing optimal contracts, using the stochastic maximum principle. An example is carried out to illustrate the proposed approach to the Principal-Agent problem under linear stoc… ▽ More We study a general class of Principal-Agent problems in continuous time under hidden action. By formulating the model as a coupled stochastic optimal control problem we are able to find a set of necessary conditions characterizing optimal contracts, using the stochastic maximum principle. An example is carried out to illustrate the proposed approach to the Principal-Agent problem under linear stochastic dynamics with a quadratic performance function. △ Less

Submitted 26 November, 2014; v1 submitted 23 October, 2014; originally announced October 2014.

Comments: 28 pages, 2 figures. v2 is a rewrite with substatial improvement of Section 3

MSC Class: 93E20; 49N70; 49N90

On the Equality of Solutions of Max-Min and Min-Max Systems of Variational Inequalities with Interconnected Bilateral Obstacles

Authors: Boualem Djehiche, Said Hamadène, Marie-Amélie Morlais, Xuzhe Zhao

Abstract: In this paper, we deal with the solutions of systems of PDEs with bilateral inter-connected obstacles of min-max and max-min types. These systems arise naturally in stochastic switching zero-sum game problems. We show that when the switching costs of one side are regular, the solutions of the min-max and max-min systems coincide. Then, this common viscosity solution is related to a multi-dimension… ▽ More In this paper, we deal with the solutions of systems of PDEs with bilateral inter-connected obstacles of min-max and max-min types. These systems arise naturally in stochastic switching zero-sum game problems. We show that when the switching costs of one side are regular, the solutions of the min-max and max-min systems coincide. Then, this common viscosity solution is related to a multi-dimensional doubly reflected BSDE with bilateral interconnected obstacles. Finally, its relationship with the the values of a zero-sum switching game is studied. △ Less

Submitted 25 July, 2016; v1 submitted 19 August, 2014; originally announced August 2014.

MSC Class: 49N70; 49L25; 60H30; 90C39; 93E20

Min-max representations of viscosity solutions of Hamilton-Jacobi equations and applications in rare-event simulation

Authors: Boualem Djehiche, Henrik Hult, Pierre Nyquist

Abstract: In this paper a duality relation between the Mañé potential and Mather's action functional is derived in the context of convex and state-dependent Hamiltonians. The duality relation is used to obtain min-max representations of viscosity solutions of first order Hamilton-Jacobi equations. These min-max representations naturally suggest class\-es of subsolutions of Hamilton-Jacobi equations that ari… ▽ More In this paper a duality relation between the Mañé potential and Mather's action functional is derived in the context of convex and state-dependent Hamiltonians. The duality relation is used to obtain min-max representations of viscosity solutions of first order Hamilton-Jacobi equations. These min-max representations naturally suggest class\-es of subsolutions of Hamilton-Jacobi equations that arise in the theory of large deviations. The subsolutions, in turn, are good candidates for designing efficient rare-event simulation algorithms. △ Less

Submitted 13 June, 2014; originally announced June 2014.

MSC Class: 35D40; 35F21; 65C05; 49L25

Mean-Field Games for Marriage

Authors: Dario Bauso, Ben Mansour Dia, Boualem Djehiche, Hamidou Tembine, Raul Tempone

Abstract: This article examines mean-field games for marriage. The results support the argument that optimizing the long-term well-being through effort and social feeling state distribution (mean-field) will help to stabilize marriage. However, if the cost of effort is very high, the couple fluctuates in a bad feeling state or the marriage breaks down. We then examine the influence of society on a couple us… ▽ More This article examines mean-field games for marriage. The results support the argument that optimizing the long-term well-being through effort and social feeling state distribution (mean-field) will help to stabilize marriage. However, if the cost of effort is very high, the couple fluctuates in a bad feeling state or the marriage breaks down. We then examine the influence of society on a couple using mean field sentimental games. We show that, in mean-field equilibrium, the optimal effort is always higher than the one-shot optimal effort. We illustrate numerically the influence of the couple's network on their feeling states and their well-being. △ Less

Submitted 13 April, 2014; originally announced April 2014.

Comments: 22 figures. Accepted and to appear in PLoS One

A Stochastic Maximum Principle for Risk-Sensitive Mean-Field Type Control

Authors: Boualem Djehiche, Hamidou Tembine, Raul Tempone

Abstract: In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of mean-field type, in which the drift and the diffusion coefficients as well as the performance functional depend not only on the state and the control but also on the mean of the dist… ▽ More In this paper we study mean-field type control problems with risk-sensitive performance functionals. We establish a stochastic maximum principle (SMP) for optimal control of stochastic differential equations (SDEs) of mean-field type, in which the drift and the diffusion coefficients as well as the performance functional depend not only on the state and the control but also on the mean of the distribution of the state. Our result extends the risk-sensitive SMP (without mean-field coupling) of Lim and Zhou (2005), derived for feedback (or Markov) type optimal controls, to optimal control problems for non-Markovian dynamics which may be time-inconsistent in the sense that the Bellman optimality principle does not hold. In our approach to the risk-sensitive SMP, the smoothness assumption on the value-function imposed in Lim and Zhou (2005) need not to be satisfied. For a general action space a Peng's type SMP is derived, specifying the necessary conditions for optimality. Two examples are carried out to illustrate the proposed risk-sensitive mean-field type SMP under linear stochastic dynamics with exponential quadratic cost function. Explicit solutions are given for both mean-field free and mean-field models. △ Less

Submitted 5 April, 2014; originally announced April 2014.

Comments: 20 pages, 2 figures

A characterization of sub-game perfect Nash equilibria for SDEs of mean field type

Authors: Boualem Djehiche, Minyi Huang

Abstract: We study a class of dynamic decision problems of mean field type with time inconsistent cost functionals, and derive a stochastic maximum principle to characterize subgame perfect Nash equilibrium points. Subsequently, this approach is extended to a mean field game to construct decentralized strategies and obtain an estimate of their performance. We study a class of dynamic decision problems of mean field type with time inconsistent cost functionals, and derive a stochastic maximum principle to characterize subgame perfect Nash equilibrium points. Subsequently, this approach is extended to a mean field game to construct decentralized strategies and obtain an estimate of their performance. △ Less

Submitted 25 March, 2014; originally announced March 2014.

Comments: 28 pages

On the functional Hodrick-Prescott Filter with non-compact operators

Authors: Boualem Djehiche, Astrid Hilbert, Hiba Nassar

Abstract: We study a version of the functional Hodrick-Prescott filter where the associated operator is not necessarily compact, but merely closed and densely defined with closed range. We show that the associated optimal smoothing operator preserves the structure obtained in the compact case, when the underlying distribution of the data is Gaussian. We study a version of the functional Hodrick-Prescott filter where the associated operator is not necessarily compact, but merely closed and densely defined with closed range. We show that the associated optimal smoothing operator preserves the structure obtained in the compact case, when the underlying distribution of the data is Gaussian. △ Less

Submitted 17 December, 2013; originally announced December 2013.

Comments: arXiv admin note: substantial text overlap with arXiv:1312.4936

MSC Class: 62G05; 62G20

A Functional Hodrick Prescott Filter

Authors: Boualem Djehiche, Hiba Nassar

Abstract: We propose a functional version of the Hodrick-Prescott filter for functional data which take values in an infinite dimensional separable Hilbert space. We further characterize the associated optimal smoothing parameter when the associated linear operator is compact and the underlying distribution of the data is Gaussian. We propose a functional version of the Hodrick-Prescott filter for functional data which take values in an infinite dimensional separable Hilbert space. We further characterize the associated optimal smoothing parameter when the associated linear operator is compact and the underlying distribution of the data is Gaussian. △ Less

Submitted 17 December, 2013; originally announced December 2013.

MSC Class: 62G05; 62G20

Viscosity Solutions of Systems of Variational Inequalities with Interconnected Bilateral Obstacles

Authors: Boualem Djehiche, Said Hamadene, Marie Amelie Morlais

Abstract: We study a general class of nonlinear second-order variational inequalities with interconnected bilateral obstacles, related to a multiple modes switching game. Under rather weak assumptions, using systems of penalized unilateral backward SDEs, we construct a continuous viscosity solution of polynomial growth. Moreover, we establish a comparison result which in turn yields uniqueness of the soluti… ▽ More We study a general class of nonlinear second-order variational inequalities with interconnected bilateral obstacles, related to a multiple modes switching game. Under rather weak assumptions, using systems of penalized unilateral backward SDEs, we construct a continuous viscosity solution of polynomial growth. Moreover, we establish a comparison result which in turn yields uniqueness of the solution. △ Less

Submitted 21 November, 2012; originally announced November 2012.

Comments: 27 pages

Optimal stopping of expected profit and cost yields in an investment under uncertainty

Authors: Boualem Djehiche, Said Hamadène, Marie Amélie Morlais

Abstract: We consider a finite horizon optimal stopping problem related to trade-off strategies between expected profit and cost cash-flows of an investment under uncertainty. The optimal problem is first formulated in terms of a system of Snell envelopes for the profit and cost yields which act as obstacles to each other. We then construct both a minimal and a maximal solutions using an approximation sch… ▽ More We consider a finite horizon optimal stopping problem related to trade-off strategies between expected profit and cost cash-flows of an investment under uncertainty. The optimal problem is first formulated in terms of a system of Snell envelopes for the profit and cost yields which act as obstacles to each other. We then construct both a minimal and a maximal solutions using an approximation scheme of the associated system of reflected backward SDEs. When the dependence of the cash-flows on the sources of uncertainty, such as fluctuation market prices, assumed to evolve according to a diffusion process, is made explicit, we also obtain a connection between these solutions and viscosity solutions of a system of variational inequalities (VI) with interconnected obstacles. We also provide two counter-examples showing that uniqueness of solutions of (VI) does not hold in general. △ Less

Submitted 19 January, 2010; originally announced January 2010.

MSC Class: 60G40; 93E20; 62P20; 91B99

Stochastic Impulse Control of Non-Markovian Processes

Authors: Boualem Djehiche, Said Hamadene, Ibtissam Hdhiri

Abstract: We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot ap… ▽ More We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot apply quasi-variational inequalities techniques. We rather derive the main results using techniques involving reflected BSDEs and the Snell envelope. △ Less

Submitted 17 June, 2008; originally announced June 2008.

MSC Class: 60G40; 60H10; 62L15; 93E20

Large Deviations for Heavy-Tailed Factor Models

Authors: Boualem Djehiche, Jens Svensson

Abstract: We study large deviation probabilities for a sum of dependent random variables from a heavy-tailed factor model, assuming that the components are regularly varying. We identify conditions where both the factor and the idiosyncratic terms contribute to the behaviour of the tail-probability of the sum. A simple conditional Monte Carlo algorithm is also provided together with a comparison between t… ▽ More We study large deviation probabilities for a sum of dependent random variables from a heavy-tailed factor model, assuming that the components are regularly varying. We identify conditions where both the factor and the idiosyncratic terms contribute to the behaviour of the tail-probability of the sum. A simple conditional Monte Carlo algorithm is also provided together with a comparison between the simulations and the large deviation approximation. We also study large deviation probabilities for stochastic processes with factor structure. The processes involved are assumed to be Levy processes with regularly varying jump measures. Based on the results of the first part of the paper, we show that large deviations on a finite time interval are due to one large jump that can come from either the factor or the idiosyncratic part of the process. △ Less

Submitted 4 December, 2007; originally announced December 2007.

Comments: 16 pages

MSC Class: 60F10; 60G50

A maximum principle for relaxed stochastic control of linear SDE's with application to bond portfolio optimization

Authors: Daniel Andersson, Boualem Djehiche

Abstract: We study relaxed stochastic control problems where the state equation is a one dimensional linear stochastic differential equation with random and unbounded coefficients. The two main results are existence of an optimal relaxed control and necessary conditions for optimality in the form of a relaxed maximum principle. The main motivation is an optimal bond portfolio problem in a market where the… ▽ More We study relaxed stochastic control problems where the state equation is a one dimensional linear stochastic differential equation with random and unbounded coefficients. The two main results are existence of an optimal relaxed control and necessary conditions for optimality in the form of a relaxed maximum principle. The main motivation is an optimal bond portfolio problem in a market where there exists a continuum of bonds and the portfolio weights are modeled as measure-valued processes on the set of times to maturity. △ Less

Submitted 15 February, 2008; v1 submitted 3 December, 2007; originally announced December 2007.

Comments: 30 pages

MSC Class: 93E20; 60H30; 60H10; 91B28

Mean-field backward stochastic differential equations: A limit approach

Authors: Rainer Buckdahn, Boualem Djehiche, Juan Li, Shige Peng

Abstract: Mathematical mean-field approaches play an important role in different fields of Physics and Chemistry, but have found in recent works also their application in Economics, Finance and Game Theory. The objective of our paper is to investigate a special mean-field problem in a purely stochastic approach: for the solution $(Y,Z)$ of a mean-field backward stochastic differential equation driven by a… ▽ More Mathematical mean-field approaches play an important role in different fields of Physics and Chemistry, but have found in recent works also their application in Economics, Finance and Game Theory. The objective of our paper is to investigate a special mean-field problem in a purely stochastic approach: for the solution $(Y,Z)$ of a mean-field backward stochastic differential equation driven by a forward stochastic differential of McKean--Vlasov type with solution $X$ we study a special approximation by the solution $(X^N,Y^N,Z^N)$ of some decoupled forward--backward equation which coefficients are governed by $N$ independent copies of $(X^N,Y^N,Z^N)$. We show that the convergence speed of this approximation is of order $1/\sqrt{N}$. Moreover, our special choice of the approximation allows to characterize the limit behavior of $\sqrt{N}(X^N-X,Y^N-Y,Z^N-Z)$. We prove that this triplet converges in law to the solution of some forward--backward stochastic differential equation of mean-field type, which is not only governed by a Brownian motion but also by an independent Gaussian field. △ Less

Submitted 28 August, 2009; v1 submitted 14 November, 2007; originally announced November 2007.

Comments: Published in at http://dx.doi.org/10.1214/08-AOP442 the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP442 MSC Class: 60H10 (Primary) 60B10 (Secondary)

Journal ref: Annals of Probability 2009, Vol. 37, No. 4, 1524-1565

A Finite Horizon Optimal Multiple Switching Problem

Authors: Boualem Djehiche, Said Hamadene, Alexandre Popier

Abstract: We consider the problem of optimal multiple switching in finite horizon, when the state of the system, including the switching costs, is a general adapted stochastic process. The problem is formulated as an extended impulse control problem and completely solved using probabilistic tools such as the Snell envelop of processes and reflected backward stochastic differential equations. Finally, when… ▽ More We consider the problem of optimal multiple switching in finite horizon, when the state of the system, including the switching costs, is a general adapted stochastic process. The problem is formulated as an extended impulse control problem and completely solved using probabilistic tools such as the Snell envelop of processes and reflected backward stochastic differential equations. Finally, when the state of the system is a Markov diffusion process, we show that the vector of value functions of the optimal problem is a viscosity solution to a system of variational inequalities with inter-connected obstacles. △ Less

Submitted 18 July, 2007; originally announced July 2007.

Comments: 26 pages

MSC Class: 60G40 ; 93E20 ; 62P20 ; 91B99