Showing 1–15 of 15 results for author: Picarelli, A

Extended mean field control: a global numerical solution via finite-dimensional approximation

Authors: Athena Picarelli, Marco Scaratti, Jonathan Tam

Abstract: We present a finite-dimensional numerical approximation for a class of extended mean field control problems. Our algorithm learns the value function on the whole Wasserstein domain, as opposed to a fixed initial condition. We leverage the approximation of the mean field problem by a finite-player cooperative optimisation problem, due to the propagation of chaos, together with the usage of finite-d… ▽ More We present a finite-dimensional numerical approximation for a class of extended mean field control problems. Our algorithm learns the value function on the whole Wasserstein domain, as opposed to a fixed initial condition. We leverage the approximation of the mean field problem by a finite-player cooperative optimisation problem, due to the propagation of chaos, together with the usage of finite-dimensional solvers. This avoids the need to directly approximate functions on an infinite-dimensional domain, and allows for more efficient memory usage and faster computation. △ Less

Submitted 26 June, 2025; v1 submitted 26 March, 2025; originally announced March 2025.

MSC Class: 49N80; 65D15; 93E20

A Semi-Lagrangian scheme for Hamilton-Jacobi-Bellman equations with Dirichlet boundary conditions

Authors: Elisabetta Carlini, Athena Picarelli, Francisco J. Silva

Abstract: We study the numerical approximation of time-dependent, possibly degenerate, second-order Hamilton-Jacobi-Bellman equations in bounded domains with nonhomogeneous Dirichlet boundary conditions. It is well known that convergence towards the exact solution of the equation, considered here in the viscosity sense, holds if the scheme is monotone, consistent, and stable. While standard finite differenc… ▽ More We study the numerical approximation of time-dependent, possibly degenerate, second-order Hamilton-Jacobi-Bellman equations in bounded domains with nonhomogeneous Dirichlet boundary conditions. It is well known that convergence towards the exact solution of the equation, considered here in the viscosity sense, holds if the scheme is monotone, consistent, and stable. While standard finite difference schemes are, in general, not monotone, the so-called semi-Lagrangian schemes are monotone by construction. On the other hand, these schemes make use of a wide stencil and, when the equation is set in a bounded domain, this typically causes an overstepping of the boundary and hence the loss of consistency. We propose here a semi-Lagrangian scheme defined on an unstructured mesh, with a suitable treatment at grid points near the boundary to preserve consistency, and show its convergence for problems where the viscosity solution can even be discontinuous. We illustrate the numerical convergence in several tests, including degenerate and first-order equations. △ Less

Submitted 26 March, 2025; originally announced March 2025.

Report number: Roma01.Math.NA MSC Class: 49L25; 65M12; 35D40; 35K55

Convergence of a Deep BSDE solver with jumps

Authors: Alessandro Gnoatto, Katharina Oberpriller, Athena Picarelli

Abstract: We study the error arising in the numerical approximation of FBSDEs and related PIDEs by means of a deep learning-based method. Our results focus on decoupled FBSDEs with jumps and extend the seminal work of HAn and Long (2020) analyzing the numerical error of the deep BSDE solver proposed in E et al. (2017). We provide a priori and a posteriori error estimates for the finite and infinite activity… ▽ More We study the error arising in the numerical approximation of FBSDEs and related PIDEs by means of a deep learning-based method. Our results focus on decoupled FBSDEs with jumps and extend the seminal work of HAn and Long (2020) analyzing the numerical error of the deep BSDE solver proposed in E et al. (2017). We provide a priori and a posteriori error estimates for the finite and infinite activity case. △ Less

Submitted 16 January, 2025; originally announced January 2025.

Comments: 33 pages

MSC Class: 60H35; 65C30; 65N75

Deep Quadratic Hedging

Authors: Alessandro Gnoatto, Silvia Lavagnini, Athena Picarelli

Abstract: We propose a novel computational procedure for quadratic hedging in high-dimensional incomplete markets, covering mean-variance hedging and local risk minimization. Starting from the observation that both quadratic approaches can be treated from the point of view of backward stochastic differential equations (BSDEs), we (recursively) apply a deep learning-based BSDE solver to compute the entire op… ▽ More We propose a novel computational procedure for quadratic hedging in high-dimensional incomplete markets, covering mean-variance hedging and local risk minimization. Starting from the observation that both quadratic approaches can be treated from the point of view of backward stochastic differential equations (BSDEs), we (recursively) apply a deep learning-based BSDE solver to compute the entire optimal hedging strategies paths. This allows us to overcome the curse of dimensionality, extending the scope of applicability of quadratic hedging in high dimension. We test our approach with a classic Heston model and with a multiasset and multifactor generalization thereof, showing that this leads to high levels of accuracy. △ Less

Submitted 22 November, 2024; v1 submitted 24 December, 2022; originally announced December 2022.

Comments: Accepted version. Final edited version available at https://doi.org/10.1287/moor.2023.0213

MSC Class: 93E20; 65M75; 68T07; 60H10

A deep solver for BSDEs with jumps

Authors: Kristoffer Andersson, Alessandro Gnoatto, Marco Patacca, Athena Picarelli

Abstract: The aim of this work is to propose an extension of the deep solver by Han, Jentzen, E (2018) to the case of forward backward stochastic differential equations (FBSDEs) with jumps. As in the aforementioned solver, starting from a discretized version of the FBSDE and parametrizing the (high dimensional) control processes by means of a family of artificial neural networks (ANNs), the FBSDE is viewed… ▽ More The aim of this work is to propose an extension of the deep solver by Han, Jentzen, E (2018) to the case of forward backward stochastic differential equations (FBSDEs) with jumps. As in the aforementioned solver, starting from a discretized version of the FBSDE and parametrizing the (high dimensional) control processes by means of a family of artificial neural networks (ANNs), the FBSDE is viewed as a model-based reinforcement learning problem and the ANN parameters are fitted so as to minimize a prescribed loss function. We take into account both finite and infinite jump activity by introducing, in the latter case, an approximation with finitely many jumps of the forward process. We successfully apply our algorithm to option pricing problems in low and high dimension and discuss the applicability in the context of counterparty credit risk. △ Less

Submitted 21 May, 2025; v1 submitted 8 November, 2022; originally announced November 2022.

Comments: 33 pages. Accepted on SIAM Journal on Financial Mathematics

MSC Class: 93E20; 65M75; 68T07; 60H10

On the set of robust sustainable thresholds for uncertain control systems

Authors: Pedro Gajardo, Cristopher Hermosilla, Athena Picarelli

Abstract: In natural resource management, or more generally in the study of sustainability issues, often the objective is to maintain the state of a given system within a desirable configuration, typically established in terms of standards or thresholds. For instance, in fisheries management, the procedure of designing policies may include keeping the spawning stock biomass over a critical threshold and als… ▽ More In natural resource management, or more generally in the study of sustainability issues, often the objective is to maintain the state of a given system within a desirable configuration, typically established in terms of standards or thresholds. For instance, in fisheries management, the procedure of designing policies may include keeping the spawning stock biomass over a critical threshold and also ensuring minimal catches. Given a controlled dynamical system in discrete-time, representing the evolution of some natural resources under the action of controls and uncertainties, and an initial endowment of the resources, the aim of this paper is to characterize the set of robust sustainable thresholds, that is, the thresholds for which there exists some control path, along with its corresponding state trajectory, satisfying for all possible uncertainty scenarios, prescribed mixed constraints parametrized by such thresholds. This set provides useful information to users and decision-makers, illustrating the trade-offs between constraints and it is strongly related to the robust viability, one of the key concepts in viability theory, discipline that study the consistency between a controlled dynamical system and given constraints. Specifically, we are concerned with characterizing the weak and strong Pareto fronts of the set of robust sustainable thresholds, providing a practical method for computing such objects based on optimal control theory and a level-set approach. A numerical example, relying on renewable resource management, is shown to demonstrate the proposed method. △ Less

Submitted 12 January, 2021; originally announced January 2021.

Duality-based a posteriori error estimates for some approximation schemes for optimal investment problems

Authors: Athena Picarelli, Christoph Reisinger

Abstract: We consider a Markov chain approximation scheme for utility maximization problems in continuous time, which uses, in turn, a piecewise constant policy approximation, Euler-Maruyama time stepping, and a Gauss-Hermite approximation of the Gaussian increments. The error estimates previously derived in Picarelli and Reisinger (2019) are asymmetric between lower and upper bounds due to the control appr… ▽ More We consider a Markov chain approximation scheme for utility maximization problems in continuous time, which uses, in turn, a piecewise constant policy approximation, Euler-Maruyama time stepping, and a Gauss-Hermite approximation of the Gaussian increments. The error estimates previously derived in Picarelli and Reisinger (2019) are asymmetric between lower and upper bounds due to the control approximation and improve on known results in the literature in the lower case only. In the present paper, we use duality results to obtain a posteriori upper error bounds which are empirically of the same order as the lower bounds. The theoretical results are confirmed by our numerical tests. △ Less

Submitted 4 January, 2020; originally announced January 2020.

Optimal management of pumped hydroelectric production with state constrained optimal control

Authors: Athena Picarelli, Tiziano Vargiolu

Abstract: We present a novel technique to solve the problem of managing optimally a pumped hydroelectric storage system. This technique relies on representing the system as a stochastic optimal control problem with state constraints, these latter corresponding to the finite volume of the reservoirs. Following the recent level-set approach presented in O. Bokanowski, A. Picarelli, H. Zidani, "State-constrain… ▽ More We present a novel technique to solve the problem of managing optimally a pumped hydroelectric storage system. This technique relies on representing the system as a stochastic optimal control problem with state constraints, these latter corresponding to the finite volume of the reservoirs. Following the recent level-set approach presented in O. Bokanowski, A. Picarelli, H. Zidani, "State-constrained stochastic optimal control problems via reachability approach", SIAM J. Control and Optim. 54 (5) (2016), we transform the original constrained problem in an auxiliary unconstrained one in augmented state and control spaces, obtained by introducing an exact penalization of the original state constraints. The latter problem is fully treatable by classical dynamic programming arguments. △ Less

Submitted 15 September, 2019; originally announced September 2019.

Improved order 1/4 convergence for piecewise constant policy approximation of stochastic control problems

Authors: Espen R. Jakobsen, Athena Picarelli, Christoph Reisinger

Abstract: In N.V. Krylov, Approximating value functions for controlled degenerate diffusion processes by using piece-wise constant policies, Electron. J. Probab., 4(2), 1999, it is proved under standard assumptions that the value functions of controlled diffusion processes can be approximated with order 1/6 error by those with controls which are constant on uniform time intervals. In this note we refine the… ▽ More In N.V. Krylov, Approximating value functions for controlled degenerate diffusion processes by using piece-wise constant policies, Electron. J. Probab., 4(2), 1999, it is proved under standard assumptions that the value functions of controlled diffusion processes can be approximated with order 1/6 error by those with controls which are constant on uniform time intervals. In this note we refine the proof and show that the provable rate can be improved to 1/4, which is optimal in our setting. Moreover, we demonstrate the improvements this implies for error estimates derived by similar techniques for approximation schemes, bringing these in line with the best available results from the PDE literature. △ Less

Submitted 4 January, 2019; originally announced January 2019.

Probabilistic error analysis for some approximation schemes to optimal control problems

Authors: Athena Picarelli, Christoph Reisinger

Abstract: We introduce a class of numerical schemes for optimal control problems based on a novel Markov chain approximation, which uses, in turn, a piecewise constant policy approximation, Euler-Maruyama time stepping, and a Gauss-Hermite approximation of the Gaussian increments. We provide lower error bounds of order arbitrarily close to 1/2 in time and 1/3 in space for Lipschitz viscosity solutions, coup… ▽ More We introduce a class of numerical schemes for optimal control problems based on a novel Markov chain approximation, which uses, in turn, a piecewise constant policy approximation, Euler-Maruyama time stepping, and a Gauss-Hermite approximation of the Gaussian increments. We provide lower error bounds of order arbitrarily close to 1/2 in time and 1/3 in space for Lipschitz viscosity solutions, coupling probabilistic arguments with regularization techniques as introduced by Krylov. The corresponding order of the upper bounds is 1/4 in time and 1/5 in space. For sufficiently regular solutions, the order is 1 in both time and space for both bounds. Finally, we propose techniques for further improving the accuracy of the individual components of the approximation. △ Less

Submitted 4 January, 2020; v1 submitted 10 October, 2018; originally announced October 2018.

A level-set approach for stochastic optimal control problems under controlled-loss constraints

Authors: Geraldine Bouveret, Athena Picarelli

Abstract: We study a family of optimal control problems under a set of controlled-loss constraints holding at different deterministic dates. The characterization of the associated value function by a Hamilton-Jacobi-Bellman equation usually calls for additional strong assumptions on the dynamics of the processes involved and the set of constraints. To treat this problem in absence of those assumptions, we f… ▽ More We study a family of optimal control problems under a set of controlled-loss constraints holding at different deterministic dates. The characterization of the associated value function by a Hamilton-Jacobi-Bellman equation usually calls for additional strong assumptions on the dynamics of the processes involved and the set of constraints. To treat this problem in absence of those assumptions, we first convert it into a state-constrained stochastic target problem and then apply a level-set approach. With this approach, the state constraints can be managed through an exact penalization technique. △ Less

Submitted 24 July, 2020; v1 submitted 9 October, 2018; originally announced October 2018.

Stability and convergence of second order backward differentiation schemes for parabolic Hamilton-Jacobi-Bellman equations

Authors: Olivier Bokanowski, Athena Picarelli, Christoph Reisinger

Abstract: We study a second order BDF (Backward Differentiation Formula) scheme for the numerical approximation of parabolic HJB (Hamilton-Jacobi-Bellman) equations. The scheme under consideration is implicit, non-monotone, and second order accurate in time and space. The lack of monotonicity prevents the use of well-known convergence results for solutions in the viscosity sense. In this work, we establish… ▽ More We study a second order BDF (Backward Differentiation Formula) scheme for the numerical approximation of parabolic HJB (Hamilton-Jacobi-Bellman) equations. The scheme under consideration is implicit, non-monotone, and second order accurate in time and space. The lack of monotonicity prevents the use of well-known convergence results for solutions in the viscosity sense. In this work, we establish rigorous stability results in a general nonlinear setting as well as convergence results for some particular cases with additional regularity assumptions. While most results are presented for one-dimensional, linear parabolic and non-linear HJB equations, some results are also extended to multiple dimensions and to Isaacs equations. Numerical tests are included to validate the method. △ Less

Submitted 20 February, 2018; originally announced February 2018.

Some regularity and convergence results for parabolic Hamilton-Jacobi-Bellman equations in bounded domains

Authors: Athena Picarelli, Christoph Reisinger, Julen Rotaetxe Arto

Abstract: We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the problem to obtain well-posedness and regularity of a related switching system and the convergence of its components to the HJB equation. In particular, we show e… ▽ More We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the problem to obtain well-posedness and regularity of a related switching system and the convergence of its components to the HJB equation. In particular, we show existence of a viscosity solution to the switching system by a novel construction of sub- and supersolutions and application of Perron's method. Error bounds for monotone schemes for the HJB equation are then derived from estimates near the boundary, where the standard regularisation procedure for viscosity solutions is not applicable, and are found to be of the same order as known results for the whole space. We deduce error bounds for some common finite difference and truncated semi-Lagrangian schemes. △ Less

Submitted 15 July, 2019; v1 submitted 30 October, 2017; originally announced October 2017.

High-order filtered schemes for time-dependent second order HJB equations

Authors: Olivier Bokanowski, Athena Picarelli, Christoph Reisinger

Abstract: In this paper, we present and analyse a class of "filtered" numerical schemes for second order Hamilton-Jacobi-Bellman equations. Our approach follows the ideas introduced in B.D. Froese and A.M. Oberman, Convergent filtered schemes for the Monge-Ampère partial differential equation, SIAM J. Numer. Anal., 51(1):423--444, 2013, and more recently applied by other authors to stationary or time-depend… ▽ More In this paper, we present and analyse a class of "filtered" numerical schemes for second order Hamilton-Jacobi-Bellman equations. Our approach follows the ideas introduced in B.D. Froese and A.M. Oberman, Convergent filtered schemes for the Monge-Ampère partial differential equation, SIAM J. Numer. Anal., 51(1):423--444, 2013, and more recently applied by other authors to stationary or time-dependent first order Hamilton-Jacobi equations. For high order approximation schemes (where "high" stands for greater than one), the inevitable loss of monotonicity prevents the use of the classical theoretical results for convergence to viscosity solutions. The work introduces a suitable local modification of these schemes by "filtering" them with a monotone scheme, such that they can be proven convergent and still show an overall high order behaviour for smooth enough solutions. We give theoretical proofs of these claims and illustrate the behaviour with numerical tests from mathematical finance, focussing also on the use of backward difference formulae (BDF) for constructing the high order schemes. △ Less

Submitted 15 November, 2016; originally announced November 2016.

Comments: 27 pages, 16 figures, 4 tables

MSC Class: 65M06; 91G80

A patchy Dynamic Programming scheme for a class of Hamilton-Jacobi-Bellman equations

Authors: Simone Cacace, Emiliano Cristiani, Maurizio Falcone, Athena Picarelli

Abstract: In this paper we present a new algorithm for the solution of Hamilton-Jacobi-Bellman equations related to optimal control problems. The key idea is to divide the domain of computation into subdomains which are shaped by the optimal dynamics of the underlying control problem. This can result in a rather complex geometrical subdivision, but it has the advantage that every subdomain is invariant with… ▽ More In this paper we present a new algorithm for the solution of Hamilton-Jacobi-Bellman equations related to optimal control problems. The key idea is to divide the domain of computation into subdomains which are shaped by the optimal dynamics of the underlying control problem. This can result in a rather complex geometrical subdivision, but it has the advantage that every subdomain is invariant with respect to the optimal dynamics, and then the solution can be computed independently in each subdomain. The features of this dynamics-dependent domain decomposition can be exploited to speed up the computation and for an efficient parallelization, since the classical transmission conditions at the boundaries of the subdomains can be avoided. For their properties, the subdomains are patches in the sense introduced by Ancona and Bressan [ESAIM Control Optim. Calc. Var., 4 (1999), pp. 445-471]. Several examples in two and three dimensions illustrate the properties of the new method. △ Less

Submitted 6 November, 2012; v1 submitted 16 September, 2011; originally announced September 2011.

MSC Class: 65N55; 49L20

Journal ref: SIAM J. Sci. Comput., Vol. 34 (2012), No. 5, pp. A2625-A2649