-
An introduction to tensors for path signatures
Authors:
Jack Beda,
Goncalo dos Reis,
Nikolas Tapia
Abstract:
We present a fit-for-purpose introduction to tensors and their operations. It is envisaged to help the reader become acquainted with its underpinning concepts for the study of path signatures. The text includes exercises, solutions and many intuitive explanations. The material discusses direct sums and tensor products as two possible operations that make the Cartesian product of vectors spaces a v…
▽ More
We present a fit-for-purpose introduction to tensors and their operations. It is envisaged to help the reader become acquainted with its underpinning concepts for the study of path signatures. The text includes exercises, solutions and many intuitive explanations. The material discusses direct sums and tensor products as two possible operations that make the Cartesian product of vectors spaces a vector space. The difference lies in linear Vs. multilinear structures -- the latter being the suitable one to deal with path signatures. The presentation is offered to understand tensors in a deeper sense than just a multidimensional array. The text concludes with the prime example of an algebra in relation to path signatures: the 'tensor algebra'.
This manuscript is the extended version (with two extra sections) of a chapter to appear in Open Access in a forthcoming Springer volume ``Signatures Methods in Finance: An Introduction with Computational Applications". The two additional sections here discuss the factoring of tensor product expressions to a minimal number of terms. This problem is relevant for the path signatures theory but not necessary for what is presented in the book. Tensor factorization is an elegant way of becoming familiar with the language of tensors and tensor products. A GitHub repository is attached.
△ Less
Submitted 25 February, 2025; v1 submitted 15 January, 2025;
originally announced February 2025.
-
The random periodic solutions for McKean-Vlasov stochastic differential equations
Authors:
Jianhai Bao,
Goncalo Dos Reis,
Yue Wu
Abstract:
In this paper, we study well-posedness of random periodic solutions of stochastic differential equations (SDEs) of McKean-Vlasov type driven by a two-sided Brownian motion, where the random periodic behaviour is characterised by the equations' long-time behaviour. Given the well-known connection between McKean-Vlasov SDEs and interacting particle systems, we show propagation of chaos and that the…
▽ More
In this paper, we study well-posedness of random periodic solutions of stochastic differential equations (SDEs) of McKean-Vlasov type driven by a two-sided Brownian motion, where the random periodic behaviour is characterised by the equations' long-time behaviour. Given the well-known connection between McKean-Vlasov SDEs and interacting particle systems, we show propagation of chaos and that the key properties of the interacting particle systems recover those of the McKean-Vlasov SDEs in the particle limit. All results in the present work are shown under two settings: fully and partially dissipative case. Each setting has its challenges and limitations. For instance, weakening full dissipativity to partial dissipativity demands stronger structural assumptions on the equations' dynamics and yields random periodic behaviour in the weak sense instead of pathwise sense (as in the full dissipativity case). The proof mechanisms are close but fundamentally different.
△ Less
Submitted 4 December, 2024; v1 submitted 30 August, 2024;
originally announced August 2024.
-
A Mean Field Ansatz for Zero-Shot Weight Transfer
Authors:
Xingyuan Chen,
Wenwei Kuang,
Lei Deng,
Wei Han,
Bo Bai,
Goncalo dos Reis
Abstract:
The pre-training cost of large language models (LLMs) is prohibitive. One cutting-edge approach to reduce the cost is zero-shot weight transfer, also known as model growth for some cases, which magically transfers the weights trained in a small model to a large model. However, there are still some theoretical mysteries behind the weight transfer. In this paper, inspired by prior applications of me…
▽ More
The pre-training cost of large language models (LLMs) is prohibitive. One cutting-edge approach to reduce the cost is zero-shot weight transfer, also known as model growth for some cases, which magically transfers the weights trained in a small model to a large model. However, there are still some theoretical mysteries behind the weight transfer. In this paper, inspired by prior applications of mean field theory to neural network dynamics, we introduce a mean field ansatz to provide a theoretical explanation for weight transfer. Specifically, we propose the row-column (RC) ansatz under the mean field point of view, which describes the measure structure of the weights in the neural network (NN) and admits a close measure dynamic. Thus, the weights of different sizes NN admit a common distribution under proper assumptions, and weight transfer methods can be viewed as sampling methods. We empirically validate the RC ansatz by exploring simple MLP examples and LLMs such as GPT-3 and Llama-3.1. We show the mean-field point of view is adequate under suitable assumptions which can provide theoretical support for zero-shot weight transfer.
△ Less
Submitted 16 August, 2024;
originally announced August 2024.
-
Improved weak convergence for the long time simulation of Mean-field Langevin equations
Authors:
Xingyuan Chen,
Goncalo dos Reis,
Wolfgang Stockinger,
Zac Wilde
Abstract:
We study the weak convergence behaviour of the Leimkuhler--Matthews method, a non-Markovian Euler-type scheme with the same computational cost as the Euler scheme, for the approximation of the stationary distribution of a one-dimensional McKean--Vlasov Stochastic Differential Equation (MV-SDE). The particular class under study is known as mean-field (overdamped) Langevin equations (MFL). We provid…
▽ More
We study the weak convergence behaviour of the Leimkuhler--Matthews method, a non-Markovian Euler-type scheme with the same computational cost as the Euler scheme, for the approximation of the stationary distribution of a one-dimensional McKean--Vlasov Stochastic Differential Equation (MV-SDE). The particular class under study is known as mean-field (overdamped) Langevin equations (MFL). We provide weak and strong error results for the scheme in both finite and infinite time. We work under a strong convexity assumption.
Based on a careful analysis of the variation processes and the Kolmogorov backward equation for the particle system associated with the MV-SDE, we show that the method attains a higher-order approximation accuracy in the long-time limit (of weak order convergence rate $3/2$) than the standard Euler method (of weak order $1$). While we use an interacting particle system (IPS) to approximate the MV-SDE, we show the convergence rate is independent of the dimension of the IPS and this includes establishing uniform-in-time decay estimates for moments of the IPS, the Kolmogorov backward equation and their derivatives. The theoretical findings are supported by numerical tests.
△ Less
Submitted 12 January, 2025; v1 submitted 2 May, 2024;
originally announced May 2024.
-
Numerical approximation of McKean-Vlasov SDEs via stochastic gradient descent
Authors:
Ankush Agarwal,
Andrea Amato,
Goncalo dos Reis,
Stefano Pagliarani
Abstract:
We propose a novel approach to numerically approximate McKean-Vlasov stochastic differential equations (MV-SDE) using stochastic gradient descent (SGD) while avoiding the use of interacting particle systems. The SGD technique is deployed to solve a Euclidean minimization problem, obtained by first representing the MV-SDE as a minimization problem over the set of continuous functions of time, and t…
▽ More
We propose a novel approach to numerically approximate McKean-Vlasov stochastic differential equations (MV-SDE) using stochastic gradient descent (SGD) while avoiding the use of interacting particle systems. The SGD technique is deployed to solve a Euclidean minimization problem, obtained by first representing the MV-SDE as a minimization problem over the set of continuous functions of time, and then approximating the domain with a finite-dimensional subspace. Convergence is established by proving certain intermediate stability and moment estimates of the relevant stochastic processes, including the tangent processes. Numerical experiments illustrate the competitive performance of our SGD based method compared to the IPS benchmarks. This work offers a theoretical foundation for using the SGD method in the context of numerical approximation of MV-SDEs, and provides analytical tools to study its stability and convergence.
△ Less
Submitted 28 February, 2025; v1 submitted 20 October, 2023;
originally announced October 2023.
-
Malliavin differentiability of McKean-Vlasov SDEs with locally Lipschitz coefficients
Authors:
Goncalo dos Reis,
Zac Wilde
Abstract:
In this short note, we establish Malliavin differentiability of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts satisfying both a locally Lipschitz and a one-sided Lipschitz assumption, and where the diffusion coefficient is assumed to be uniformly Lipschitz in its variables.
As a secondary contribution, we investigate how Malliavin differentiability transfers across the in…
▽ More
In this short note, we establish Malliavin differentiability of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts satisfying both a locally Lipschitz and a one-sided Lipschitz assumption, and where the diffusion coefficient is assumed to be uniformly Lipschitz in its variables.
As a secondary contribution, we investigate how Malliavin differentiability transfers across the interacting particle system associated with the McKean-Vlasov equation to its limiting equation. This final result requires both spatial and measure differentiability of the coefficients and doubles as a standalone result of independent interest since the study of Malliavin derivatives of weakly interacting particle systems seems novel to the literature. The presentation is didactic and finishes with a discussion on mollification techniques for the Lions derivative.
△ Less
Submitted 8 May, 2025; v1 submitted 20 October, 2023;
originally announced October 2023.
-
An iterative method for Helmholtz boundary value problems arising in wave propagation
Authors:
Francisco Bernal,
Xingyuan Chen,
Goncalo dos Reis
Abstract:
The complex Helmholtz equation $(Δ+ k^2)u=f$ (where $k\in{\mathbb R},u(\cdot),f(\cdot)\in{\mathbb C}$) is a mainstay of computational wave simulation. Despite its apparent simplicity, efficient numerical methods are challenging to design and, in some applications, regarded as an open problem. Two sources of difficulty are the large number of degrees of freedom and the indefiniteness of the matrice…
▽ More
The complex Helmholtz equation $(Δ+ k^2)u=f$ (where $k\in{\mathbb R},u(\cdot),f(\cdot)\in{\mathbb C}$) is a mainstay of computational wave simulation. Despite its apparent simplicity, efficient numerical methods are challenging to design and, in some applications, regarded as an open problem. Two sources of difficulty are the large number of degrees of freedom and the indefiniteness of the matrices arising after discretisation. Seeking to meet them within the novel framework of probabilistic domain decomposition, we set out to rewrite the Helmholtz equation into a form amenable to the Feynman-Kac formula for elliptic boundary value problems. We consider two typical scenarios, the scattering of a plane wave and the propagation inside a cavity, and recast them as a sequence of Poisson equations. By means of stochastic arguments, we find a sufficient and simulatable condition for the convergence of the iterations. Upon discretisation a necessary condition for convergence can be derived by adding up the iterates using the harmonic series for the matrix inverse -- we illustrate the procedure in the case of finite differences.
From a practical point of view, our results are ultimately of limited scope. Nonetheless, this unexpected -- even paradoxical -- new direction of attack on the Helmholtz equation proposed by this work offers a fresh perspective on this classical and difficult problem. Our results show that there indeed exists a predictable range $k<k_{max}$ in which this new ansatz works with $k_{max}$ being far below the challenging situation.
△ Less
Submitted 22 August, 2023;
originally announced August 2023.
-
Wellposedness, exponential ergodicity and numerical approximation of fully super-linear McKean--Vlasov SDEs and associated particle systems
Authors:
Xingyuan Chen,
Goncalo dos Reis,
Wolfgang Stockinger
Abstract:
We study a class of McKean--Vlasov Stochastic Differential Equations (MV-SDEs) with drifts and diffusions having super-linear growth in measure and space -- the maps have general polynomial form but also satisfy a certain monotonicity condition. The combination of the drift's super-linear growth in measure (by way of a convolution) and the super-linear growth in space and measure of the diffusion…
▽ More
We study a class of McKean--Vlasov Stochastic Differential Equations (MV-SDEs) with drifts and diffusions having super-linear growth in measure and space -- the maps have general polynomial form but also satisfy a certain monotonicity condition. The combination of the drift's super-linear growth in measure (by way of a convolution) and the super-linear growth in space and measure of the diffusion coefficient requires novel technical elements in order to obtain the main results. We establish wellposedness, propagation of chaos (PoC), and under further assumptions on the model parameters, we show an exponential ergodicity property alongside the existence of an invariant distribution. No differentiability or non-degeneracy conditions are required.
Further, we present a particle system based Euler-type split-step scheme (SSM) for the simulation of this type of MV-SDEs. The scheme attains, in stepsize, the strong error rate $1/2$ in the non-path-space root-mean-square error metric and we demonstrate the property of mean-square contraction. Our results are illustrated by numerical examples including: estimation of PoC rates across dimensions, preservation of periodic phase-space, and the observation that taming appears to be not a suitable method unless strong dissipativity is present.
△ Less
Submitted 31 January, 2025; v1 submitted 10 February, 2023;
originally announced February 2023.
-
Many-Server Queueing Systems with Heterogeneous Strategic Servers in Heavy Traffic
Authors:
Burak Büke,
Goncalo dos Reis,
Vadim Platonov
Abstract:
In most service systems, the servers are humans who desire to experience a certain level of idleness. In call centers, this manifests itself as the call avoidance behavior, where servers strategically adjust their service rate to strike a balance between the idleness they receive and effort to work harder. Moreover, being humans, each server values this trade-off differently and has different capa…
▽ More
In most service systems, the servers are humans who desire to experience a certain level of idleness. In call centers, this manifests itself as the call avoidance behavior, where servers strategically adjust their service rate to strike a balance between the idleness they receive and effort to work harder. Moreover, being humans, each server values this trade-off differently and has different capabilities. Drawing ideas on mean-field games we develop a novel framework relying on measure-valued processes to simultaneously address strategic server behavior and inherent server heterogeneity in service systems. This framework enables us to extend the recent literature on strategic servers in four new directions by: (i) incorporating individual choices of servers, (ii) incorporating individual abilities of servers, (iii) modeling the discomfort experienced by servers due to low levels of idleness, and (iv) considering more general routing policies. Using our framework, we are able to asymptotically characterize asymmetric Nash equilibria for many-server systems with strategic servers.
In simpler cases, it has been shown that the purely quality-driven regime is asymptotically optimal. However, we show that if the discomfort increases fast enough as the idleness approaches zero, the quality-and-efficiency-driven regime and other quality driven regimes can be optimal. This is the first time this conclusion appears in the literature.
△ Less
Submitted 27 May, 2025; v1 submitted 8 November, 2022;
originally announced November 2022.
-
High order splitting methods for SDEs satisfying a commutativity condition
Authors:
James Foster,
Goncalo dos Reis,
Calum Strange
Abstract:
In this paper, we introduce a new simple approach to developing and establishing the convergence of splitting methods for a large class of stochastic differential equations (SDEs), including additive, diagonal and scalar noise types. The central idea is to view the splitting method as a replacement of the driving signal of an SDE, namely Brownian motion and time, with a piecewise linear path that…
▽ More
In this paper, we introduce a new simple approach to developing and establishing the convergence of splitting methods for a large class of stochastic differential equations (SDEs), including additive, diagonal and scalar noise types. The central idea is to view the splitting method as a replacement of the driving signal of an SDE, namely Brownian motion and time, with a piecewise linear path that yields a sequence of ODEs $-$ which can be discretized to produce a numerical scheme. This new way of understanding splitting methods is inspired by, but does not use, rough path theory. We show that when the driving piecewise linear path matches certain iterated stochastic integrals of Brownian motion, then a high order splitting method can be obtained. We propose a general proof methodology for establishing the strong convergence of these approximations that is akin to the general framework of Milstein and Tretyakov. That is, once local error estimates are obtained for the splitting method, then a global rate of convergence follows. This approach can then be readily applied in future research on SDE splitting methods. By incorporating recently developed approximations for iterated integrals of Brownian motion into these piecewise linear paths, we propose several high order splitting methods for SDEs satisfying a certain commutativity condition. In our experiments, which include the Cox-Ingersoll-Ross model and additive noise SDEs (noisy anharmonic oscillator, stochastic FitzHugh-Nagumo model, underdamped Langevin dynamics), the new splitting methods exhibit convergence rates of $O(h^{3/2})$ and outperform schemes previously proposed in the literature.
△ Less
Submitted 15 February, 2024; v1 submitted 31 October, 2022;
originally announced October 2022.
-
Euler simulation of interacting particle systems and McKean-Vlasov SDEs with fully superlinear growth drifts in space and interaction
Authors:
Xingyuan Chen,
Goncalo dos Reis
Abstract:
We consider in this work the convergence of a split-step Euler type scheme (SSM) for the numerical simulation of interacting particle Stochastic Differential Equation (SDE) systems and McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with full super-linear growth in the spatial and the interaction component in the drift, and non-constant Lipschitz diffusion coefficient.
The super-linear…
▽ More
We consider in this work the convergence of a split-step Euler type scheme (SSM) for the numerical simulation of interacting particle Stochastic Differential Equation (SDE) systems and McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with full super-linear growth in the spatial and the interaction component in the drift, and non-constant Lipschitz diffusion coefficient.
The super-linear growth in the interaction (or measure) component stems from convolution operations with super-linear growth functions allowing in particular application to the granular media equation with multi-well confining potentials. From a methodological point of view, we avoid altogether functional inequality arguments (as we allow for non-constant non-bounded diffusion maps).
The scheme attains, in stepsize, a near-optimal classical (path-space) root mean-square error rate of $1/2-\varepsilon$ for $\varepsilon>0$ and an optimal rate $1/2$ in the non-path-space mean-square error metric. Numerical examples illustrate all findings. In particular, the testing raises doubts if taming is a suitable methodology for this type of problem (with convolution terms and non-constant diffusion coefficients).
△ Less
Submitted 27 March, 2023; v1 submitted 26 August, 2022;
originally announced August 2022.
-
An explicit Milstein-type scheme for interacting particle systems and McKean--Vlasov SDEs with common noise and non-differentiable drift coefficients
Authors:
Sani Biswas,
Chaman Kumar,
Neelima,
Gonçalo dos Reis,
Christoph Reisinger
Abstract:
We propose an explicit drift-randomised Milstein scheme for both McKean--Vlasov stochastic differential equations and associated high-dimensional interacting particle systems with common noise. By using a drift-randomisation step in space and measure, we establish the scheme's strong convergence rate of $1$ under reduced regularity assumptions on the drift coefficient: no classical (Euclidean) der…
▽ More
We propose an explicit drift-randomised Milstein scheme for both McKean--Vlasov stochastic differential equations and associated high-dimensional interacting particle systems with common noise. By using a drift-randomisation step in space and measure, we establish the scheme's strong convergence rate of $1$ under reduced regularity assumptions on the drift coefficient: no classical (Euclidean) derivatives in space or measure derivatives (e.g., Lions/Fréchet) are required. The main result is established by enriching the concepts of bistability and consistency of numerical schemes used previously for standard SDE. We introduce certain Spijker-type norms (and associated Banach spaces) to deal with the interaction of particles present in the stochastic systems being analysed. A discussion of the scheme's complexity is provided.
△ Less
Submitted 16 June, 2023; v1 submitted 22 August, 2022;
originally announced August 2022.
-
"Knees" in lithium-ion battery aging trajectories
Authors:
Peter M. Attia,
Alexander Bills,
Ferran Brosa Planella,
Philipp Dechent,
Gonçalo dos Reis,
Matthieu Dubarry,
Paul Gasper,
Richard Gilchrist,
Samuel Greenbank,
David Howey,
Ouyang Liu,
Edwin Khoo,
Yuliya Preger,
Abhishek Soni,
Shashank Sripad,
Anna G. Stefanopoulou,
Valentin Sulzer
Abstract:
Lithium-ion batteries can last many years but sometimes exhibit rapid, nonlinear degradation that severely limits battery lifetime. In this work, we review prior work on "knees" in lithium-ion battery aging trajectories. We first review definitions for knees and three classes of "internal state trajectories" (termed snowball, hidden, and threshold trajectories) that can cause a knee. We then discu…
▽ More
Lithium-ion batteries can last many years but sometimes exhibit rapid, nonlinear degradation that severely limits battery lifetime. In this work, we review prior work on "knees" in lithium-ion battery aging trajectories. We first review definitions for knees and three classes of "internal state trajectories" (termed snowball, hidden, and threshold trajectories) that can cause a knee. We then discuss six knee "pathways", including lithium plating, electrode saturation, resistance growth, electrolyte and additive depletion, percolation-limited connectivity, and mechanical deformation -- some of which have internal state trajectories with signals that are electrochemically undetectable. We also identify key design and usage sensitivities for knees. Finally, we discuss challenges and opportunities for knee modeling and prediction. Our findings illustrate the complexity and subtlety of lithium-ion battery degradation and can aid both academic and industrial efforts to improve battery lifetime.
△ Less
Submitted 8 January, 2022;
originally announced January 2022.
-
On the relation between Stratonovich and Ito integrals with functional integrands of conditional measure flows
Authors:
Goncalo dos Reis,
Vadim Platonov
Abstract:
In this small note we explicit the relation between Ito and Stratonovich integrals when conditional measure flow components are present in the integrands. The `correction' term involves Lions-type measure derivatives and clarifies which cross-correlations need to be taken into account. We cast the framework in relation to SDEs of mean-field type depending on conditional flows of measure. The resul…
▽ More
In this small note we explicit the relation between Ito and Stratonovich integrals when conditional measure flow components are present in the integrands. The `correction' term involves Lions-type measure derivatives and clarifies which cross-correlations need to be taken into account. We cast the framework in relation to SDEs of mean-field type depending on conditional flows of measure. The result being trivial under full flows of measure.
△ Less
Submitted 5 November, 2021;
originally announced November 2021.
-
Operator-splitting schemes for degenerate, non-local, conservative-dissipative systems
Authors:
Daniel Adams,
Manh Hong Duong,
Goncalo dos Reis
Abstract:
In this paper, we develop a natural operator-splitting variational scheme for a general class of non-local, degenerate conservative-dissipative evolutionary equations. The splitting-scheme consists of two phases: a conservative (transport) phase and a dissipative (diffusion) phase. The first phase is solved exactly using the method of characteristic and DiPerna-Lions theory while the second phase…
▽ More
In this paper, we develop a natural operator-splitting variational scheme for a general class of non-local, degenerate conservative-dissipative evolutionary equations. The splitting-scheme consists of two phases: a conservative (transport) phase and a dissipative (diffusion) phase. The first phase is solved exactly using the method of characteristic and DiPerna-Lions theory while the second phase is solved approximately using a JKO-type variational scheme that minimizes an energy functional with respect to a certain Kantorovich optimal transport cost functional. In addition, we also introduce an entropic-regularisation of the scheme. We prove the convergence of both schemes to a weak solution of the evolutionary equation. We illustrate the generality of our work by providing a number of examples, including the kinetic Fokker-Planck equation and the (regularized) Vlasov-Poisson-Fokker-Planck equation.
△ Less
Submitted 23 June, 2022; v1 submitted 24 May, 2021;
originally announced May 2021.
-
A flexible split-step scheme for solving McKean-Vlasov Stochastic Differential Equations
Authors:
Xingyuan Chen,
Goncalo dos Reis
Abstract:
We present an implicit Split-Step explicit Euler type Method (dubbed SSM) for the simulation of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts of superlinear growth in space, Lipschitz in measure and non-constant Lipschitz diffusion coefficient. The scheme is designed to leverage the structure induced by the interacting particle approximation system, including parallel imple…
▽ More
We present an implicit Split-Step explicit Euler type Method (dubbed SSM) for the simulation of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts of superlinear growth in space, Lipschitz in measure and non-constant Lipschitz diffusion coefficient. The scheme is designed to leverage the structure induced by the interacting particle approximation system, including parallel implementation and the solvability of the implicit equation. The scheme attains the classical $1/2$ root mean square error (rMSE) convergence rate in stepsize and closes the gap left by [18, "Simulation of McKean-Vlasov SDEs with super-linear growth" in IMA Journal of Numerical Analysis, 01 2021. draa099] regarding efficient implicit methods and their convergence rate for this class of McKean-Vlasov SDEs. A sufficient condition for mean-square contractivity of the scheme is presented. Several numerical examples are presented, including a comparative analysis to other known algorithms for this class (Taming and Adaptive time-stepping) across parallel and non-parallel implementations.
△ Less
Submitted 9 May, 2022; v1 submitted 20 May, 2021;
originally announced May 2021.
-
Entropic regularisation of non-gradient systems
Authors:
Daniel Adams,
Manh Hong Duong,
Goncalo dos Reis
Abstract:
The theory of Wasserstein gradient flows in the space of probability measures has made an enormous progress over the last twenty years. It constitutes a unified and powerful framework in the study of dissipative partial differential equations (PDEs) providing the means to prove well-posedness, regularity, stability and quantitative convergence to the equilibrium. The recently developed entropic re…
▽ More
The theory of Wasserstein gradient flows in the space of probability measures has made an enormous progress over the last twenty years. It constitutes a unified and powerful framework in the study of dissipative partial differential equations (PDEs) providing the means to prove well-posedness, regularity, stability and quantitative convergence to the equilibrium. The recently developed entropic regularisation technique paves the way for fast and efficient numerical methods for solving these gradient flows. However, many PDEs of interest do not have a gradient flow structure and, a priori, the theory is not applicable. In this paper, we develop a time-discrete entropy regularised variational scheme for a general class of such non-gradient PDEs. We prove the convergence of the scheme and illustrate the breadth of the proposed framework with concrete examples including the non-linear kinetic Fokker-Planck (Kramers) equation and a non-linear degenerate diffusion of Kolmogorov type. Numerical simulations are also provided.
△ Less
Submitted 14 January, 2022; v1 submitted 9 April, 2021;
originally announced April 2021.
-
Regression-type analysis for block maxima on block maxima
Authors:
Miguel de Carvalho,
Gonçalo dos Reis,
Alina Kumukova
Abstract:
This paper devises a regression-type model for the situation where both the response and covariates are extreme. The proposed approach is designed for the setting where both the response and covariates are themselves block maxima, and thus contrarily to standard regression methods it takes into account the key fact that the limiting distribution of suitably standardized componentwise maxima is an…
▽ More
This paper devises a regression-type model for the situation where both the response and covariates are extreme. The proposed approach is designed for the setting where both the response and covariates are themselves block maxima, and thus contrarily to standard regression methods it takes into account the key fact that the limiting distribution of suitably standardized componentwise maxima is an extreme value copula. An important target in the proposed framework is the regression manifold, which consists of a family of regression lines obeying the latter asymptotic result. To learn about the proposed model from data, we employ a Bernstein polynomial prior on the space of angular densities which leads to an induced prior on the space of regression manifolds. Numerical studies suggest a good performance of the proposed methods, and a finance real-data illustration reveals interesting aspects on the comovements of extreme losses between two leading stock markets.
△ Less
Submitted 29 July, 2021; v1 submitted 18 February, 2021;
originally announced February 2021.
-
On the Use of Computational Fluid Dynamics (CFD) Modelling to Design Improved Dry Powder Inhalers
Authors:
David F Fletcher,
Vishal Chaugule,
Larissa Gomes dos Reis,
Paul M Young,
Daniela Traini,
Julio Soria
Abstract:
Purpose: Computational Fluid Dynamics (CFD) simulations are performed to investigate the impact of adding a grid to a two-inlet dry powder inhaler (DPI). The purpose of the paper is to show the importance of the correct choice of closure model and modeling approach, as well as to perform validation against particle dispersion data obtained from in-vitro studies and flow velocity data obtained from…
▽ More
Purpose: Computational Fluid Dynamics (CFD) simulations are performed to investigate the impact of adding a grid to a two-inlet dry powder inhaler (DPI). The purpose of the paper is to show the importance of the correct choice of closure model and modeling approach, as well as to perform validation against particle dispersion data obtained from in-vitro studies and flow velocity data obtained from particle image velocimetry (PIV) experiments. Methods: CFD simulations are performed using the Ansys Fluent 2020R1 software package. Two RANS turbulence models (realisable $k - ε$ and $k - ω$ SST) and the Stress Blended Eddy Simulation (SBES) models are considered. Lagrangian particle tracking for both carrier and fine particles is also performed. Results: Excellent comparison with the PIV data is found for the SBES approach and the particle tracking data are consistent with the dispersion results, given the simplicity of the assumptions made. Conclusions: This work shows the importance of selecting the correct turbulence modelling approach and boundary conditions to obtain good agreement with PIV data for the flow-field exiting the device. With this validated, the model can be used with much higher confidence to explore the fluid and particle dynamics within the device.
△ Less
Submitted 21 January, 2021;
originally announced January 2021.
-
In-vitro and Particle Image Velocimetry Studies of Dry Powder Inhalers
Authors:
Larissa Gomes dos Reis,
Vishal Chaugule,
David F Fletcher,
Paul M Young,
Daniela Traini,
Julio Soria
Abstract:
Inhalation drug delivery has seen a swift rise in the use of dry powder inhalers (DPIs) to treat chronic respiratory conditions. However, universal adoption of DPIs has been restrained due to their low efficiencies and significant drug losses in the mouth-throat region. Aerosol efficiency of DPIs is closely related to the fluid-dynamics characteristics of the inhalation flow generated from the dev…
▽ More
Inhalation drug delivery has seen a swift rise in the use of dry powder inhalers (DPIs) to treat chronic respiratory conditions. However, universal adoption of DPIs has been restrained due to their low efficiencies and significant drug losses in the mouth-throat region. Aerosol efficiency of DPIs is closely related to the fluid-dynamics characteristics of the inhalation flow generated from the devices, which in turn are influenced by the device design. In-vitro and particle image velocimetry (PIV) have been used in this study to assess the aerosol performance of a model carrier formulation delivered by DPI devices and to investigate their flow characteristics. Four DPI device models, with modification to their tangential inlets and addition of a grid, have been explored. Similar aerosol performances were observed for all four device models, with FPF larger than 50%, indicating desirable lung deposition. A high swirling and recirculating jet-flow emerging from the mouthpiece of the DPI models without the grid was observed, which contributed to particle deposition in the throat. DPI models where the grid was present showed a straightened outflow without undesired lateral spreading, that reduced particle deposition in the throat and mass retention in the device. These findings demonstrate that PIV measurements strengthen in-vitro evaluation and can be jointly used to develop high-performance DPIs.
△ Less
Submitted 21 January, 2021;
originally announced January 2021.
-
Forward utility and market adjustments in relative investment-consumption games of many players
Authors:
Goncalo dos Reis,
Vadim Platonov
Abstract:
We study a portfolio management problem featuring many-player and mean field competition, investment and consumption, and relative performance concerns under the forward performance processes (FPP) framework. We focus on agents using power (CRRA) type FPPs for their investment-consumption optimization problem under a common noise Merton market model. We solve both the many-player and mean field ga…
▽ More
We study a portfolio management problem featuring many-player and mean field competition, investment and consumption, and relative performance concerns under the forward performance processes (FPP) framework. We focus on agents using power (CRRA) type FPPs for their investment-consumption optimization problem under a common noise Merton market model. We solve both the many-player and mean field game providing closed-form expressions for the solutions where the limit of the former yields the latter. In our case, the FPP framework yields a continuum of solutions for the consumption component as indexed to a market parameter we coin "market-risk relative consumption preference". The parameter permits the agent to set a preference for their consumption going forward in time that, in the competition case, reflects a common market behaviour. We show the FPP framework, under both competition and no-competition, allows the agent to disentangle her risk-tolerance and elasticity of intertemporal substitution (EIS) just like Epstein-Zin preferences under recursive utility framework and unlike the classical utility theory one. This, in turn, allows a finer analysis on the agent's consumption "income" and "substitution" regimes, and, of independent interest, motivates a new strand of economics research on EIS under the FPP framework. We find that competition rescales the agent's perception of consumption in a non-trivial manner. We provide numerical illustrations of our results.
△ Less
Submitted 4 March, 2022; v1 submitted 2 December, 2020;
originally announced December 2020.
-
Well-posedness and tamed Euler schemes for McKean-Vlasov equations driven by Lévy noise
Authors:
Neelima,
Sani Biswas,
Chaman Kumar,
Gonçalo dos Reis,
Christoph Reisinger
Abstract:
We prove the well-posedness of solutions to McKean-Vlasov stochastic differential equations driven by Lévy noise under mild assumptions where, in particular, the Lévy measure is not required to be finite. The drift, diffusion and jump coefficients are allowed to be random, can grow super-linearly in the state variable, and all may depend on the marginal law of the solution process. We provide a pr…
▽ More
We prove the well-posedness of solutions to McKean-Vlasov stochastic differential equations driven by Lévy noise under mild assumptions where, in particular, the Lévy measure is not required to be finite. The drift, diffusion and jump coefficients are allowed to be random, can grow super-linearly in the state variable, and all may depend on the marginal law of the solution process. We provide a propagation of chaos result under more relaxed conditions than those existing in the literature, and consistent with our well-posedness result.
We propose a tamed Euler scheme for the associated interacting particle system and prove that the rate of its strong convergence is arbitrarily close to $1/2$. As a by-product, we also obtain the corresponding results on well-posedness, propagation of chaos and strong convergence of the tamed Euler scheme for McKean-Vlasov stochastic delay differential equations (SDDE) and McKean-Vlasov stochastic differential equations with Markovian switching (SDEwMS), both driven by Lévy noise. Furthermore, our results on tamed Euler schemes are new even for ordinary SDEs driven by Lévy noise and with super-linearly growing coefficients.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
Rough Weierstrass functions and dynamical systems: the smoothness of the SBR measure
Authors:
Peter Imkeller,
Olivier Menoukeu Pamen,
Goncalo dos Reis,
Anthony Reveillac
Abstract:
We investigate Weierstrass functions with roughness parameter $γ$ that are Hölder continuous with coefficient $H={\logγ}/{\log \frac12}.$ Analytical access is provided by an embedding into a dynamical system related to the baker transform where the graphs of the functions are identified as their global attractors. They possess stable manifolds hosting Sinai-Bowen-Ruelle (SBR) measures. We systemat…
▽ More
We investigate Weierstrass functions with roughness parameter $γ$ that are Hölder continuous with coefficient $H={\logγ}/{\log \frac12}.$ Analytical access is provided by an embedding into a dynamical system related to the baker transform where the graphs of the functions are identified as their global attractors. They possess stable manifolds hosting Sinai-Bowen-Ruelle (SBR) measures. We systematically exploit a telescoping property of associated measures to give an alternative proof of the absolute continuity of the SBR measure for large enough $γ$ with square-integrable density. Telescoping allows a macroscopic argument using the transversality of the flow related to the mapping describing the stable manifold. The smoothness of the SBR measure can be used to compute the Hausdorff dimension of the graphs of the original Weierstrass functions and investigate their local times.
△ Less
Submitted 12 April, 2021; v1 submitted 8 September, 2020;
originally announced September 2020.
-
Characterizing Quality of Experience for Demand Management in South Brazil
Authors:
José Diogo Forte de Oliveira Luna,
Guilherme Nascimento Gouvêa dos Reis,
Paulo Renato da Costa Mendes,
Julio Elias Normey-Rico
Abstract:
The present work delivers the results of a survey conducted in Florianópolis, on the southern region of Brazil, using a digital questionnaire which inquired about the interaction with demand management systems (DMSs) in a smart house context. In particular, the survey addressed the interviewees' thoughts on demand management and gathered data to enable the design of Quality of Experience (QoE) bas…
▽ More
The present work delivers the results of a survey conducted in Florianópolis, on the southern region of Brazil, using a digital questionnaire which inquired about the interaction with demand management systems (DMSs) in a smart house context. In particular, the survey addressed the interviewees' thoughts on demand management and gathered data to enable the design of Quality of Experience (QoE) based demand management policies. The investigation of QoE-aware approaches is significant as it enables the DMS to take decisions not only based on economic metrics, but also taking the discomfort caused to the users into account. The number of responses guaranteed a confidence level of 95\% and an error margin of 4.63\% and the content of such responses showed favorable disposition of the interviewees on allowing interventions of DMSs on their energy consumption habits as long as it reduces their expenses with energy. The data concerning discomfort caused by demand management actions on several home appliances was treated using clustering techniques and different typical user profiles were leveraged, represented by the centroid of each cluster. Those profiles can be used to deploy QoE-aware DMSs tailored for the local reality, which seems as a promising business model as smart houses become a reality.
△ Less
Submitted 27 May, 2020;
originally announced May 2020.
-
Large Deviations and Exit-times for reflected McKean-Vlasov equations with self-stabilizing terms and superlinear drifts
Authors:
Daniel Adams,
Gonçalo dos Reis,
Romain Ravaille,
William Salkeld,
Julian Tugaut
Abstract:
We study a class of reflected McKean-Vlasov diffusions over a convex domain with self-stabilizing coefficients. This includes coefficients that do not satisfy the classical Wasserstein Lipschitz condition. Further, the process is constrained to a (not necessarily bounded) convex domain by a local time on the boundary. These equations include the subclass of reflected self-stabilizing diffusions th…
▽ More
We study a class of reflected McKean-Vlasov diffusions over a convex domain with self-stabilizing coefficients. This includes coefficients that do not satisfy the classical Wasserstein Lipschitz condition. Further, the process is constrained to a (not necessarily bounded) convex domain by a local time on the boundary. These equations include the subclass of reflected self-stabilizing diffusions that drift towards their mean via a convolution of the solution law with a stabilizing potential.
Firstly, we establish existence and uniqueness results for this class and address the propagation of chaos. We work with a broad class of coefficients, including drift terms that are locally Lipschitz in spatial and measure variables. However, we do not rely on the boundedness of the domain or the coefficients to account for these non-linearities and instead use the self-stabilizing properties.
We prove a Freidlin-Wentzell type Large Deviations Principle and an Eyring-Kramer's law for the exit-time from subdomains contained in the interior of the reflecting domain.
△ Less
Submitted 17 January, 2022; v1 submitted 20 May, 2020;
originally announced May 2020.
-
Forward utilities and Mean-field games under relative performance concerns
Authors:
Goncalo dos Reis,
Vadim Platonov
Abstract:
We introduce the concept of mean field games for agents using Forward utilities of CARA type to study a family of portfolio management problems under relative performance concerns. Under asset specialization of the fund managers, we solve the forward-utility finite player game and the forward-utility mean-field game. We study best response and equilibrium strategies in the single common stock asse…
▽ More
We introduce the concept of mean field games for agents using Forward utilities of CARA type to study a family of portfolio management problems under relative performance concerns. Under asset specialization of the fund managers, we solve the forward-utility finite player game and the forward-utility mean-field game. We study best response and equilibrium strategies in the single common stock asset and the asset specialization with common noise. As an application, we draw on the core features of the forward utility paradigm and discuss a problem of time-consistent mean-field dynamic model selection in sequential time-horizons.
△ Less
Submitted 8 September, 2020; v1 submitted 16 May, 2020;
originally announced May 2020.
-
Rough functional quantization and the support of McKean-Vlasov equations
Authors:
Thomas Cass,
Goncalo dos Reis,
William Salkeld
Abstract:
We prove a representation for the support of McKean Vlasov Equations. To do so, we construct functional quantizations for the law of Brownian motion as a measure over the (non-reflexive) Banach space of Hölder continuous paths. By solving optimal Karhunen Loève expansions and exploiting the compact embedding of Gaussian measures, we obtain a sequence of deterministic finite supported measures that…
▽ More
We prove a representation for the support of McKean Vlasov Equations. To do so, we construct functional quantizations for the law of Brownian motion as a measure over the (non-reflexive) Banach space of Hölder continuous paths. By solving optimal Karhunen Loève expansions and exploiting the compact embedding of Gaussian measures, we obtain a sequence of deterministic finite supported measures that converge to the law of a Brownian motion with explicit rate. We show the approximation sequence is near optimal with very favourable integrability properties and prove these approximations remain true when the paths are enhanced to rough paths. These results are of independent interest.
The functional quantization results then yield a novel way to build deterministic, finite supported measures that approximate the law of the McKean Vlasov Equation driven by the Brownian motion which crucially avoid the use of random empirical distributions. These are then used to solve an approximate skeleton process that characterises the support of the McKean Vlasov Equation.
We give explicit rates of convergence for the deterministic finite supported measures in rough-path Hölder metrics and determine the size of the particle system required to accurately estimate the law of McKean Vlasov equations with respect to the Hölder norm.
△ Less
Submitted 4 March, 2020; v1 submitted 5 November, 2019;
originally announced November 2019.
-
Ito-Wentzell-Lions formula for measure dependent random fields under full and conditional measure flows
Authors:
Goncalo dos Reis,
Vadim Platonov
Abstract:
We present several Ito-Wentzell formulae on Wiener spaces for real-valued functional random field of Ito type that depend on measure flows. We distinguish the full- and the marginal-measure flow cases in the spirit of mean-field games. Derivatives with respect to the measure components are understood in the sense of Lions.
We present several Ito-Wentzell formulae on Wiener spaces for real-valued functional random field of Ito type that depend on measure flows. We distinguish the full- and the marginal-measure flow cases in the spirit of mean-field games. Derivatives with respect to the measure components are understood in the sense of Lions.
△ Less
Submitted 5 May, 2022; v1 submitted 4 October, 2019;
originally announced October 2019.
-
Irreversible hardening of a colloidal gel under shear: the smart response of natural rubber latex gels
Authors:
Guilherme de Oliveira Reis,
Thomas Gibaud,
Brice Saint-Michel,
Sébastien Manneville,
Mathieu Leocmach,
Laurent Vaysse,
Frédéric Bonfils,
Christian Sanchez,
Paul Menut
Abstract:
Natural rubber is obtained by processing natural rubber latex, a liquid colloidal suspension that rapidly gels after exudation from the tree. We prepared such gels by acidification, in a large range of particle volume fractions, and investigated their rheological properties. We show that natural rubber latex gels exhibit a unique behavior of irreversible strain hardening: when subjected to a large…
▽ More
Natural rubber is obtained by processing natural rubber latex, a liquid colloidal suspension that rapidly gels after exudation from the tree. We prepared such gels by acidification, in a large range of particle volume fractions, and investigated their rheological properties. We show that natural rubber latex gels exhibit a unique behavior of irreversible strain hardening: when subjected to a large enough strain, the elastic modulus increases irreversibly. Hardening proceeds over a large range of deformations in such a way that the material maintains an elastic modulus close to, or slightly higher than the imposed shear stress. Local displacements inside the gel are investigated by ultrasound imaging coupled to oscillatory rheometry, together with a Fourier decomposition of the oscillatory response of the material during hardening. Our observations suggest that hardening is associated with irreversible local rearrangements of the fractal structure, which occur homogeneously throughout the sample.
△ Less
Submitted 10 January, 2019;
originally announced January 2019.
-
The Skorokhod embedding problem for inhomogeneous diffusions
Authors:
Stefan Ankirchner,
Stefan Engelhardt,
Alexander Fromm,
Goncalo dos Reis
Abstract:
We solve the Skorokhod embedding problem for a class of stochastic processes satisfying an inhomogeneous stochastic differential equation (SDE) of the form $d A_t =μ(t, A_t) d t + σ(t, A_t) d W_t$. We provide sufficient conditions guaranteeing that for a given probability measure $ν$ on $\mathbb{R}$ there exists a bounded stopping time $τ$ and a real $a$ such that the solution $(A_t)$ of the SDE w…
▽ More
We solve the Skorokhod embedding problem for a class of stochastic processes satisfying an inhomogeneous stochastic differential equation (SDE) of the form $d A_t =μ(t, A_t) d t + σ(t, A_t) d W_t$. We provide sufficient conditions guaranteeing that for a given probability measure $ν$ on $\mathbb{R}$ there exists a bounded stopping time $τ$ and a real $a$ such that the solution $(A_t)$ of the SDE with initial value $a$ satisfies $A_τ\sim ν$. We hereby distinguish the cases where $(A_t)$ is a solution of the SDE in a weak or strong sense. Our construction of embedding stopping times is based on a solution of a fully coupled forward-backward SDE. We use the so-called method of decoupling fields for verifying that the FBSDE has a unique solution. Finally, we sketch an algorithm for putting our theoretical construction into practice and illustrate it with a numerical experiment.
△ Less
Submitted 18 June, 2019; v1 submitted 11 October, 2018;
originally announced October 2018.
-
Capturing Model Risk and Rating Momentum in the Estimation of Probabilities of Default and Credit Rating Migrations
Authors:
Marius Pfeuffer,
Goncalo dos Reis,
Greig smith
Abstract:
We present two methodologies on the estimation of rating transition probabilities within Markov and non-Markov frameworks. We first estimate a continuous-time Markov chain using discrete (missing) data and derive a simpler expression for the Fisher information matrix, reducing the computational time needed for the Wald confidence interval by a factor of a half. We provide an efficient procedure fo…
▽ More
We present two methodologies on the estimation of rating transition probabilities within Markov and non-Markov frameworks. We first estimate a continuous-time Markov chain using discrete (missing) data and derive a simpler expression for the Fisher information matrix, reducing the computational time needed for the Wald confidence interval by a factor of a half. We provide an efficient procedure for transferring such uncertainties from the generator matrix of the Markov chain to the corresponding rating migration probabilities and, crucially, default probabilities.
For our second contribution, we assume access to the full (continuous) data set and propose a tractable and parsimonious self-exciting marked point processes model able to capture the non-Markovian effect of rating momentum. Compared to the Markov model, the non-Markov model yields higher probabilities of default in the investment grades, but also lower default probabilities in some speculative grades. Both findings agree with empirical observations and have clear practical implications.
We illustrate all methods using data from Moody's proprietary corporate credit ratings data set. Implementations are available in the R package ctmcd.
△ Less
Submitted 3 February, 2020; v1 submitted 26 September, 2018;
originally announced September 2018.
-
Simulation of McKean Vlasov SDEs with super linear growth
Authors:
G. dos Reis,
S. Engelhardt,
G. Smith
Abstract:
We present two fully probabilistic Euler schemes, one explicit and one implicit, for the simulation of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts of super-linear growth and random initial condition.
We provide a pathwise propagation of chaos result and show strong convergence for both schemes on the consequent particle system. The explicit scheme attains the standard…
▽ More
We present two fully probabilistic Euler schemes, one explicit and one implicit, for the simulation of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) with drifts of super-linear growth and random initial condition.
We provide a pathwise propagation of chaos result and show strong convergence for both schemes on the consequent particle system. The explicit scheme attains the standard $1/2$ rate in stepsize. From a technical point of view, we successfully use stopping times to prove the convergence of the implicit method although we avoid them altogether for the explicit one. The combination of particle interactions and random initial condition makes the proofs technically more involved.
Numerical tests recover the theoretical convergence rates and illustrate a computational complexity advantage of the explicit over the implicit scheme. A comparative analysis is carried out on a stylized non-Lipschitz MV-SDE and a mean-field model for FitzHugh-Nagumo neurons. We provide numerical tests illustrating "particle corruption" effect where one single particle diverging can "corrupt" the whole particle system. Moreover, the more particles in the system the more likely this divergence is to occur.
△ Less
Submitted 28 December, 2020; v1 submitted 16 August, 2018;
originally announced August 2018.
-
On the Hausdorff dimension of a 2-dimensional Weierstrass curve
Authors:
Peter Imkeller,
Goncalo dos Reis
Abstract:
We compute the Hausdorff dimension of a two-dimensional Weierstrass function, related to lacunary (Hadamard gap) power series, that has no Lévy area. This is done by interpreting it as a pullback attractor of a dynamical system based on the Baker transformation. A lower bound for the Hausdorff dimension is obtained by investigating the pushforward of the Lebesgue measure on the graph along scaled…
▽ More
We compute the Hausdorff dimension of a two-dimensional Weierstrass function, related to lacunary (Hadamard gap) power series, that has no Lévy area. This is done by interpreting it as a pullback attractor of a dynamical system based on the Baker transformation. A lower bound for the Hausdorff dimension is obtained by investigating the pushforward of the Lebesgue measure on the graph along scaled neighborhoods of stable fibers of the underlying dynamical system following the graph. Scaling ideas are crucial. They become accessible by self similarity properties of a mapping whose increments coincide with vertical distances on the stable fibers.
△ Less
Submitted 19 August, 2018; v1 submitted 25 June, 2018;
originally announced June 2018.
-
An unbiased Ito type stochastic representation for transport PDEs: A Toy Example
Authors:
Goncalo dos Reis,
Greig Smith
Abstract:
We propose a stochastic representation for a simple class of transport PDEs based on Ito representations. We detail an algorithm using an estimator stemming for the representation that, unlike regularization by noise estimators, is unbiased. We rely on recent developments on branching diffusions, regime switching processes and their representations of PDEs.
There is a loose relation between our…
▽ More
We propose a stochastic representation for a simple class of transport PDEs based on Ito representations. We detail an algorithm using an estimator stemming for the representation that, unlike regularization by noise estimators, is unbiased. We rely on recent developments on branching diffusions, regime switching processes and their representations of PDEs.
There is a loose relation between our technique and regularization by noise, but contrary to the latter, we add a perturbation and immediately its correction. The method is only possible through a judicious choice of the diffusion coefficient $σ$. A key feature is that our approach does not rely on the smallness of $σ$, in fact, our $σ$ is strictly bounded from below which is in stark contrast with standard perturbation techniques. This is critical for extending this method to non-toy PDEs which have nonlinear terms in the first derivative where the usual perturbation technique breaks down.
The examples presented show the algorithm outperforming alternative approaches. Moreover, the examples point toward a potential algorithm for the fully nonlinear case where the method of characteristics breaks down.
△ Less
Submitted 29 April, 2019; v1 submitted 10 April, 2018;
originally announced April 2018.
-
Importance sampling for McKean-Vlasov SDEs
Authors:
Goncalo dos Reis,
Greig Smith,
Peter Tankov
Abstract:
This paper deals with the Monte-Carlo methods for evaluating expectations of functionals of solutions to McKean-Vlasov Stochastic Differential Equations (MV-SDE) with drifts of super-linear growth. We assume that the MV-SDE is approximated in the standard manner by means of an interacting particle system and propose two importance sampling (IS) techniques to reduce the variance of the resulting Mo…
▽ More
This paper deals with the Monte-Carlo methods for evaluating expectations of functionals of solutions to McKean-Vlasov Stochastic Differential Equations (MV-SDE) with drifts of super-linear growth. We assume that the MV-SDE is approximated in the standard manner by means of an interacting particle system and propose two importance sampling (IS) techniques to reduce the variance of the resulting Monte Carlo estimator. In the \emph{complete measure change} approach, the IS measure change is applied simultaneously in the coefficients and in the expectation to be evaluated. In the \emph{decoupling} approach we first estimate the law of the solution in a first set of simulations without measure change and then perform a second set of simulations under the importance sampling measure using the approximate solution law computed in the first step.
For both approaches, we use large deviations techniques to identify an optimisation problem for the candidate measure change. The decoupling approach yields a far simpler optimisation problem than the complete measure change, however, we can reduce the complexity of the complete measure change through some symmetry arguments. We implement both algorithms for two examples coming from the Kuramoto model from statistical physics and show that the variance of the importance sampling schemes is up to 3 orders of magnitude smaller than that of the standard Monte Carlo. The computational cost is approximately the same as for standard Monte Carlo for the complete measure change and only increases by a factor of 2--3 for the decoupled approach. We also estimate the propagation of chaos error and find that this is dominated by the statistical error by one order of magnitude.
△ Less
Submitted 12 October, 2018; v1 submitted 25 March, 2018;
originally announced March 2018.
-
Differentiability of SDEs with drifts of super-linear growth
Authors:
Peter Imkeller,
Gonçalo dos Reis,
William Salkeld
Abstract:
We close an unexpected gap in the literature of stochastic differential equations (SDEs) with drifts of super linear growth (and random coefficients), namely, we prove Malliavin and Parametric Differentiability of such SDEs. The former is shown by proving Ray Absolute Continuity and Stochastic Gâteaux Differentiability. This method enables one to take limits in probability rather than mean square…
▽ More
We close an unexpected gap in the literature of stochastic differential equations (SDEs) with drifts of super linear growth (and random coefficients), namely, we prove Malliavin and Parametric Differentiability of such SDEs. The former is shown by proving Ray Absolute Continuity and Stochastic Gâteaux Differentiability. This method enables one to take limits in probability rather than mean square which bypasses the potentially non-integrable error terms from the unbounded drift. This issue is strongly linked with the difficulties of the standard methodology from Nualart's 2006 work, Lemma 1.2.3 for this setting. Several examples illustrating the range and scope of our results are presented.
We close with parametric differentiability and recover representations linking both derivatives as well as a Bismut-Elworthy-Li formula.
△ Less
Submitted 31 August, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
-
Freidlin-Wentzell LDP in path space for McKean-Vlasov equations and the Functional Iterated Logarithm Law
Authors:
Goncalo Dos Reis,
William Salkeld,
Julian Tugaut
Abstract:
We show two Freidlin-Wentzell type Large Deviations Principles (LDP) in path space topologies (uniform and Hölder) for the solution process of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) using techniques which directly address the presence of the law in the coefficients and altogether avoiding decoupling arguments or limits of particle systems. We provide existence and uniqueness res…
▽ More
We show two Freidlin-Wentzell type Large Deviations Principles (LDP) in path space topologies (uniform and Hölder) for the solution process of McKean-Vlasov Stochastic Differential Equations (MV-SDEs) using techniques which directly address the presence of the law in the coefficients and altogether avoiding decoupling arguments or limits of particle systems. We provide existence and uniqueness results along with several properties for a class of MV-SDEs having random coefficients and drifts of super-linear growth.
As an application of our results, we establish a Functional Strassen type result (Law of Iterated Logarithm) for the solution process of a MV-SDE.
△ Less
Submitted 27 August, 2018; v1 submitted 16 August, 2017;
originally announced August 2017.
-
Hybrid PDE solver for data-driven problems and modern branching
Authors:
Francisco Bernal,
Gonçalo dos Reis,
Greig Smith
Abstract:
The numerical solution of large-scale PDEs, such as those occurring in data-driven applications, unavoidably require powerful parallel computers and tailored parallel algorithms to make the best possible use of them. In fact, considerations about the parallelization and scalability of realistic problems are often critical enough to warrant acknowledgement in the modelling phase. The purpose of thi…
▽ More
The numerical solution of large-scale PDEs, such as those occurring in data-driven applications, unavoidably require powerful parallel computers and tailored parallel algorithms to make the best possible use of them. In fact, considerations about the parallelization and scalability of realistic problems are often critical enough to warrant acknowledgement in the modelling phase. The purpose of this paper is to spread awareness of the Probabilistic Domain Decomposition (PDD) method, a fresh approach to the parallelization of PDEs with excellent scalability properties. The idea exploits the stochastic representation of the PDE and its approximation via Monte Carlo in combination with deterministic high-performance PDE solvers. We describe the ingredients of PDD and its applicability in the scope of data science. In particular, we highlight recent advances in stochastic representations for nonlinear PDEs using branching diffusions, which have significantly broadened the scope of PDD.
We envision this work as a dictionary giving large-scale PDE practitioners references on the very latest algorithms and techniques of a non-standard, yet highly parallelizable, methodology at the interface of deterministic and probabilistic numerical methods. We close this work with an invitation to the fully nonlinear case and open research questions.
△ Less
Submitted 10 May, 2017;
originally announced May 2017.
-
Robust and Consistent Estimation of Generators in Credit Risk
Authors:
Greig Smith,
Goncalo dos Reis
Abstract:
Bond rating Transition Probability Matrices (TPMs) are built over a one-year time-frame and for many practical purposes, like the assessment of risk in portfolios or the computation of banking Capital Requirements (e.g. the new IFRS 9 regulation), one needs to compute the TPM and probabilities of default over a smaller time interval. In the context of continuous time Markov chains (CTMC) several d…
▽ More
Bond rating Transition Probability Matrices (TPMs) are built over a one-year time-frame and for many practical purposes, like the assessment of risk in portfolios or the computation of banking Capital Requirements (e.g. the new IFRS 9 regulation), one needs to compute the TPM and probabilities of default over a smaller time interval. In the context of continuous time Markov chains (CTMC) several deterministic and statistical algorithms have been proposed to estimate the generator matrix. We focus on the Expectation-Maximization (EM) algorithm by Bladt and Sorensen (2005) for a CTMC with an absorbing state for such estimation.
This work's contribution is threefold. Firstly, we provide directly computable closed-form expressions for quantities appearing in the EM algorithm and associated information matrix, allowing to easily approximate confidence intervals. Previously, these quantities had to be estimated numerically and considerable computational speedups have been gained. Secondly, we prove convergence to a single set of parameters under very weak conditions (for the TPM problem). Finally, we provide a numerical benchmark of our results against other known algorithms, in particular, on several problems related to credit risk. The EM algorithm we propose, padded with the new formulas (and error criteria), outperforms other known algorithms in several metrics, in particular, with much less overestimation of probabilities of default in higher ratings than other statistical algorithms.
△ Less
Submitted 15 October, 2017; v1 submitted 28 February, 2017;
originally announced February 2017.
-
Full-Projection explicit FBSDE scheme for parabolic PDEs with superlinear nonlinearities
Authors:
Arnaud Lionnet,
Gonçalos dos Reis,
Lukasz Szpruch
Abstract:
Developing efficient and stable approximations for high dimensional PDEs is of key importance for numerous applications. The language of Forward-Backward Stochastic Differential Equations (FBSDE), with its nonlinear Feynman-Kac formula, allows for purely probabilistic representations of the solution and its gradient for parabolic nonlinear PDEs.
In this work we build on the recent results of [Li…
▽ More
Developing efficient and stable approximations for high dimensional PDEs is of key importance for numerous applications. The language of Forward-Backward Stochastic Differential Equations (FBSDE), with its nonlinear Feynman-Kac formula, allows for purely probabilistic representations of the solution and its gradient for parabolic nonlinear PDEs.
In this work we build on the recent results of [Lionnet, dos Reis and Szpruch 2015] by introducing and studying a Full-Projection explicit time-discretization scheme for the approximation of FBSDEs with non-globally Lipschitz drivers of polynomial growth. We establish convergence rates and we show that, unlike classical explicit schemes, it preserves stability properties present in the continuous-time dynamics, in particular, the scheme is able to preserve the possible coercivity/contraction property of the PDE's coefficients.
The scheme is then coupled with a quantization-type approximation of the conditional expectations on a space-time grid in order to provide a complete approximation scheme for these FBSDEs/nonlinear PDEs and a full analysis is also carried out. We illustrate our findings with numerical examples.
△ Less
Submitted 10 August, 2017; v1 submitted 30 November, 2016;
originally announced December 2016.
-
Convergence and qualitative properties of modified explicit schemes for BSDEs with polynomial growth
Authors:
Arnaud Lionnet,
Gonçalo dos Reis,
Lukasz Szpruch
Abstract:
The theory of Forward-Backward Stochastic Differential Equations (FBSDEs) paves a way to probabilistic numerical methods for nonlinear parabolic PDEs. The majority of the results on the numerical methods for FBSDEs relies on the global Lipschitz assumption, which is not satisfied for a number of important cases such as the Fisher--KPP or the FitzHugh--Nagumo equations. Furthermore, it has been sho…
▽ More
The theory of Forward-Backward Stochastic Differential Equations (FBSDEs) paves a way to probabilistic numerical methods for nonlinear parabolic PDEs. The majority of the results on the numerical methods for FBSDEs relies on the global Lipschitz assumption, which is not satisfied for a number of important cases such as the Fisher--KPP or the FitzHugh--Nagumo equations. Furthermore, it has been shown in \cite{LionnetReisSzpruch2015} that for BSDEs with monotone drivers having polynomial growth in the primary variable $y$, only the (sufficiently) implicit schemes converge. But these require an additional computational effort compared to explicit schemes.
This article develops a general framework that allows the analysis, in a systematic fashion, of the integrability properties, convergence and qualitative properties (e.g.~comparison theorem) for whole families of modified explicit schemes. The framework yields the convergence of some modified explicit scheme with the same rate as implicit schemes and with the computational cost of the standard explicit scheme.
To illustrate our theory, we present several classes of easily implementable modified explicit schemes that can computationally outperform the implicit one and preserve the qualitative properties of the solution to the BSDE. These classes fit into our developed framework and are tested in computational experiments.
△ Less
Submitted 22 July, 2016;
originally announced July 2016.
-
Equilibrium pricing under relative performance concerns
Authors:
Jana Bielagk,
Arnaud Lionnet,
Goncalo Dos Reis
Abstract:
We investigate the effects of the social interactions of a finite set of agents on an equilibrium pricing mechanism. A derivative written on non-tradable underlyings is introduced to the market and priced in an equilibrium framework by agents who assess risk using convex dynamic risk measures expressed by Backward Stochastic Differential Equations (BSDE). Each agent is not only exposed to financia…
▽ More
We investigate the effects of the social interactions of a finite set of agents on an equilibrium pricing mechanism. A derivative written on non-tradable underlyings is introduced to the market and priced in an equilibrium framework by agents who assess risk using convex dynamic risk measures expressed by Backward Stochastic Differential Equations (BSDE). Each agent is not only exposed to financial and non-financial risk factors, but she also faces performance concerns with respect to the other agents.
Within our proposed model we prove the existence and uniqueness of an equilibrium whose analysis involves systems of fully coupled multi-dimensional quadratic BSDEs. We extend the theory of the representative agent by showing that a non-standard aggregation of risk measures is possible via weighted-dilated infimal convolution. We analyze the impact of the problem's parameters on the pricing mechanism, in particular how the agents' performance concern rates affect prices and risk perceptions. In extreme situations, we find that the concern rates destroy the equilibrium while the risk measures themselves remain stable.
△ Less
Submitted 10 February, 2017; v1 submitted 13 November, 2015;
originally announced November 2015.
-
Eliminating Network Protocol Vulnerabilities Through Abstraction and Systems Language Design
Authors:
C. Jasson Casey,
Andrew Sutton,
Gabriel Dos Reis,
Alex Sprintson
Abstract:
Incorrect implementations of network protocol message specifications affect the stability, security, and cost of network system development. Most implementation defects fall into one of three categories of well defined message constraints. However, the general process of constructing network protocol stacks and systems does not capture these categorical con- straints. We introduce a systems progra…
▽ More
Incorrect implementations of network protocol message specifications affect the stability, security, and cost of network system development. Most implementation defects fall into one of three categories of well defined message constraints. However, the general process of constructing network protocol stacks and systems does not capture these categorical con- straints. We introduce a systems programming language with new abstractions that capture these constraints. Safe and efficient implementations of standard message handling operations are synthesized by our compiler, and whole-program analysis is used to ensure constraints are never violated. We present language examples using the OpenFlow protocol.
△ Less
Submitted 13 November, 2013;
originally announced November 2013.
-
Time discretization of FBSDE with polynomial growth drivers and reaction-diffusion PDEs
Authors:
Arnaud Lionnet,
Gonçalo dos Reis,
Lukasz Szpruch
Abstract:
In this paper, we undertake the error analysis of the time discretization of systems of Forward-Backward Stochastic Differential Equations (FBSDEs) with drivers having polynomial growth and that are also monotone in the state variable. We show with a counter-example that the natural explicit Euler scheme may diverge, unlike in the canonical Lipschitz driver case. This is due to the lack of a certa…
▽ More
In this paper, we undertake the error analysis of the time discretization of systems of Forward-Backward Stochastic Differential Equations (FBSDEs) with drivers having polynomial growth and that are also monotone in the state variable. We show with a counter-example that the natural explicit Euler scheme may diverge, unlike in the canonical Lipschitz driver case. This is due to the lack of a certain stability property of the Euler scheme which is essential to obtain convergence. However, a thorough analysis of the family of $θ$-schemes reveals that this required stability property can be recovered if the scheme is sufficiently implicit. As a by-product of our analysis, we shed some light on higher order approximation schemes for FBSDEs under non-Lipschitz condition. We then return to fully explicit schemes and show that an appropriately tamed version of the explicit Euler scheme enjoys the required stability property and as a consequence converges. In order to establish convergence of the several discretizations, we extend the canonical path- and first-order variational regularity results to FBSDEs with polynomial growth drivers which are also monotone. These results are of independent interest for the theory of FBSDEs.
△ Less
Submitted 9 September, 2015; v1 submitted 11 September, 2013;
originally announced September 2013.
-
A note on comonotonicity and positivity of the control components of decoupled quadratic FBSDE
Authors:
Gonçalo Dos Reis,
Ricardo J. N. dos Reis
Abstract:
In this small note we are concerned with the solution of Forward-Backward Stochastic Differential Equations (FBSDE) with drivers that grow quadratically in the control component (quadratic growth FBSDE or qgFBSDE). The main theorem is a comparison result that allows comparing componentwise the signs of the control processes of two different qgFBSDE. As a byproduct one obtains conditions that allow…
▽ More
In this small note we are concerned with the solution of Forward-Backward Stochastic Differential Equations (FBSDE) with drivers that grow quadratically in the control component (quadratic growth FBSDE or qgFBSDE). The main theorem is a comparison result that allows comparing componentwise the signs of the control processes of two different qgFBSDE. As a byproduct one obtains conditions that allow establishing the positivity of the control process.
△ Less
Submitted 18 January, 2013;
originally announced January 2013.
-
Root's barrier, viscosity solutions of obstacle problems and reflected FBSDEs
Authors:
Paul Gassiat,
Harald Oberhauser,
Goncalo dos Reis
Abstract:
We revisit work of Rost, Dupire and Cox--Wang on connections between Root's solution of the Skorokhod embedding problem and obstacle problems. We develop an approach based on viscosity sub- and supersolutions and an accompanying comparison principle. This gives a complete characterization of (reversed) Root barriers and leads to new proofs of existence as well as minimality of such barrier solutio…
▽ More
We revisit work of Rost, Dupire and Cox--Wang on connections between Root's solution of the Skorokhod embedding problem and obstacle problems. We develop an approach based on viscosity sub- and supersolutions and an accompanying comparison principle. This gives a complete characterization of (reversed) Root barriers and leads to new proofs of existence as well as minimality of such barrier solutions by pure PDE methods. The approach is self-contained and general enough to cover martingale diffusions with degenerate elliptic or time-dependent volatility; it also provides insights about the dynamics of general Skorokhod embeddings.
△ Less
Submitted 15 September, 2014; v1 submitted 16 January, 2013;
originally announced January 2013.
-
Quadratic FBSDE with generalized Burgers' type nonlinearities, perturbations and large deviations
Authors:
Christoph Frei,
Gonçalo Dos Reis
Abstract:
We discuss BSDE with drivers containing nonlinearities of the type $p(y)|z|$ and $p(y)|z|^2$ with $p$ a polynomial of any degree. Sufficient conditions are given for existence and uniqueness of solutions as well as comparison results. We then connect the results to the Markovian FBSDE setting, discussing applications in the theory of PDE perturbation and stating a result concerning a large deviati…
▽ More
We discuss BSDE with drivers containing nonlinearities of the type $p(y)|z|$ and $p(y)|z|^2$ with $p$ a polynomial of any degree. Sufficient conditions are given for existence and uniqueness of solutions as well as comparison results. We then connect the results to the Markovian FBSDE setting, discussing applications in the theory of PDE perturbation and stating a result concerning a large deviations principle for the first component of the solution to the BSDE.
△ Less
Submitted 16 May, 2012;
originally announced May 2012.
-
FBSDE with time delayed generators: Lp-solutions, differentiability, representation formulas and path regularity
Authors:
Gonçalo dos Reis,
Anthony Réveillac,
Jianing Zhang
Abstract:
We extend the work of Delong and Imkeller (2010a,b) concerning Backward stochastic differential equations with time delayed generators (delay BSDE). We give moment and a priori estimates in general $L^p$-spaces and provide sufficient conditions for the solution of a delay BSDE to exist in $L^p$. We introduce decoupled systems of SDE and delay BSDE (delay FBSDE) and give sufficient conditions for t…
▽ More
We extend the work of Delong and Imkeller (2010a,b) concerning Backward stochastic differential equations with time delayed generators (delay BSDE). We give moment and a priori estimates in general $L^p$-spaces and provide sufficient conditions for the solution of a delay BSDE to exist in $L^p$. We introduce decoupled systems of SDE and delay BSDE (delay FBSDE) and give sufficient conditions for their variational differentiability. We connect these variational derivatives to the Malliavin derivatives of delay FBSDE via the usual representation formulas. We conclude with several path regularity results, in particular we extend the classic $L^2$-path regularity to delay FBSDE.
△ Less
Submitted 4 May, 2011; v1 submitted 6 August, 2010;
originally announced August 2010.
-
Results on numerics for FBSDE with drivers of quadratic growth
Authors:
Peter Imkeller,
Gonçalo dos Reis,
Jianing Zhang
Abstract:
We consider the problem of numerical approximation for forward-backward stochastic differential equations with drivers of quadratic growth (qgFBSDE). To illustrate the significance of qgFBSDE, we discuss a problem of cross hedging of an insurance related financial derivative using correlated assets. For the convergence of numerical approximation schemes for such systems of stochastic equations, pa…
▽ More
We consider the problem of numerical approximation for forward-backward stochastic differential equations with drivers of quadratic growth (qgFBSDE). To illustrate the significance of qgFBSDE, we discuss a problem of cross hedging of an insurance related financial derivative using correlated assets. For the convergence of numerical approximation schemes for such systems of stochastic equations, path regularity of the solution processes is instrumental. We present a method based on the truncation of the driver, and explicitly exhibit error estimates as functions of the truncation height. We discuss a reduction method to FBSDE with globally Lipschitz continuous drivers, by using the Cole-Hopf exponential transformation. We finally illustrate our numerical approximation methods by giving simulations for prices and optimal hedges of simple insurance derivatives.
△ Less
Submitted 13 April, 2010;
originally announced April 2010.
-
Path regularity and explicit convergence rate for BSDE with truncated quadratic growth
Authors:
Peter Imkeller,
Goncalo dos Reis
Abstract:
We consider backward stochastic differential equations with drivers of quadratic growth (qgBSDE). We prove several statements concerning path regularity and stochastic smoothness of the solution processes of the qgBSDE, in particular we prove an extension of Zhang's path regularity theorem to the quadratic growth setting. We give explicit convergence rates for the difference between the solution…
▽ More
We consider backward stochastic differential equations with drivers of quadratic growth (qgBSDE). We prove several statements concerning path regularity and stochastic smoothness of the solution processes of the qgBSDE, in particular we prove an extension of Zhang's path regularity theorem to the quadratic growth setting. We give explicit convergence rates for the difference between the solution of a qgBSDE and its truncation, filling an important gap in numerics for qgBSDE. We give an alternative proof of second order Malliavin differentiability for BSDE with drivers that are Lipschitz continuous (and differentiable), and then derive an analogous result for qgBSDE.
△ Less
Submitted 27 October, 2009; v1 submitted 6 May, 2009;
originally announced May 2009.