-
A non-zero-sum game with reinforcement learning under mean-variance framework
Authors:
Junyi Guo,
Xia Han,
Hao Wang,
Kam Chuen Yuen
Abstract:
In this paper, we investigate a competitive market involving two agents who consider both their own wealth and the wealth gap with their opponent. Both agents can invest in a financial market consisting of a risk-free asset and a risky asset, under conditions where model parameters are partially or completely unknown. This setup gives rise to a non-zero-sum differential game within the framework o…
▽ More
In this paper, we investigate a competitive market involving two agents who consider both their own wealth and the wealth gap with their opponent. Both agents can invest in a financial market consisting of a risk-free asset and a risky asset, under conditions where model parameters are partially or completely unknown. This setup gives rise to a non-zero-sum differential game within the framework of reinforcement learning (RL). Each agent aims to maximize his own Choquet-regularized, time-inconsistent mean-variance objective. Adopting the dynamic programming approach, we derive a time-consistent Nash equilibrium strategy in a general incomplete market setting. Under the additional assumption of a Gaussian mean return model, we obtain an explicit analytical solution, which facilitates the development of a practical RL algorithm. Notably, the proposed algorithm achieves uniform convergence, even though the conventional policy improvement theorem does not apply to the equilibrium policy. Numerical experiments demonstrate the robustness and effectiveness of the algorithm, underscoring its potential for practical implementation.
△ Less
Submitted 7 February, 2025;
originally announced February 2025.
-
Optimal reinsurance and dividends with transaction costs and taxes under thinning structure
Authors:
Mi Chen,
Kam Chuen Yuen,
Wenyuan Wang
Abstract:
In this paper, we investigate the problem of optimal strategies of dividend and reinsurance under the Cramér-Lundberg risk model embedded with the thinning-dependence structure which was firstly introduced by Wang and Yuen (2005), subject to the optimality criteria of maximizing the expected accumulated discounted dividends paid until ruin. To enhance the practical relevance of the optimal dividen…
▽ More
In this paper, we investigate the problem of optimal strategies of dividend and reinsurance under the Cramér-Lundberg risk model embedded with the thinning-dependence structure which was firstly introduced by Wang and Yuen (2005), subject to the optimality criteria of maximizing the expected accumulated discounted dividends paid until ruin. To enhance the practical relevance of the optimal dividend and reinsurance problem, non-cheap reinsurance is considered and transaction costs and taxes are imposed on dividends, which converts our optimization problem into a mixed classical-impulse control problem. For the purpose of better mathematical tractability and neat, explicit solutions of our control problem, instead of the Cramér-Lundberg framework we study its approximated diffusion model with two thinly dependent classes of insurance businesses. Using a method of quasi-variational inequalities, we show that the optimal reinsurance follows a two-dimensional excess-of-loss reinsurance strategy, and, the optimal dividend strategy turns out to be an impulse dividend strategy with an upper and a lower barrier, i.e., every thing above the lower barrier is paid as dividends each time the surplus is above the upper barrier, otherwise no dividends are paid. Closed-form expression for the value function associated with the optimal dividend and reinsurance strategy is also given. In addition, some numerical examples are presented to illustrate the optimality results.
△ Less
Submitted 1 July, 2020;
originally announced July 2020.
-
Optimal dividend problems for a jump-diffusion model with capital injections and proportional transaction costs
Authors:
Chuancun Yin,
Kam Chuen Yuen
Abstract:
In this paper, we study the optimal control problem for a company whose surplus process evolves as an upward jump diffusion with random return on investment. Three types of practical optimization problems faced by a company that can control its liquid reserves by paying dividends and injecting capital. In the first problem, we consider the classical dividend problem without capital injections. The…
▽ More
In this paper, we study the optimal control problem for a company whose surplus process evolves as an upward jump diffusion with random return on investment. Three types of practical optimization problems faced by a company that can control its liquid reserves by paying dividends and injecting capital. In the first problem, we consider the classical dividend problem without capital injections. The second problem aims at maximizing the expected discounted dividend payments minus the expected discounted costs of capital injections over strategies with positive surplus at all times. The third problem has the same objective as the second one, but without the constraints on capital injections. Under the assumption of proportional transaction costs, we identify the value function and the optimal strategies for any distribution of gains.
△ Less
Submitted 1 September, 2014;
originally announced September 2014.
-
Asymptotic results for tail probabilities of sums of dependent heavy-tailed random variables
Authors:
Kam Chuen Yuen,
Chuancun Yin
Abstract:
Let $\{X_1, X_2, ... \}$ be a sequence of dependent heavy-tailed random variables with distributions $F_1, F_2,...$ on $(-\infty,\infty)$, and let $τ$ be a nonnegative integer-valued random variable independent of the sequence $\{X_k, k \ge 1\}$. In this framework, we study the asymptotic behavior of the tail probabilities of the quantities $X_{(n)} = \max_{1\le k \le n} X_k$,…
▽ More
Let $\{X_1, X_2, ... \}$ be a sequence of dependent heavy-tailed random variables with distributions $F_1, F_2,...$ on $(-\infty,\infty)$, and let $τ$ be a nonnegative integer-valued random variable independent of the sequence $\{X_k, k \ge 1\}$. In this framework, we study the asymptotic behavior of the tail probabilities of the quantities $X_{(n)} = \max_{1\le k \le n} X_k$, $S_n =\sum_{k=1}^n X_k$ and $S_{(n)}=\max_{1\le k\le n} S_k$ for $n>1$, and for those of their randomized versions $X_{(τ)}$, $S_τ$ and $S_{(τ)}$. We also consider applications of the results obtained to some commonly-used risk processes.
△ Less
Submitted 20 January, 2011;
originally announced January 2011.
-
Convexity of ruin probability and optimal dividend strategies for a general Levy process
Authors:
Chuancun Yin,
Kam Chuen Yuen,
Ying Shen
Abstract:
In this paper, we consider the optimal dividends problem for a company whose cash reserves follow a general Levy process with certain positive jumps and arbitrary negative jumps. The objective is to find a policy which maximizes the expected discounted dividends until the time of ruin. Under appropriate conditions, we appeal to very recent results in the theory of potential analysis of subordinato…
▽ More
In this paper, we consider the optimal dividends problem for a company whose cash reserves follow a general Levy process with certain positive jumps and arbitrary negative jumps. The objective is to find a policy which maximizes the expected discounted dividends until the time of ruin. Under appropriate conditions, we appeal to very recent results in the theory of potential analysis of subordinators to obtain the convexity properties of probability of ruin. We present conditions under which the optimal dividend strategy, among all admissible ones, takes the form of a barrier strategy.
△ Less
Submitted 26 March, 2014; v1 submitted 2 January, 2011;
originally announced January 2011.
-
On optimality of the barrier strategy for a general Levy risk process
Authors:
Kam Chuen Yuen,
Chuancun Yin
Abstract:
We consider the optimal dividend problem for the insurance risk process in a general Levy process setting. The objective is to find a strategy which maximizes the expected total discounted dividends until the time of ruin. We give sufficient conditions under which the optimal strategy is of barrier type. In particular, we show that if the Levy density is a completely monotone function, then the op…
▽ More
We consider the optimal dividend problem for the insurance risk process in a general Levy process setting. The objective is to find a strategy which maximizes the expected total discounted dividends until the time of ruin. We give sufficient conditions under which the optimal strategy is of barrier type. In particular, we show that if the Levy density is a completely monotone function, then the optimal dividend strategy is a barrier strategy. This approach was inspired by the work of Avram et al. (2007) [Annals of Applied Probability 17, 156-180], Loeffen (2008) [Annals of Applied Probability 18, 1669-1680] and Kyprianou et al. (2010) [Journal of Theoretical Probability 23, 547-564] in which the same problem was considered under the spectrally negative Levy processes setting.
△ Less
Submitted 2 January, 2011;
originally announced January 2011.
-
Alternative approach to the optimality of the threshold strategy for spectrally negative Levy processes
Authors:
Ying Shen,
Chuancun Yin,
Kam Chuen Yuen
Abstract:
Consider the optimal dividend problem for an insurance company whose uncontrolled surplus precess evolves as a spectrally negative Levy process. We assume that dividends are paid to the shareholders according to admissible strategies whose dividend rate is bounded by a constant. The objective is to find a dividend policy so as to maximize the expected discounted value of dividends which are paid t…
▽ More
Consider the optimal dividend problem for an insurance company whose uncontrolled surplus precess evolves as a spectrally negative Levy process. We assume that dividends are paid to the shareholders according to admissible strategies whose dividend rate is bounded by a constant. The objective is to find a dividend policy so as to maximize the expected discounted value of dividends which are paid to the shareholders until the company is ruined. Kyprianou, Loeffen and Perez [28] have shown that a refraction strategy (also called threshold strategy) forms an optimal strategy under the condition that the Levy measure has a completely monotone density. In this paper, we propose an alternative approach to this optimal problem.
△ Less
Submitted 25 February, 2014; v1 submitted 2 January, 2011;
originally announced January 2011.
-
Exact joint laws associated with spectrally negative Levy processes and applications to insurance risk theory
Authors:
Chuancun Yin,
Kam Chuen Yuen
Abstract:
We consider the spectrally negative Levy processes and determine the joint laws for the quantities such as the first and last passage times over a fixed level, the overshoots and undershoots at first passage, the minimum, the maximum and the duration of negative values. We apply our results to insurance risk theory to find an explicit expression for the generalized expected discounted penalty func…
▽ More
We consider the spectrally negative Levy processes and determine the joint laws for the quantities such as the first and last passage times over a fixed level, the overshoots and undershoots at first passage, the minimum, the maximum and the duration of negative values. We apply our results to insurance risk theory to find an explicit expression for the generalized expected discounted penalty function in terms of scale functions. Further, a new expression for the generalized Dickson's formula is provided.
△ Less
Submitted 25 February, 2014; v1 submitted 2 January, 2011;
originally announced January 2011.
