Showing 1–7 of 7 results for author: Uryasev, S

Risk Quadrangle and Robust Optimization Based on Extended $\varphi$-Divergence

Authors: Cheng Peng, Anton Malandii, Stan Uryasev

Abstract: The Fundamental Risk Quadrangle (FRQ) is a unified framework linking risk management, statistical estimation, and optimization. Distributionally robust optimization (DRO) based on $\varphi$-divergence minimizes the maximal expected loss, where the maximum is over a $\varphi$-divergence ambiguity set. This paper introduces the \emph{extended} $\varphi$-divergence and the extended $\varphi$-divergen… ▽ More The Fundamental Risk Quadrangle (FRQ) is a unified framework linking risk management, statistical estimation, and optimization. Distributionally robust optimization (DRO) based on $\varphi$-divergence minimizes the maximal expected loss, where the maximum is over a $\varphi$-divergence ambiguity set. This paper introduces the \emph{extended} $\varphi$-divergence and the extended $\varphi$-divergence quadrangle, which integrates DRO into the FRQ framework. We derive the primal and dual representations of the quadrangle elements (risk, deviation, regret, error, and statistic). The dual representation provides an interpretation of classification, portfolio optimization, and regression as robust optimization based on the extended $\varphi$-divergence. The primal representation offers tractable formulations of these robust optimizations as convex optimization. We provide illustrative examples showing that many common problems, such as least-squares regression, quantile regression, support vector machines, and CVaR optimization, fall within this framework. Additionally, we conduct a case study to visualize the optimal solution of the inner maximization in robust optimization. △ Less

Submitted 9 December, 2024; v1 submitted 16 March, 2024; originally announced March 2024.

Divergence Based Quadrangle and Applications

Authors: Anton Malandii, Siddhartha Gupte, Cheng Peng, Stan Uryasev

Abstract: This paper introduces a novel framework for assessing risk and decision-making in the presence of uncertainty, the \emph{$\varphi$-Divergence Quadrangle}. This approach expands upon the traditional Risk Quadrangle, a model that quantifies uncertainty through four key components: \emph{risk, deviation, regret}, and \emph{error}. The $\varphi$-Divergence Quadrangle incorporates the $\varphi$-diverge… ▽ More This paper introduces a novel framework for assessing risk and decision-making in the presence of uncertainty, the \emph{$\varphi$-Divergence Quadrangle}. This approach expands upon the traditional Risk Quadrangle, a model that quantifies uncertainty through four key components: \emph{risk, deviation, regret}, and \emph{error}. The $\varphi$-Divergence Quadrangle incorporates the $\varphi$-divergence as a measure of the difference between probability distributions, thereby providing a more nuanced understanding of risk. Importantly, the $\varphi$-Divergence Quadrangle is closely connected with the distributionally robust optimization based on the $\varphi$-divergence approach through the duality theory of convex functionals. To illustrate its practicality and versatility, several examples of the $\varphi$-Divergence Quadrangle are provided, including the Quantile Quadrangle. The final portion of the paper outlines a case study implementing regression with the Entropic Value-at-Risk Quadrangle. The proposed $\varphi$-Divergence Quadrangle presents a refined methodology for understanding and managing risk, contributing to the ongoing development of risk assessment and management strategies. △ Less

Submitted 12 July, 2023; v1 submitted 28 June, 2023; originally announced June 2023.

Comments: Incomplete result

Expectile Quadrangle and Applications

Authors: Viktor Kuzmenko, Anton Malandii, Stan Uryasev

Abstract: The paper explores the concept of the \emph{expectile risk measure} within the framework of the Fundamental Risk Quadrangle (FRQ) theory. According to the FRQ theory, a quadrangle comprises four stochastic functions associated with a random variable: ``error'', ``regret'', ``risk'', and ``deviation''. These functions are interconnected through a stochastic function known as the ``statistic''. Expe… ▽ More The paper explores the concept of the \emph{expectile risk measure} within the framework of the Fundamental Risk Quadrangle (FRQ) theory. According to the FRQ theory, a quadrangle comprises four stochastic functions associated with a random variable: ``error'', ``regret'', ``risk'', and ``deviation''. These functions are interconnected through a stochastic function known as the ``statistic''. Expectile is a risk measure that, similar to VaR (quantile) and CVaR (superquantile), can be employed in risk management. While quadrangles based on VaR and CVaR statistics are well-established and widely used, the paper focuses on the recently proposed quadrangles based on expectile. The aim of this paper is to rigorously examine the properties of these Expectile Quadrangles, with particular emphasis on a quadrangle that encompasses expectile as both a statistic and a measure of risk. △ Less

Submitted 12 July, 2023; v1 submitted 28 June, 2023; originally announced June 2023.

Comments: Incomplete result

Mixture Quantiles Estimated by Constrained Linear Regression

Authors: Cheng Peng, Yizhou Li, Stan Uryasev

Abstract: The paper considers the problem of modeling a univariate random variable. Main contributions: (i) Suggested a new family of distributions with quantile defined by a linear combination of some basis quantiles. This family of distributions has a high shape flexibility and covers commonly used distributions. (ii) Proposed an efficient estimation method by constrained linear regression (linearity with… ▽ More The paper considers the problem of modeling a univariate random variable. Main contributions: (i) Suggested a new family of distributions with quantile defined by a linear combination of some basis quantiles. This family of distributions has a high shape flexibility and covers commonly used distributions. (ii) Proposed an efficient estimation method by constrained linear regression (linearity with respect to the parameters). Various types of constraints and regularizations are readily available to reduce model flexibility and improve out-of-sample performance for small datasets . (iii) Proved that the estimator is asymptotically a minimum Wasserstein distance estimator and is asymptotically normal. The estimation method can also be viewed as the best fit in quantile-quantile plot. (iv) Case study demonstrated numerical efficiency of the approach (estimated distribution of historical drawdowns of SP500 Index). △ Less

Submitted 28 April, 2023; originally announced May 2023.

Factor Model of Mixtures

Authors: Cheng Peng, Stanislav Uryasev

Abstract: This paper proposes a new approach to estimating the distribution of a response variable conditioned on observing some factors. The proposed approach possesses desirable properties of flexibility, interpretability, tractability and extendability. The conditional quantile function is modeled by a mixture (weighted sum) of basis quantile functions, with the weights depending on factors. The calibrat… ▽ More This paper proposes a new approach to estimating the distribution of a response variable conditioned on observing some factors. The proposed approach possesses desirable properties of flexibility, interpretability, tractability and extendability. The conditional quantile function is modeled by a mixture (weighted sum) of basis quantile functions, with the weights depending on factors. The calibration problem is formulated as a convex optimization problem. It can be viewed as conducting quantile regressions for all confidence levels simultaneously while avoiding quantile crossing by definition. The calibration problem is equivalent to minimizing the continuous ranked probability score (CRPS). Based on the canonical polyadic (CP) decomposition of tensors, we propose a dimensionality reduction method that reduces the rank of the parameter tensor and propose an alternating algorithm for estimation. Additionally, based on Risk Quadrangle framework, we generalize the approach to conditional distributions defined by Conditional Value-at-Risk (CVaR), expectile and other functions of uncertainty measures. Although this paper focuses on using splines as the weight functions, it can be extended to neural networks. Numerical experiments demonstrate the effectiveness of our approach. △ Less

Submitted 14 March, 2023; v1 submitted 31 January, 2023; originally announced January 2023.

Support Vector Regression: Risk Quadrangle Framework

Authors: Anton Malandii, Stan Uryasev

Abstract: This paper investigates Support Vector Regression (SVR) within the framework of the Risk Quadrangle (RQ) theory. Every RQ includes four stochastic functionals -- error, regret, risk, and \emph{deviation}, bound together by a so-called statistic. The RQ framework unifies stochastic optimization, risk management, and statistical estimation. Within this framework, both $\varepsilon$-SVR and $ν$-SVR a… ▽ More This paper investigates Support Vector Regression (SVR) within the framework of the Risk Quadrangle (RQ) theory. Every RQ includes four stochastic functionals -- error, regret, risk, and \emph{deviation}, bound together by a so-called statistic. The RQ framework unifies stochastic optimization, risk management, and statistical estimation. Within this framework, both $\varepsilon$-SVR and $ν$-SVR are shown to reduce to the minimization of the \emph{Vapnik error} and the Conditional Value-at-Risk (CVaR) norm, respectively. The Vapnik error and CVaR norm define quadrangles with a statistic equal to the average of two symmetric quantiles. Therefore, RQ theory implies that $\varepsilon$-SVR and $ν$-SVR are asymptotically unbiased estimators of the average of two symmetric conditional quantiles. Moreover, the equivalence between $\varepsilon$-SVR and $ν$-SVR is demonstrated in a general stochastic setting. Additionally, SVR is formulated as a deviation minimization problem. Another implication of the RQ theory is the formulation of $ν$-SVR as a Distributionally Robust Regression (DRR) problem. Finally, an alternative dual formulation of SVR within the RQ framework is derived. Theoretical results are validated with a case study. △ Less

Submitted 2 December, 2024; v1 submitted 18 December, 2022; originally announced December 2022.

Calculating CVaR and bPOE for Common Probability Distributions With Application to Portfolio Optimization and Density Estimation

Authors: Matthew Norton, Valentyn Khokhlov, Stan Uryasev

Abstract: Conditional Value-at-Risk (CVaR) and Value-at-Risk (VaR), also called the superquantile and quantile, are frequently used to characterize the tails of probability distribution's and are popular measures of risk. Buffered Probability of Exceedance (bPOE) is a recently introduced characterization of the tail which is the inverse of CVaR, much like the CDF is the inverse of the quantile. These quanti… ▽ More Conditional Value-at-Risk (CVaR) and Value-at-Risk (VaR), also called the superquantile and quantile, are frequently used to characterize the tails of probability distribution's and are popular measures of risk. Buffered Probability of Exceedance (bPOE) is a recently introduced characterization of the tail which is the inverse of CVaR, much like the CDF is the inverse of the quantile. These quantities can prove very useful as the basis for a variety of risk-averse parametric engineering approaches. Their use, however, is often made difficult by the lack of well-known closed-form equations for calculating these quantities for commonly used probability distribution's. In this paper, we derive formulas for the superquantile and bPOE for a variety of common univariate probability distribution's. Besides providing a useful collection within a single reference, we use these formulas to incorporate the superquantile and bPOE into parametric procedures. In particular, we consider two: portfolio optimization and density estimation. First, when portfolio returns are assumed to follow particular distribution families, we show that finding the optimal portfolio via minimization of bPOE has advantages over superquantile minimization. We show that, given a fixed threshold, a single portfolio is the minimal bPOE portfolio for an entire class of distribution's simultaneously. Second, we apply our formulas to parametric density estimation and propose the method of superquantile's (MOS), a simple variation of the method of moment's (MM) where moment's are replaced by superquantile's at different confidence levels. With the freedom to select various combinations of confidence levels, MOS allows the user to focus the fitting procedure on different portions of the distribution, such as the tail when fitting heavy-tailed asymmetric data. △ Less

Submitted 17 February, 2019; v1 submitted 27 November, 2018; originally announced November 2018.

Comments: Fixed typo in Proposition 5 (changed - to +) and added reference