-
Set-valued conditional functionals of random sets
Authors:
Tobias Fissler,
Ilya Molchanov
Abstract:
Many key quantities in statistics and probability theory such as the expectation, quantiles, expectiles and many risk measures are law-determined maps from a space of random variables to the reals. We call such a law-determined map, which is normalised, positively homogeneous, monotone and translation equivariant, a gauge function. Considered as a functional on the space of distributions, we can a…
▽ More
Many key quantities in statistics and probability theory such as the expectation, quantiles, expectiles and many risk measures are law-determined maps from a space of random variables to the reals. We call such a law-determined map, which is normalised, positively homogeneous, monotone and translation equivariant, a gauge function. Considered as a functional on the space of distributions, we can apply such a gauge to the conditional distribution of a random variable. This results in conditional gauges, such as conditional quantiles or conditional expectations. In this paper, we apply such scalar gauges to the support function of a random closed convex set $\bX$. This leads to a set-valued extension of a gauge function. We also introduce a conditional variant whose values are themselves random closed convex sets. In special cases, this functional becomes the conditional set-valued quantile or the conditional set-valued expectation of a random set. In particular, in the unconditional setup, if $\bX$ is a random translation of a deterministic cone and the gauge is either a quantile or an expectile, we recover the cone distribution functions studied by Andreas Hamel and his co-authors. In the conditional setup, the conditional quantile of a random singleton yields the conditional version of the half-space depth-trimmed regions.
△ Less
Submitted 18 April, 2025;
originally announced April 2025.
-
Elicitability and identifiability of tail risk measures
Authors:
Tobias Fissler,
Fangda Liu,
Ruodu Wang,
Linxiao Wei
Abstract:
Tail risk measures are fully determined by the distribution of the underlying loss beyond its quantile at a certain level, with Value-at-Risk and Expected Shortfall being prime examples. They are induced by law-based risk measures, called their generators, evaluated on the tail distribution. This paper establishes joint identifiability and elicitability results of tail risk measures together with…
▽ More
Tail risk measures are fully determined by the distribution of the underlying loss beyond its quantile at a certain level, with Value-at-Risk and Expected Shortfall being prime examples. They are induced by law-based risk measures, called their generators, evaluated on the tail distribution. This paper establishes joint identifiability and elicitability results of tail risk measures together with the corresponding quantile, provided that their generators are identifiable and elicitable, respectively. As an example, we establish the joint identifiability and elicitability of the tail expectile together with the quantile. The corresponding consistent scores constitute a novel class of weighted scores, nesting the known class of scores of Fissler and Ziegel for the Expected Shortfall together with the quantile. For statistical purposes, our results pave the way to easier model fitting for tail risk measures via regression and the generalized method of moments, but also model comparison and model validation in terms of established backtesting procedures.
△ Less
Submitted 29 June, 2024; v1 submitted 22 April, 2024;
originally announced April 2024.
-
Characterizing M-estimators
Authors:
Timo Dimitriadis,
Tobias Fissler,
Johanna Ziegel
Abstract:
We characterize the full classes of M-estimators for semiparametric models of general functionals by formally connecting the theory of consistent loss functions from forecast evaluation with the theory of M-estimation. This novel characterization result opens up the possibility for theoretical research on efficient and equivariant M-estimation and, more generally, it allows to leverage existing re…
▽ More
We characterize the full classes of M-estimators for semiparametric models of general functionals by formally connecting the theory of consistent loss functions from forecast evaluation with the theory of M-estimation. This novel characterization result opens up the possibility for theoretical research on efficient and equivariant M-estimation and, more generally, it allows to leverage existing results on loss functions known from the literature of forecast evaluation in estimation theory.
△ Less
Submitted 17 August, 2022;
originally announced August 2022.
-
Osband's Principle for Identification Functions
Authors:
Timo Dimitriadis,
Tobias Fissler,
Johanna Ziegel
Abstract:
Given a statistical functional of interest such as the mean or median, a (strict) identification function is zero in expectation at (and only at) the true functional value. Identification functions are key objects in forecast validation, statistical estimation and dynamic modelling. For a possibly vector-valued functional of interest, we fully characterise the class of (strict) identification func…
▽ More
Given a statistical functional of interest such as the mean or median, a (strict) identification function is zero in expectation at (and only at) the true functional value. Identification functions are key objects in forecast validation, statistical estimation and dynamic modelling. For a possibly vector-valued functional of interest, we fully characterise the class of (strict) identification functions subject to mild regularity conditions.
△ Less
Submitted 16 August, 2022;
originally announced August 2022.
-
Measurability of functionals and of ideal point forecasts
Authors:
Tobias Fissler,
Hajo Holzmann
Abstract:
The ideal probabilistic forecast for a random variable $Y$ based on an information set $\mathcal{F}$ is the conditional distribution of $Y$ given $\mathcal{F}$. In the context of point forecasts aiming to specify a functional $T$ such as the mean, a quantile or a risk measure, the ideal point forecast is the respective functional applied to the conditional distribution. This paper provides a theor…
▽ More
The ideal probabilistic forecast for a random variable $Y$ based on an information set $\mathcal{F}$ is the conditional distribution of $Y$ given $\mathcal{F}$. In the context of point forecasts aiming to specify a functional $T$ such as the mean, a quantile or a risk measure, the ideal point forecast is the respective functional applied to the conditional distribution. This paper provides a theoretical justification why this ideal forecast is actually a forecast, that is, an $\mathcal{F}$-measurable random variable. To that end, the appropriate notion of measurability of $T$ is clarified and this measurability is established for a large class of practically relevant functionals, including elicitable ones. More generally, the measurability of $T$ implies the measurability of any point forecast which arises by applying $T$ to a probabilistic forecast. Similar measurability results are established for proper scoring rules, the main tool to evaluate the predictive accuracy of probabilistic forecasts.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
Is the mode elicitable relative to unimodal distributions?
Authors:
Claudio Heinrich-Mertsching,
Tobias Fissler
Abstract:
Statistical functionals are called elicitable if there exists a loss or scoring function under which the functional is the optimal point forecast in expectation. While the mean and quantiles are elicitable, it has been shown in Heinrich (2014) that the mode cannot be elicited if the true distribution can follow any Lebesgue density. We strengthen this result substantially, showing that the mode ca…
▽ More
Statistical functionals are called elicitable if there exists a loss or scoring function under which the functional is the optimal point forecast in expectation. While the mean and quantiles are elicitable, it has been shown in Heinrich (2014) that the mode cannot be elicited if the true distribution can follow any Lebesgue density. We strengthen this result substantially, showing that the mode cannot be elicited if the true distribution is any distribution with continuous Lebesgue density and unique local maximum. Likewise, the mode fails to be identifiable relative to this class.
△ Less
Submitted 3 September, 2021; v1 submitted 1 September, 2021;
originally announced September 2021.
-
The Efficiency Gap
Authors:
Timo Dimitriadis,
Tobias Fissler,
Johanna Ziegel
Abstract:
Parameter estimation via M- and Z-estimation is equally powerful in semiparametric models for one-dimensional functionals due to a one-to-one relation between corresponding loss and identification functions via integration and differentiation. For multivariate functionals such as multiple moments, quantiles, or the pair (Value at Risk, Expected Shortfall), this one-to-one relation fails and not ev…
▽ More
Parameter estimation via M- and Z-estimation is equally powerful in semiparametric models for one-dimensional functionals due to a one-to-one relation between corresponding loss and identification functions via integration and differentiation. For multivariate functionals such as multiple moments, quantiles, or the pair (Value at Risk, Expected Shortfall), this one-to-one relation fails and not every identification function possesses an antiderivative. The most important implication is an efficiency gap: The most efficient Z-estimator often outperforms the most efficient M-estimator. We theoretically establish this phenomenon for multiple quantiles at different levels and for the pair (Value at Risk, Expected Shortfall), and illustrate the gap numerically. Our results further give guidance for pseudo-efficient M-estimation for semiparametric models of the Value at Risk and Expected Shortfall.
△ Less
Submitted 6 September, 2022; v1 submitted 27 October, 2020;
originally announced October 2020.
-
Forecast Evaluation of Quantiles, Prediction Intervals, and other Set-Valued Functionals
Authors:
Tobias Fissler,
Rafael Frongillo,
Jana Hlavinová,
Birgit Rudloff
Abstract:
We introduce a theoretical framework of elicitability and identifiability of set-valued functionals, such as quantiles, prediction intervals, and systemic risk measures. A functional is elicitable if it is the unique minimiser of an expected scoring function, and identifiable if it is the unique zero of an expected identification function; both notions are essential for forecast ranking and valida…
▽ More
We introduce a theoretical framework of elicitability and identifiability of set-valued functionals, such as quantiles, prediction intervals, and systemic risk measures. A functional is elicitable if it is the unique minimiser of an expected scoring function, and identifiable if it is the unique zero of an expected identification function; both notions are essential for forecast ranking and validation, and $M$- and $Z$-estimation. Our framework distinguishes between exhaustive forecasts, being set-valued and aiming at correctly specifying the entire functional, and selective forecasts, content with solely specifying a single point in the correct functional. We establish a mutual exclusivity result: A set-valued functional can be either selectively elicitable or exhaustively elicitable or not elicitable at all. Notably, since quantiles are well known to be selectively elicitable, they fail to be exhaustively elicitable. We further show that the class of prediction intervals and Vorob'ev quantiles turn out to be exhaustively elicitable and selectively identifiable. In particular, we provide a mixture representation of elementary exhaustive scores, leading the way to Murphy diagrams. We give possibility and impossibility results for the shortest prediction interval and prediction intervals specified by an endpoint or a midpoint. We end with a comprehensive literature review on common practice in forecast evaluation of set-valued functionals.
△ Less
Submitted 27 July, 2020; v1 submitted 16 October, 2019;
originally announced October 2019.
-
Elicitability and Identifiability of Systemic Risk Measures
Authors:
Tobias Fissler,
Jana Hlavinová,
Birgit Rudloff
Abstract:
Identification and scoring functions are statistical tools to assess the calibration and the relative performance of risk measure estimates, e.g., in backtesting. A risk measures is called identifiable (elicitable) it it admits a strict identification function (strictly consistent scoring function). We consider measures of systemic risk introduced in Feinstein, Rudloff and Weber (2017). Since thes…
▽ More
Identification and scoring functions are statistical tools to assess the calibration and the relative performance of risk measure estimates, e.g., in backtesting. A risk measures is called identifiable (elicitable) it it admits a strict identification function (strictly consistent scoring function). We consider measures of systemic risk introduced in Feinstein, Rudloff and Weber (2017). Since these are set-valued, we work within the theoretical framework of Fissler, Hlavinová and Rudloff (2019) for forecast evaluation of set-valued functionals. We construct oriented selective identification functions, which induce a mixture representation of (strictly) consistent scoring functions. Their applicability is demonstrated with a comprehensive simulation study.
△ Less
Submitted 17 October, 2019; v1 submitted 2 July, 2019;
originally announced July 2019.
-
Evaluating Range Value at Risk Forecasts
Authors:
Tobias Fissler,
Johanna F. Ziegel
Abstract:
The debate of what quantitative risk measure to choose in practice has mainly focused on the dichotomy between Value at Risk (VaR) -- a quantile -- and Expected Shortfall (ES) -- a tail expectation. Range Value at Risk (RVaR) is a natural interpolation between these two prominent risk measures, which constitutes a tradeoff between the sensitivity of the latter and the robustness of the former, tur…
▽ More
The debate of what quantitative risk measure to choose in practice has mainly focused on the dichotomy between Value at Risk (VaR) -- a quantile -- and Expected Shortfall (ES) -- a tail expectation. Range Value at Risk (RVaR) is a natural interpolation between these two prominent risk measures, which constitutes a tradeoff between the sensitivity of the latter and the robustness of the former, turning it into a practically relevant risk measure on its own. As such, there is a need to statistically validate RVaR forecasts and to compare and rank the performance of different RVaR models, tasks subsumed under the term 'backtesting' in finance. The predictive performance is best evaluated and compared in terms of strictly consistent loss or scoring functions. That is, functions which are minimised in expectation by the correct RVaR forecast. Much like ES, it has been shown recently that RVaR does not admit strictly consistent scoring functions, i.e., it is not elicitable. Mitigating this negative result, this paper shows that a triplet of RVaR with two VaR components at different levels is elicitable. We characterise the class of strictly consistent scoring functions for this triplet. Additional properties of these scoring functions are examined, including the diagnostic tool of Murphy diagrams. The results are illustrated with a simulation study, and we put our approach in perspective with respect to the classical approach of trimmed least squares in robust regression.
△ Less
Submitted 28 November, 2020; v1 submitted 12 February, 2019;
originally announced February 2019.
-
Supplement to "Erratum: Higher Order Elicitability and Osband's Principle"
Authors:
Tobias Fissler,
Johanna F. Ziegel
Abstract:
This note corrects conditions in Proposition 3.4 and Theorem 5.2(ii) and comments on imprecisions in Propositions 4.2 and 4.4 in Fissler and Ziegel (2016).
This note corrects conditions in Proposition 3.4 and Theorem 5.2(ii) and comments on imprecisions in Propositions 4.2 and 4.4 in Fissler and Ziegel (2016).
△ Less
Submitted 6 October, 2020; v1 submitted 25 January, 2019;
originally announced January 2019.
-
Order-Sensitivity and Equivariance of Scoring Functions
Authors:
Tobias Fissler,
Johanna F. Ziegel
Abstract:
The relative performance of competing point forecasts is usually measured in terms of loss or scoring functions. It is widely accepted that these scoring function should be strictly consistent in the sense that the expected score is minimized by the correctly specified forecast for a certain statistical functional such as the mean, median, or a certain risk measure. Thus, strict consistency opens…
▽ More
The relative performance of competing point forecasts is usually measured in terms of loss or scoring functions. It is widely accepted that these scoring function should be strictly consistent in the sense that the expected score is minimized by the correctly specified forecast for a certain statistical functional such as the mean, median, or a certain risk measure. Thus, strict consistency opens the way to meaningful forecast comparison, but is also important in regression and M-estimation. Usually strictly consistent scoring functions for an elicitable functional are not unique. To give guidance on the choice of a scoring function, this paper introduces two additional quality criteria. Order-sensitivity opens the possibility to compare two deliberately misspecified forecasts given that the forecasts are ordered in a certain sense. On the other hand, equivariant scoring functions obey similar equivariance properties as the functional at hand - such as translation invariance or positive homogeneity. In our study, we consider scoring functions for popular functionals, putting special emphasis on vector-valued functionals, e.g. the pair (mean, variance) or (Value at Risk, Expected Shortfall).
△ Less
Submitted 27 November, 2017;
originally announced November 2017.
-
A new quantitative central limit theorem on the Wiener space with applications to Gaussian processes
Authors:
Tobias Fissler,
Christoph Thaele
Abstract:
Quantitative limit theorems for non-linear functionals on the Wiener space are considered. Given the possibly infinite sequence of kernels of the chaos decomposition of such a functional, an estimate for different probability distances between the functional and a Gaussian random variable in terms of contraction norms of these kernels is derived. The applicability of this result is demonstrated by…
▽ More
Quantitative limit theorems for non-linear functionals on the Wiener space are considered. Given the possibly infinite sequence of kernels of the chaos decomposition of such a functional, an estimate for different probability distances between the functional and a Gaussian random variable in terms of contraction norms of these kernels is derived. The applicability of this result is demonstrated by means of the Breuer-Major theorem, unfolding thereby a new connection between the Hermite rank of the considered function and a chaotic gap. Especially, power variations of the fractional Brownian motion and processes belonging to the Cauchy class are studied.
△ Less
Submitted 5 October, 2016;
originally announced October 2016.
-
Higher order elicitability and Osband's principle
Authors:
Tobias Fissler,
Johanna F. Ziegel
Abstract:
A statistical functional, such as the mean or the median, is called elicitable if there is a scoring function or loss function such that the correct forecast of the functional is the unique minimizer of the expected score. Such scoring functions are called strictly consistent for the functional. The elicitability of a functional opens the possibility to compare competing forecasts and to rank them…
▽ More
A statistical functional, such as the mean or the median, is called elicitable if there is a scoring function or loss function such that the correct forecast of the functional is the unique minimizer of the expected score. Such scoring functions are called strictly consistent for the functional. The elicitability of a functional opens the possibility to compare competing forecasts and to rank them in terms of their realized scores. In this paper, we explore the notion of elicitability for multi-dimensional functionals and give both necessary and sufficient conditions for strictly consistent scoring functions. We cover the case of functionals with elicitable components, but we also show that one-dimensional functionals that are not elicitable can be a component of a higher order elicitable functional. In the case of the variance this is a known result. However, an important result of this paper is that spectral risk measures with a spectral measure with finite support are jointly elicitable if one adds the `correct' quantiles. A direct consequence of applied interest is that the pair (Value at Risk, Expected Shortfall) is jointly elicitable under mild conditions that are usually fulfilled in risk management applications.
△ Less
Submitted 30 September, 2015; v1 submitted 27 March, 2015;
originally announced March 2015.
-
A four moments theorem for Gamma limits on a Poisson chaos
Authors:
Tobias Fissler,
Christoph Thaele
Abstract:
This paper deals with sequences of random variables belonging to a fixed chaos of order $q$ generated by a Poisson random measure on a Polish space. The problem is investigated whether convergence of the third and fourth moment of such a suitably normalized sequence to the third and fourth moment of a centred Gamma law implies convergence in distribution of the involved random variables. A positiv…
▽ More
This paper deals with sequences of random variables belonging to a fixed chaos of order $q$ generated by a Poisson random measure on a Polish space. The problem is investigated whether convergence of the third and fourth moment of such a suitably normalized sequence to the third and fourth moment of a centred Gamma law implies convergence in distribution of the involved random variables. A positive answer is obtained for $q=2$ and $q=4$. The proof of this four moments theorem is based on a number of new estimates for contraction norms. Applications concern homogeneous sums and $U$-statistics on the Poisson space.
△ Less
Submitted 5 February, 2015;
originally announced February 2015.
-
Testing the maximal rank of the volatility process for continuous diffusions observed with noise
Authors:
Tobias Fissler,
Mark Podolskij
Abstract:
In this paper, we present a test for the maximal rank of the volatility process in continuous diffusion models observed with noise. Such models are typically applied in mathematical finance, where latent price processes are corrupted by microstructure noise at ultra high frequencies. Using high frequency observations we construct a test statistic for the maximal rank of the time varying stochastic…
▽ More
In this paper, we present a test for the maximal rank of the volatility process in continuous diffusion models observed with noise. Such models are typically applied in mathematical finance, where latent price processes are corrupted by microstructure noise at ultra high frequencies. Using high frequency observations we construct a test statistic for the maximal rank of the time varying stochastic volatility process. Our methodology is based upon a combination of a matrix perturbation approach and pre-averaging. We will show the asymptotic mixed normality of the test statistic and obtain a consistent testing procedure.
△ Less
Submitted 24 October, 2014;
originally announced October 2014.
