-
Detection of intensity bursts using Hawkes processes: an application to high frequency financial data
Authors:
Marcello Rambaldi,
Vladimir Filimonov,
Fabrizio Lillo
Abstract:
Given a stationary point process, an intensity burst is defined as a short time period during which the number of counts is larger than the typical count rate. It might signal a local non-stationarity or the presence of an external perturbation to the system. In this paper we propose a novel procedure for the detection of intensity bursts within the Hawkes process framework. By using a model selec…
▽ More
Given a stationary point process, an intensity burst is defined as a short time period during which the number of counts is larger than the typical count rate. It might signal a local non-stationarity or the presence of an external perturbation to the system. In this paper we propose a novel procedure for the detection of intensity bursts within the Hawkes process framework. By using a model selection scheme we show that our procedure can be used to detect intensity bursts when both their occurrence time and their total number is unknown. Moreover, the initial time of the burst can be determined with a precision given by the typical inter-event time. We apply our methodology to the mid-price change in FX markets showing that these bursts are frequent and that only a relatively small fraction is associated to news arrival. We show lead-lag relations in intensity burst occurrence across different FX rates and we discuss their relation with price jumps.
△ Less
Submitted 17 October, 2016;
originally announced October 2016.
-
Modified Profile Likelihood Inference and Interval Forecast of the Burst of Financial Bubbles
Authors:
Vladimir Filimonov,
Guilherme Demos,
Didier Sornette
Abstract:
We present a detailed methodological study of the application of the modified profile likelihood method for the calibration of nonlinear financial models characterised by a large number of parameters. We apply the general approach to the Log-Periodic Power Law Singularity (LPPLS) model of financial bubbles. This model is particularly relevant because one of its parameters, the critical time $t_c$…
▽ More
We present a detailed methodological study of the application of the modified profile likelihood method for the calibration of nonlinear financial models characterised by a large number of parameters. We apply the general approach to the Log-Periodic Power Law Singularity (LPPLS) model of financial bubbles. This model is particularly relevant because one of its parameters, the critical time $t_c$ signalling the burst of the bubble, is arguably the target of choice for dynamical risk management. However, previous calibrations of the LPPLS model have shown that the estimation of $t_c$ is in general quite unstable. Here, we provide a rigorous likelihood inference approach to determine $t_c$, which takes into account the impact of the other nonlinear (so-called "nuisance") parameters for the correct adjustment of the uncertainty on $t_c$. This provides a rigorous interval estimation for the critical time, rather than a point estimation in previous approaches. As a bonus, the interval estimations can also be obtained for the nuisance parameters ($m,ω$, damping), which can be used to improve filtering of the calibration results. We show that the use of the modified profile likelihood method dramatically reduces the number of local extrema by constructing much simpler smoother log-likelihood landscapes. The remaining distinct solutions can be interpreted as genuine scenarios that unfold as the time of the analysis flows, which can be compared directly via their likelihood ratio. Finally, we develop a multi-scale profile likelihood analysis to visualize the structure of the financial data at different scales (typically from 100 to 750 days). We test the methodology successfully on synthetic price time series and on three well-known historical financial bubbles.
△ Less
Submitted 26 February, 2016;
originally announced February 2016.
-
Power law scaling and "Dragon-Kings" in distributions of intraday financial drawdowns
Authors:
Vladimir Filimonov,
Didier Sornette
Abstract:
We investigate the distributions of epsilon-drawdowns and epsilon-drawups of the most liquid futures financial contracts of the world at time scales of 30 seconds. The epsilon-drawdowns (resp. epsilon- drawups) generalise the notion of runs of negative (resp. positive) returns so as to capture the risks to which investors are arguably the most concerned with. Similarly to the distribution of retur…
▽ More
We investigate the distributions of epsilon-drawdowns and epsilon-drawups of the most liquid futures financial contracts of the world at time scales of 30 seconds. The epsilon-drawdowns (resp. epsilon- drawups) generalise the notion of runs of negative (resp. positive) returns so as to capture the risks to which investors are arguably the most concerned with. Similarly to the distribution of returns, we find that the distributions of epsilon-drawdowns and epsilon-drawups exhibit power law tails, albeit with exponents significantly larger than those for the return distributions. This paradoxical result can be attributed to (i) the existence of significant transient dependence between returns and (ii) the presence of large outliers (dragon-kings) characterizing the extreme tail of the drawdown/drawup distributions deviating from the power law. The study of the tail dependence between the sizes, speeds and durations of drawdown/drawup indicates a clear relationship between size and speed but none between size and duration. This implies that the most extreme drawdown/drawup tend to occur fast and are dominated by a few very large returns. We discuss both the endogenous and exogenous origins of these extreme events.
△ Less
Submitted 7 April, 2015; v1 submitted 18 July, 2014;
originally announced July 2014.
-
Apparent criticality and calibration issues in the Hawkes self-excited point process model: application to high-frequency financial data
Authors:
Vladimir Filimonov,
Didier Sornette
Abstract:
We present a careful analysis of possible issues on the application of the self-excited Hawkes process to high-frequency financial data. We carefully analyze a set of effects leading to significant biases in the estimation of the "criticality index" n that quantifies the degree of endogeneity of how much past events trigger future events. We report a number of model biases that are intrinsic to th…
▽ More
We present a careful analysis of possible issues on the application of the self-excited Hawkes process to high-frequency financial data. We carefully analyze a set of effects leading to significant biases in the estimation of the "criticality index" n that quantifies the degree of endogeneity of how much past events trigger future events. We report a number of model biases that are intrinsic to the estimation of brnaching ratio (n) when using power law memory kernels. We demonstrate that the calibration of the Hawkes process on mixtures of pure Poisson process with changes of regime leads to completely spurious apparent critical values for the branching ratio (n~1) while the true value is actually n=0. More generally, regime shifts on the parameters of the Hawkes model and/or on the generating process itself are shown to systematically lead to a significant upward bias in the estimation of the branching ratio. We also demonstrate the importance of the preparation of the high-frequency financial data and give special care to the decrease of quality of the timestamps of tick data due to latency and grouping of messages to packets by the stock exchange. Altogether, our careful exploration of the caveats of the calibration of the Hawkes process stresses the need for considering all the above issues before any conclusion can be sustained. In this respect, because the above effects are plaguing their analyses, the claim by Hardiman, Bercot and Bouchaud (2013) that financial market have been continuously functioning at or close to criticality (n~1) cannot be supported. In contrast, our previous results on E-mini S&P 500 Futures Contracts and on major commodity future contracts are upheld.
△ Less
Submitted 3 July, 2014; v1 submitted 30 August, 2013;
originally announced August 2013.
-
Effective Measure of Endogeneity for the Autoregressive Conditional Duration Point Processes via Mapping to the Self-Excited Hawkes Process
Authors:
Vladimir Filimonov,
Spencer Wheatley,
Didier Sornette
Abstract:
In order to disentangle the internal dynamics from exogenous factors within the Autoregressive Conditional Duration (ACD) model, we present an effective measure of endogeneity. Inspired from the Hawkes model, this measure is defined as the average fraction of events that are triggered due to internal feedback mechanisms within the total population. We provide a direct comparison of the Hawkes and…
▽ More
In order to disentangle the internal dynamics from exogenous factors within the Autoregressive Conditional Duration (ACD) model, we present an effective measure of endogeneity. Inspired from the Hawkes model, this measure is defined as the average fraction of events that are triggered due to internal feedback mechanisms within the total population. We provide a direct comparison of the Hawkes and ACD models based on numerical simulations and show that our effective measure of endogeneity for the ACD can be mapped onto the "branching ratio" of the Hawkes model.
△ Less
Submitted 19 June, 2014; v1 submitted 10 June, 2013;
originally announced June 2013.
-
Quantifying reflexivity in financial markets: towards a prediction of flash crashes
Authors:
Vladimir Filimonov,
Didier Sornette
Abstract:
We introduce a new measure of activity of financial markets that provides a direct access to their level of endogeneity. This measure quantifies how much of price changes are due to endogenous feedback processes, as opposed to exogenous news. For this, we calibrate the self-excited conditional Poisson Hawkes model, which combines in a natural and parsimonious way exogenous influences with self-exc…
▽ More
We introduce a new measure of activity of financial markets that provides a direct access to their level of endogeneity. This measure quantifies how much of price changes are due to endogenous feedback processes, as opposed to exogenous news. For this, we calibrate the self-excited conditional Poisson Hawkes model, which combines in a natural and parsimonious way exogenous influences with self-excited dynamics, to the E-mini S&P 500 futures contracts traded in the Chicago Mercantile Exchange from 1998 to 2010. We find that the level of endogeneity has increased significantly from 1998 to 2010, with only 70% in 1998 to less than 30% since 2007 of the price changes resulting from some revealed exogenous information. Analogous to nuclear plant safety concerned with avoiding "criticality", our measure provides a direct quantification of the distance of the financial market to a critical state defined precisely as the limit of diverging trading activity in absence of any external driving.
△ Less
Submitted 17 April, 2012; v1 submitted 17 January, 2012;
originally announced January 2012.
-
Spurious trend switching phenomena in financial markets
Authors:
Vladimir Filimonov,
Didier Sornette
Abstract:
The observation of power laws in the time to extrema of volatility, volume and intertrade times, from milliseconds to years, are shown to result straightforwardly from the selection of biased statistical subsets of realizations in otherwise featureless processes such as random walks. The bias stems from the selection of price peaks that imposes a condition on the statistics of price change and of…
▽ More
The observation of power laws in the time to extrema of volatility, volume and intertrade times, from milliseconds to years, are shown to result straightforwardly from the selection of biased statistical subsets of realizations in otherwise featureless processes such as random walks. The bias stems from the selection of price peaks that imposes a condition on the statistics of price change and of trade volumes that skew their distributions. For the intertrade times, the extrema and power laws results from the format of transaction data.
△ Less
Submitted 16 December, 2011;
originally announced December 2011.
-
A Stable and Robust Calibration Scheme of the Log-Periodic Power Law Model
Authors:
Vladimir Filimonov,
Didier Sornette
Abstract:
We present a simple transformation of the formulation of the log-periodic power law formula of the Johansen-Ledoit-Sornette model of financial bubbles that reduces it to a function of only three nonlinear parameters. The transformation significantly decreases the complexity of the fitting procedure and improves its stability tremendously because the modified cost function is now characterized by g…
▽ More
We present a simple transformation of the formulation of the log-periodic power law formula of the Johansen-Ledoit-Sornette model of financial bubbles that reduces it to a function of only three nonlinear parameters. The transformation significantly decreases the complexity of the fitting procedure and improves its stability tremendously because the modified cost function is now characterized by good smooth properties with in general a single minimum in the case where the model is appropriate to the empirical data. We complement the approach with an additional subordination procedure that slaves two of the nonlinear parameters to what can be considered to be the most crucial nonlinear parameter, the critical time $t_c$ defined as the end of the bubble and the most probably time for a crash to occur. This further decreases the complexity of the search and provides an intuitive representation of the results of the calibration. With our proposed methodology, metaheuristic searches are not longer necessary and one can resort solely to rigorous controlled local search algorithms, leading to dramatic increase in efficiency. Empirical tests on the Shanghai Composite index (SSE) from January 2007 to March 2008 illustrate our findings.
△ Less
Submitted 10 June, 2013; v1 submitted 30 July, 2011;
originally announced August 2011.
-
Homogeneous Volatility Bridge Estimators
Authors:
Alexander Saichev,
Didier Sornette,
Vladimir Filimonov,
Fulvio Corsi
Abstract:
We present a theory of homogeneous volatility bridge estimators for log-price stochastic processes. The main tool of our theory is the parsimonious encoding of the information contained in the open, high and low prices of incomplete bridge, corresponding to given log-price stochastic process, and in its close value, for a given time interval. The efficiency of the new proposed estimators is favo…
▽ More
We present a theory of homogeneous volatility bridge estimators for log-price stochastic processes. The main tool of our theory is the parsimonious encoding of the information contained in the open, high and low prices of incomplete bridge, corresponding to given log-price stochastic process, and in its close value, for a given time interval. The efficiency of the new proposed estimators is favorably compared with that of the Garman-Klass and Parkinson estimators.
△ Less
Submitted 8 December, 2009;
originally announced December 2009.
-
Most Efficient Homogeneous Volatility Estimators
Authors:
A. Saichev,
D. Sornette,
V. Filimonov
Abstract:
We present a comprehensive theory of homogeneous volatility (and variance) estimators of arbitrary stochastic processes that fully exploit the OHLC (open, high, low, close) prices. For this, we develop the theory of most efficient point-wise homogeneous OHLC volatility estimators, valid for any price processes. We introduce the "quasi-unbiased estimators", that can address any type of desirable…
▽ More
We present a comprehensive theory of homogeneous volatility (and variance) estimators of arbitrary stochastic processes that fully exploit the OHLC (open, high, low, close) prices. For this, we develop the theory of most efficient point-wise homogeneous OHLC volatility estimators, valid for any price processes. We introduce the "quasi-unbiased estimators", that can address any type of desirable constraints. The main tool of our theory is the parsimonious encoding of all the information contained in the OHLC prices for a given time interval in the form of the joint distributions of the high-minus-open, low-minus-open and close-minus-open values, whose analytical expression is derived exactly for Wiener processes with drift. The distributions can be calculated to yield the most efficient estimators associated with any statistical properties of the underlying log-price stochastic process. Applied to Wiener processes for log-prices with drift, we provide explicit analytical expressions for the most efficient point-wise volatility and variance estimators, based on the analytical expression of the joint distribution of the high-minus-open, low-minus-open and close-minus-open values. The efficiency of the new proposed estimators is favorably compared with that of the Garman-Klass, Roger-Satchell and maximum likelihood estimators.
△ Less
Submitted 12 August, 2009;
originally announced August 2009.