Showing 1–49 of 49 results for author: Potters, M

Distribution of the Diagonal Entries of the Resolvent of a Complex Ginibre Matrix

Authors: Pierre Bousseyroux, Jean-Philippe Bouchaud, Marc Potters

Abstract: The study of eigenvalue distributions in random matrix theory is often conducted by analyzing the resolvent matrix $ \mathbf{G}_{\mathbf{M}}^N(z) = (z \mathbf{1} - \mathbf{M})^{-1} $. The normalized trace of the resolvent, known as the Stieltjes transform $ \mathfrak{g}_{\mathbf{M}}^N(z) $, converges to a limit $ \mathfrak{g}_{\mathbf{M}}(z) $ as the matrix dimension $ N $ grows, which provides th… ▽ More The study of eigenvalue distributions in random matrix theory is often conducted by analyzing the resolvent matrix $ \mathbf{G}_{\mathbf{M}}^N(z) = (z \mathbf{1} - \mathbf{M})^{-1} $. The normalized trace of the resolvent, known as the Stieltjes transform $ \mathfrak{g}_{\mathbf{M}}^N(z) $, converges to a limit $ \mathfrak{g}_{\mathbf{M}}(z) $ as the matrix dimension $ N $ grows, which provides the eigenvalue density $ ρ_{\mathbf{M}} $ in the large-$ N $ limit. In the Hermitian case, the distribution of $ \mathfrak{g}_{\mathbf{M}}^N(z) $, now regarded as a random variable, is explicitly known when $ z $ lies within the limiting spectrum, and it coincides with the distribution of any diagonal entry of $ \mathbf{G}_{\mathbf{M}}^N(z) $. In this paper, we investigate what becomes of these results when $ \mathbf{M} $ is non-Hermitian. Our main result is the exact computation of the diagonal elements of $ \mathbf{G}_{\mathbf{M}}^N(z) $ when $ \mathbf{M} $ is a Ginibre matrix of size $ N $, as well as the high-dimensional limit for different regimes of $ z $, revealing a tail behavior connected to the statistics of the left and right eigenvectors. Interestingly, the limit distribution is stable under inversion, a property previously observed in the symmetric case. We then propose two general conjectures regarding the distribution of the diagonal elements of the resolvent and its normalized trace in the non-Hermitian case, both of which reveal a symmetry under inversion. △ Less

Submitted 28 November, 2024; originally announced November 2024.

Spectral Initialization for High-Dimensional Phase Retrieval with Biased Spatial Directions

Authors: Pierre Bousseyroux, Marc Potters

Abstract: We explore a spectral initialization method that plays a central role in contemporary research on signal estimation in nonconvex scenarios. In a noiseless phase retrieval framework, we precisely analyze the method's performance in the high-dimensional limit when sensing vectors follow a multivariate Gaussian distribution for two rotationally invariant models of the covariance matrix C. In the firs… ▽ More We explore a spectral initialization method that plays a central role in contemporary research on signal estimation in nonconvex scenarios. In a noiseless phase retrieval framework, we precisely analyze the method's performance in the high-dimensional limit when sensing vectors follow a multivariate Gaussian distribution for two rotationally invariant models of the covariance matrix C. In the first model C is a projector on a lower dimensional space while in the second it is a Wishart matrix. Our analytical results extend the well-established case when C is the identity matrix. Our examination shows that the introduction of biased spatial directions leads to a substantial improvement in the spectral method's effectiveness, particularly when the number of measurements is less than the signal's dimension. This extension also consistently reveals a phase transition phenomenon dependent on the ratio between sample size and signal dimension. Surprisingly, both of these models share the same threshold value. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: 13 pages, 4 figures

Excess Out-of-Sample Risk and Fleeting Modes

Authors: Jean-Philippe Bouchaud, Iacopo Mastromatteo, Marc Potters, Konstantin Tikhonov

Abstract: Using Random Matrix Theory, we propose a universal and versatile tool to reveal the existence of "fleeting modes", i.e. portfolios that carry statistically significant excess risk, signalling ex-post a change in the correlation structure in the underlying asset space. Our proposed test is furthermore independent of the "true" (but unknown) underlying correlation structure. We show empirically that… ▽ More Using Random Matrix Theory, we propose a universal and versatile tool to reveal the existence of "fleeting modes", i.e. portfolios that carry statistically significant excess risk, signalling ex-post a change in the correlation structure in the underlying asset space. Our proposed test is furthermore independent of the "true" (but unknown) underlying correlation structure. We show empirically that such fleeting modes exist both in futures markets and in equity markets. We proposed a metric to quantify the alignment between known factors and fleeting modes and identify momentum as a source of excess risk in the equity space. △ Less

Submitted 2 May, 2022; originally announced May 2022.

Comments: 9 pages, 5 figures

Right large deviation principle for the top eigenvalue of the sum or product of invariant random matrices

Authors: Pierre Mergny, Marc Potters

Abstract: In this note we study the right large deviation of the top eigenvalue (or singular value) of the sum or product of two random matrices $\mathbf{A}$ and $\mathbf{B}$ as their dimensions goes to infinity. The matrices $\mathbf{A}$ and $\mathbf{B}$ are each assumed to be taken from an invariant (or bi-invariant) ensemble with a confining potential with a possible \emph{wall} beyond which no eigenvalu… ▽ More In this note we study the right large deviation of the top eigenvalue (or singular value) of the sum or product of two random matrices $\mathbf{A}$ and $\mathbf{B}$ as their dimensions goes to infinity. The matrices $\mathbf{A}$ and $\mathbf{B}$ are each assumed to be taken from an invariant (or bi-invariant) ensemble with a confining potential with a possible \emph{wall} beyond which no eigenvalues/singular values are allowed. The introduction of this wall puts different models in a very generic framework. In particular, the case where the wall is exactly at the right edge of the limiting spectral density is equivalent, from the point of view of large deviations, to considering a fixed diagonal matrices, as studied previously in Ref. \cite{GuionnetMaida20}. We show that that the tilting method introduced in Ref. \cite{GuionnetMaida20} can be extended to our general setting and is equivalent to the study of a spherical spin glass model specific to the operation - sum of symmetric matrices / product of symmetric matrices / sum of rectangular matrices - we are considering. △ Less

Submitted 27 January, 2022; originally announced January 2022.

Comments: 70 pages, 11 figures

Rank one HCIZ at high temperature: interpolating between classical and free convolutions

Authors: Pierre Mergny, Marc Potters

Abstract: We study the rank one Harish-Chandra-Itzykson-Zuber integral in the limit where $\frac{N β}{2} \to c $, called the high temperature regime and show that it can be used to construct a promising one-parameter interpolation, with parameter $c$ between the classical and the free convolution. This $c$-convolution has a simple interpretation in terms of another associated family of distribution indexed… ▽ More We study the rank one Harish-Chandra-Itzykson-Zuber integral in the limit where $\frac{N β}{2} \to c $, called the high temperature regime and show that it can be used to construct a promising one-parameter interpolation, with parameter $c$ between the classical and the free convolution. This $c$-convolution has a simple interpretation in terms of another associated family of distribution indexed by $c$, called the Markov-Krein transform: the $c$-convolution of two distributions corresponds to the classical convolution of their Markov-Krein transforms. We derive first cumulants-moments relations, a central limit theorem, a Poisson limit theorem and shows several numerical examples of $c$-convoluted distributions. △ Less

Submitted 22 January, 2021; v1 submitted 5 January, 2021; originally announced January 2021.

Comments: 37 pages, 5 figures

Journal ref: SciPost Phys. 12, 022 (2022)

On a Generalisation of the Marcenko-Pastur Problem

Authors: Jean-Philippe Bouchaud, Marc Potters

Abstract: We study the spectrum of generalized Wishart matrices, defined as $\mathbf{F}=( X Y^\top + Y X^\top)/2T$, where $X$ and $Y$ are $N \times T$ matrices with zero mean, unit variance IID entries and such that $\mathbb{E}[X_{it} Y_{jt}]=c δ_{i,j}$. The limit $c=1$ corresponds to the Marcenko-Pastur problem. For a general $c$, we show that the Stietjes transform of $\mathbf{F}$ is the solution of a cub… ▽ More We study the spectrum of generalized Wishart matrices, defined as $\mathbf{F}=( X Y^\top + Y X^\top)/2T$, where $X$ and $Y$ are $N \times T$ matrices with zero mean, unit variance IID entries and such that $\mathbb{E}[X_{it} Y_{jt}]=c δ_{i,j}$. The limit $c=1$ corresponds to the Marcenko-Pastur problem. For a general $c$, we show that the Stietjes transform of $\mathbf{F}$ is the solution of a cubic equation. In the limit $c=0$, $T \gg N$ the density of eigenvalues converges to the Wigner semi-circle. △ Less

Submitted 20 September, 2020; v1 submitted 15 September, 2020; originally announced September 2020.

Comments: 5 pages, 3 figures, reference to the "Tetilla" law added

Journal ref: Phys. Rev. E 102, 062117 (2020)

Asymptotic behavior of the multiplicative counterpart of the Harish-Chandra integral and the $S$-transform

Authors: Pierre Mergny, Marc Potters

Abstract: In this note, we study the asymptotic of spherical integrals, which are analytical extension in index of the normalized Schur polynomials for $β=2$ , and of Jack symmetric polynomials otherwise. Such integrals are the multiplicative counterparts of the Harish-Chandra-Itzykson-Zuber (HCIZ) integrals, whose asymptotic are given by the so-called $R$-transform when one of the matrix is of rank one. We… ▽ More In this note, we study the asymptotic of spherical integrals, which are analytical extension in index of the normalized Schur polynomials for $β=2$ , and of Jack symmetric polynomials otherwise. Such integrals are the multiplicative counterparts of the Harish-Chandra-Itzykson-Zuber (HCIZ) integrals, whose asymptotic are given by the so-called $R$-transform when one of the matrix is of rank one. We argue by a saddle-point analysis that a similar result holds for all $β>0$ in the multiplicative case, where the asymptotic is governed by the logarithm of the $S$-transform. As a consequence of this result one can calculate the asymptotic behavior of complete homogeneous symmetric polynomials. △ Less

Submitted 22 January, 2021; v1 submitted 18 July, 2020; originally announced July 2020.

Comments: 14 pages, 1 figure

Two short pieces around the Wigner problem

Authors: J. P. Bouchaud, M. Potters

Abstract: We revisit the classic Wigner semi-circle from two different angles. One consists in studying the Stieltjes transform directly on the real axis, which does not converge to a fixed value but follows a Cauchy distribution that depends on the local eigenvalue density. This result was recently proven by Aizenman \& Warzel for a wide class of eigenvalue distributions. We shed new light onto their resul… ▽ More We revisit the classic Wigner semi-circle from two different angles. One consists in studying the Stieltjes transform directly on the real axis, which does not converge to a fixed value but follows a Cauchy distribution that depends on the local eigenvalue density. This result was recently proven by Aizenman \& Warzel for a wide class of eigenvalue distributions. We shed new light onto their result using a Coulomb gas method. The second angle is to derive a Langevin equation for the full (matrix) resolvent, extending Dyson's Brownian motion framework. The full matrix structure of this equation allows one to recover known results on the overlaps between the eigenvectors of a fixed matrix and its noisy counterpart. △ Less

Submitted 15 October, 2018; v1 submitted 6 September, 2018; originally announced September 2018.

Comments: Some minor misprints corrected. To appear in J. Phys. A, special issue: Random Matrices, the first 90 years

Cleaning large correlation matrices: tools from random matrix theory

Authors: Joël Bun, Jean-Philippe Bouchaud, Marc Potters

Abstract: This review covers recent results concerning the estimation of large covariance matrices using tools from Random Matrix Theory (RMT). We introduce several RMT methods and analytical techniques, such as the Replica formalism and Free Probability, with an emphasis on the Marchenko-Pastur equation that provides information on the resolvent of multiplicatively corrupted noisy matrices. Special care is… ▽ More This review covers recent results concerning the estimation of large covariance matrices using tools from Random Matrix Theory (RMT). We introduce several RMT methods and analytical techniques, such as the Replica formalism and Free Probability, with an emphasis on the Marchenko-Pastur equation that provides information on the resolvent of multiplicatively corrupted noisy matrices. Special care is devoted to the statistics of the eigenvectors of the empirical correlation matrix, which turn out to be crucial for many applications. We show in particular how these results can be used to build consistent "Rotationally Invariant" estimators (RIE) for large correlation matrices when there is no prior on the structure of the underlying process. The last part of this review is dedicated to some real-world applications within financial markets as a case in point. We establish empirically the efficacy of the RIE framework, which is found to be superior in this case to all previously proposed methods. The case of additively (rather than multiplicatively) corrupted noisy matrices is also dealt with in a special Appendix. Several open problems and interesting technical developments are discussed throughout the paper. △ Less

Submitted 25 October, 2016; originally announced October 2016.

Comments: 165 pages, article submitted to Physics Reports

On the overlaps between eigenvectors of correlated random matrices

Authors: Joël Bun, Jean-Philippe Bouchaud, Marc Potters

Abstract: We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum thermalisation to high dimensional statistics. We find that the overlaps only depend on measurable quantities, and do not require the knowledge of the underlying "tr… ▽ More We obtain general, exact formulas for the overlaps between the eigenvectors of large correlated random matrices, with additive or multiplicative noise. These results have potential applications in many different contexts, from quantum thermalisation to high dimensional statistics. We find that the overlaps only depend on measurable quantities, and do not require the knowledge of the underlying "true" (noiseless) matrices. We apply our results to the case of empirical correlation matrices, that allow us to estimate reliably the width of the spectrum of the true correlation matrix, even when the latter is very close to the identity. We illustrate our results on the example of stock returns correlations, that clearly reveal a non trivial structure for the bulk eigenvalues. We also apply our results to the problem of matrix denoising in high dimension. △ Less

Submitted 23 July, 2017; v1 submitted 14 March, 2016; originally announced March 2016.

Comments: 12 pages, 5 figures

Journal ref: Phys. Rev. E 98, 052145 (2018)

Rotational invariant estimator for general noisy matrices

Authors: Joël Bun, Romain Allez, Jean-Philippe Bouchaud, Marc Potters

Abstract: We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes either from an arbitrary additive or multiplicative rotational invariant perturbation. We establish, using the Replica method, the asymptotic global law estimate f… ▽ More We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes either from an arbitrary additive or multiplicative rotational invariant perturbation. We establish, using the Replica method, the asymptotic global law estimate for three general classes of noisy matrices, significantly extending previously obtained results. We give exact results concerning the asymptotic deviations (called overlaps) of the perturbed eigenvectors away from the true ones, and we explain how to use these overlaps to "clean" the noisy eigenvalues of $\textbf{M}$. We provide some numerical checks for the different estimators proposed in this paper and we also make the connection with some well known results of Bayesian statistics. △ Less

Submitted 26 October, 2016; v1 submitted 24 February, 2015; originally announced February 2015.

Comments: 19 pages, 9 figures

Instanton Approach to Large $N$ Harish-Chandra-Itzykson-Zuber Integrals

Authors: Joel Bun, Jean-Philippe Bouchaud, Satya N. Majumdar, Marc Potters

Abstract: We reconsider the large $N$ asymptotics of Harish-Chandra-Itzykson-Zuber integrals. We provide, using Dyson's Brownian motion and the method of instantons, an alternative, transparent derivation of the Matytsin formalism for the unitary case. Our method is easily generalized to the orthogonal and symplectic ensembles. We obtain an explicit solution of Matytsin's equations in the case of Wigner mat… ▽ More We reconsider the large $N$ asymptotics of Harish-Chandra-Itzykson-Zuber integrals. We provide, using Dyson's Brownian motion and the method of instantons, an alternative, transparent derivation of the Matytsin formalism for the unitary case. Our method is easily generalized to the orthogonal and symplectic ensembles. We obtain an explicit solution of Matytsin's equations in the case of Wigner matrices, as well as a general expansion method in the dilute limit, when the spectrum of eigenvalues spreads over very wide regions. △ Less

Submitted 5 September, 2014; v1 submitted 30 March, 2014; originally announced March 2014.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. Lett. 113, 070201 (2014)

Sampling microcanonical measures of the 2D Euler equations through Creutz's algorithm: a phase transition from disorder to order when energy is increased

Authors: Max Potters, Timothee Vaillant, Freddy Bouchet

Abstract: The 2D Euler equations is the basic example of fluid models for which a microcanical measure can be constructed from first principles. This measure is defined through finite-dimensional approximations and a limiting procedure. Creutz's algorithm is a microcanonical generalization of the Metropolis-Hasting algorithm (to sample Gibbs measures, in the canonical ensemble). We prove that Creutz's algor… ▽ More The 2D Euler equations is the basic example of fluid models for which a microcanical measure can be constructed from first principles. This measure is defined through finite-dimensional approximations and a limiting procedure. Creutz's algorithm is a microcanonical generalization of the Metropolis-Hasting algorithm (to sample Gibbs measures, in the canonical ensemble). We prove that Creutz's algorithm can sample finite-dimensional approximations of the 2D Euler microcanonical measures (incorporating fixed energy and other invariants). This is essential as microcanonical and canonical measures are known to be inequivalent at some values of energy and vorticity distribution. Creutz's algorithm is used to check predictions from the mean-field statistical mechanics theory of the 2D Euler equations (the Robert-Sommeria-Miller theory). We found full agreement with theory. Three different ways to compute the temperature give consistent results. Using Creutz's algorithm, a first-order phase transition never observed previously, and a situation of statistical ensemble inequivalence are found and studied. Strikingly, and contrasting usual statistical mechanics interpretations, this phase transition appears from a disordered phase to an ordered phase (with less symmetries) when energy is increased. We explain this paradox. △ Less

Submitted 20 December, 2012; v1 submitted 16 October, 2012; originally announced October 2012.

Comments: 27 pages, 12 figures

One-dimensional lattice of oscillators coupled through power-law interactions: Continuum limit and dynamics of spatial Fourier modes

Authors: Shamik Gupta, Max Potters, Stefano Ruffo

Abstract: We study synchronization in a system of phase-only oscillators residing on the sites of a one-dimensional periodic lattice. The oscillators interact with a strength that decays as a power law of the separation along the lattice length and is normalized by a size-dependent constant. The exponent $α$ of the power law is taken in the range $0 \le α<1$. The oscillator frequency distribution is symmetr… ▽ More We study synchronization in a system of phase-only oscillators residing on the sites of a one-dimensional periodic lattice. The oscillators interact with a strength that decays as a power law of the separation along the lattice length and is normalized by a size-dependent constant. The exponent $α$ of the power law is taken in the range $0 \le α<1$. The oscillator frequency distribution is symmetric about its mean (taken to be zero), and is non-increasing on $[0,\infty)$. In the continuum limit, the local density of oscillators evolves in time following the continuity equation that expresses the conservation of the number of oscillators of each frequency under the dynamics. This equation admits as a stationary solution the unsynchronized state uniform both in phase and over the space of the lattice. We perform a linear stability analysis of this state to show that when it is unstable, different spatial Fourier modes of fluctuations have different stability thresholds beyond which they grow exponentially in time with rates that depend on the Fourier modes. However, numerical simulations show that at long times, all the non-zero Fourier modes decay in time, while only the zero Fourier mode (i.e., the "mean-field" mode) grows in time, thereby dominating the instability process and driving the system to a synchronized state. Our theoretical analysis is supported by extensive numerical simulations. △ Less

Submitted 4 June, 2012; v1 submitted 3 March, 2012; originally announced March 2012.

Comments: 7 pages, 4 figures. v2: new simulation results added, close to the published version

Journal ref: Phys. Rev. E 85, 066201 (2012)

Financial Applications of Random Matrix Theory: a short review

Authors: J. P. Bouchaud, M. Potters

Abstract: We discuss the applications of Random Matrix Theory in the context of financial markets and econometric models, a topic about which a considerable number of papers have been devoted to in the last decade. This mini-review is intended to guide the reader through various theoretical results (the Marcenko-Pastur spectrum and its various generalisations, random SVD, free matrices, largest eigenvalue… ▽ More We discuss the applications of Random Matrix Theory in the context of financial markets and econometric models, a topic about which a considerable number of papers have been devoted to in the last decade. This mini-review is intended to guide the reader through various theoretical results (the Marcenko-Pastur spectrum and its various generalisations, random SVD, free matrices, largest eigenvalue statistics, etc.) as well as some concrete applications to portfolio optimisation and out-of-sample risk estimation. △ Less

Submitted 7 October, 2009; originally announced October 2009.

Comments: To appear in the "Handbook on Random Matrix Theory", Oxford University Press

The Student ensemble of correlation matrices: eigenvalue spectrum and Kullback-Leibler entropy

Authors: Giulio Biroli, Jean-Philippe Bouchaud, Marc Potters

Abstract: We study a new ensemble of random correlation matrices related to multivariate Student (or more generally elliptic) random variables. We establish the exact density of states of empirical correlation matrices that generalizes the Marcenko-Pastur result. The comparison between the theoretical density of states in the Student case and empirical financial data is surprisingly good, even if we are s… ▽ More We study a new ensemble of random correlation matrices related to multivariate Student (or more generally elliptic) random variables. We establish the exact density of states of empirical correlation matrices that generalizes the Marcenko-Pastur result. The comparison between the theoretical density of states in the Student case and empirical financial data is surprisingly good, even if we are still able to detect systematic deviations. Finally, we compute explicitely the Kullback-Leibler entropies of empirical Student matrices, which are found to be independent of the true correlation matrix, as in the Gaussian case. We provide numerically exact values for these Kullback-Leibler entropies. △ Less

Submitted 3 October, 2007; originally announced October 2007.

Extreme value problems in Random Matrix Theory and other disordered systems

Authors: Giulio Biroli, Jean-Philippe Bouchaud, Marc Potters

Abstract: We review some applications of central limit theorems and extreme values statistics in the context of disordered systems. We discuss several problems, in particular concerning Random Matrix Theory and the generalisation of the Tracy-Widom distribution when the disorder has ``fat tails''. We underline the relevance of power-law tails for Directed Polymers and mean-field Spin Glasses, and we point… ▽ More We review some applications of central limit theorems and extreme values statistics in the context of disordered systems. We discuss several problems, in particular concerning Random Matrix Theory and the generalisation of the Tracy-Widom distribution when the disorder has ``fat tails''. We underline the relevance of power-law tails for Directed Polymers and mean-field Spin Glasses, and we point out various open problems and conjectures on these matters. We find that in many instances the assumption of Gaussian disorder cannot be taken for granted. △ Less

Submitted 9 February, 2007; originally announced February 2007.

Comments: to appear in JSTAT, proceedings of `Principles of Dynamics of Nonequilibrium Systems', ISI Cambridge 2006

On the top eigenvalue of heavy-tailed random matrices

Authors: Giulio Biroli, Jean-Philippe Bouchaud, Marc Potters

Abstract: We study the statistics of the largest eigenvalue lambda_max of N x N random matrices with unit variance, but power-law distributed entries, P(M_{ij})~ |M_{ij}|^{-1-mu}. When mu > 4, lambda_max converges to 2 with Tracy-Widom fluctuations of order N^{-2/3}. When mu < 4, lambda_max is of order N^{2/mu-1/2} and is governed by Fréchet statistics. The marginal case mu=4 provides a new class of limit… ▽ More We study the statistics of the largest eigenvalue lambda_max of N x N random matrices with unit variance, but power-law distributed entries, P(M_{ij})~ |M_{ij}|^{-1-mu}. When mu > 4, lambda_max converges to 2 with Tracy-Widom fluctuations of order N^{-2/3}. When mu < 4, lambda_max is of order N^{2/mu-1/2} and is governed by Fréchet statistics. The marginal case mu=4 provides a new class of limiting distribution that we compute explicitely. We extend these results to sample covariance matrices, and show that extreme events may cause the largest eigenvalue to significantly exceed the Marcenko-Pastur edge. Connections with Directed Polymers are briefly discussed. △ Less

Submitted 4 September, 2006; originally announced September 2006.

Comments: 4 pages, 2 figures

Relation between Bid-Ask Spread, Impact and Volatility in Double Auction Markets

Authors: Matthieu Wyart, Jean-Philippe Bouchaud, Julien Kockelkoren, Marc Potters, Michele Vettorazzo

Abstract: We show that the cost of market orders and the profit of infinitesimal market-making or -taking strategies can be expressed in terms of directly observable quantities, namely the spread and the lag-dependent impact function. Imposing that any market taking or liquidity providing strategies is at best marginally profitable, we obtain a linear relation between the bid-ask spread and the instantane… ▽ More We show that the cost of market orders and the profit of infinitesimal market-making or -taking strategies can be expressed in terms of directly observable quantities, namely the spread and the lag-dependent impact function. Imposing that any market taking or liquidity providing strategies is at best marginally profitable, we obtain a linear relation between the bid-ask spread and the instantaneous impact of market orders, in good agreement with our empirical observations on electronic markets. We then use this relation to justify a strong, and hitherto unnoticed, empirical correlation between the spread and the volatility_per trade_, with R^2s exceeding 0.9. This correlation suggests both that the main determinant of the bid-ask spread is adverse selection, and that most of the volatilitycomes from trade impact. We argue that the role of the time-horizon appearing in the definition of costs is crucial and that long-range correlations in the order flow, overlooked in previous studies, must be carefully factored in. We find that the spread is significantly larger on the nyse, a liquid market with specialists, where monopoly rents appear to be present. △ Less

Submitted 12 March, 2007; v1 submitted 10 March, 2006; originally announced March 2006.

Comments: 35 pages, 12 figures, still improved version

Large dimension forecasting models and random singular value spectra

Authors: Jean-Philippe Bouchaud, Laurent Laloux, M. Augusta Miceli, Marc Potters

Abstract: We present a general method to detect and extract from a finite time sample statistically meaningful correlations between input and output variables of large dimensionality. Our central result is derived from the theory of free random matrices, and gives an explicit expression for the interval where singular values are expected in the absence of any true correlations between the variables under… ▽ More We present a general method to detect and extract from a finite time sample statistically meaningful correlations between input and output variables of large dimensionality. Our central result is derived from the theory of free random matrices, and gives an explicit expression for the interval where singular values are expected in the absence of any true correlations between the variables under study. Our result can be seen as the natural generalization of the Marcenko-Pastur distribution for the case of rectangular correlation matrices. We illustrate the interest of our method on a set of macroeconomic time series. △ Less

Submitted 10 December, 2005; originally announced December 2005.

Comments: 20 pages, 5 figures, submitted to EPJB

Trend followers lose more often than they gain

Authors: Marc Potters, Jean-Philippe Bouchaud

Abstract: We solve exactly a simple model of trend following strategy, and obtain the analytical shape of the profit per trade distribution. This distribution is non trivial and has an option like, asymmetric structure. The degree of asymmetry depends continuously on the parameters of the strategy and on the volatility of the traded asset. While the average gain per trade is always exactly zero, the fract… ▽ More We solve exactly a simple model of trend following strategy, and obtain the analytical shape of the profit per trade distribution. This distribution is non trivial and has an option like, asymmetric structure. The degree of asymmetry depends continuously on the parameters of the strategy and on the volatility of the traded asset. While the average gain per trade is always exactly zero, the fraction f of winning trades decreases from f=1/2 for small volatility to f=0 for high volatility, showing that this winning probability does not give any information on the reliability of the strategy but is indicative of the trading style. △ Less

Submitted 16 August, 2005; originally announced August 2005.

Comments: 7 pages, 3 figures, submitted to Wilmott magazine

Financial Applications of Random Matrix Theory: Old Laces and New Pieces

Authors: M. Potters, J. P. Bouchaud, L. Laloux

Abstract: This contribution to the proceedings of the Cracow meeting on `Applications of Random Matrix Theory' summarizes a series of studies, some old and others more recent on financial applications of Random Matrix Theory (RMT). We first review some early results in that field, with particular emphasis on the applications of correlation cleaning to portfolio optimisation, and discuss the extension of t… ▽ More This contribution to the proceedings of the Cracow meeting on `Applications of Random Matrix Theory' summarizes a series of studies, some old and others more recent on financial applications of Random Matrix Theory (RMT). We first review some early results in that field, with particular emphasis on the applications of correlation cleaning to portfolio optimisation, and discuss the extension of the Marcenko-Pastur (MP) distribution to a non trivial `true' underlying correlation matrix. We then present new results concerning different problems that arise in a financial context: (a) the generalisation of the MP result to the case of an empirical correlation matrix (ECM) constructed using exponential moving averages, for which we give a new elegant derivation (b) the specific dynamics of the `market' eigenvalue and its associated eigenvector, which defines an interesting Ornstein-Uhlenbeck process on the unit sphere and (c) the problem of the dependence of ECM's on the observation frequency of the returns and its interpretation in terms of lagged cross-influences. △ Less

Submitted 14 July, 2005; originally announced July 2005.

Comments: Proceedings of the Cracow conference on `Applications of Random Matrix Theory to Economy and Other Complex Systems'

Random walks, liquidity molasses and critical response in financial markets

Authors: J. -P. Bouchaud, J. Kockelkoren, M. Potters

Abstract: Stock prices are observed to be random walks in time despite a strong, long term memory in the signs of trades (buys or sells). Lillo and Farmer have recently suggested that these correlations are compensated by opposite long ranged fluctuations in liquidity, with an otherwise permanent market impact, challenging the scenario proposed in Quantitative Finance 4, 176 (2004), where the impact is *t… ▽ More Stock prices are observed to be random walks in time despite a strong, long term memory in the signs of trades (buys or sells). Lillo and Farmer have recently suggested that these correlations are compensated by opposite long ranged fluctuations in liquidity, with an otherwise permanent market impact, challenging the scenario proposed in Quantitative Finance 4, 176 (2004), where the impact is *transient*, with a power-law decay in time. The exponent of this decay is precisely tuned to a critical value, ensuring simultaneously that prices are diffusive on long time scales and that the response function is nearly constant. We provide new analysis of empirical data that confirm and make more precise our previous claims. We show that the power-law decay of the bare impact function comes both from an excess flow of limit order opposite to the market order flow, and to a systematic anti-correlation of the bid-ask motion between trades, two effects that create a `liquidity molasses' which dampens market volatility. △ Less

Submitted 10 June, 2004; v1 submitted 9 June, 2004; originally announced June 2004.

Comments: 18 Pages, 11 Figures, 2 Tables, 3 spurious figures removed

Exponential Weighting and Random-Matrix-Theory-Based Filtering of Financial Covariance Matrices for Portfolio Optimization

Authors: Szilard Pafka, Marc Potters, Imre Kondor

Abstract: We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence measurement noise) via techniques borrowed from random matrix theory. We calculate the spectrum of large exponentially weighted random matrices (whose upper ban… ▽ More We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence measurement noise) via techniques borrowed from random matrix theory. We calculate the spectrum of large exponentially weighted random matrices (whose upper band edge needs to be known for the implementation of the estimation) analytically, by a procedure analogous to that used for standard random matrices. Finally, we illustrate, on empirical data, the superiority of the newly introduced estimator in a portfolio optimization context over both the method of exponentially weighted moving averages and the uniformly-weighted random-matrix-theory-based filtering. △ Less

Submitted 24 February, 2004; originally announced February 2004.

Fluctuations and response in financial markets: the subtle nature of `random' price changes

Authors: Jean-Philippe Bouchaud, Yuval Gefen, Marc Potters, Matthieu Wyart

Abstract: Using Trades and Quotes data from the Paris stock market, we show that the random walk nature of traded prices results from a very delicate interplay between two opposite tendencies: long-range correlated market orders that lead to super-diffusion (or persistence), and mean reverting limit orders that lead to sub-diffusion (or anti-persistence). We define and study a model where the price, at an… ▽ More Using Trades and Quotes data from the Paris stock market, we show that the random walk nature of traded prices results from a very delicate interplay between two opposite tendencies: long-range correlated market orders that lead to super-diffusion (or persistence), and mean reverting limit orders that lead to sub-diffusion (or anti-persistence). We define and study a model where the price, at any instant, is the result of the impact of all past trades, mediated by a non constant `propagator' in time that describes the response of the market to a single trade. Within this model, the market is shown to be, in a precise sense, at a critical point, where the price is purely diffusive and the average response function almost constant. We find empirically, and discuss theoretically, a fluctuation-response relation. We also discuss the fraction of truly informed market orders, that correctly anticipate short term moves, and find that it is quite small. △ Less

Submitted 25 August, 2003; v1 submitted 14 July, 2003; originally announced July 2003.

Journal ref: Quantitative Finance 4 (April 2004) 176-190

Comment on: "Two-phase behaviour of financial markets"

Authors: M. Potters, J-P Bouchaud

Abstract: In a recent article [Nature 421, 130 (2003)], Plerou, Gopikrishnan and Stanley report some evidence for an intriguing two-phase behavior of financial markets when studying the distribution of volume imbalance conditional to the local intensity of its fluctuations. We show here that this apparent phase transition is a generic consequence of the conditioning and exists even in the absence of any n… ▽ More In a recent article [Nature 421, 130 (2003)], Plerou, Gopikrishnan and Stanley report some evidence for an intriguing two-phase behavior of financial markets when studying the distribution of volume imbalance conditional to the local intensity of its fluctuations. We show here that this apparent phase transition is a generic consequence of the conditioning and exists even in the absence of any non trivial collective phenomenon. △ Less

Submitted 23 April, 2003; originally announced April 2003.

More statistical properties of order books and price impact

Authors: Marc Potters, Jean-Philippe Bouchaud

Abstract: We investigate present some new statistical properties of order books. We analyse data from the Nasdaq and investigate (a) the statistics of incoming limit order prices, (b) the shape of the average order book, and (c) the typical life time of a limit order as a function of the distance from the best price. We also determine the `price impact' function using French and British stocks, and find a… ▽ More We investigate present some new statistical properties of order books. We analyse data from the Nasdaq and investigate (a) the statistics of incoming limit order prices, (b) the shape of the average order book, and (c) the typical life time of a limit order as a function of the distance from the best price. We also determine the `price impact' function using French and British stocks, and find a logarithmic, rather than a power-law, dependence of the price response on the volume. The weak time dependence of the response function shows that the impact is, surprisingly, quasi-permanent, and suggests that trading itself is interpreted by the market as new information. △ Less

Submitted 31 October, 2002; originally announced October 2002.

Comments: Proceedings of the Bali conference of Econophysics, to appear in Physica A

Reply to Johansen's comment

Authors: Laurent Laloux, Marc Potters, Jean-Pierre Aguilar, Jean-Philippe Bouchaud

Abstract: This is a reply to Johansen's comment on `Are Financial Crashes Predictable?', by L. Laloux, M. Potters, R. Cont, J.P. Aguilar, J.P. Bouchaud, Europhys. Lett. 45, p. 1 (1999). This is a reply to Johansen's comment on `Are Financial Crashes Predictable?', by L. Laloux, M. Potters, R. Cont, J.P. Aguilar, J.P. Bouchaud, Europhys. Lett. 45, p. 1 (1999). △ Less

Submitted 19 June, 2002; originally announced June 2002.

Comments: 2 pages, submitted to Europhys. Lett

Statistical properties of stock order books: empirical results and models

Authors: J. -P. Bouchaud, M. Mezard, M. Potters

Abstract: We investigate several statistical properties of the order book of three liquid stocks of the Paris Bourse. The results are to a large degree independent of the stock studied. The most interesting features concern (i) the statistics of incoming limit order prices, which follows a power-law around the current price with a diverging mean; and (ii) the humped shape of the average order book, which… ▽ More We investigate several statistical properties of the order book of three liquid stocks of the Paris Bourse. The results are to a large degree independent of the stock studied. The most interesting features concern (i) the statistics of incoming limit order prices, which follows a power-law around the current price with a diverging mean; and (ii) the humped shape of the average order book, which can be quantitatively reproduced using a `zero intelligence' numerical model, and qualitatively predicted using a simple approximation. △ Less

Submitted 18 June, 2002; v1 submitted 25 March, 2002; originally announced March 2002.

Comments: Revised version, 10 pages, 4 .eps figures. to appear in Quantitative Finance

Journal ref: Quantitative Finance 2 251-256 (2002).

Introducing Variety in Risk Management

Authors: Fabrizio Lillo, Rosario N. Mantegna, Jean-Philippe Bouchaud, Marc Potters

Abstract: We review the recently introduced concept of variety of a financial portfolio and we sketch its importance for risk control purposes. The empirical behaviour of variety, correlation, exceedance correlation and asymmetry of the probability density function of daily returns is discussed. The results obtained are compared with the ones of a one-factor model showing strengths and limitations of this… ▽ More We review the recently introduced concept of variety of a financial portfolio and we sketch its importance for risk control purposes. The empirical behaviour of variety, correlation, exceedance correlation and asymmetry of the probability density function of daily returns is discussed. The results obtained are compared with the ones of a one-factor model showing strengths and limitations of this model. △ Less

Submitted 10 July, 2001; originally announced July 2001.

Comments: 12 pages, 5 figures, to appear in Risk

The leverage effect in financial markets: retarded volatility and market panic

Authors: Jean-Philippe Bouchaud, Andrew Matacz, Marc Potters

Abstract: We investigate quantitatively the so-called leverage effect, which corresponds to a negative correlation between past returns and future volatility. For individual stocks, this correlation is moderate and decays exponentially over 50 days, while for stock indices, it is much stronger but decays faster. For individual stocks, the magnitude of this correlation has a universal value that can be rat… ▽ More We investigate quantitatively the so-called leverage effect, which corresponds to a negative correlation between past returns and future volatility. For individual stocks, this correlation is moderate and decays exponentially over 50 days, while for stock indices, it is much stronger but decays faster. For individual stocks, the magnitude of this correlation has a universal value that can be rationalized in terms of a new `retarded' model which interpolates between a purely additive and a purely multiplicative stochastic process. For stock indices a specific market panic phenomenon seems to be necessary to account for the observed amplitude of the effect. △ Less

Submitted 16 January, 2001; v1 submitted 9 January, 2001; originally announced January 2001.

Comments: Corrected word inversion in abstract (should read: past returns and future volatility). LaTeX, 12 pp, 2 figures

Journal ref: Physical Review Letters 87(22), 228701 (2001)

Option Pricing and Hedging with Temporal Correlations

Authors: Lorenzo Cornalba, Jean-Philippe Bouchaud, Marc Potters

Abstract: We consider the problem of option pricing and hedging when stock returns are correlated in time. Within a quadratic-risk minimisation scheme, we obtain a general formula, valid for weakly correlated non-Gaussian processes. We show that for Gaussian price increments, the correlations are irrelevant, and the Black-Scholes formula holds with the volatility of the price increments on the scale of th… ▽ More We consider the problem of option pricing and hedging when stock returns are correlated in time. Within a quadratic-risk minimisation scheme, we obtain a general formula, valid for weakly correlated non-Gaussian processes. We show that for Gaussian price increments, the correlations are irrelevant, and the Black-Scholes formula holds with the volatility of the price increments on the scale of the re-hedging. For non-Gaussian processes, further non trivial corrections to the `smile' are brought about by the correlations, even when the hedge is the Black-Scholes Delta-hedge. We introduce a compact notation which eases the computations and could be of use to deal with more complicated models. △ Less

Submitted 29 November, 2000; originally announced November 2000.

Comments: LaTeX, 15 pp, no figure

Journal ref: International Journal of Theoretical and Applied Finance 5 (3) (2002) 307-320

Hedged Monte-Carlo: low variance derivative pricing with objective probabilities

Authors: Marc Potters, Jean-Philippe Bouchaud, Dragan Sestovic

Abstract: We propose a new `hedged' Monte-Carlo (HMC) method to price financial derivatives, which allows to determine simultaneously the optimal hedge. The inclusion of the optimal hedging strategy allows one to reduce the financial risk associated with option trading, and for the very same reason reduces considerably the variance of our HMC scheme as compared to previous methods. The explicit accounting… ▽ More We propose a new `hedged' Monte-Carlo (HMC) method to price financial derivatives, which allows to determine simultaneously the optimal hedge. The inclusion of the optimal hedging strategy allows one to reduce the financial risk associated with option trading, and for the very same reason reduces considerably the variance of our HMC scheme as compared to previous methods. The explicit accounting of the hedging cost naturally converts the objective probability into the `risk-neutral' one. This allows a consistent use of purely historical time series to price derivatives and obtain their residual risk. The method can be used to price a large class of exotic options, including those with path dependent and early exercise features. △ Less

Submitted 9 August, 2000; originally announced August 2000.

Comments: LaTeX, 10 pp, 3 eps figures (in text)

Journal ref: Physica A 289 (3-4) (2001) pp. 517-525.

Correlation structure of extreme stock returns

Authors: Pierre Cizeau, Marc Potters, Jean-Philippe Bouchaud

Abstract: It is commonly believed that the correlations between stock returns increase in high volatility periods. We investigate how much of these correlations can be explained within a simple non-Gaussian one-factor description with time independent correlations. Using surrogate data with the true market return as the dominant factor, we show that most of these correlations, measured by a variety of dif… ▽ More It is commonly believed that the correlations between stock returns increase in high volatility periods. We investigate how much of these correlations can be explained within a simple non-Gaussian one-factor description with time independent correlations. Using surrogate data with the true market return as the dominant factor, we show that most of these correlations, measured by a variety of different indicators, can be accounted for. In particular, this one-factor model can explain the level and asymmetry of empirical exceedance correlations. However, more subtle effects require an extension of the one factor model, where the variance and skewness of the residuals also depend on the market return. △ Less

Submitted 22 January, 2001; v1 submitted 2 June, 2000; originally announced June 2000.

Comments: Substantial rewriting. Added exceedance correlations, removed some confusing material. To appear in Quantitative Finance

Journal ref: Quantitative Finance 1 217-222 (2001)

Worse fluctuation method for fast Value-at-Risk estimates

Authors: Jean-Philippe Bouchaud, Marc Potters

Abstract: We show how one can actually take advantage of the strongly non-Gaussian nature of the fluctuations of financial assets to simplify the calculation of the Value-at-Risk of complex non linear portfolios. The resulting equations are not hard to solve numerically, and should allow fast VaR and $Δ$VaR estimates of large portfolios, where {\it by construction} the influence of rare events is taken in… ▽ More We show how one can actually take advantage of the strongly non-Gaussian nature of the fluctuations of financial assets to simplify the calculation of the Value-at-Risk of complex non linear portfolios. The resulting equations are not hard to solve numerically, and should allow fast VaR and $Δ$VaR estimates of large portfolios, where {\it by construction} the influence of rare events is taken into account reliably. Our method can be seen as a correctly probabilized `scenario' calculation (or `stress-testing'). △ Less

Submitted 16 September, 1999; originally announced September 1999.

Comments: LaTeX no figures

Apparent multifractality in financial time series

Authors: Jean-Philippe Bouchaud, Marc Potters, Martin Meyer

Abstract: We present a exactly soluble model for financial time series that mimics the long range volatility correlations known to be present in financial data. Although our model is `monofractal' by construction, it shows apparent multiscaling as a result of a slow crossover phenomenon on finite time scales. Our results suggest that it might be hard to distinguish apparent and true multifractal behavior… ▽ More We present a exactly soluble model for financial time series that mimics the long range volatility correlations known to be present in financial data. Although our model is `monofractal' by construction, it shows apparent multiscaling as a result of a slow crossover phenomenon on finite time scales. Our results suggest that it might be hard to distinguish apparent and true multifractal behavior in financial data. Our model also leads to a new family of stable laws for sums of correlated random variables. △ Less

Submitted 23 June, 1999; originally announced June 1999.

Comments: Latex 9 pp with 3 postscript figures (in-text)

Theory of Financial Risk: Basic notions in probability

Authors: Jean-Philippe Bouchaud, Marc Potters

Abstract: Risk control has become one of the major concern of financial institutions. The need for adequate statistical tools to measure and anticipate the amplitude of the potential moves of financial markets is clearly expressed, in particular for derivative markets. Classical theories, however, are based on simplified assumptions -- such as Gaussian statistics -- and lead to a systematic (and sometimes… ▽ More Risk control has become one of the major concern of financial institutions. The need for adequate statistical tools to measure and anticipate the amplitude of the potential moves of financial markets is clearly expressed, in particular for derivative markets. Classical theories, however, are based on simplified assumptions -- such as Gaussian statistics -- and lead to a systematic (and sometimes dramatic) underestimation of real risks. We summarize a few basic notions in probability theory which are useful in a financial context: Statistics of Extremes, Sums of Random Variables, Central Limit Theorems and Deviations, Correlations and Dependence, and a brief introduction to Random Matrix Theory. This self-contained text corresponds to the first chapter of our book, `Theory of Financial Risk'. △ Less

Submitted 27 May, 1999; originally announced May 1999.

Comments: 50 pages, LaTeX + 10 EPS figures

Noise Dressing of Financial Correlation Matrices

Authors: Laurent Laloux, Pierre Cizeau, Jean-Philippe Bouchaud, Marc Potters

Abstract: We show that results from the theory of random matrices are potentially of great interest to understand the statistical structure of the empirical correlation matrices appearing in the study of price fluctuations. The central result of the present study is the remarkable agreement between the theoretical prediction (based on the assumption that the correlation matrix is random) and empirical dat… ▽ More We show that results from the theory of random matrices are potentially of great interest to understand the statistical structure of the empirical correlation matrices appearing in the study of price fluctuations. The central result of the present study is the remarkable agreement between the theoretical prediction (based on the assumption that the correlation matrix is random) and empirical data concerning the density of eigenvalues associated to the time series of the different stocks of the S&P500 (or other major markets). In particular the present study raises serious doubts on the blind use of empirical correlation matrices for risk management. △ Less

Submitted 20 October, 1998; originally announced October 1998.

Comments: Latex (Revtex) 3 pp + 2 postscript figures (in-text)

Journal ref: Physical Review Letters 83(7), 1467 (1999)

Back to basics: historical option pricing revisited

Authors: Jean-Philippe Bouchaud, Marc Potters

Abstract: We reconsider the problem of option pricing using historical probability distributions. We first discuss how the risk-minimisation scheme proposed recently is an adequate starting point under the realistic assumption that price increments are uncorrelated (but not necessarily independent) and of arbitrary probability density. We discuss in particular how, in the Gaussian limit, the Black-Scholes… ▽ More We reconsider the problem of option pricing using historical probability distributions. We first discuss how the risk-minimisation scheme proposed recently is an adequate starting point under the realistic assumption that price increments are uncorrelated (but not necessarily independent) and of arbitrary probability density. We discuss in particular how, in the Gaussian limit, the Black-Scholes results are recovered, including the fact that the average return of the underlying stock disappears from the price (and the hedging strategy). We compare this theory to real option prices and find these reflect in a surprisingly accurate way the subtle statistical features of the underlying asset fluctuations. △ Less

Submitted 19 August, 1998; originally announced August 1998.

Comments: 14 pages, 2 .ps figures. Proceedings, to appear in Proc. Roy. Soc

Are Financial Crashes Predictable?

Authors: Laurent Laloux, Marc Potters, Rama Cont, Jean-Pierre Aguilar, Jean-Philippe Bouchaud

Abstract: We critically review recent claims that financial crashes can be predicted using the idea of log-periodic oscillations or by other methods inspired by the physics of critical phenomena. In particular, the October 1997 `correction' does not appear to be the accumulation point of a geometric series of local minima. We critically review recent claims that financial crashes can be predicted using the idea of log-periodic oscillations or by other methods inspired by the physics of critical phenomena. In particular, the October 1997 `correction' does not appear to be the accumulation point of a geometric series of local minima. △ Less

Submitted 9 April, 1998; originally announced April 1998.

Comments: LaTeX, 5 pages + 1 postscript figure

Rational Decisions, Random Matrices and Spin Glasses

Authors: Stefano Galluccio, Jean-Philippe Bouchaud, Marc Potters

Abstract: We consider the problem of rational decision making in the presence of nonlinear constraints. By using tools borrowed from spin glass and random matrix theory, we focus on the portfolio optimisation problem. We show that the number of ``optimal'' solutions is generically exponentially large: rationality is thus de facto of limited use. In addition, this problem is related to spin glasses with Lé… ▽ More We consider the problem of rational decision making in the presence of nonlinear constraints. By using tools borrowed from spin glass and random matrix theory, we focus on the portfolio optimisation problem. We show that the number of ``optimal'' solutions is generically exponentially large: rationality is thus de facto of limited use. In addition, this problem is related to spin glasses with Lévy-like (long-ranged) couplings, for which we show that the ground state is not exponentially degenerate. △ Less

Submitted 21 January, 1998; originally announced January 1998.

Phenomenology of the Interest Rate Curve

Authors: J. -P. Bouchaud, N. Sagna, R. Cont, N. El-Karoui, M. Potters

Abstract: This paper contains a phenomenological description of the whole U.S. forward rate curve (FRC), based on an data in the period 1990-1996. We find that the average FRC (measured from the spot rate) grows as the square-root of the maturity, with a prefactor which is comparable to the spot rate volatility. This suggests that forward rate market prices include a risk premium, comparable to the probab… ▽ More This paper contains a phenomenological description of the whole U.S. forward rate curve (FRC), based on an data in the period 1990-1996. We find that the average FRC (measured from the spot rate) grows as the square-root of the maturity, with a prefactor which is comparable to the spot rate volatility. This suggests that forward rate market prices include a risk premium, comparable to the probable changes of the spot rate between now and maturity, which can be understood as a `Value-at-Risk' type of pricing. The instantaneous FRC however departs form a simple square-root law. The distortion is maximum around one year, and reflects the market anticipation of a local trend on the spot rate. This anticipated trend is shown to be calibrated on the past behaviour of the spot itself. We show that this is consistent with the volatility `hump' around one year found by several authors (and which we confirm). Finally, the number of independent components needed to interpret most of the FRC fluctuations is found to be small. We rationalize this by showing that the dynamical evolution of the FRC contains a stabilizing second derivative (line tension) term, which tends to suppress short scale distortions of the FRC. This shape dependent term could lead, in principle, to arbitrage. However, this arbitrage cannot be implemented in practice because of transaction costs. We suggest that the presence of transaction costs (or other market `imperfections') is crucial for model building, for a much wider class of models becomes eligible to represent reality. △ Less

Submitted 15 December, 1997; originally announced December 1997.

Comments: 34 LaTeX pages and 11 .ps figures

Missing Information and Asset Allocation

Authors: Jean-Philippe Bouchaud, Marc Potters, Jean-Pierre Aguilar

Abstract: When the available statistical information is imperfect, it is dangerous to follow standard optimisation procedures to construct an optimal portfolio, which usually leads to a strong concentration of the weights on very few assets. We propose a new way, based on generalised entropies, to ensure a minimal degree of diversification. When the available statistical information is imperfect, it is dangerous to follow standard optimisation procedures to construct an optimal portfolio, which usually leads to a strong concentration of the weights on very few assets. We propose a new way, based on generalised entropies, to ensure a minimal degree of diversification. △ Less

Submitted 4 July, 1997; originally announced July 1997.

Comments: LaTeX 5 pages + 1 eps figure

Scaling in stock market data: stable laws and beyond

Authors: Rama Cont, Marc Potters, Jean-Philippe Bouchaud

Abstract: The concepts of scale invariance, self-similarity and scaling have been fruitfully applied to the study of price fluctuations in financial markets. After a brief review of the properties of stable Levy distributions and their applications to market data we indicate the shortcomings of such models and describe the truncated Levy flight as an alternative model for price movements. Furthermore, stu… ▽ More The concepts of scale invariance, self-similarity and scaling have been fruitfully applied to the study of price fluctuations in financial markets. After a brief review of the properties of stable Levy distributions and their applications to market data we indicate the shortcomings of such models and describe the truncated Levy flight as an alternative model for price movements. Furthermore, studying the dependence structure of the price increments shows that while their autocorrelation function decreases rapidly to zero, the correlation of their squares and absolute values shows a slow power law decay, indicating persistence in the scale of fluctuations, a property which can be related to the anomalous scaling of the kurtosis. In the last section we review, in the light of these empirical facts, recent attempts to draw analogies between scaling in financial markets and in turbulent flows. △ Less

Submitted 9 May, 1997; originally announced May 1997.

Comments: Lecture given at Les Houches Workshop on Scale Invariance (March 1997). Plain TEX file, macros included. 11 pages, including 7 postscript figures

Journal ref: Scale Invariance and Beyond (proceedings of the CNRS Workshop on Scale Invariance, Les Houches, March 1997)

Financial markets as adaptative ecosystems

Authors: Marc Potters, Rama Cont, Jean-Philippe Bouchaud

Abstract: We show, by studying in detail the market prices of options on liquid markets, that the market has empirically corrected the simple, but inadequate Black-Scholes formula to account for two important statistical features of asset fluctuations: `fat tails' and correlations in the scale of fluctuations. These aspects, although not included in the pricing models, are very precisely reflected in the… ▽ More We show, by studying in detail the market prices of options on liquid markets, that the market has empirically corrected the simple, but inadequate Black-Scholes formula to account for two important statistical features of asset fluctuations: `fat tails' and correlations in the scale of fluctuations. These aspects, although not included in the pricing models, are very precisely reflected in the price fixed by the market as a whole. Financial markets thus behave as rather efficient adaptive systems. △ Less

Submitted 18 June, 1997; v1 submitted 18 September, 1996; originally announced September 1996.

Comments: Revised version, 1 figure added

Comment on ``Turbulent cascades in foreign exchange markets''

Authors: Alain Arneodo, Jean-Philippe Bouchaud, Rama Cont, Jean-Francois Muzy, Marc Potters, Didier Sornette, .

Abstract: Recently, Ghashghaie et al. have shown that some statistical aspects of fully developed turbulence and exchange rate fluctuations exhibit striking similarities (Nature 381, 767 (1996)). The authors then suggested that the two problems might be deeply connected, and speculated on the existence of an `information cascade' which would play the role in finance of the well known Kolmogorov energy cas… ▽ More Recently, Ghashghaie et al. have shown that some statistical aspects of fully developed turbulence and exchange rate fluctuations exhibit striking similarities (Nature 381, 767 (1996)). The authors then suggested that the two problems might be deeply connected, and speculated on the existence of an `information cascade' which would play the role in finance of the well known Kolmogorov energy cascade in turbulence. Here we want to convince the reader that the two problems differ on a fundamental aspect, namely, correlations. △ Less

Submitted 17 July, 1996; originally announced July 1996.

Comments: LaTeX, 4 pages + 2 postscript figures, submitted to Nature

On the number of metastable states in spin glasses

Authors: Giorgio Parisi, Marc Potters

Abstract: In this letter, we show that the formulae of Bray and Moore for the average logarithm of the number of metastable states in spin glasses can be obtained by calculating the partition function with $m$ coupled replicas with the symmetry among these explicitly broken according to a generalization of the `two-group' ansatz. This equivalence allows us to find solutions of the BM equations where the l… ▽ More In this letter, we show that the formulae of Bray and Moore for the average logarithm of the number of metastable states in spin glasses can be obtained by calculating the partition function with $m$ coupled replicas with the symmetry among these explicitly broken according to a generalization of the `two-group' ansatz. This equivalence allows us to find solutions of the BM equations where the lower `band-edge' free energy equals the standard static free energy. We present these results for the Sherrington-Kirkpatrick model, but we expect them to apply to all mean-field spin glasses. △ Less

Submitted 12 June, 1995; originally announced June 1995.

Comments: 6 pages, LaTeX, no figures. Postscript directly available http://chimera.roma1.infn.it/index_papers_complex.html

Mean-Field Equations for Spin Models with Orthogonal Interaction Matrices

Authors: Giorgio Parisi, Marc Potters

Abstract: We study the metastable states in Ising spin models with orthogonal interaction matrices. We focus on three realizations of this model, the random case and two non-random cases, i.e.\ the fully-frustrated model on an infinite dimensional hypercube and the so-called sine-model. We use the mean-field (or {\sc tap}) equations which we derive by resuming the high-temperature expansion of the Gibbs f… ▽ More We study the metastable states in Ising spin models with orthogonal interaction matrices. We focus on three realizations of this model, the random case and two non-random cases, i.e.\ the fully-frustrated model on an infinite dimensional hypercube and the so-called sine-model. We use the mean-field (or {\sc tap}) equations which we derive by resuming the high-temperature expansion of the Gibbs free energy. In some special non-random cases, we can find the absolute minimum of the free energy. For the random case we compute the average number of solutions to the {\sc tap} equations. We find that the configurational entropy (or complexity) is extensive in the range $T_{\mbox{\tiny RSB}}<T<T_{\mbox{\tiny M}}$. Finally we present an apparently unrelated replica calculation which reproduces the analytical expression for the total number of {\sc tap} solutions. △ Less

Submitted 27 March, 1995; v1 submitted 1 March, 1995; originally announced March 1995.

Comments: 22+3 pages, section 5 slightly modified, 1 Ref added, LaTeX and uuencoded figures now independent of each other (easier to print). Postscript available http://chimera.roma1.infn.it/index_papers_complex.html

Journal ref: J Phys A (Math Gen) 28, 5267-5285 (1995)

Statistical Mechanics and Visual Signal Processing

Authors: Marc Potters, William Bialek

Abstract: The nervous system solves a wide variety of problems in signal processing. In many cases the performance of the nervous system is so good that it apporaches fundamental physical limits, such as the limits imposed by diffraction and photon shot noise in vision. In this paper we show how to use the language of statistical field theory to address and solve problems in signal processing, that is pro… ▽ More The nervous system solves a wide variety of problems in signal processing. In many cases the performance of the nervous system is so good that it apporaches fundamental physical limits, such as the limits imposed by diffraction and photon shot noise in vision. In this paper we show how to use the language of statistical field theory to address and solve problems in signal processing, that is problems in which one must estimate some aspect of the environment from the data in an array of sensors. In the field theory formulation the optimal estimator can be written as an expectation value in an ensemble where the input data act as external field. Problems at low signal-to-noise ratio can be solved in perturbation theory, while high signal-to-noise ratios are treated with a saddle-point approximation. These ideas are illustrated in detail by an example of visual motion estimation which is chosen to model a problem solved by the fly's brain. In this problem the optimal estimator has a rich structure, adapting to various parameters of the environment such as the mean-square contrast and the correlation time of contrast fluctuations. This structure is in qualitative accord with existing measurements on motion sensitive neurons in the fly's brain, and we argue that the adaptive properties of the optimal estimator may help resolve conlficts among different interpretations of these data. Finally we propose some crucial direct tests of the adaptive behavior. △ Less

Submitted 30 January, 1994; originally announced January 1994.

Comments: 34pp, LaTeX, PUPT-1435

Journal ref: J. Phys. I France (1994) 1755-1775