-
Reinforcement-Learning Portfolio Allocation with Dynamic Embedding of Market Information
Authors:
Jinghai He,
Cheng Hua,
Chunyang Zhou,
Zeyu Zheng
Abstract:
We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding method that reduces the non-stationary, high-dimensional state space into a lower-dimensional representation. We design a reinforcement learning (RL) framework t…
▽ More
We develop a portfolio allocation framework that leverages deep learning techniques to address challenges arising from high-dimensional, non-stationary, and low-signal-to-noise market information. Our approach includes a dynamic embedding method that reduces the non-stationary, high-dimensional state space into a lower-dimensional representation. We design a reinforcement learning (RL) framework that integrates generative autoencoders and online meta-learning to dynamically embed market information, enabling the RL agent to focus on the most impactful parts of the state space for portfolio allocation decisions. Empirical analysis based on the top 500 U.S. stocks demonstrates that our framework outperforms common portfolio benchmarks and the predict-then-optimize (PTO) approach using machine learning, particularly during periods of market stress. Traditional factor models do not fully explain this superior performance. The framework's ability to time volatility reduces its market exposure during turbulent times. Ablation studies confirm the robustness of this performance across various reinforcement learning algorithms. Additionally, the embedding and meta-learning techniques effectively manage the complexities of high-dimensional, noisy, and non-stationary financial data, enhancing both portfolio performance and risk management.
△ Less
Submitted 29 January, 2025;
originally announced January 2025.
-
Limit Order Book Event Stream Prediction with Diffusion Model
Authors:
Zetao Zheng,
Guoan Li,
Deqiang Ouyang,
Decui Liang,
Jie Shao
Abstract:
Limit order book (LOB) is a dynamic, event-driven system that records real-time market demand and supply for a financial asset in a stream flow. Event stream prediction in LOB refers to forecasting both the timing and the type of events. The challenge lies in modeling the time-event distribution to capture the interdependence between time and event type, which has traditionally relied on stochasti…
▽ More
Limit order book (LOB) is a dynamic, event-driven system that records real-time market demand and supply for a financial asset in a stream flow. Event stream prediction in LOB refers to forecasting both the timing and the type of events. The challenge lies in modeling the time-event distribution to capture the interdependence between time and event type, which has traditionally relied on stochastic point processes. However, modeling complex market dynamics using stochastic processes, e.g., Hawke stochastic process, can be simplistic and struggle to capture the evolution of market dynamics. In this study, we present LOBDIF (LOB event stream prediction with diffusion model), which offers a new paradigm for event stream prediction within the LOB system. LOBDIF learns the complex time-event distribution by leveraging a diffusion model, which decomposes the time-event distribution into sequential steps, with each step represented by a Gaussian distribution. Additionally, we propose a denoising network and a skip-step sampling strategy. The former facilitates effective learning of time-event interdependence, while the latter accelerates the sampling process during inference. By introducing a diffusion model, our approach breaks away from traditional modeling paradigms, offering novel insights and providing an effective and efficient solution for learning the time-event distribution in order streams within the LOB system. Extensive experiments using real-world data from the limit order books of three widely traded assets confirm that LOBDIF significantly outperforms current state-of-the-art methods.
△ Less
Submitted 27 November, 2024;
originally announced December 2024.
-
Can Perturbations Help Reduce Investment Risks? Risk-Aware Stock Recommendation via Split Variational Adversarial Training
Authors:
Jiezhu Cheng,
Kaizhu Huang,
Zibin Zheng
Abstract:
In the stock market, a successful investment requires a good balance between profits and risks. Based on the learning to rank paradigm, stock recommendation has been widely studied in quantitative finance to recommend stocks with higher return ratios for investors. Despite the efforts to make profits, many existing recommendation approaches still have some limitations in risk control, which may le…
▽ More
In the stock market, a successful investment requires a good balance between profits and risks. Based on the learning to rank paradigm, stock recommendation has been widely studied in quantitative finance to recommend stocks with higher return ratios for investors. Despite the efforts to make profits, many existing recommendation approaches still have some limitations in risk control, which may lead to intolerable paper losses in practical stock investing. To effectively reduce risks, we draw inspiration from adversarial learning and propose a novel Split Variational Adversarial Training (SVAT) method for risk-aware stock recommendation. Essentially, SVAT encourages the stock model to be sensitive to adversarial perturbations of risky stock examples and enhances the model's risk awareness by learning from perturbations. To generate representative adversarial examples as risk indicators, we devise a variational perturbation generator to model diverse risk factors. Particularly, the variational architecture enables our method to provide a rough risk quantification for investors, showing an additional advantage of interpretability. Experiments on several real-world stock market datasets demonstrate the superiority of our SVAT method. By lowering the volatility of the stock recommendation model, SVAT effectively reduces investment risks and outperforms state-of-the-art baselines by more than 30% in terms of risk-adjusted profits. All the experimental data and source code are available at https://drive.google.com/drive/folders/14AdM7WENEvIp5x5bV3zV_i4Aev21C9g6?usp=sharing.
△ Less
Submitted 26 January, 2024; v1 submitted 20 April, 2023;
originally announced April 2023.
-
Towards Multi-Agent Reinforcement Learning driven Over-The-Counter Market Simulations
Authors:
Nelson Vadori,
Leo Ardon,
Sumitra Ganesh,
Thomas Spooner,
Selim Amrouni,
Jared Vann,
Mengda Xu,
Zeyu Zheng,
Tucker Balch,
Manuela Veloso
Abstract:
We study a game between liquidity provider and liquidity taker agents interacting in an over-the-counter market, for which the typical example is foreign exchange. We show how a suitable design of parameterized families of reward functions coupled with shared policy learning constitutes an efficient solution to this problem. By playing against each other, our deep-reinforcement-learning-driven age…
▽ More
We study a game between liquidity provider and liquidity taker agents interacting in an over-the-counter market, for which the typical example is foreign exchange. We show how a suitable design of parameterized families of reward functions coupled with shared policy learning constitutes an efficient solution to this problem. By playing against each other, our deep-reinforcement-learning-driven agents learn emergent behaviors relative to a wide spectrum of objectives encompassing profit-and-loss, optimal execution and market share. In particular, we find that liquidity providers naturally learn to balance hedging and skewing, where skewing refers to setting their buy and sell prices asymmetrically as a function of their inventory. We further introduce a novel RL-based calibration algorithm which we found performed well at imposing constraints on the game equilibrium. On the theoretical side, we are able to show convergence rates for our multi-agent policy gradient algorithm under a transitivity assumption, closely related to generalized ordinal potential games.
△ Less
Submitted 1 August, 2023; v1 submitted 13 October, 2022;
originally announced October 2022.
-
Stochastic arbitrage with market index options
Authors:
Brendan K. Beare,
Juwon Seo,
Zhongxi Zheng
Abstract:
Opportunities for stochastic arbitrage in an options market arise when it is possible to construct a portfolio of options which provides a positive option premium and which, when combined with a direct investment in the underlying asset, generates a payoff which stochastically dominates the payoff from the direct investment in the underlying asset. We provide linear and mixed-integer linear progra…
▽ More
Opportunities for stochastic arbitrage in an options market arise when it is possible to construct a portfolio of options which provides a positive option premium and which, when combined with a direct investment in the underlying asset, generates a payoff which stochastically dominates the payoff from the direct investment in the underlying asset. We provide linear and mixed-integer linear programs for computing the stochastic arbitrage opportunity providing the maximum option premium to an investor. We apply our programs to 18 years of data on monthly put and call options on the Standard & Poors 500 index, finding no evidence that stochastic arbitrage opportunities are systematically present. A skewed specification of the underlying market return distribution with a constant market risk premium and constant multiplicative variance risk premium is broadly consistent with the pricing of market index options at moderate strikes.
△ Less
Submitted 22 January, 2025; v1 submitted 3 July, 2022;
originally announced July 2022.
-
Market Manipulation of Bitcoin: Evidence from Mining the Mt. Gox Transaction Network
Authors:
Weili Chen,
Jun Wu,
Zibin Zheng,
Chuan Chen,
Yuren Zhou
Abstract:
The cryptocurrency market is a very huge market without effective supervision. It is of great importance for investors and regulators to recognize whether there are market manipulation and its manipulation patterns. This paper proposes an approach to mine the transaction networks of exchanges for answering this question.By taking the leaked transaction history of Mt. Gox Bitcoin exchange as a samp…
▽ More
The cryptocurrency market is a very huge market without effective supervision. It is of great importance for investors and regulators to recognize whether there are market manipulation and its manipulation patterns. This paper proposes an approach to mine the transaction networks of exchanges for answering this question.By taking the leaked transaction history of Mt. Gox Bitcoin exchange as a sample,we first divide the accounts into three categories according to its characteristic and then construct the transaction history into three graphs. Many observations and findings are obtained via analyzing the constructed graphs. To evaluate the influence of the accounts' transaction behavior on the Bitcoin exchange price,the graphs are reconstructed into series and reshaped as matrices. By using singular value decomposition (SVD) on the matrices, we identify many base networks which have a great correlation with the price fluctuation. When further analyzing the most important accounts in the base networks, plenty of market manipulation patterns are found. According to these findings, we conclude that there was serious market manipulation in Mt. Gox exchange and the cryptocurrency market must strengthen the supervision.
△ Less
Submitted 19 January, 2019;
originally announced February 2019.
-
The Equilibrium Statistical Model of Economic Systems using Concepts and Theorems of Statistical Physics
Authors:
Zhiwu Zheng
Abstract:
Economic systems are similar with physic systems for their large number of individuals and the exist of equilibrium. In this paper, we present a model applying the equilibrium statistical model in economic systems. Consistent with statistical physics, we define a series of concepts, such as economic temperature, economic pressure, economic potential, wealth and population. Moreover, we suggest tha…
▽ More
Economic systems are similar with physic systems for their large number of individuals and the exist of equilibrium. In this paper, we present a model applying the equilibrium statistical model in economic systems. Consistent with statistical physics, we define a series of concepts, such as economic temperature, economic pressure, economic potential, wealth and population. Moreover, we suggest that these parameters show pretty close relationship with the concepts in economy. This paper presents related concepts in the equilibrium economic model and constructs significant theorems and corollaries, which is derived from the priori possibility postulate, getting theorems including the equilibrium theorem between open systems, the distribution theorem of wealth and population along with related corollaries. More importantly, we demonstrate a method constructing optimal density of states, optimizing a macroscopic parameter depending on need to get the distribution of density of states utilizing the variation method, which is significant for the development of a society. In addition, we calculate a simple economic system as an example, indicating that the system occupied mostly by the middle class could develop stably and soundly, explaining the reason for resulting distributions of macroscopic parameters.
△ Less
Submitted 16 April, 2015;
originally announced April 2015.
-
Predicting market instability: New dynamics between volume and volatility
Authors:
Zeyu Zheng,
Zhi Qiao,
Joel N. Tenenbaum,
H. Eugene Stanley,
Baowen Li
Abstract:
Econophysics and econometrics agree that there is a correlation between volume and volatility in a time series. Using empirical data and their distributions, we further investigate this correlation and discover new ways that volatility and volume interact, particularly when the levels of both are high. We find that the distribution of the volume-conditional volatility is well fit by a power-law fu…
▽ More
Econophysics and econometrics agree that there is a correlation between volume and volatility in a time series. Using empirical data and their distributions, we further investigate this correlation and discover new ways that volatility and volume interact, particularly when the levels of both are high. We find that the distribution of the volume-conditional volatility is well fit by a power-law function with an exponential cutoff. We find that the volume-conditional volatility distribution scales with volume, and collapses these distributions to a single curve. We exploit the characteristics of the volume-volatility scatter plot to find a strong correlation between logarithmic volume and a quantity we define as local maximum volatility (LMV), which indicates the largest volatility observed in a given range of trading volumes. This finding supports our empirical analysis showing that volume is an excellent predictor of the maximum value of volatility for both same-day and near-future time periods. We also use a joint conditional probability that includes both volatility and volume to demonstrate that invoking both allows us to better predict the largest next-day volatility than invoking either one alone.
△ Less
Submitted 20 March, 2014;
originally announced March 2014.
-
Analysis of Realized Volatility in Two Trading Sessions of the Japanese Stock Market
Authors:
Tetsuya Takaishi,
Ting Ting Chen,
Zeyu Zheng
Abstract:
We analyze realized volatilities constructed using high-frequency stock data on the Tokyo Stock Exchange. In order to avoid non-trading hours issue in volatility calculations we define two realized volatilities calculated separately in the two trading sessions of the Tokyo Stock Exchange, i.e. morning and afternoon sessions. After calculating the realized volatilities at various sampling frequenci…
▽ More
We analyze realized volatilities constructed using high-frequency stock data on the Tokyo Stock Exchange. In order to avoid non-trading hours issue in volatility calculations we define two realized volatilities calculated separately in the two trading sessions of the Tokyo Stock Exchange, i.e. morning and afternoon sessions. After calculating the realized volatilities at various sampling frequencies we evaluate the bias from the microstructure noise as a function of sampling frequency. Taking into account of the bias to realized volatility we examine returns standardized by realized volatilities and confirm that price returns on the Tokyo Stock Exchange are described approximately by Gaussian time series with time-varying volatility, i.e. consistent with a mixture of distributions hypothesis.
△ Less
Submitted 22 April, 2013;
originally announced April 2013.
-
A Model of Market Limit Orders By Stochastic PDE's, Parameter Estimation, and Investment Optimization
Authors:
Zhi Zheng,
Richard B. Sowers
Abstract:
In this paper we introduce a completely continuous and time-variate model of the evolution of market limit orders based on the existence, uniqueness, and regularity of the solutions to a type of stochastic partial differential equations obtained in Zheng and Sowers (2012). In contrary to several models proposed and researched in literature, this model provides complete continuity in both time and…
▽ More
In this paper we introduce a completely continuous and time-variate model of the evolution of market limit orders based on the existence, uniqueness, and regularity of the solutions to a type of stochastic partial differential equations obtained in Zheng and Sowers (2012). In contrary to several models proposed and researched in literature, this model provides complete continuity in both time and price inherited from the stochastic PDE, and thus is particularly suitable for the cases where transactions happen in an extremely fast pace, such as those delivered by high frequency traders (HFT's).
We first elaborate the precise definition of the model with its associated parameters, and show its existence and uniqueness from the related mathematical results given a fixed set of parameters. Then we statistically derive parameter estimation schemes of the model using maximum likelihood and least mean-square-errors estimation methods under certain criteria such as AIC to accommodate to variant number of parameters . Finally as a typical economics and finance use case of the model we settle the investment optimization problem in both static and dynamic sense by analysing the stochastic (Itô) evolution of the utility function of an investor or trader who takes the model and its parameters as exogenous. Two theorems are proved which provide criteria for determining the best (limit) price and time point to make the transaction.
△ Less
Submitted 26 October, 2012;
originally announced October 2012.
-
Carbon-dioxide emissions trading and hierarchical structure in worldwide finance and commodities markets
Authors:
Zeyu Zheng,
Kazuko Yamasaki,
Joel N. Tenenbaum,
H. Eugene Stanley
Abstract:
In a highly interdependent economic world, the nature of relationships between financial entities is becoming an increasingly important area of study. Recently, many studies have shown the usefulness of minimal spanning trees (MST) in extracting interactions between financial entities. Here, we propose a modified MST network whose metric distance is defined in terms of cross-correlation coefficien…
▽ More
In a highly interdependent economic world, the nature of relationships between financial entities is becoming an increasingly important area of study. Recently, many studies have shown the usefulness of minimal spanning trees (MST) in extracting interactions between financial entities. Here, we propose a modified MST network whose metric distance is defined in terms of cross-correlation coefficient absolute values, enabling the connections between anticorrelated entities to manifest properly. We investigate 69 daily time series, comprising three types of financial assets: 28 stock market indicators, 21 currency futures, and 20 commodity futures. We show that though the resulting MST network evolves over time, the financial assets of similar type tend to have connections which are stable over time. In addition, we find a characteristic time lag between the volatility time series of the stock market indicators and those of the EU CO2 emission allowance (EUA) and crude oil futures (WTI). This time lag is given by the peak of the cross-correlation function of the volatility time series EUA (or WTI) with that of the stock market indicators, and is markedly different (>20 days) from 0, showing that the volatility of stock market indicators today can predict the volatility of EU emissions allowances and of crude oil in the near future.
△ Less
Submitted 16 August, 2013; v1 submitted 8 May, 2012;
originally announced May 2012.
-
A Top-down Model for Cash CLO
Authors:
Yadong Li,
Ziyu Zheng
Abstract:
We propose a top-down model for cash CLO. This model can consistently price cash CLO tranches both within the same deal and across different deals. Meaningful risk measures for cash CLO tranches can also be defined and computed. This method is self-consistent, easy to implement and computationally efficient. It has the potential to bring the much needed pricing transparency to the cash CLO markets…
▽ More
We propose a top-down model for cash CLO. This model can consistently price cash CLO tranches both within the same deal and across different deals. Meaningful risk measures for cash CLO tranches can also be defined and computed. This method is self-consistent, easy to implement and computationally efficient. It has the potential to bring the much needed pricing transparency to the cash CLO markets; and it could also greatly improve the risk management of cash instruments.
△ Less
Submitted 16 April, 2010;
originally announced April 2010.