-
Assessing Uncertainty in Stock Returns: A Gaussian Mixture Distribution-Based Method
Authors:
Yanlong Wang,
Jian Xu,
Shao-Lun Huang,
Danny Dongning Sun,
Xiao-Ping Zhang
Abstract:
This study seeks to advance the understanding and prediction of stock market return uncertainty through the application of advanced deep learning techniques. We introduce a novel deep learning model that utilizes a Gaussian mixture distribution to capture the complex, time-varying nature of asset return distributions in the Chinese stock market. By incorporating the Gaussian mixture distribution,…
▽ More
This study seeks to advance the understanding and prediction of stock market return uncertainty through the application of advanced deep learning techniques. We introduce a novel deep learning model that utilizes a Gaussian mixture distribution to capture the complex, time-varying nature of asset return distributions in the Chinese stock market. By incorporating the Gaussian mixture distribution, our approach effectively characterizes short-term fluctuations and non-traditional features of stock returns, such as skewness and heavy tails, that are often overlooked by traditional models. Compared to GARCH models and their variants, our method demonstrates superior performance in volatility estimation, particularly during periods of heightened market volatility. It provides more accurate volatility forecasts and offers unique risk insights for different assets, thereby deepening the understanding of return uncertainty. Additionally, we propose a novel use of Code embedding which utilizes a bag-of-words approach to train hidden representations of stock codes and transforms the uncertainty attributes of stocks into high-dimensional vectors. These vectors are subsequently reduced to two dimensions, allowing the observation of similarity among different stocks. This visualization facilitates the identification of asset clusters with similar risk profiles, offering valuable insights for portfolio management and risk mitigation. Since we predict the uncertainty of returns by estimating their latent distribution, it is challenging to evaluate the return distribution when the true distribution is unobservable. However, we can measure it through the CRPS to assess how well the predicted distribution matches the true returns, and through MSE and QLIKE metrics to evaluate the error between the volatility level of the predicted distribution and proxy measures of true volatility.
△ Less
Submitted 10 March, 2025;
originally announced March 2025.
-
FinTSBridge: A New Evaluation Suite for Real-world Financial Prediction with Advanced Time Series Models
Authors:
Yanlong Wang,
Jian Xu,
Tiantian Gao,
Hongkang Zhang,
Shao-Lun Huang,
Danny Dongning Sun,
Xiao-Ping Zhang
Abstract:
Despite the growing attention to time series forecasting in recent years, many studies have proposed various solutions to address the challenges encountered in time series prediction, aiming to improve forecasting performance. However, effectively applying these time series forecasting models to the field of financial asset pricing remains a challenging issue. There is still a need for a bridge to…
▽ More
Despite the growing attention to time series forecasting in recent years, many studies have proposed various solutions to address the challenges encountered in time series prediction, aiming to improve forecasting performance. However, effectively applying these time series forecasting models to the field of financial asset pricing remains a challenging issue. There is still a need for a bridge to connect cutting-edge time series forecasting models with financial asset pricing. To bridge this gap, we have undertaken the following efforts: 1) We constructed three datasets from the financial domain; 2) We selected over ten time series forecasting models from recent studies and validated their performance in financial time series; 3) We developed new metrics, msIC and msIR, in addition to MSE and MAE, to showcase the time series correlation captured by the models; 4) We designed financial-specific tasks for these three datasets and assessed the practical performance and application potential of these forecasting models in important financial problems. We hope the developed new evaluation suite, FinTSBridge, can provide valuable insights into the effectiveness and robustness of advanced forecasting models in finanical domains.
△ Less
Submitted 11 June, 2025; v1 submitted 10 March, 2025;
originally announced March 2025.
-
\textsc{Perseus}: Tracing the Masterminds Behind Cryptocurrency Pump-and-Dump Schemes
Authors:
Honglin Fu,
Yebo Feng,
Cong Wu,
Jiahua Xu
Abstract:
Masterminds are entities organizing, coordinating, and orchestrating cryptocurrency pump-and-dump schemes, a form of trade-based manipulation undermining market integrity and causing financial losses for unwitting investors. Previous research detects pump-and-dump activities in the market, predicts the target cryptocurrency, and examines investors and \ac{osn} entities. However, these solutions do…
▽ More
Masterminds are entities organizing, coordinating, and orchestrating cryptocurrency pump-and-dump schemes, a form of trade-based manipulation undermining market integrity and causing financial losses for unwitting investors. Previous research detects pump-and-dump activities in the market, predicts the target cryptocurrency, and examines investors and \ac{osn} entities. However, these solutions do not address the root cause of the problem. There is a critical gap in identifying and tracing the masterminds involved in these schemes. In this research, we develop a detection system \textsc{Perseus}, which collects real-time data from the \acs{osn} and cryptocurrency markets. \textsc{Perseus} then constructs temporal attributed graphs that preserve the direction of information diffusion and the structure of the community while leveraging \ac{gnn} to identify the masterminds behind pump-and-dump activities. Our design of \textsc{Perseus} leads to higher F1 scores and precision than the \ac{sota} fraud detection method, achieving fast training and inferring speeds. Deployed in the real world from February 16 to October 9 2024, \textsc{Perseus} successfully detects $438$ masterminds who are efficient in the pump-and-dump information diffusion networks. \textsc{Perseus} provides regulators with an explanation of the risks of masterminds and oversight capabilities to mitigate the pump-and-dump schemes of cryptocurrency.
△ Less
Submitted 3 March, 2025;
originally announced March 2025.
-
HedgeAgents: A Balanced-aware Multi-agent Financial Trading System
Authors:
Xiangyu Li,
Yawen Zeng,
Xiaofen Xing,
Jin Xu,
Xiangmin Xu
Abstract:
As automated trading gains traction in the financial market, algorithmic investment strategies are increasingly prominent. While Large Language Models (LLMs) and Agent-based models exhibit promising potential in real-time market analysis and trading decisions, they still experience a significant -20% loss when confronted with rapid declines or frequent fluctuations, impeding their practical applic…
▽ More
As automated trading gains traction in the financial market, algorithmic investment strategies are increasingly prominent. While Large Language Models (LLMs) and Agent-based models exhibit promising potential in real-time market analysis and trading decisions, they still experience a significant -20% loss when confronted with rapid declines or frequent fluctuations, impeding their practical application. Hence, there is an imperative to explore a more robust and resilient framework. This paper introduces an innovative multi-agent system, HedgeAgents, aimed at bolstering system robustness via ``hedging'' strategies. In this well-balanced system, an array of hedging agents has been tailored, where HedgeAgents consist of a central fund manager and multiple hedging experts specializing in various financial asset classes. These agents leverage LLMs' cognitive capabilities to make decisions and coordinate through three types of conferences. Benefiting from the powerful understanding of LLMs, our HedgeAgents attained a 70% annualized return and a 400% total return over a period of 3 years. Moreover, we have observed with delight that HedgeAgents can even formulate investment experience comparable to those of human experts (https://hedgeagents.github.io/).
△ Less
Submitted 16 February, 2025;
originally announced February 2025.
-
LLM-Powered Multi-Agent System for Automated Crypto Portfolio Management
Authors:
Yichen Luo,
Yebo Feng,
Jiahua Xu,
Paolo Tasca,
Yang Liu
Abstract:
Cryptocurrency investment is inherently difficult due to its shorter history compared to traditional assets, the need to integrate vast amounts of data from various modalities, and the requirement for complex reasoning. While deep learning approaches have been applied to address these challenges, their black-box nature raises concerns about trust and explainability. Recently, large language models…
▽ More
Cryptocurrency investment is inherently difficult due to its shorter history compared to traditional assets, the need to integrate vast amounts of data from various modalities, and the requirement for complex reasoning. While deep learning approaches have been applied to address these challenges, their black-box nature raises concerns about trust and explainability. Recently, large language models (LLMs) have shown promise in financial applications due to their ability to understand multi-modal data and generate explainable decisions. However, single LLM faces limitations in complex, comprehensive tasks such as asset investment. These limitations are even more pronounced in cryptocurrency investment, where LLMs have less domain-specific knowledge in their training corpora.
To overcome these challenges, we propose an explainable, multi-modal, multi-agent framework for cryptocurrency investment. Our framework uses specialized agents that collaborate within and across teams to handle subtasks such as data analysis, literature integration, and investment decision-making for the top 30 cryptocurrencies by market capitalization. The expert training module fine-tunes agents using multi-modal historical data and professional investment literature, while the multi-agent investment module employs real-time data to make informed cryptocurrency investment decisions. Unique intrateam and interteam collaboration mechanisms enhance prediction accuracy by adjusting final predictions based on confidence levels within agent teams and facilitating information sharing between teams. Empirical evaluation using data from November 2023 to September 2024 demonstrates that our framework outperforms single-agent models and market benchmarks in classification, asset pricing, portfolio, and explainability performance.
△ Less
Submitted 6 January, 2025; v1 submitted 1 January, 2025;
originally announced January 2025.
-
A Consolidated Volatility Prediction with Back Propagation Neural Network and Genetic Algorithm
Authors:
Zong Ke,
Jingyu Xu,
Zizhou Zhang,
Yu Cheng,
Wenjun Wu
Abstract:
This paper provides a unique approach with AI algorithms to predict emerging stock markets volatility. Traditionally, stock volatility is derived from historical volatility,Monte Carlo simulation and implied volatility as well. In this paper, the writer designs a consolidated model with back-propagation neural network and genetic algorithm to predict future volatility of emerging stock markets and…
▽ More
This paper provides a unique approach with AI algorithms to predict emerging stock markets volatility. Traditionally, stock volatility is derived from historical volatility,Monte Carlo simulation and implied volatility as well. In this paper, the writer designs a consolidated model with back-propagation neural network and genetic algorithm to predict future volatility of emerging stock markets and found that the results are quite accurate with low errors.
△ Less
Submitted 30 May, 2025; v1 submitted 10 December, 2024;
originally announced December 2024.
-
Dynamic Pricing in Securities Lending Market: Application in Revenue Optimization for an Agent Lender Portfolio
Authors:
Jing Xu,
Yung-Cheng Hsu,
William Biscarri
Abstract:
Securities lending is an important part of the financial market structure, where agent lenders help long term institutional investors to lend out their securities to short sellers in exchange for a lending fee. Agent lenders within the market seek to optimize revenue by lending out securities at the highest rate possible. Typically, this rate is set by hard-coded business rules or standard supervi…
▽ More
Securities lending is an important part of the financial market structure, where agent lenders help long term institutional investors to lend out their securities to short sellers in exchange for a lending fee. Agent lenders within the market seek to optimize revenue by lending out securities at the highest rate possible. Typically, this rate is set by hard-coded business rules or standard supervised machine learning models. These approaches are often difficult to scale and are not adaptive to changing market conditions. Unlike a traditional stock exchange with a centralized limit order book, the securities lending market is organized similarly to an e-commerce marketplace, where agent lenders and borrowers can transact at any agreed price in a bilateral fashion. This similarity suggests that the use of typical methods for addressing dynamic pricing problems in e-commerce could be effective in the securities lending market. We show that existing contextual bandit frameworks can be successfully utilized in the securities lending market. Using offline evaluation on real historical data, we show that the contextual bandit approach can consistently outperform typical approaches by at least 15% in terms of total revenue generated.
△ Less
Submitted 7 October, 2024; v1 submitted 18 July, 2024;
originally announced July 2024.
-
No Questions Asked: Effects of Transparency on Stablecoin Liquidity During the Collapse of Silicon Valley Bank
Authors:
Walter Hernandez Cruz,
Jiahua Xu,
Paolo Tasca,
Carlo Campajola
Abstract:
Fiat-pegged stablecoins are by nature exposed to spillover effects during market turmoil in Traditional Finance (TradFi). We observe a difference in TradFi market shocks impact between various stablecoins, in particular, USD Coin (USDC) and Tether USDT (USDT), the former with a higher reporting frequency and transparency than the latter. We investigate this, using top USDC and USDT liquidity pools…
▽ More
Fiat-pegged stablecoins are by nature exposed to spillover effects during market turmoil in Traditional Finance (TradFi). We observe a difference in TradFi market shocks impact between various stablecoins, in particular, USD Coin (USDC) and Tether USDT (USDT), the former with a higher reporting frequency and transparency than the latter. We investigate this, using top USDC and USDT liquidity pools in Uniswap, by adapting the Marginal Cost of Immediacy (MCI) measure to Uniswap's Automated Market Maker, and then conducting Difference-in-Differences analysis on MCI and Total Value Locked (TVL) in USD, as well as measuring liquidity concentration across different providers. Results show that the Silicon Valley Bank (SVB) event reduced USDC's TVL dominance over USDT, increased USDT's liquidity cost relative to USDC, and liquidity provision remained concentrated with pool-specific trends. These findings reveal a flight-to-safety behavior and counterintuitive effects of stablecoin transparency: USDC's frequent and detailed disclosures led to swift market reactions, while USDT's opacity and less frequent reporting provided a safety net against immediate impacts.
△ Less
Submitted 16 July, 2024;
originally announced July 2024.
-
A K-means Algorithm for Financial Market Risk Forecasting
Authors:
Jinxin Xu,
Kaixian Xu,
Yue Wang,
Qinyan Shen,
Ruisi Li
Abstract:
Financial market risk forecasting involves applying mathematical models, historical data analysis and statistical methods to estimate the impact of future market movements on investments. This process is crucial for investors to develop strategies, financial institutions to manage assets and regulators to formulate policy. In today's society, there are problems of high error rate and low precision…
▽ More
Financial market risk forecasting involves applying mathematical models, historical data analysis and statistical methods to estimate the impact of future market movements on investments. This process is crucial for investors to develop strategies, financial institutions to manage assets and regulators to formulate policy. In today's society, there are problems of high error rate and low precision in financial market risk prediction, which greatly affect the accuracy of financial market risk prediction. K-means algorithm in machine learning is an effective risk prediction technique for financial market. This study uses K-means algorithm to develop a financial market risk prediction system, which significantly improves the accuracy and efficiency of financial market risk prediction. Ultimately, the outcomes of the experiments confirm that the K-means algorithm operates with user-friendly simplicity and achieves a 94.61% accuracy rate
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
Piercing the Veil of TVL: DeFi Reappraised
Authors:
Yichen Luo,
Yebo Feng,
Jiahua Xu,
Paolo Tasca
Abstract:
Total value locked (TVL) is widely used to measure the size and popularity of decentralized finance (DeFi). However, TVL can be easily manipulated and inflated through "double counting" activities such as wrapping and leveraging. As existing methodologies addressing double counting are inconsistent and flawed, we propose a new framework, termed "total value redeemable (TVR)", to assess the true un…
▽ More
Total value locked (TVL) is widely used to measure the size and popularity of decentralized finance (DeFi). However, TVL can be easily manipulated and inflated through "double counting" activities such as wrapping and leveraging. As existing methodologies addressing double counting are inconsistent and flawed, we propose a new framework, termed "total value redeemable (TVR)", to assess the true underlying value of DeFi. Our formal analysis reveals how DeFi's complex network spreads financial contagion via derivative tokens, increasing TVL's sensitivity to external shocks. To quantify double counting, we construct the DeFi multiplier, which mirrors the money multiplier in traditional finance (TradFi). This measurement reveals substantial double counting in DeFi, finding that the gap between TVL and TVR reached \$139.87 billion during the peak of DeFi activity on December 2, 2021, with a TVL-to-TVR ratio of approximately 2. We conduct sensitivity tests to evaluate the stability of TVL compared to TVR, demonstrating the former's significantly higher level of instability than the latter, especially during market downturns: A 25% decline in the price of Ether (ETH) leads to a \$1 billion greater non-linear decrease in TVL compared to TVR via the liquidations triggered by derivative tokens. We also document that the DeFi money multiplier is positively correlated with crypto market indicators and negatively correlated with macroeconomic indicators. Overall, our findings suggest that TVR is more reliable and stable than TVL.
△ Less
Submitted 4 July, 2025; v1 submitted 17 April, 2024;
originally announced April 2024.
-
AI in ESG for Financial Institutions: An Industrial Survey
Authors:
Jun Xu
Abstract:
The burgeoning integration of Artificial Intelligence (AI) into Environmental, Social, and Governance (ESG) initiatives within the financial sector represents a paradigm shift towards more sus-tainable and equitable financial practices. This paper surveys the industrial landscape to delineate the necessity and impact of AI in bolstering ESG frameworks. With the advent of stringent regulatory requi…
▽ More
The burgeoning integration of Artificial Intelligence (AI) into Environmental, Social, and Governance (ESG) initiatives within the financial sector represents a paradigm shift towards more sus-tainable and equitable financial practices. This paper surveys the industrial landscape to delineate the necessity and impact of AI in bolstering ESG frameworks. With the advent of stringent regulatory requirements and heightened stakeholder awareness, financial institutions (FIs) are increasingly compelled to adopt ESG criteria. AI emerges as a pivotal tool in navigating the complex in-terplay of financial activities and sustainability goals. Our survey categorizes AI applications across three main pillars of ESG, illustrating how AI enhances analytical capabilities, risk assessment, customer engagement, reporting accuracy and more. Further, we delve into the critical con-siderations surrounding the use of data and the development of models, underscoring the importance of data quality, privacy, and model robustness. The paper also addresses the imperative of responsible and sustainable AI, emphasizing the ethical dimensions of AI deployment in ESG-related banking processes. Conclusively, our findings suggest that while AI offers transformative potential for ESG in banking, it also poses significant challenges that necessitate careful consideration. The final part of the paper synthesizes the survey's insights, proposing a forward-looking stance on the adoption of AI in ESG practices. We conclude with recommendations with a reference architecture for future research and development, advocating for a balanced approach that leverages AI's strengths while mitigating its risks within the ESG domain.
△ Less
Submitted 2 February, 2024;
originally announced March 2024.
-
Learning the Market: Sentiment-Based Ensemble Trading Agents
Authors:
Andrew Ye,
James Xu,
Vidyut Veedgav,
Yi Wang,
Yifan Yu,
Daniel Yan,
Ryan Chen,
Vipin Chaudhary,
Shuai Xu
Abstract:
We propose and study the integration of sentiment analysis and deep reinforcement learning ensemble algorithms for stock trading by evaluating strategies capable of dynamically altering their active agent given the concurrent market environment. In particular, we design a simple-yet-effective method for extracting financial sentiment and combine this with improvements on existing trading agents, r…
▽ More
We propose and study the integration of sentiment analysis and deep reinforcement learning ensemble algorithms for stock trading by evaluating strategies capable of dynamically altering their active agent given the concurrent market environment. In particular, we design a simple-yet-effective method for extracting financial sentiment and combine this with improvements on existing trading agents, resulting in a strategy that effectively considers both qualitative market factors and quantitative stock data. We show that our approach results in a strategy that is profitable, robust, and risk-minimal - outperforming the traditional ensemble strategy as well as single agent algorithms and market metrics. Our findings suggest that the conventional practice of switching and reevaluating agents in ensemble every fixed-number of months is sub-optimal, and that a dynamic sentiment-based framework greatly unlocks additional performance. Furthermore, as we have designed our algorithm with simplicity and efficiency in mind, we hypothesize that the transition of our method from historical evaluation towards real-time trading with live data to be relatively simple.
△ Less
Submitted 20 November, 2024; v1 submitted 2 February, 2024;
originally announced February 2024.
-
An Empirical Study on the Holiday Effect of China's Time-Honored Companies
Authors:
Xianyang Li,
Jiayi Xu,
Haoxuan Xu,
Yunxuan Ma,
Yu Zhong,
Lei Wang
Abstract:
The stock segment of China's time-honored brand enterprises has an important position in our securities stock market. The holiday effect is one of the market anomalies that occur in the securities market, which refers to the phenomenon that the stock market has significantly different returns than other trading days around festivals. The study of the holiday effect of China's time-honored brand en…
▽ More
The stock segment of China's time-honored brand enterprises has an important position in our securities stock market. The holiday effect is one of the market anomalies that occur in the securities market, which refers to the phenomenon that the stock market has significantly different returns than other trading days around festivals. The study of the holiday effect of China's time-honored brand enterprises can provide fresh ideas for the revitalization of our time-honored brands and the revitalization of time-honored enterprises. This paper takes listed companies of China's time-honored brand enterprises as the research object and focuses on the impact of the holiday effect on listed companies of China's time-honored brands with the help of the event study, and empirically analyses the changes in the return of listed companies of China time-honored brands during the Spring Festival period from 2012 to 2021. The empirical results reveal that: the time-honored brand concept stocks have a significant post-holiday effect during the Chinese New Year period, the time-honored alcoholic beverage enterprises are more sensitive to the Chinese New Year reflection, while the holiday effect of the time-honored pharmaceutical manufacturing enterprises is not significant.
△ Less
Submitted 29 June, 2023;
originally announced August 2023.
-
MOPO-LSI: A User Guide
Authors:
Yong Zheng,
Kumar Neelotpal Shukla,
Jasmine Xu,
David,
Wang,
Michael O'Leary
Abstract:
MOPO-LSI is an open-source Multi-Objective Portfolio Optimization Library for Sustainable Investments. This document provides a user guide for MOPO-LSI version 1.0, including problem setup, workflow and the hyper-parameters in configurations.
MOPO-LSI is an open-source Multi-Objective Portfolio Optimization Library for Sustainable Investments. This document provides a user guide for MOPO-LSI version 1.0, including problem setup, workflow and the hyper-parameters in configurations.
△ Less
Submitted 12 July, 2023; v1 submitted 4 July, 2023;
originally announced July 2023.
-
Copula Variational LSTM for High-dimensional Cross-market Multivariate Dependence Modeling
Authors:
Jia Xu,
Longbing Cao
Abstract:
We address an important yet challenging problem - modeling high-dimensional dependencies across multivariates such as financial indicators in heterogeneous markets. In reality, a market couples and influences others over time, and the financial variables of a market are also coupled. We make the first attempt to integrate variational sequential neural learning with copula-based dependence modeling…
▽ More
We address an important yet challenging problem - modeling high-dimensional dependencies across multivariates such as financial indicators in heterogeneous markets. In reality, a market couples and influences others over time, and the financial variables of a market are also coupled. We make the first attempt to integrate variational sequential neural learning with copula-based dependence modeling to characterize both temporal observable and latent variable-based dependence degrees and structures across non-normal multivariates. Our variational neural network WPVC-VLSTM models variational sequential dependence degrees and structures across multivariate time series by variational long short-term memory networks and regular vine copula. The regular vine copula models nonnormal and long-range distributional couplings across multiple dynamic variables. WPVC-VLSTM is verified in terms of both technical significance and portfolio forecasting performance. It outperforms benchmarks including linear models, stochastic volatility models, deep neural networks, and variational recurrent networks in cross-market portfolio forecasting.
△ Less
Submitted 9 May, 2023;
originally announced May 2023.
-
Auto.gov: Learning-based Governance for Decentralized Finance (DeFi)
Authors:
Jiahua Xu,
Yebo Feng,
Daniel Perez,
Benjamin Livshits
Abstract:
Decentralized finance (DeFi) is an integral component of the blockchain ecosystem, enabling a range of financial activities through smart-contract-based protocols. Traditional DeFi governance typically involves manual parameter adjustments by protocol teams or token holder votes, and is thus prone to human bias and financial risks, undermining the system's integrity and security. While existing ef…
▽ More
Decentralized finance (DeFi) is an integral component of the blockchain ecosystem, enabling a range of financial activities through smart-contract-based protocols. Traditional DeFi governance typically involves manual parameter adjustments by protocol teams or token holder votes, and is thus prone to human bias and financial risks, undermining the system's integrity and security. While existing efforts aim to establish more adaptive parameter adjustment schemes, there remains a need for a governance model that is both more efficient and resilient to significant market manipulations. In this paper, we introduce "Auto$.$gov", a learning-based governance framework that employs a deep Qnetwork (DQN) reinforcement learning (RL) strategy to perform semi-automated, data-driven parameter adjustments. We create a DeFi environment with an encoded action-state space akin to the Aave lending protocol for simulation and testing purposes, where Auto$.$gov has demonstrated the capability to retain funds that would have otherwise been lost to price oracle attacks. In tests with real-world data, Auto$.$gov outperforms the benchmark approaches by at least 14% and the static baseline model by tenfold, in terms of the preset performance metric--protocol profitability. Overall, the comprehensive evaluations confirm that Auto$.$gov is more efficient and effective than traditional governance methods, thereby enhancing the security, profitability, and ultimately, the sustainability of DeFi protocols.
△ Less
Submitted 7 May, 2025; v1 submitted 19 February, 2023;
originally announced February 2023.
-
Reap the Harvest on Blockchain: A Survey of Yield Farming Protocols
Authors:
Jiahua Xu,
Yebo Feng
Abstract:
Yield farming represents an immensely popular asset management activity in decentralized finance (DeFi). It involves supplying, borrowing, or staking crypto assets to earn an income in forms of transaction fees, interest, or participation rewards at different DeFi marketplaces. In this systematic survey, we present yield farming protocols as an aggregation-layer constituent of the wider DeFi ecosy…
▽ More
Yield farming represents an immensely popular asset management activity in decentralized finance (DeFi). It involves supplying, borrowing, or staking crypto assets to earn an income in forms of transaction fees, interest, or participation rewards at different DeFi marketplaces. In this systematic survey, we present yield farming protocols as an aggregation-layer constituent of the wider DeFi ecosystem that interact with primitive-layer protocols such as decentralized exchanges (DEXs) and protocols for loanable funds (PLFs). We examine the yield farming mechanism by first studying the operations encoded in the yield farming smart contracts, and then performing stylized, parameterized simulations on various yield farming strategies. We conduct a thorough literature review on related work, and establish a framework for yield farming protocols that takes into account pool structure, accepted token types, and implemented strategies. Using our framework, we characterize major yield aggregators in the market including Yearn Finance, Beefy, and Badger DAO. Moreover, we discuss anecdotal attacks against yield aggregators and generalize a number of risks associated with yield farming.
△ Less
Submitted 14 December, 2022; v1 submitted 9 October, 2022;
originally announced October 2022.
-
SoK: Yield Aggregators in DeFi
Authors:
Simon Cousaert,
Jiahua Xu,
Toshiko Matsui
Abstract:
Yield farming has been an immensely popular activity for cryptocurrency holders since the explosion of Decentralized Finance (DeFi) in the summer of 2020. In this Systematization of Knowledge (SoK), we study a general framework for yield farming strategies with empirical analysis. First, we summarize the fundamentals of yield farming by focusing on the protocols and tokens used by aggregators. We…
▽ More
Yield farming has been an immensely popular activity for cryptocurrency holders since the explosion of Decentralized Finance (DeFi) in the summer of 2020. In this Systematization of Knowledge (SoK), we study a general framework for yield farming strategies with empirical analysis. First, we summarize the fundamentals of yield farming by focusing on the protocols and tokens used by aggregators. We then examine the sources of yield and translate those into three example yield farming strategies, followed by the simulations of yield farming performance, based on these strategies. We further compare four major yield aggregrators -- Idle, Pickle, Harvest and Yearn -- in the ecosystem, along with brief introductions of others. We systematize their strategies and revenue models, and conduct an empirical analysis with on-chain data from example vaults, to find a plausible connection between data anomalies and historical events. Finally, we discuss the benefits and risks of yield aggregators.
△ Less
Submitted 27 March, 2022; v1 submitted 28 May, 2021;
originally announced May 2021.
-
SoK: Decentralized Exchanges (DEX) with Automated Market Maker (AMM) Protocols
Authors:
Jiahua Xu,
Krzysztof Paruch,
Simon Cousaert,
Yebo Feng
Abstract:
As an integral part of the decentralized finance (DeFi) ecosystem, decentralized exchanges (DEXs) with automated market maker (AMM) protocols have gained massive traction with the recently revived interest in blockchain and distributed ledger technology (DLT) in general. Instead of matching the buy and sell sides, automated market makers (AMMs) employ a peer-to-pool method and determine asset pric…
▽ More
As an integral part of the decentralized finance (DeFi) ecosystem, decentralized exchanges (DEXs) with automated market maker (AMM) protocols have gained massive traction with the recently revived interest in blockchain and distributed ledger technology (DLT) in general. Instead of matching the buy and sell sides, automated market makers (AMMs) employ a peer-to-pool method and determine asset price algorithmically through a so-called conservation function. To facilitate the improvement and development of automated market maker (AMM)-based decentralized exchanges (DEXs), we create the first systematization of knowledge in this area. We first establish a general automated market maker (AMM) framework describing the economics and formalizing the system's state-space representation. We then employ our framework to systematically compare the top automated market maker (AMM) protocols' mechanics, illustrating their conservation functions, as well as slippage and divergence loss functions. We further discuss security and privacy concerns, how they are enabled by automated market maker (AMM)-based decentralized exchanges (DEXs)' inherent properties, and explore mitigating solutions. Finally, we conduct a comprehensive literature review on related work covering both decentralized finance (DeFi) and conventional market microstructure.
△ Less
Submitted 14 March, 2023; v1 submitted 23 March, 2021;
originally announced March 2021.
-
Predicting the Behavior of Dealers in Over-The-Counter Corporate Bond Markets
Authors:
Yusen Lin,
Jinming Xue,
Louiqa Raschid
Abstract:
Trading in Over-The-Counter (OTC) markets is facilitated by broker-dealers, in comparison to public exchanges, e.g., the New York Stock Exchange (NYSE). Dealers play an important role in stabilizing prices and providing liquidity in OTC markets. We apply machine learning methods to model and predict the trading behavior of OTC dealers for US corporate bonds. We create sequences of daily historical…
▽ More
Trading in Over-The-Counter (OTC) markets is facilitated by broker-dealers, in comparison to public exchanges, e.g., the New York Stock Exchange (NYSE). Dealers play an important role in stabilizing prices and providing liquidity in OTC markets. We apply machine learning methods to model and predict the trading behavior of OTC dealers for US corporate bonds. We create sequences of daily historical transaction reports for each dealer over a vocabulary of US corporate bonds. Using this history of dealer activity, we predict the future trading decisions of the dealer. We consider a range of neural network-based prediction models. We propose an extension, the Pointwise-Product ReZero (PPRZ) Transformer model, and demonstrate the improved performance of our model. We show that individual history provides the best predictive model for the most active dealers. For less active dealers, a collective model provides improved performance. Further, clustering dealers based on their similarity can improve performance. Finally, prediction accuracy varies based on the activity level of both the bond and the dealer.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
Liquidations: DeFi on a Knife-edge
Authors:
Daniel Perez,
Sam M. Werner,
Jiahua Xu,
Benjamin Livshits
Abstract:
The trustless nature of permissionless blockchains renders overcollateralization a key safety component relied upon by decentralized finance (DeFi) protocols. Nonetheless, factors such as price volatility may undermine this mechanism. In order to protect protocols from suffering losses, undercollateralized positions can be liquidated. In this paper, we present the first in-depth empirical analysis…
▽ More
The trustless nature of permissionless blockchains renders overcollateralization a key safety component relied upon by decentralized finance (DeFi) protocols. Nonetheless, factors such as price volatility may undermine this mechanism. In order to protect protocols from suffering losses, undercollateralized positions can be liquidated. In this paper, we present the first in-depth empirical analysis of liquidations on protocols for loanable funds (PLFs). We examine Compound, one of the most widely used PLFs, for a period starting from its conception to September 2020. We analyze participants' behavior and risk-appetite in particular, to elucidate recent developments in the dynamics of the protocol. Furthermore, we assess how this has changed with a modification in Compound's incentive structure and show that variations of only 3% in an asset's dollar price can result in over 10m USD becoming liquidable. To further understand the implications of this, we investigate the efficiency of liquidators. We find that liquidators' efficiency has improved significantly over time, with currently over 70% of liquidable positions being immediately liquidated. Lastly, we provide a discussion on how a false sense of security fostered by a misconception of the stability of non-custodial stablecoins, increases the overall liquidation risk faced by Compound participants.
△ Less
Submitted 11 December, 2021; v1 submitted 28 September, 2020;
originally announced September 2020.
-
Improving the Robustness of Trading Strategy Backtesting with Boltzmann Machines and Generative Adversarial Networks
Authors:
Edmond Lezmi,
Jules Roche,
Thierry Roncalli,
Jiali Xu
Abstract:
This article explores the use of machine learning models to build a market generator. The underlying idea is to simulate artificial multi-dimensional financial time series, whose statistical properties are the same as those observed in the financial markets. In particular, these synthetic data must preserve the probability distribution of asset returns, the stochastic dependence between the differ…
▽ More
This article explores the use of machine learning models to build a market generator. The underlying idea is to simulate artificial multi-dimensional financial time series, whose statistical properties are the same as those observed in the financial markets. In particular, these synthetic data must preserve the probability distribution of asset returns, the stochastic dependence between the different assets and the autocorrelation across time. The article proposes then a new approach for estimating the probability distribution of backtest statistics. The final objective is to develop a framework for improving the risk management of quantitative investment strategies, in particular in the space of smart beta, factor investing and alternative risk premia.
△ Less
Submitted 9 July, 2020;
originally announced July 2020.
-
Optimal liquidation for a risk averse investor in a one-sided limit order book driven by a Levy process
Authors:
Arne Lokka,
Junwei Xu
Abstract:
In a one-sided limit order book, satisfying some realistic assumptions, where the unaffected price process follows a Levy process, we consider a market agent that wants to liquidate a large position of shares. We assume that the agent has constant absolute risk aversion and aims at maximising the expected utility of the cash position at the end of time. The agent is then faced with the problem of…
▽ More
In a one-sided limit order book, satisfying some realistic assumptions, where the unaffected price process follows a Levy process, we consider a market agent that wants to liquidate a large position of shares. We assume that the agent has constant absolute risk aversion and aims at maximising the expected utility of the cash position at the end of time. The agent is then faced with the problem of balancing the market risk and the cost of a rapid execution. In particular we are interested in how the agent should go about optimally submitting orders. Since liquidation normally takes place within a short period of time, modelling the risk as a Levy process should provide a realistic model with good statistical fit to observed market data, and thus the model should provide a realistic reflection of the agent's market risk. We reduce the optimisation problem to a deterministic two-dimensional singular problem, to which we are able to derive an explicit solution in terms of the model data. In particular we find an expression for the optimal intervention boundary, which completely characterise the optimal liquidation strategy.
△ Less
Submitted 30 October, 2020; v1 submitted 9 February, 2020;
originally announced February 2020.
-
Optimal liquidation trajectories for the Almgren-Chriss model with Levy processes
Authors:
Arne Lokka,
Junwei Xu
Abstract:
We consider an optimal liquidation problem with infinite horizon in the Almgren-Chriss framework, where the unaffected asset price follows a Levy process. The temporary price impact is described by a general function which satisfies some reasonable conditions. We consider an investor with constant absolute risk aversion, who wants to maximise the expected utility of the cash received from the sale…
▽ More
We consider an optimal liquidation problem with infinite horizon in the Almgren-Chriss framework, where the unaffected asset price follows a Levy process. The temporary price impact is described by a general function which satisfies some reasonable conditions. We consider an investor with constant absolute risk aversion, who wants to maximise the expected utility of the cash received from the sale of his assets, and show that this problem can be reduced to a deterministic optimisation problem which we are able to solve explicitly. In order to compare our results with exponential Levy models, which provides a very good statistical fit with observed asset price data for short time horizons, we derive the (linear) Levy process approximation of such models. In particular we derive expressions for the Levy process approximation of the exponential Variance-Gamma Levy process, and study properties of the corresponding optimal liquidation strategy. We then provide a comparison of the liquidation trajectories for reasonable parameters between the Levy process model and the classical Almgren-Chriss model. In particular, we obtain an explicit expression for the connection between the temporary impact function for the Levy model and the temporary impact function for the Brownian motion model (the classical Almgren-Chriss model), for which the optimal liquidation trajectories for the two models coincide.
△ Less
Submitted 15 September, 2020; v1 submitted 9 February, 2020;
originally announced February 2020.
-
A Note on Portfolio Optimization with Quadratic Transaction Costs
Authors:
Pierre Chen,
Edmond Lezmi,
Thierry Roncalli,
Jiali Xu
Abstract:
In this short note, we consider mean-variance optimized portfolios with transaction costs. We show that introducing quadratic transaction costs makes the optimization problem more difficult than using linear transaction costs. The reason lies in the specification of the budget constraint, which is no longer linear. We provide numerical algorithms for solving this issue and illustrate how transacti…
▽ More
In this short note, we consider mean-variance optimized portfolios with transaction costs. We show that introducing quadratic transaction costs makes the optimization problem more difficult than using linear transaction costs. The reason lies in the specification of the budget constraint, which is no longer linear. We provide numerical algorithms for solving this issue and illustrate how transaction costs may considerably impact the expected returns of optimized portfolios.
△ Less
Submitted 6 January, 2020;
originally announced January 2020.
-
Financial Applications of Gaussian Processes and Bayesian Optimization
Authors:
Joan Gonzalvez,
Edmond Lezmi,
Thierry Roncalli,
Jiali Xu
Abstract:
In the last five years, the financial industry has been impacted by the emergence of digitalization and machine learning. In this article, we explore two methods that have undergone rapid development in recent years: Gaussian processes and Bayesian optimization. Gaussian processes can be seen as a generalization of Gaussian random vectors and are associated with the development of kernel methods.…
▽ More
In the last five years, the financial industry has been impacted by the emergence of digitalization and machine learning. In this article, we explore two methods that have undergone rapid development in recent years: Gaussian processes and Bayesian optimization. Gaussian processes can be seen as a generalization of Gaussian random vectors and are associated with the development of kernel methods. Bayesian optimization is an approach for performing derivative-free global optimization in a small dimension, and uses Gaussian processes to locate the global maximum of a black-box function. The first part of the article reviews these two tools and shows how they are connected. In particular, we focus on the Gaussian process regression, which is the core of Bayesian machine learning, and the issue of hyperparameter selection. The second part is dedicated to two financial applications. We first consider the modeling of the term structure of interest rates. More precisely, we test the fitting method and compare the GP prediction and the random walk model. The second application is the construction of trend-following strategies, in particular the online estimation of trend and covariance windows.
△ Less
Submitted 12 March, 2019;
originally announced March 2019.
-
The Anatomy of a Cryptocurrency Pump-and-Dump Scheme
Authors:
Jiahua Xu,
Benjamin Livshits
Abstract:
While pump-and-dump schemes have attracted the attention of cryptocurrency observers and regulators alike, this paper represents the first detailed empirical query of pump-and-dump activities in cryptocurrency markets. We present a case study of a recent pump-and-dump event, investigate 412 pump-and-dump activities organized in Telegram channels from June 17, 2018 to February 26, 2019, and discove…
▽ More
While pump-and-dump schemes have attracted the attention of cryptocurrency observers and regulators alike, this paper represents the first detailed empirical query of pump-and-dump activities in cryptocurrency markets. We present a case study of a recent pump-and-dump event, investigate 412 pump-and-dump activities organized in Telegram channels from June 17, 2018 to February 26, 2019, and discover patterns in crypto-markets associated with pump-and-dump schemes. We then build a model that predicts the pump likelihood of all coins listed in a crypto-exchange prior to a pump. The model exhibits high precision as well as robustness, and can be used to create a simple, yet very effective trading strategy, which we empirically demonstrate can generate a return as high as 60% on small retail investments within a span of two and half months. The study provides a proof of concept for strategic crypto-trading and sheds light on the application of machine learning for crime detection.
△ Less
Submitted 17 August, 2019; v1 submitted 25 November, 2018;
originally announced November 2018.
-
Quantum spatial-periodic harmonic model for daily price-limited stock markets
Authors:
Xiangyi Meng,
Jian-Wei Zhang,
Jingjing Xu,
Hong Guo
Abstract:
We investigate the behavior of stocks in daily price-limited stock markets by purposing a quantum spatial-periodic harmonic model. The stock price is presumed to oscillate and damp in a quantum spatial-periodic harmonic oscillator potential well. Complicated non-linear relations including inter-band positive correlation and intra-band negative correlation between the volatility and the trading vol…
▽ More
We investigate the behavior of stocks in daily price-limited stock markets by purposing a quantum spatial-periodic harmonic model. The stock price is presumed to oscillate and damp in a quantum spatial-periodic harmonic oscillator potential well. Complicated non-linear relations including inter-band positive correlation and intra-band negative correlation between the volatility and the trading volume of stocks are derived by considering the energy band structure of the model. The validity of price limitation is then examined and abnormal phenomena of a price-limited stock market (Shanghai Stock Exchange) of China are studied by applying our quantum model.
△ Less
Submitted 18 May, 2014;
originally announced May 2014.
-
Hedging strategies with a put option and their failure rates
Authors:
Guanghui Huang,
Jing Xu,
Wenting Xing
Abstract:
The problem of stock hedging is reconsidered in this paper, where a put option is chosen from a set of available put options to hedge the market risk of a stock. A formula is proposed to determine the probability that the potential loss exceeds a predetermined level of Value-at-Risk, which is used to find the optimal strike price and optimal hedge ratio. The assumptions that the chosen put option…
▽ More
The problem of stock hedging is reconsidered in this paper, where a put option is chosen from a set of available put options to hedge the market risk of a stock. A formula is proposed to determine the probability that the potential loss exceeds a predetermined level of Value-at-Risk, which is used to find the optimal strike price and optimal hedge ratio. The assumptions that the chosen put option finishes in-the-money and the constraint of hedging budget is binding are relaxed in this paper. A hypothesis test is proposed to determine whether the failure rate of hedging strategy is greater than the predetermined level of risk. The performances of the proposed method and the method with those two assumptions are compared through simulations. The results of simulated investigations indicate that the proposed method is much more prudent than the method with those two assumptions.
△ Less
Submitted 2 October, 2011;
originally announced October 2011.
