Showing 1–34 of 34 results for author: Shirvani, A

Implied Probabilities and Volatility in Credit Risk: A Merton-Based Approach with Binomial Trees

Authors: Jagdish Gnawali, Abootaleb Shirvani, Svetlozar T. Rachev

Abstract: We explore credit risk pricing by modeling equity as a call option and debt as the difference between the firm's asset value and a put option, following the structural framework of the Merton model. Our approach proceeds in two stages: first, we calibrate the asset volatility using the Black-Scholes-Merton (BSM) formula; second, we recover implied mean return and probability surfaces under the phy… ▽ More We explore credit risk pricing by modeling equity as a call option and debt as the difference between the firm's asset value and a put option, following the structural framework of the Merton model. Our approach proceeds in two stages: first, we calibrate the asset volatility using the Black-Scholes-Merton (BSM) formula; second, we recover implied mean return and probability surfaces under the physical measure. To achieve this, we construct a recombining binomial tree under the real-world (natural) measure, assuming a fixed initial asset value. The volatility input is taken from a specific region of the implied volatility surface - based on moneyness and maturity - which then informs the calibration of drift and probability. A novel mapping is established between risk-neutral and physical parameters, enabling construction of implied surfaces that reflect the market's credit expectations and offer practical tools for stress testing and credit risk analysis. △ Less

Submitted 14 June, 2025; originally announced June 2025.

Winners vs. Losers: Momentum-based Strategies with Intertemporal Choice for ESG Portfolios

Authors: Ayush Jha, Abootaleb Shirvani, Ali Jaffri, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: This paper introduces a state-dependent momentum framework that integrates ESG regime switching with tail-risk-aware reward-risk metrics. Using a dynamic programming approach and solving a finite-horizon Bellman equation, we construct long-short momentum portfolios that adjust to changing ESG sentiment regimes. Unlike traditional momentum strategies based on historical returns, our approach incorp… ▽ More This paper introduces a state-dependent momentum framework that integrates ESG regime switching with tail-risk-aware reward-risk metrics. Using a dynamic programming approach and solving a finite-horizon Bellman equation, we construct long-short momentum portfolios that adjust to changing ESG sentiment regimes. Unlike traditional momentum strategies based on historical returns, our approach incorporates the Stable Tail Adjusted Return ratio and Rachev ratio to better capture downside risk in turbulent markets. We apply this framework across three asset classes, Russell 3000 equities, Dow Jones~30 stocks, and cryptocurrencies, under both pro- and anti-ESG market regimes. We find that ESG-loser portfolios significantly outperform ESG-winner portfolios in pro-ESG regimes, a counterintuitive result suggesting that market overreaction to ESG sentiment creates short-term pricing inefficiencies. This pattern is robust across tail-sensitive performance metrics and is most pronounced under a two-week formation and holding period. Our framework highlights how ESG considerations and sentiment regimes alter return dynamics, offering practical guidance for investors seeking to implement responsive momentum strategies under sustainability constraints. These findings challenge conventional assumptions about ESG investing and underscore the importance of dynamic, regime-aware portfolio construction in environments shaped by regulatory signals, investor flows, and behavioral biases. △ Less

Submitted 30 May, 2025; originally announced May 2025.

Multivariate Affine GARCH with Heavy Tails: A Unified Framework for Portfolio Optimization and Option Valuation

Authors: Ayush Jha, Abootaleb Shirvani, Ali Jaffri, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: This paper develops and estimates a multivariate affine GARCH(1,1) model with Normal Inverse Gaussian innovations that captures time-varying volatility, heavy tails, and dynamic correlation across asset returns. We generalize the Heston-Nandi framework to a multivariate setting and apply it to 30 Dow Jones Industrial Average stocks. The model jointly supports three core financial applications: dyn… ▽ More This paper develops and estimates a multivariate affine GARCH(1,1) model with Normal Inverse Gaussian innovations that captures time-varying volatility, heavy tails, and dynamic correlation across asset returns. We generalize the Heston-Nandi framework to a multivariate setting and apply it to 30 Dow Jones Industrial Average stocks. The model jointly supports three core financial applications: dynamic portfolio optimization, wealth path simulation, and option pricing. Closed-form solutions are derived for a Constant Relative Risk Aversion (CRRA) investor's intertemporal asset allocation, and we implement a forward-looking risk-adjusted performance comparison against Merton-style constant strategies. Using the model's conditional volatilities, we also construct implied volatility surfaces for European options, capturing skew and smile features. Empirically, we document substantial wealth-equivalent utility losses from ignoring time-varying correlation and tail risk. These findings underscore the value of a unified econometric framework for analyzing joint asset dynamics and for managing portfolio and derivative exposures under non-Gaussian risks. △ Less

Submitted 17 May, 2025; originally announced May 2025.

Advancing Portfolio Optimization: Adaptive Minimum-Variance Portfolios and Minimum Risk Rate Frameworks

Authors: Ayush Jha, Abootaleb Shirvani, Ali Jaffri, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: This study presents the Adaptive Minimum-Variance Portfolio (AMVP) framework and the Adaptive Minimum-Risk Rate (AMRR) metric, innovative tools designed to optimize portfolios dynamically in volatile and nonstationary financial markets. Unlike traditional minimum-variance approaches, the AMVP framework incorporates real-time adaptability through advanced econometric models, including ARFIMA-FIGARC… ▽ More This study presents the Adaptive Minimum-Variance Portfolio (AMVP) framework and the Adaptive Minimum-Risk Rate (AMRR) metric, innovative tools designed to optimize portfolios dynamically in volatile and nonstationary financial markets. Unlike traditional minimum-variance approaches, the AMVP framework incorporates real-time adaptability through advanced econometric models, including ARFIMA-FIGARCH processes and non-Gaussian innovations. Empirical applications on cryptocurrency and equity markets demonstrate the proposed framework's superior performance in risk reduction and portfolio stability, particularly during periods of structural market breaks and heightened volatility. The findings highlight the practical implications of using the AMVP and AMRR methodologies to address modern investment challenges, offering actionable insights for portfolio managers navigating uncertain and rapidly changing market conditions. △ Less

Submitted 27 January, 2025; originally announced January 2025.

Optimizing Portfolios with Pakistan-Exposed ETFs: Risk and Performance Insight

Authors: Ali Jaffri, Abootaleb Shirvani, Ayush Jha, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: This study examines the investment landscape of Pakistan as an emerging and frontier market, focusing on implications for international investors, particularly those in the United States, through exchange-traded funds (ETFs) with exposure to Pakistan. The analysis encompasses 30 ETFs with varying degrees of exposure to Pakistan, covering the period from January 1, 2016, to February 2024. This rese… ▽ More This study examines the investment landscape of Pakistan as an emerging and frontier market, focusing on implications for international investors, particularly those in the United States, through exchange-traded funds (ETFs) with exposure to Pakistan. The analysis encompasses 30 ETFs with varying degrees of exposure to Pakistan, covering the period from January 1, 2016, to February 2024. This research highlights the potential benefits and risks associated with investing in these ETFs, emphasizing the importance of thorough risk assessments and portfolio performance comparisons. By providing descriptive statistics and performance metrics based on historical optimization, this paper aims to equip investors with the necessary insights to make informed decisions when optimizing their portfolios with Pakistan-exposed ETFs. The second part of the paper introduces and assesses dynamic optimization methodologies. This section is designed to explore the adaptability and performance metrics of dynamic optimization techniques in comparison with conventional historical optimization methods. By integrating dynamic optimization into the investigation, this research aims to offer insights into the efficacy of these contrasting methodologies in the context of Pakistan-exposed ETFs. The findings underscore the significance of Pakistan's market dynamics within the broader context of emerging markets, offering a pathway for diversification and potential growth in investment strategies. △ Less

Submitted 23 January, 2025; originally announced January 2025.

Risk-Adjusted Performance of Random Forest Models in High-Frequency Trading

Authors: Akash Deep, Abootaleb Shirvani, Chris Monico, Svetlozar Rachev, Frank J. Fabozzi

Abstract: Because of the theoretical challenges posed by the Efficient Market Hypothesis to technical analysis, the effectiveness of technical indicators in high-frequency trading remains inadequately explored, particularly at the minute-level frequency, where effects of the microstructure of the market dominate. This study evaluates the integration of traditional technical indicators with random forest reg… ▽ More Because of the theoretical challenges posed by the Efficient Market Hypothesis to technical analysis, the effectiveness of technical indicators in high-frequency trading remains inadequately explored, particularly at the minute-level frequency, where effects of the microstructure of the market dominate. This study evaluates the integration of traditional technical indicators with random forest regression models using minute-level SPY data, analyzing 13 distinct model configurations. Our empirical results reveal a stark contrast between in-sample and out-of-sample performance, with $R^2$ values deteriorating from 0.749--0.812 during training to negative values in testing. A feature importance analysis demonstrates that primary price-based features dominate the predictions made by the model, accounting for over 60% of the importance, while established technical indicators, such as RSI and Bollinger Bands, account for only 14%--15%. Although the indicator-enhanced models achieved superior risk-adjusted metrics, with Rachev ratios between 0.919 and 0.961, they consistently underperformed a simple buy-and-hold strategy, generating returns ranging from -2.4% to -3.9%. These findings challenge conventional assumptions about the usefulness of technical indicators in algorithmic trading, suggesting that in high-frequency contexts, they may be more relevant to risk management rather than to predicting returns. For practitioners and researchers, our findings indicate that successful high-frequency trading strategies should focus on adaptive feature selection and regime-specific modeling rather than relying on traditional technical indicators, as well as indicating the critical importance of robust out-of-sample testing in the development of a model. △ Less

Submitted 28 February, 2025; v1 submitted 19 December, 2024; originally announced December 2024.

Comments: 32 pages, 9 figures

Beyond the Traditional VIX: A Novel Approach to Identifying Uncertainty Shocks in Financial Markets

Authors: Ayush Jha, Abootaleb Shirvani, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: We introduce a new identification strategy for uncertainty shocks to explain macroeconomic volatility in financial markets. The Chicago Board Options Exchange Volatility Index (VIX) measures market expectations of future volatility, but traditional methods based on second-moment shocks and time-varying volatility of the VIX often fail to capture the non-Gaussian, heavy-tailed nature of asset retur… ▽ More We introduce a new identification strategy for uncertainty shocks to explain macroeconomic volatility in financial markets. The Chicago Board Options Exchange Volatility Index (VIX) measures market expectations of future volatility, but traditional methods based on second-moment shocks and time-varying volatility of the VIX often fail to capture the non-Gaussian, heavy-tailed nature of asset returns. To address this, we construct a revised VIX by fitting a double-subordinated Normal Inverse Gaussian Levy process to S&P 500 option prices, providing a more comprehensive measure of volatility that reflects the extreme movements and heavy tails observed in financial data. Using an axiomatic approach, we introduce a general family of risk-reward ratios, computed with our revised VIX and fitted over a fractional time series to more accurately identify uncertainty shocks in financial markets. △ Less

Submitted 4 November, 2024; originally announced November 2024.

Beyond the Bid-Ask: Strategic Insights into Spread Prediction and the Global Mid-Price Phenomenon

Authors: Yifan He, Abootaleb Shirvani, Barret Shao, Svetlozar Rachev, Frank Fabozzi

Abstract: This research extends the conventional concepts of the bid--ask spread (BAS) and mid-price to include the total market order book bid--ask spread (TMOBBAS) and the global mid-price (GMP). Using high-frequency trading data, we investigate these new constructs, finding that they have heavy tails and significant deviations from normality in the distributions of their log returns, which are confirmed… ▽ More This research extends the conventional concepts of the bid--ask spread (BAS) and mid-price to include the total market order book bid--ask spread (TMOBBAS) and the global mid-price (GMP). Using high-frequency trading data, we investigate these new constructs, finding that they have heavy tails and significant deviations from normality in the distributions of their log returns, which are confirmed by three different methods. We shift from a static to a dynamic analysis, employing the ARMA(1,1)-GARCH(1,1) model to capture the temporal dependencies in the return time-series, with the normal inverse Gaussian distribution used to capture the heavy tails of the returns. We apply an option pricing model to address the risks associated with the low liquidity indicated by the TMOBBAS and GMP. Additionally, we employ the Rachev ratio to evaluate the risk--return performance at various depths of the limit order book and examine tail risk interdependencies across spread levels. This study provides insights into the dynamics of financial markets, offering tools for trading strategies and systemic risk management. △ Less

Submitted 21 October, 2024; v1 submitted 17 April, 2024; originally announced April 2024.

Comments: 52 pages, 32 figures, and 18 tables

The Financial Market of Environmental Indices

Authors: Thisari K. Mahanama, Abootaleb Shirvani, Svetlozar Rachev, Frank J. Fabozzi

Abstract: This paper introduces the concept of a global financial market for environmental indices, addressing sustainability concerns and aiming to attract institutional investors. Risk mitigation measures are implemented to manage inherent risks associated with investments in this new financial market. We monetize the environmental indices using quantitative measures and construct country-specific environ… ▽ More This paper introduces the concept of a global financial market for environmental indices, addressing sustainability concerns and aiming to attract institutional investors. Risk mitigation measures are implemented to manage inherent risks associated with investments in this new financial market. We monetize the environmental indices using quantitative measures and construct country-specific environmental indices, enabling them to be viewed as dollar-denominated assets. Our primary goal is to encourage the active engagement of institutional investors in portfolio analysis and trading within this emerging financial market. To evaluate and manage investment risks, our approach incorporates financial econometric theory and dynamic asset pricing tools. We provide an econometric analysis that reveals the relationships between environmental and economic indicators in this market. Additionally, we derive financial put options as insurance instruments that can be employed to manage investment risks. Our factor analysis identifies key drivers in the global financial market for environmental indices. To further evaluate the market's performance, we employ pricing options, efficient frontier analysis, and regression analysis. These tools help us assess the efficiency and effectiveness of the market. Overall, our research contributes to the understanding and development of the global financial market for environmental indices. △ Less

Submitted 29 August, 2023; originally announced August 2023.

The Financial Market of Indices of Socioeconomic Wellbeing

Authors: Thilini V. Mahanama, Abootaleb Shirvani, Svetlozar Rachev

Abstract: The financial industry should be involved in mitigating the risk of downturns in the financial wellbeing indices around the world by implementing well-developed financial tools such as insurance instruments on the underlying wellbeing indices. We define a new quantitative measure of the wellbeing of a country's population for those countries using the world development indicators provided by the W… ▽ More The financial industry should be involved in mitigating the risk of downturns in the financial wellbeing indices around the world by implementing well-developed financial tools such as insurance instruments on the underlying wellbeing indices. We define a new quantitative measure of the wellbeing of a country's population for those countries using the world development indicators provided by the World Bank. We monetize the indices of socioeconomic wellbeing, which serve as "risky assets," and consequently develop a global financial market for them, which serves as a "market of indices of socioeconomic wellbeing." Then, we compare the wellbeing of different countries using financial econometric analysis and dynamic asset pricing theory. We provide the optimal portfolio weight composition along with the efficient frontiers of the wellbeing socioeconomic indices with different risk-return measures. We derive insurance instruments, such as put options, which allow the financial industry to monitor, manage, and trade these indices, creating the funds for insurance against adverse movements of those indices. Our findings should help financial institutions to incorporate socioeconomic issues as an additional dimension to their "two-dimensional" risk-return adjusted optimal financial portfolios. △ Less

Submitted 9 March, 2023; originally announced March 2023.

Comments: 33 pages, 20 figures

Bitcoin Volatility and Intrinsic Time Using Double Subordinated Levy Processes

Authors: Abootaleb Shirvani, Stefan Mittnik, W. Brent Lindquist, Svetlozar T. Rachev

Abstract: We propose a doubly subordinated Levy process, NDIG, to model the time series properties of the cryptocurrency bitcoin. NDIG captures the skew and fat-tailed properties of bitcoin prices and gives rise to an arbitrage free, option pricing model. In this framework we derive two bitcoin volatility measures. The first combines NDIG option pricing with the Cboe VIX model to compute an implied volatili… ▽ More We propose a doubly subordinated Levy process, NDIG, to model the time series properties of the cryptocurrency bitcoin. NDIG captures the skew and fat-tailed properties of bitcoin prices and gives rise to an arbitrage free, option pricing model. In this framework we derive two bitcoin volatility measures. The first combines NDIG option pricing with the Cboe VIX model to compute an implied volatility; the second uses the volatility of the unit time increment of the NDIG model. Both are compared to a volatility based upon historical standard deviation. With appropriate linear scaling, the NDIG process perfectly captures observed, in-sample, volatility. △ Less

Submitted 29 August, 2023; v1 submitted 25 September, 2021; originally announced September 2021.

Market Complete Option Valuation using a Jarrow-Rudd Pricing Tree with Skewness and Kurtosis

Authors: Yuan Hu, Abootaleb Shirvani, W. Brent Lindquist, Frank J. Fabozzi, Svetlozar T. Rachev

Abstract: Applying the Cherny-Shiryaev-Yor invariance principle, we introduce a generalized Jarrow-Rudd (GJR) option pricing model with uncertainty driven by a skew random walk. The GJR pricing tree exhibits skewness and kurtosis in both the natural and risk-neutral world. We construct implied surfaces for the parameters determining the GJR tree. Motivated by Merton's pricing tree incorporating transaction… ▽ More Applying the Cherny-Shiryaev-Yor invariance principle, we introduce a generalized Jarrow-Rudd (GJR) option pricing model with uncertainty driven by a skew random walk. The GJR pricing tree exhibits skewness and kurtosis in both the natural and risk-neutral world. We construct implied surfaces for the parameters determining the GJR tree. Motivated by Merton's pricing tree incorporating transaction costs, we extend the GJR pricing model to include a hedging cost. We demonstrate ways to fit the GJR pricing model to a market driver that influences the price dynamics of the underlying asset. We supplement our findings with numerical examples. △ Less

Submitted 16 June, 2021; originally announced June 2021.

Comments: 25 pages, 12 figures

Global Index on Financial Losses due to Crime in the United States

Authors: Thilini Mahanama, Abootaleb Shirvani, Svetlozar Rachev

Abstract: Crime can have a volatile impact on investments. Despite the potential importance of crime rates in investments, there are no indices dedicated to evaluating the financial impact of crime in the United States. As such, this paper presents an index-based insurance portfolio for crime in the United States by utilizing the financial losses reported by the Federal Bureau of Investigation for property… ▽ More Crime can have a volatile impact on investments. Despite the potential importance of crime rates in investments, there are no indices dedicated to evaluating the financial impact of crime in the United States. As such, this paper presents an index-based insurance portfolio for crime in the United States by utilizing the financial losses reported by the Federal Bureau of Investigation for property crimes and cybercrimes. Our research intends to help investors envision risk exposure in our portfolio, gauge investment risk based on their desired risk level, and hedge strategies for potential losses due to economic crashes. Underlying the index, we hedge the investments by issuing marketable European call and put options and providing risk budgets (diversifying risk to each type of crime). We find that real estate, ransomware, and government impersonation are the main risk contributors. We then evaluate the performance of our index to determine its resilience to economic crisis. The unemployment rate potentially demonstrates a high systemic risk on the portfolio compared to the economic factors used in this study. In conclusion, we provide a basis for the securitization of insurance risk from certain crimes that could forewarn investors to transfer their risk to capital market investors. △ Less

Submitted 7 May, 2021; originally announced May 2021.

Option Pricing Incorporating Factor Dynamics in Complete Markets

Authors: Yuan Hu, Abootaleb Shirvani, W. Brent Lindquist, Frank J. Fabozzi, Svetlozar T. Rachev

Abstract: Using the Donsker-Prokhorov invariance principle we extend the Kim-Stoyanov-Rachev-Fabozzi option pricing model to allow for variably-spaced trading instances, an important consideration for short-sellers of options. Applying the Cherny-Shiryaev-Yor invariance principles, we formulate a new binomial path-dependent pricing model for discrete- and continuous-time complete markets where the stock pri… ▽ More Using the Donsker-Prokhorov invariance principle we extend the Kim-Stoyanov-Rachev-Fabozzi option pricing model to allow for variably-spaced trading instances, an important consideration for short-sellers of options. Applying the Cherny-Shiryaev-Yor invariance principles, we formulate a new binomial path-dependent pricing model for discrete- and continuous-time complete markets where the stock price dynamics depends on the log-return dynamics of a market influencing factor. In the discrete case, we extend the results of this new approach to a financial market with informed traders employing a statistical arbitrage strategy involving trading of forward contracts. Our findings are illustrated with numerical examples employing US financial market data. Our work provides further support for the conclusion that any option pricing model must preserve valuable information on the instantaneous mean log-return, the probability of the stock's upturn movement (per trading interval), and other market microstructure features. △ Less

Submitted 16 November, 2020; originally announced November 2020.

Comments: 31 pages, 13 figures

A Natural Disasters Index

Authors: Thilini V. Mahanama, Abootaleb Shirvani

Abstract: Natural disasters, such as tornadoes, floods, and wildfire pose risks to life and property, requiring the intervention of insurance corporations. One of the most visible consequences of changing climate is an increase in the intensity and frequency of extreme weather events. The relative strengths of these disasters are far beyond the habitual seasonal maxima, often resulting in subsequent increas… ▽ More Natural disasters, such as tornadoes, floods, and wildfire pose risks to life and property, requiring the intervention of insurance corporations. One of the most visible consequences of changing climate is an increase in the intensity and frequency of extreme weather events. The relative strengths of these disasters are far beyond the habitual seasonal maxima, often resulting in subsequent increases in property losses. Thus, insurance policies should be modified to endure increasingly volatile catastrophic weather events. We propose a Natural Disasters Index (NDI) for the property losses caused by natural disasters in the United States based on the "Storm Data" published by the National Oceanic and Atmospheric Administration. The proposed NDI is an attempt to construct a financial instrument for hedging the intrinsic risk. The NDI is intended to forecast the degree of future risk that could forewarn the insurers and corporations allowing them to transfer insurance risk to capital market investors. This index could also be modified to other regions and countries. △ Less

Submitted 9 August, 2020; originally announced August 2020.

Option Pricing in Markets with Informed Traders

Authors: Yuan Hu, Abootaleb Shirvani, Stoyan Stoyanov, Young Shin Kim, Frank J. Fabozzi, Svetlozar T. Rachev

Abstract: The objective of this paper is to introduce the theory of option pricing for markets with informed traders within the framework of dynamic asset pricing theory. We introduce new models for option pricing for informed traders in complete markets where we consider traders with information on the stock price direction and stock return mean. The Black-Scholes-Merton option pricing theory is extended f… ▽ More The objective of this paper is to introduce the theory of option pricing for markets with informed traders within the framework of dynamic asset pricing theory. We introduce new models for option pricing for informed traders in complete markets where we consider traders with information on the stock price direction and stock return mean. The Black-Scholes-Merton option pricing theory is extended for markets with informed traders, where price processes are following continuous-diffusions. By doing so, the discontinuity puzzle in option pricing is resolved. Using market option data, we estimate the implied surface of the probability for a stock upturn, the implied mean stock return surface, and implied trader information intensity surface. △ Less

Submitted 12 August, 2020; v1 submitted 3 June, 2020; originally announced June 2020.

Comments: This paper is forthcoming in the Journal of Theoretical and Applied Finance and has corrections to the preprint posted on the journal's web site

Rational Finance Approach to Behavioral Option Pricing

Authors: Jiexin Dai, Abootaleb Shirvani, Frank J. Fabozzi

Abstract: When pricing options, there may be different views on the instantaneous mean return of the underlying price process. According to Black (1972), where there exist heterogeneous views on the instantaneous mean return, this will result in arbitrage opportunities. Behavioral finance proponents argue that such heterogenous views are likely to occur and this will not impact option pricing models propose… ▽ More When pricing options, there may be different views on the instantaneous mean return of the underlying price process. According to Black (1972), where there exist heterogeneous views on the instantaneous mean return, this will result in arbitrage opportunities. Behavioral finance proponents argue that such heterogenous views are likely to occur and this will not impact option pricing models proposed by rational dynamic asset pricing theory and will not give rise to volatility smiles. To rectify this, a leading advocate of behavioral finance has proposed a behavioral option pricing model. As there may be unexplored links between the behavioral and rational approaches to option pricing, in this paper we revisit Shefrin (2008) option pricing model as an example and suggest one approach to modify this behavioral finance option pricing formula to be consistent with rational dynamic asset pricing theory by introducing arbitrage transaction costs which offset the gains from arbitrage trades. △ Less

Submitted 10 May, 2020; originally announced May 2020.

Comments: arXiv admin note: text overlap with arXiv:1710.03205

Natural Language Processing Advancements By Deep Learning: A Survey

Authors: Amirsina Torfi, Rouzbeh A. Shirvani, Yaser Keneshloo, Nader Tavaf, Edward A. Fox

Abstract: Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of large amounts of linguistic data have heightened the need and demand for automating semantic analysis using data-driven approaches. The utilization of data-drive… ▽ More Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of large amounts of linguistic data have heightened the need and demand for automating semantic analysis using data-driven approaches. The utilization of data-driven strategies is pervasive now due to the significant improvements demonstrated through the usage of deep learning methods in areas such as Computer Vision, Automatic Speech Recognition, and in particular, NLP. This survey categorizes and addresses the different aspects and applications of NLP that have benefited from deep learning. It covers core NLP tasks and applications and describes how deep learning methods and models advance these areas. We further analyze and compare different approaches and state-of-the-art models. △ Less

Submitted 27 February, 2021; v1 submitted 2 March, 2020; originally announced March 2020.

Choosing the Right Return Distribution and the Excess Volatility Puzzle

Authors: Abootaleb Shirvani, Frank J. Fabozzi

Abstract: Proponents of behavioral finance have identified several "puzzles" in the market that are inconsistent with rational finance theory. One such puzzle is the "excess volatility puzzle". Changes in equity prices are too large given changes in the fundamentals that are expected to change equity prices. In this paper, we offer a resolution to the excess volatility puzzle within the context of rational… ▽ More Proponents of behavioral finance have identified several "puzzles" in the market that are inconsistent with rational finance theory. One such puzzle is the "excess volatility puzzle". Changes in equity prices are too large given changes in the fundamentals that are expected to change equity prices. In this paper, we offer a resolution to the excess volatility puzzle within the context of rational finance. We empirically show that market inefficiency attributable to the volatility of excess return across time is caused by fitting an improper distribution to the historical returns. Our results indicate that the variation of gross excess returns is attributable to poorly fitting the tail of the return distribution and that the puzzle disappears by employing a more appropriate distribution for the return data. The new distribution that we introduce in this paper that better fits the historical return distribution of stocks explains the excess volatility in the market and thereby explains the volatility puzzle. Failing to estimate the historical returns using the proper distribution is only one possible explanation for the existence of the volatility puzzle. However, it offers statistical models within the rational finance framework which can be used without relying on behavioral finance assumptions when searching for an explanation for the volatility puzzle. △ Less

Submitted 23 January, 2020; originally announced January 2020.

A Socioeconomic Well-Being Index

Authors: A. Alexandre Trindade, Abootaleb Shirvani, Xiaohan Ma

Abstract: An annual well-being index constructed from thirteen socioeconomic factors is proposed in order to dynamically measure the mood of the US citizenry. Econometric models are fitted to the log-returns of the index in order to quantify its tail risk and perform option pricing and risk budgeting. By providing a statistically sound assessment of socioeconomic content, the index is consistent with ration… ▽ More An annual well-being index constructed from thirteen socioeconomic factors is proposed in order to dynamically measure the mood of the US citizenry. Econometric models are fitted to the log-returns of the index in order to quantify its tail risk and perform option pricing and risk budgeting. By providing a statistically sound assessment of socioeconomic content, the index is consistent with rational finance theory, enabling the construction and valuation of insurance-type financial instruments to serve as contracts written against it. Endogenously, the VXO volatility measure of the stock market appears to be the greatest contributor to tail risk. Exogenously, "stress-testing" the index against the politically important factors of trade imbalance and legal immigration, quantify the systemic risk. For probability levels in the range of 5% to 10%, values of trade below these thresholds are associated with larger downward movements of the index than for immigration at the same level. The main intent of the index is to provide early-warning for negative changes in the mood of citizens, thus alerting policy makers and private agents to potential future market downturns. △ Less

Submitted 3 January, 2020; originally announced January 2020.

Journal ref: Applied Economics and Finance, Vol. 7, No. 4; July 2020

Option Pricing in an Investment Risk-Return Setting

Authors: Abootaleb Shirvani, Frank J. Fabozzi, Stoyan V. Stoyanov

Abstract: In this paper, we combine modern portfolio theory and option pricing theory so that a trader who takes a position in a European option contract and the underlying assets can construct an optimal portfolio such that at the moment of the contract's maturity the contract is perfectly hedged. We derive both the optimal holdings in the underlying assets for the trader's optimal mean-variance portfolio… ▽ More In this paper, we combine modern portfolio theory and option pricing theory so that a trader who takes a position in a European option contract and the underlying assets can construct an optimal portfolio such that at the moment of the contract's maturity the contract is perfectly hedged. We derive both the optimal holdings in the underlying assets for the trader's optimal mean-variance portfolio and the amount of unhedged risk prior to maturity. Solutions assuming the cases where the price dynamics in the underlying assets follow discrete binomial price dynamics, continuous diffusions, stochastic volatility, volatility-of-volatility, and Merton-jump diffusion are derived. △ Less

Submitted 3 January, 2020; originally announced January 2020.

A Rational Finance Explanation of the Stock Predictability Puzzle

Authors: Abootaleb Shirvani, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: In this paper, we address one of the main puzzles in finance observed in the stock market by proponents of behavioral finance: the stock predictability puzzle. We offer a statistical model within the context of rational finance which can be used without relying on behavioral finance assumptions to model the predictability of stock returns. We incorporate the predictability of stock returns into th… ▽ More In this paper, we address one of the main puzzles in finance observed in the stock market by proponents of behavioral finance: the stock predictability puzzle. We offer a statistical model within the context of rational finance which can be used without relying on behavioral finance assumptions to model the predictability of stock returns. We incorporate the predictability of stock returns into the well-known Black-Scholes option pricing formula. Empirically, we analyze the option and spot trader's market predictability of stock prices by defining a forward-looking measure which we call "implied excess predictability". The empirical results indicate the effect of option trader's predictability of stock returns on the price of stock options is an increasing function of moneyness, while this effect is decreasing for spot traders. These empirical results indicate potential asymmetric predictability of stock prices by spot and option traders. We show in pricing options with the strike price significantly higher or lower than the stock price, the predictability of the underlying stock's return should be incorporated into the option pricing formula. In pricing options that have moneyness close to one, stock return predictability is not incorporated into the option pricing model because stock return predictability is the same for both types of traders. In other words, spot traders and option traders are equally informed about the future value of the stock market in this case. Comparing different volatility measures, we find that the difference between implied and realized variances or variance risk premium can potentially be used as a stock return predictor. △ Less

Submitted 5 November, 2019; originally announced November 2019.

A Regulated Market Under Sanctions: On Tail Dependence Between Oil, Gold, and Tehran Stock Exchange Index

Authors: Abootaleb Shirvani, Dimitri Volchenkov

Abstract: We demonstrate that the tail dependence should always be taken into account as a proxy for systematic risk of loss for investments. We provide the clear statistical evidence of that the structure of investment portfolios on a regulated market should be adjusted to the price of gold. Our finding suggests that the active bartering of oil for goods would prevent collapsing the national market facing… ▽ More We demonstrate that the tail dependence should always be taken into account as a proxy for systematic risk of loss for investments. We provide the clear statistical evidence of that the structure of investment portfolios on a regulated market should be adjusted to the price of gold. Our finding suggests that the active bartering of oil for goods would prevent collapsing the national market facing international sanctions. △ Less

Submitted 1 November, 2019; originally announced November 2019.

Journal ref: Journal of Vibration Testing and System Dynamics, Vol. 3(2), 297-311 (2019)

Option Pricing with Mixed Levy Subordinated Price Process and Implied Probability Weighting Function

Authors: Abootaleb Shirvani, Yuan Hu, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: It is essential to incorporate the impact of investor behavior when modeling the dynamics of asset returns. In this paper, we reconcile behavioral finance and rational finance by incorporating investor behavior within the framework of dynamic asset pricing theory. To include the views of investors, we employ the method of subordination which has been proposed in the literature by including busines… ▽ More It is essential to incorporate the impact of investor behavior when modeling the dynamics of asset returns. In this paper, we reconcile behavioral finance and rational finance by incorporating investor behavior within the framework of dynamic asset pricing theory. To include the views of investors, we employ the method of subordination which has been proposed in the literature by including business (intrinsic, market) time. We define a mixed Levy subordinated model by adding a single subordinated Levy process to the well-known log-normal model, resulting in a new log-price process. We apply the proposed models to study the behavioral finance notion of "greed and fear" disposition from the perspective of rational dynamic asset pricing theory. The greedy or fearful disposition of option traders is studied using the shape of the probability weighting function. We then derive the implied probability weighting function for the fear and greed deposition of option traders in comparison to spot traders. Our result shows the diminishing sensitivity of option traders. Diminishing sensitivity results in option traders overweighting the probability of big losses in comparison to spot traders. △ Less

Submitted 21 April, 2020; v1 submitted 13 October, 2019; originally announced October 2019.

Report number: jod.2020.1.102

Journal ref: The Journal of Derivatives Winter 2020, jod.2020.1.102;

Equity Premium Puzzle or Faulty Economic Modelling?

Authors: Abootaleb Shirvani, Stoyan V. Stoyanov, Frank J. Fabozzi, Svetlozar T. Rachev

Abstract: In this paper, we revisit the equity premium puzzle reported in 1985 by Mehra and Prescott. We show that the large equity premium that they report can be explained by choosing a more appropriate distribution for the return data. We demonstrate that the high-risk aversion value observed by Mehra and Prescott may be attributable to the problem of fitting a proper distribution to the historical retur… ▽ More In this paper, we revisit the equity premium puzzle reported in 1985 by Mehra and Prescott. We show that the large equity premium that they report can be explained by choosing a more appropriate distribution for the return data. We demonstrate that the high-risk aversion value observed by Mehra and Prescott may be attributable to the problem of fitting a proper distribution to the historical returns and partly caused by poorly fitting the tail of the return distribution. We describe a new distribution that better fits the return distribution and when used to describe historical returns can explain the large equity risk premium and thereby explains the puzzle. △ Less

Submitted 11 January, 2020; v1 submitted 27 September, 2019; originally announced September 2019.

Multiple Subordinated Modeling of Asset Returns

Authors: Abootaleb Shirvani, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: Subordination is an often used stochastic process in modeling asset prices. Subordinated Levy price processes and local volatility price processes are now the main tools in modern dynamic asset pricing theory. In this paper, we introduce the theory of multiple internally embedded financial time-clocks motivated by behavioral finance. To be consistent with dynamic asset pricing theory and option pr… ▽ More Subordination is an often used stochastic process in modeling asset prices. Subordinated Levy price processes and local volatility price processes are now the main tools in modern dynamic asset pricing theory. In this paper, we introduce the theory of multiple internally embedded financial time-clocks motivated by behavioral finance. To be consistent with dynamic asset pricing theory and option pricing, as suggested by behavioral finance, the investors' view is considered by introducing an intrinsic time process which we refer to as a behavioral subordinator. The process is subordinated to the Brownian motion process in the well-known log-normal model, resulting in a new log-price process. The number of embedded subordinations results in a new parameter that must be estimated and this parameter is as important as the mean and variance of asset returns. We describe new distributions, demonstrating how they can be applied to modeling the tail behavior of stock market returns. We apply the proposed models to modeling S&P 500 returns, treating the CBOE Volatility Index as intrinsic time change and the CBOE Volatility-of-Volatility Index as the volatility subordinator. We find that these volatility indexes are not proper time-change subordinators in modeling the returns of the S&P 500. △ Less

Submitted 29 July, 2019; originally announced July 2019.

Comments: 37 pages, 3 figures, 5 tables

MSC Class: 91G99

GASL: Guided Attention for Sparsity Learning in Deep Neural Networks

Authors: Amirsina Torfi, Rouzbeh A. Shirvani, Sobhan Soleymani, Naser M. Nasrabadi

Abstract: The main goal of network pruning is imposing sparsity on the neural network by increasing the number of parameters with zero value in order to reduce the architecture size and the computational speedup. In most of the previous research works, sparsity is imposed stochastically without considering any prior knowledge of the weights distribution or other internal network characteristics. Enforcing t… ▽ More The main goal of network pruning is imposing sparsity on the neural network by increasing the number of parameters with zero value in order to reduce the architecture size and the computational speedup. In most of the previous research works, sparsity is imposed stochastically without considering any prior knowledge of the weights distribution or other internal network characteristics. Enforcing too much sparsity may induce accuracy drop due to the fact that a lot of important elements might have been eliminated. In this paper, we propose Guided Attention for Sparsity Learning (GASL) to achieve (1) model compression by having less number of elements and speed-up; (2) prevent the accuracy drop by supervising the sparsity operation via a guided attention mechanism and (3) introduce a generic mechanism that can be adapted for any type of architecture; Our work is aimed at providing a framework based on interpretable attention mechanisms for imposing structured and non-structured sparsity in deep neural networks. For Cifar-100 experiments, we achieved the state-of-the-art sparsity level and 2.91x speedup with competitive accuracy compared to the best method. For MNIST and LeNet architecture we also achieved the highest sparsity and speedup level. △ Less

Submitted 15 January, 2019; v1 submitted 7 January, 2019; originally announced January 2019.

Attention-Based Guided Structured Sparsity of Deep Neural Networks

Authors: Amirsina Torfi, Rouzbeh A. Shirvani, Sobhan Soleymani, Nasser M. Nasrabadi

Abstract: Network pruning is aimed at imposing sparsity in a neural network architecture by increasing the portion of zero-valued weights for reducing its size regarding energy-efficiency consideration and increasing evaluation speed. In most of the conducted research efforts, the sparsity is enforced for network pruning without any attention to the internal network characteristics such as unbalanced output… ▽ More Network pruning is aimed at imposing sparsity in a neural network architecture by increasing the portion of zero-valued weights for reducing its size regarding energy-efficiency consideration and increasing evaluation speed. In most of the conducted research efforts, the sparsity is enforced for network pruning without any attention to the internal network characteristics such as unbalanced outputs of the neurons or more specifically the distribution of the weights and outputs of the neurons. That may cause severe accuracy drop due to uncontrolled sparsity. In this work, we propose an attention mechanism that simultaneously controls the sparsity intensity and supervised network pruning by keeping important information bottlenecks of the network to be active. On CIFAR-10, the proposed method outperforms the best baseline method by 6% and reduced the accuracy drop by 2.6x at the same level of sparsity. △ Less

Submitted 14 July, 2018; v1 submitted 12 February, 2018; originally announced February 2018.

Behavioral Finance -- Asset Prices Predictability, Equity Premium Puzzle, Volatility Puzzle: The Rational Finance Approach

Authors: Svetlozar Rachev, Stoyan Stoyanov, Stefan Mittnik, Frank J. Fabozzi, Abootaleb Shirvani

Abstract: In this paper we address three main objections of behavioral finance to the theory of rational finance, considered as anomalies the theory of rational finance cannot explain: Predictability of asset returns, The Equity Premium, (The Volatility Puzzle. We offer resolutions of those objections within the rational finance. We do not claim that those are the only possible explanations of the anomalies… ▽ More In this paper we address three main objections of behavioral finance to the theory of rational finance, considered as anomalies the theory of rational finance cannot explain: Predictability of asset returns, The Equity Premium, (The Volatility Puzzle. We offer resolutions of those objections within the rational finance. We do not claim that those are the only possible explanations of the anomalies, but offer statistical models within the rational theory of finance which can be used without relying on behavioral finance assumptions when searching for explanations of those anomalies. △ Less

Submitted 2 February, 2020; v1 submitted 9 October, 2017; originally announced October 2017.

Option Pricing with Greed and Fear Factor: The Rational Finance Approach

Authors: Svetlozar Rachev, Frank J. Fabozzi, Boryana Racheva-Iotova, Abootaleb Shirvani

Abstract: We explain the main concepts of Prospect Theory and Cumulative Prospect Theory within the framework of rational dynamic asset pricing theory. We derive option pricing formulas when asset returns are altered with a generalized Prospect Theory value function or a modified Prelec weighting probability function and introduce new parametric classes for Prospect Theory value functions and weighting prob… ▽ More We explain the main concepts of Prospect Theory and Cumulative Prospect Theory within the framework of rational dynamic asset pricing theory. We derive option pricing formulas when asset returns are altered with a generalized Prospect Theory value function or a modified Prelec weighting probability function and introduce new parametric classes for Prospect Theory value functions and weighting probability functions consistent with rational dynamic pricing Theory. We study the behavioral finance notion of greed and fear from the point of view of rational dynamic asset pricing theory and derive the corresponding option pricing formulas in the case of asset returns that follow continuous diffusion or discrete binomial trees. △ Less

Submitted 6 March, 2020; v1 submitted 23 September, 2017; originally announced September 2017.

Polar Coding for Achieving the Capacity of Marginal Channels in Nonbinary-Input Setting

Authors: Amirsina Torfi, Sobhan Soleymani, Seyed Mehdi Iranmanesh, Hadi Kazemi, Rouzbeh Asghari Shirvani, Vahid Tabataba Vakili

Abstract: Achieving information-theoretic security using explicit coding scheme in which unlimited computational power for eavesdropper is assumed, is one of the main topics is security consideration. It is shown that polar codes are capacity achieving codes and have a low complexity in encoding and decoding. It has been proven that polar codes reach to secrecy capacity in the binary-input wiretap channels… ▽ More Achieving information-theoretic security using explicit coding scheme in which unlimited computational power for eavesdropper is assumed, is one of the main topics is security consideration. It is shown that polar codes are capacity achieving codes and have a low complexity in encoding and decoding. It has been proven that polar codes reach to secrecy capacity in the binary-input wiretap channels in symmetric settings for which the wiretapper's channel is degraded with respect to the main channel. The first task of this paper is to propose a coding scheme to achieve secrecy capacity in asymmetric nonbinary-input channels while keeping reliability and security conditions satisfied. Our assumption is that the wiretap channel is stochastically degraded with respect to the main channel and message distribution is unspecified. The main idea is to send information set over good channels for Bob and bad channels for Eve and send random symbols for channels that are good for both. In this scheme the frozen vector is defined over all possible choices using polar codes ensemble concept. We proved that there exists a frozen vector for which the coding scheme satisfies reliability and security conditions. It is further shown that uniform distribution of the message is the necessary condition for achieving secrecy capacity. △ Less

Submitted 6 February, 2017; v1 submitted 20 January, 2017; originally announced January 2017.

Comments: Accepted to be published in "51th Conference on Information Sciences and Systems", Baltimore, Maryland

Journal ref: 51th Annual Conference on Information Sciences and Systems (CISS), 1-6 (2017)

A New Set of Financial Instruments

Authors: Abootaleb Shirvani, Stoyan V. Stoyanov, Svetlozar T. Rachev, Frank J. Fabozzi

Abstract: In complete markets, there are risky assets and a riskless asset. It is assumed that the riskless asset and the risky asset are traded continuously in time and that the market is frictionless. In this paper, we propose a new method for hedging derivatives assuming that a hedger should not always rely on trading existing assets that are used to form a linear portfolio comprised of the risky asset,… ▽ More In complete markets, there are risky assets and a riskless asset. It is assumed that the riskless asset and the risky asset are traded continuously in time and that the market is frictionless. In this paper, we propose a new method for hedging derivatives assuming that a hedger should not always rely on trading existing assets that are used to form a linear portfolio comprised of the risky asset, the riskless asset, and standard derivatives, but rather should design a set of specific, most-suited financial instruments for the hedging problem. We introduce a sequence of new financial instruments best suited for hedging jump-diffusion and stochastic volatility market models. The new instruments we introduce are perpetual derivatives. More specifically, they are options with perpetual maturities. In a financial market where perpetual derivatives are introduced, there is a new set of partial and partial-integro differential equations for pricing derivatives. Our analysis demonstrates that the set of new financial instruments together with a risk measure called the tail-loss ratio measure defined by the new instrument's return series can be potentially used as an early warning system for a market crash. △ Less

Submitted 1 October, 2019; v1 submitted 2 December, 2016; originally announced December 2016.

Automatic Detection of Small Groups of Persons, Influential Members, Relations and Hierarchy in Written Conversations Using Fuzzy Logic

Authors: French Pope III, Rouzbeh A. Shirvani, Mugizi Robert Rwebangira, Mohamed Chouikha, Ayo Taylor, Andres Alarcon Ramirez, Amirsina Torfi

Abstract: Nowadays a lot of data is collected in online forums. One of the key tasks is to determine the social structure of these online groups, for example the identification of subgroups within a larger group. We will approach the grouping of individual as a classification problem. The classifier will be based on fuzzy logic. The input to the classifier will be linguistic features and degree of relations… ▽ More Nowadays a lot of data is collected in online forums. One of the key tasks is to determine the social structure of these online groups, for example the identification of subgroups within a larger group. We will approach the grouping of individual as a classification problem. The classifier will be based on fuzzy logic. The input to the classifier will be linguistic features and degree of relationships (among individuals). The output of the classifiers are the groupings of individuals. We also incorporate a method that ranks the members of the detected subgroup to identify the hierarchies in each subgroup. Data from the HBO television show The Wire is used to analyze the efficacy and usefulness of fuzzy logic based methods as alternative methods to classical statistical methods usually used for these problems. The proposed methodology could detect automatically the most influential members of each organization The Wire with 90% accuracy. △ Less

Submitted 5 October, 2016; originally announced October 2016.

Models of fragmentation with power law log-normal distributions

Authors: Z. Tavassoli, A. Esmaeilnia Shirvani

Abstract: Two models of binary fragmentation are introduced in which a time dependent transition size produces two regions of fragment sizes above and below the transition size. In the models we consider a fixed rate of fragmentation for the largest fragment and two different rates of fragmentation for the two regions of sizes above and below the transition size. The models are solved exactly in the long… ▽ More Two models of binary fragmentation are introduced in which a time dependent transition size produces two regions of fragment sizes above and below the transition size. In the models we consider a fixed rate of fragmentation for the largest fragment and two different rates of fragmentation for the two regions of sizes above and below the transition size. The models are solved exactly in the long time limit to reveal stable time-invariant solutions for the fragment size distributions. A rate of fragmentation proportional to the inverse of fragment size in the smaller size region produces a power law distribution in that region. A rate of fragmentation combined of two terms, one proportional to the inverse of the fragment size and the other proportional to a logarithmic function of the fragment size, in the larger size region produces a log-normal distribution in that region. Special cases of the models with no fragmentation for the smaller fragments are also considered. The similarities between the stable distributions in our models and power law log-normal distributions from experimental work on shock fragmentation of long thin glass rods and rupture of mercury droplets are investigated. △ Less

Submitted 4 April, 2000; v1 submitted 7 March, 2000; originally announced March 2000.

Comments: 22 pages, no figures