-
Latent Variable Estimation in Bayesian Black-Litterman Models
Authors:
Thomas Y. L. Lin,
Jerry Yao-Chieh Hu,
Paul W. Chiou,
Peter Lin
Abstract:
We revisit the Bayesian Black-Litterman (BL) portfolio model and remove its reliance on subjective investor views. Classical BL requires an investor "view": a forecast vector $q$ and its uncertainty matrix $Ω$ that describe how much a chosen portfolio should outperform the market. Our key idea is to treat $(q,Ω)$ as latent variables and learn them from market data within a single Bayesian network.…
▽ More
We revisit the Bayesian Black-Litterman (BL) portfolio model and remove its reliance on subjective investor views. Classical BL requires an investor "view": a forecast vector $q$ and its uncertainty matrix $Ω$ that describe how much a chosen portfolio should outperform the market. Our key idea is to treat $(q,Ω)$ as latent variables and learn them from market data within a single Bayesian network. Consequently, the resulting posterior estimation admits closed-form expression, enabling fast inference and stable portfolio weights. Building on these, we propose two mechanisms to capture how features interact with returns: shared-latent parametrization and feature-influenced views; both recover classical BL and Markowitz portfolios as special cases. Empirically, on 30-year Dow-Jones and 20-year sector-ETF data, we improve Sharpe ratios by 50% and cut turnover by 55% relative to Markowitz and the index baselines. This work turns BL into a fully data-driven, view-free, and coherent Bayesian framework for portfolio optimization.
△ Less
Submitted 4 May, 2025;
originally announced May 2025.
-
Strategic Collusion of LLM Agents: Market Division in Multi-Commodity Competitions
Authors:
Ryan Y. Lin,
Siddhartha Ojha,
Kevin Cai,
Maxwell F. Chen
Abstract:
Machine-learning technologies are seeing increased deployment in real-world market scenarios. In this work, we explore the strategic behaviors of large language models (LLMs) when deployed as autonomous agents in multi-commodity markets, specifically within Cournot competition frameworks. We examine whether LLMs can independently engage in anti-competitive practices such as collusion or, more spec…
▽ More
Machine-learning technologies are seeing increased deployment in real-world market scenarios. In this work, we explore the strategic behaviors of large language models (LLMs) when deployed as autonomous agents in multi-commodity markets, specifically within Cournot competition frameworks. We examine whether LLMs can independently engage in anti-competitive practices such as collusion or, more specifically, market division. Our findings demonstrate that LLMs can effectively monopolize specific commodities by dynamically adjusting their pricing and resource allocation strategies, thereby maximizing profitability without direct human input or explicit collusion commands. These results pose unique challenges and opportunities for businesses looking to integrate AI into strategic roles and for regulatory bodies tasked with maintaining fair and competitive markets. The study provides a foundation for further exploration into the ramifications of deferring high-stakes decisions to LLM-based agents.
△ Less
Submitted 16 May, 2025; v1 submitted 19 September, 2024;
originally announced October 2024.
-
A Krasnoselskii-Mann Proximity Algorithm for Markowitz Portfolios with Adaptive Expected Return Level
Authors:
Yizun Lin,
Yongxin He,
Zhao-Rong Lai
Abstract:
Markowitz's criterion aims to balance expected return and risk when optimizing the portfolio. The expected return level is usually fixed according to the risk appetite of an investor, then the risk is minimized at this fixed return level. However, the investor may not know which return level is suitable for her/him and the current financial circumstance. It motivates us to find a novel approach th…
▽ More
Markowitz's criterion aims to balance expected return and risk when optimizing the portfolio. The expected return level is usually fixed according to the risk appetite of an investor, then the risk is minimized at this fixed return level. However, the investor may not know which return level is suitable for her/him and the current financial circumstance. It motivates us to find a novel approach that adaptively optimizes this return level and the portfolio at the same time. It not only relieves the trouble of deciding the return level during an investment but also gets more adaptive to the ever-changing financial market than a subjective return level. In order to solve the new model, we propose an exact, convergent, and efficient Krasnoselskii-Mann Proximity Algorithm based on the proximity operator and Krasnoselskii-Mann momentum technique. Extensive experiments show that the proposed method achieves significant improvements over state-of-the-art methods in portfolio optimization. This finding may contribute a new perspective on the relationship between return and risk in portfolio optimization.
△ Less
Submitted 7 November, 2024; v1 submitted 20 September, 2024;
originally announced September 2024.
-
Autonomous Sparse Mean-CVaR Portfolio Optimization
Authors:
Yizun Lin,
Yangyu Zhang,
Zhao-Rong Lai,
Cheng Li
Abstract:
The $\ell_0$-constrained mean-CVaR model poses a significant challenge due to its NP-hard nature, typically tackled through combinatorial methods characterized by high computational demands. From a markedly different perspective, we propose an innovative autonomous sparse mean-CVaR portfolio model, capable of approximating the original $\ell_0$-constrained mean-CVaR model with arbitrary accuracy.…
▽ More
The $\ell_0$-constrained mean-CVaR model poses a significant challenge due to its NP-hard nature, typically tackled through combinatorial methods characterized by high computational demands. From a markedly different perspective, we propose an innovative autonomous sparse mean-CVaR portfolio model, capable of approximating the original $\ell_0$-constrained mean-CVaR model with arbitrary accuracy. The core idea is to convert the $\ell_0$ constraint into an indicator function and subsequently handle it through a tailed approximation. We then propose a proximal alternating linearized minimization algorithm, coupled with a nested fixed-point proximity algorithm (both convergent), to iteratively solve the model. Autonomy in sparsity refers to retaining a significant portion of assets within the selected asset pool during adjustments in pool size. Consequently, our framework offers a theoretically guaranteed approximation of the $\ell_0$-constrained mean-CVaR model, improving computational efficiency while providing a robust asset selection scheme.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Mean-variance hybrid portfolio optimization with quantile-based risk measure
Authors:
Weiping Wu,
Yu Lin,
Jianjun Gao,
Ke Zhou
Abstract:
This paper addresses the importance of incorporating various risk measures in portfolio management and proposes a dynamic hybrid portfolio optimization model that combines the spectral risk measure and the Value-at-Risk in the mean-variance formulation. By utilizing the quantile optimization technique and martingale representation, we offer a solution framework for these issues and also develop a…
▽ More
This paper addresses the importance of incorporating various risk measures in portfolio management and proposes a dynamic hybrid portfolio optimization model that combines the spectral risk measure and the Value-at-Risk in the mean-variance formulation. By utilizing the quantile optimization technique and martingale representation, we offer a solution framework for these issues and also develop a closed-form portfolio policy when all market parameters are deterministic. Our hybrid model outperforms the classical continuous-time mean-variance portfolio policy by allocating a higher position of the risky asset in favorable market states and a less risky asset in unfavorable market states. This desirable property leads to promising numerical experiment results, including improved Sortino ratio and reduced downside risk compared to the benchmark models.
△ Less
Submitted 10 April, 2023; v1 submitted 28 March, 2023;
originally announced March 2023.
-
Predicting the Behavior of Dealers in Over-The-Counter Corporate Bond Markets
Authors:
Yusen Lin,
Jinming Xue,
Louiqa Raschid
Abstract:
Trading in Over-The-Counter (OTC) markets is facilitated by broker-dealers, in comparison to public exchanges, e.g., the New York Stock Exchange (NYSE). Dealers play an important role in stabilizing prices and providing liquidity in OTC markets. We apply machine learning methods to model and predict the trading behavior of OTC dealers for US corporate bonds. We create sequences of daily historical…
▽ More
Trading in Over-The-Counter (OTC) markets is facilitated by broker-dealers, in comparison to public exchanges, e.g., the New York Stock Exchange (NYSE). Dealers play an important role in stabilizing prices and providing liquidity in OTC markets. We apply machine learning methods to model and predict the trading behavior of OTC dealers for US corporate bonds. We create sequences of daily historical transaction reports for each dealer over a vocabulary of US corporate bonds. Using this history of dealer activity, we predict the future trading decisions of the dealer. We consider a range of neural network-based prediction models. We propose an extension, the Pointwise-Product ReZero (PPRZ) Transformer model, and demonstrate the improved performance of our model. We show that individual history provides the best predictive model for the most active dealers. For less active dealers, a collective model provides improved performance. Further, clustering dealers based on their similarity can improve performance. Finally, prediction accuracy varies based on the activity level of both the bond and the dealer.
△ Less
Submitted 11 March, 2021;
originally announced March 2021.
-
Generating Realistic Stock Market Order Streams
Authors:
Junyi Li,
Xitong Wang,
Yaoyang Lin,
Arunesh Sinha,
Micheal P. Wellman
Abstract:
We propose an approach to generate realistic and high-fidelity stock market data based on generative adversarial networks (GANs). Our Stock-GAN model employs a conditional Wasserstein GAN to capture history dependence of orders. The generator design includes specially crafted aspects including components that approximate the market's auction mechanism, augmenting the order history with order-book…
▽ More
We propose an approach to generate realistic and high-fidelity stock market data based on generative adversarial networks (GANs). Our Stock-GAN model employs a conditional Wasserstein GAN to capture history dependence of orders. The generator design includes specially crafted aspects including components that approximate the market's auction mechanism, augmenting the order history with order-book constructions to improve the generation task. We perform an ablation study to verify the usefulness of aspects of our network structure. We provide a mathematical characterization of distribution learned by the generator. We also propose statistics to measure the quality of generated orders. We test our approach with synthetic and actual market data, compare to many baseline generative models, and find the generated data to be close to real data.
△ Less
Submitted 7 June, 2020;
originally announced June 2020.
-
Utility maximization problem under transaction costs: optimal dual processes and stability
Authors:
Lingqi Gu,
Yiqing Lin,
Junjian Yang
Abstract:
This paper discusses the numéraire-based utility maximization problem in markets with proportional transaction costs. In particular, the investor is required to liquidate all her position in stock at the terminal time. We first observe the stability of the primal and dual value functions as well as the convergence of the primal and dual optimizers when perturbations occur on the utility function a…
▽ More
This paper discusses the numéraire-based utility maximization problem in markets with proportional transaction costs. In particular, the investor is required to liquidate all her position in stock at the terminal time. We first observe the stability of the primal and dual value functions as well as the convergence of the primal and dual optimizers when perturbations occur on the utility function and on the physical probability. We then study the properties of the optimal dual process (ODP), that is, a process from the dual domain that induces the optimality of the dual problem. When the market is driven by a continuous process, we construct the ODP for the problem in the limiting market by a sequence of ODPs corresponding to the problems with small misspecificated parameters. Moreover, we prove that this limiting ODP defines a shadow price.
△ Less
Submitted 12 October, 2017;
originally announced October 2017.
-
Utility maximization problem with random endowment and transaction costs: when wealth may become negative
Authors:
Yiqing Lin,
Junjian Yang
Abstract:
In this paper we study the problem of maximizing expected utility from the terminal wealth with proportional transaction costs and random endowment. In the context of the existence of consistent price systems, we consider the duality between the primal utility maximization problem and the dual one, which is set up on the domain of finitely additive measures. In particular, we prove duality results…
▽ More
In this paper we study the problem of maximizing expected utility from the terminal wealth with proportional transaction costs and random endowment. In the context of the existence of consistent price systems, we consider the duality between the primal utility maximization problem and the dual one, which is set up on the domain of finitely additive measures. In particular, we prove duality results for utility functions supporting possibly negative values. Moreover, we construct the shadow market by the dual optimal process and consider the utility based pricing for random endowment.
△ Less
Submitted 5 September, 2016; v1 submitted 27 April, 2016;
originally announced April 2016.
-
On the existence of shadow prices for optimal investment with random endowment
Authors:
Lingqi Gu,
Yiqing Lin,
Junjian Yang
Abstract:
In this paper, we consider a numéraire-based utility maximization problem under constant proportional transaction costs and random endowment. Assuming that the agent cannot short sell assets and is endowed with a strictly positive contingent claim, a primal optimizer of this utility maximization problem exists. Moreover, we observe that the original market with transaction costs can be replaced by…
▽ More
In this paper, we consider a numéraire-based utility maximization problem under constant proportional transaction costs and random endowment. Assuming that the agent cannot short sell assets and is endowed with a strictly positive contingent claim, a primal optimizer of this utility maximization problem exists. Moreover, we observe that the original market with transaction costs can be replaced by a frictionless shadow market that yields the same optimality. On the other hand, we present an example to show that in some case when these constraints are relaxed, the existence of shadow prices is still warranted.
△ Less
Submitted 23 February, 2017; v1 submitted 2 February, 2016;
originally announced February 2016.
-
A note on utility maximization with transaction costs and random endoment: numéraire-based model and convex duality
Authors:
Lingqi Gu,
Yiqing Lin,
Junjian Yang
Abstract:
In this note, we study the utility maximization problem on the terminal wealth under proportional transaction costs and bounded random endowment. In particular, we restrict ourselves to the numéraire-based model and work with utility functions only supporting R+. Under the assumption of existence of consistent price systems and natural regularity conditions, standard convex duality results are est…
▽ More
In this note, we study the utility maximization problem on the terminal wealth under proportional transaction costs and bounded random endowment. In particular, we restrict ourselves to the numéraire-based model and work with utility functions only supporting R+. Under the assumption of existence of consistent price systems and natural regularity conditions, standard convex duality results are established. Precisely, we first enlarge the dual domain from the collection of martingale densities associated with consistent price systems to a set of finitely additive measures; then the dual formulation of the utility maximization problem can be regarded as an extension of the paper of Cvitanić-Schachermayer-Wang (2001) to the context under proportional transaction costs.
△ Less
Submitted 4 February, 2016; v1 submitted 2 February, 2016;
originally announced February 2016.
