-
Gaussian Cumulative Prospect Theory
Authors:
Mederic Motte
Abstract:
We propose a novel parametrization of Cumulative Prospect Theory (CPT), as developed by Daniel Kahneman and Amos Tversky, that yields an explicit gamble valuation formula for Gaussian reward distributions. Specifically, we define parametric functions $ v_θ $, $ w^{-}_θ $, and $ w^{+}_θ $ satisfying three key properties. The first, \emph{validity}, ensures that for any parameter $θ$, the functions…
▽ More
We propose a novel parametrization of Cumulative Prospect Theory (CPT), as developed by Daniel Kahneman and Amos Tversky, that yields an explicit gamble valuation formula for Gaussian reward distributions. Specifically, we define parametric functions $ v_θ $, $ w^{-}_θ $, and $ w^{+}_θ $ satisfying three key properties. The first, \emph{validity}, ensures that for any parameter $θ$, the functions conform to the qualitative principles of CPT: $ v_θ $ is concave over gains and convex over losses with a steeper slope for losses; $ w^{-}_θ $ and $ w^{+}_θ $ are increasing, exhibit inverse S-shaped curves, and map 0 to 0 and 1 to 1. The second, \emph{richness}, guarantees that the parametrization is expressive enough to capture a wide range of behaviors: $ v_θ $ can exhibit arbitrary asymptotic behavior and convergence rates, while $ w^{-}_θ $ and $ w^{+}_θ $ can achieve any specified crossover points and slopes. The third, \emph{explicit valuation}, ensures that for any $θ$, the CPT valuation of a Gaussian-distributed gamble (with arbitrary mean and variance) can be computed in closed form -- enabling efficient approximations for bell-shaped reward distributions. This framework is designed for scalable and rapid computation, making it particularly suited for applications involving large populations. We demonstrate its practicality through two illustrative examples in population-level CPT modeling.
△ Less
Submitted 4 May, 2025;
originally announced May 2025.
-
Opinion dynamics in communities with major influencers and implicit social influence via mean-field approximation
Authors:
Delia Coculescu,
Médéric Motte,
Huyên Pham
Abstract:
We study binary opinion formation in a large population where individuals are influenced by the opinions of other individuals. The population is characterised by the existence of (i) communities where individuals share some similar features, (ii) opinion leaders that may trigger unpredictable opinion shifts in the short term (iii) some degree of incomplete information in the observation of the ind…
▽ More
We study binary opinion formation in a large population where individuals are influenced by the opinions of other individuals. The population is characterised by the existence of (i) communities where individuals share some similar features, (ii) opinion leaders that may trigger unpredictable opinion shifts in the short term (iii) some degree of incomplete information in the observation of the individual or public opinion processes. In this setting, we study three different approximate mechanisms: common sampling approximation, independent sampling approximation, and, what will be our main focus in this paper, McKean-Vlasov (or mean-field) approximation. We show that all three approximations perform well in terms of different metrics that we introduce for measuring population level and individual level errors. In the presence of a common noise represented by the major influencers opinions processes, and despite the absence of idiosyncratic noises, we derive a propagation of chaos type result. For the particular case of a linear model and particular specifications of the major influencers opinion dynamics, we provide additional analysis, including long term behavior and fluctuations of the public opinion. The theoretical results are complemented by some concrete examples and numerical analysis, illustrating the formation of echo-chambers, the propagation of chaos, and phenomena such as snowball effect and social inertia.42 pages
△ Less
Submitted 28 June, 2023;
originally announced June 2023.
-
Quantitative propagation of chaos for mean field Markov decision process with common noise
Authors:
Médéric Motte,
Huyên Pham
Abstract:
We investigate propagation of chaos for mean field Markov Decision Process with common noise (CMKV-MDP), and when the optimization is performed over randomized open-loop controls on infinite horizon. We first state a rate of convergence of order $M_N^γ$, where $M_N$ is the mean rate of convergence in Wasserstein distance of the empirical measure, and $γ\in (0,1]$ is an explicit constant, in the li…
▽ More
We investigate propagation of chaos for mean field Markov Decision Process with common noise (CMKV-MDP), and when the optimization is performed over randomized open-loop controls on infinite horizon. We first state a rate of convergence of order $M_N^γ$, where $M_N$ is the mean rate of convergence in Wasserstein distance of the empirical measure, and $γ\in (0,1]$ is an explicit constant, in the limit of the value functions of $N$-agent control problem with asymmetric open-loop controls, towards the value function of CMKV-MDP. Furthermore, we show how to explicitly construct $(ε+\mathcal{O}(M_N^γ))$-optimal policies for the $N$-agent model from $ε$-optimal policies for the CMKV-MDP. Our approach relies on sharp comparison between the Bellman operators in the $N$-agent problem and the CMKV-MDP, and fine coupling of empirical measures.
△ Less
Submitted 26 July, 2022;
originally announced July 2022.
-
Optimal bidding strategies for digital advertising
Authors:
Médéric Motte,
Huyên Pham
Abstract:
With the emergence of new online channels and information technology, digital advertising tends to substitute more and more to traditional advertising by offering the opportunity to companies to target the consumers/users that are really interested by their products or services. We introduce a novel framework for the study of optimal bidding strategies associated to different types of advertising,…
▽ More
With the emergence of new online channels and information technology, digital advertising tends to substitute more and more to traditional advertising by offering the opportunity to companies to target the consumers/users that are really interested by their products or services. We introduce a novel framework for the study of optimal bidding strategies associated to different types of advertising, namely, commercial advertising for triggering purchases or subscriptions, and social marketing for alerting population about unhealthy behaviours (anti-drug, vaccination, road-safety campaigns). Our continuoustime models are based on a common framework encoding users online behaviours via their web-browsing at random times, and the targeted advertising auction mechanism widely used on Internet, the objective being to efficiently diffuse advertising information by means of digital channels. Our main results are to provide semi-explicit formulas for the optimal value and bidding policy for each of these problems. We show some sensitivity properties of the solution with respect to model parameters, and analyse how the different sources of digital information accessible to users including the social interactions affect the optimal bid for advertising auctions. We also study how to efficiently combine targeted advertising and non-targeted advertising mechanisms. Finally, some classes of examples with fully explicit formulas are derived.
△ Less
Submitted 16 November, 2021;
originally announced November 2021.
-
Mean-field Markov decision processes with common noise and open-loop controls
Authors:
Médéric Motte,
Huyên Pham
Abstract:
We develop an exhaustive study of Markov decision process (MDP) under mean field interaction both on states and actions in the presence of common noise, and when optimization is performed over open-loop controls on infinite horizon. Such model, called CMKV-MDP for conditional McKean-Vlasov MDP, arises and is obtained here rigorously with a rate of convergence as the asymptotic problem of N-coopera…
▽ More
We develop an exhaustive study of Markov decision process (MDP) under mean field interaction both on states and actions in the presence of common noise, and when optimization is performed over open-loop controls on infinite horizon. Such model, called CMKV-MDP for conditional McKean-Vlasov MDP, arises and is obtained here rigorously with a rate of convergence as the asymptotic problem of N-cooperative agents controlled by a social planner/influencer that observes the environment noises but not necessarily the individual states of the agents. We highlight the crucial role of relaxed controls and randomization hypothesis for this class of models with respect to classical MDP theory. We prove the correspondence between CMKV-MDP and a general lifted MDP on the space of probability measures, and establish the dynamic programming Bellman fixed point equation satisfied by the value function, as well as the existence of-optimal randomized feedback controls. The arguments of proof involve an original measurable optimal coupling for the Wasserstein distance. This provides a procedure for learning strategies in a large population of interacting collaborative agents. MSC Classification: 90C40, 49L20.
△ Less
Submitted 9 September, 2021; v1 submitted 17 December, 2019;
originally announced December 2019.