-
The Learning Approach to Games
Authors:
Melih İşeri,
Erhan Bayraktar
Abstract:
This work provides a unified framework for exploring games. In existing literature, strategies of players are typically assigned scalar values, and the concept of Nash equilibrium is used to identify compatible strategies. However, this approach lacks the internal structure of a player, thereby failing to accurately model observed behaviors in reality. To address this limitation, we propose to cha…
▽ More
This work provides a unified framework for exploring games. In existing literature, strategies of players are typically assigned scalar values, and the concept of Nash equilibrium is used to identify compatible strategies. However, this approach lacks the internal structure of a player, thereby failing to accurately model observed behaviors in reality. To address this limitation, we propose to characterize players by their learning algorithms, and as their estimations intrinsically induce a distribution over strategies, we introduced the notion of equilibrium in terms of characterizing the recurrent behaviors of the learning algorithms. This approach allows for a more nuanced understanding of players, and brings the focus to the challenge of learning that players face. While our explorations in discrete games, mean-field games, and reinforcement learning demonstrate the framework's broad applicability, they also set the stage for future research aimed at specific applications.
△ Less
Submitted 28 February, 2025;
originally announced March 2025.
-
Set Valued Hamilton-Jacobi-Bellman Equations
Authors:
Melih İşeri,
Jianfeng Zhang
Abstract:
Building upon the dynamic programming principle for set valued functions arising from many applications, in this paper we propose a new notion of set valued PDEs. The key component in the theory is a set valued Itô formula, characterizing the flows on the surface of the dynamic sets. In the contexts of multivariate control problems, we establish the wellposedness of the set valued HJB equations, w…
▽ More
Building upon the dynamic programming principle for set valued functions arising from many applications, in this paper we propose a new notion of set valued PDEs. The key component in the theory is a set valued Itô formula, characterizing the flows on the surface of the dynamic sets. In the contexts of multivariate control problems, we establish the wellposedness of the set valued HJB equations, which extends the standard HJB equations in the scalar case to the multivariate case. As an application, a moving scalarization for certain time inconsistent problems is constructed by using the classical solution of the set valued HJB equation.
△ Less
Submitted 6 April, 2024; v1 submitted 9 November, 2023;
originally announced November 2023.
-
Set Values for Mean Field Games
Authors:
Melih Iseri,
Jianfeng Zhang
Abstract:
In this paper we study mean field games with possibly multiple mean field equilibria. Instead of focusing on the individual equilibria, we propose to study the set of values over all possible equilibria, which we call the set value of the mean field game. When the mean field equilibrium is unique, typically under certain monotonicity conditions, our set value reduces to the singleton of the standa…
▽ More
In this paper we study mean field games with possibly multiple mean field equilibria. Instead of focusing on the individual equilibria, we propose to study the set of values over all possible equilibria, which we call the set value of the mean field game. When the mean field equilibrium is unique, typically under certain monotonicity conditions, our set value reduces to the singleton of the standard value function which solves the master equation. The set value is by nature unique, and we shall establish two crucial properties: (i) the dynamic programming principle, also called time consistency; and (ii) the convergence of the set values of the corresponding $N$-player games, which can be viewed as a type of stability result. To our best knowledge, this is the first work in the literature which studies the dynamic value of mean field games without requiring the uniqueness of mean field equilibria. We emphasize that the set value is very sensitive to the type of the admissible controls. In particular, for the convergence one has to restrict to corresponding types of equilibria for the N-player game and for the mean field game. We shall illustrate this point by investigating three cases, two in finite state space models and the other in a continuous time model with controlled diffusions.
△ Less
Submitted 16 March, 2024; v1 submitted 4 July, 2021;
originally announced July 2021.
-
Depinning as a coagulation process
Authors:
Melih İşeri,
David C. Kaspar,
Muhittin Mungan
Abstract:
We consider a one-dimensional sandpile model which mimics an elastic string of particles driven through a strongly pinning periodic environment with phase disorder. The evolution towards depinning occurs by the triggering of avalanches in regions of activity which are at first isolated but later grow and merge. For large system sizes the dynamically critical behavior is dominated by the coagulatio…
▽ More
We consider a one-dimensional sandpile model which mimics an elastic string of particles driven through a strongly pinning periodic environment with phase disorder. The evolution towards depinning occurs by the triggering of avalanches in regions of activity which are at first isolated but later grow and merge. For large system sizes the dynamically critical behavior is dominated by the coagulation of these active regions. Our analysis of the evolution and numerical simulations show that the observed sizes of active regions is well-described by a Smoluchowski coagulation equation, allowing us to predict correlation lengths and avalanche sizes.
△ Less
Submitted 12 February, 2016; v1 submitted 20 January, 2016;
originally announced January 2016.
