-
On the cosine similarity and orthogonality between persistence diagrams
Authors:
Azmeer Nordin,
Mohd Salmi Md Noorani,
Nurulkamal Masseran,
Mohd Sabri Ismail,
Nur Firyal Roslan
Abstract:
Topological data analysis is an approach to study shape of a data set by means of topology. Its main object of study is the persistence diagram, which represents the topological features of the data set at different spatial resolutions. Multiple data sets can be compared by the similarity of their diagrams to understand their behaviors in relative to each other. The bottleneck and Wasserstein dist…
▽ More
Topological data analysis is an approach to study shape of a data set by means of topology. Its main object of study is the persistence diagram, which represents the topological features of the data set at different spatial resolutions. Multiple data sets can be compared by the similarity of their diagrams to understand their behaviors in relative to each other. The bottleneck and Wasserstein distances are often used as a tool to indicate the similarity. In this paper, we introduce cosine similarity as a new indicator for the similarity between persistence diagrams and investigate its properties. Furthermore, it leads to the new notion of orthogonality between persistence diagrams. It turns out that the orthogonality refers to perfect dissimilarity between persistence diagrams under the cosine similarity. Through data demonstration, the cosine similarity is shown to be more accurate than the standard distances to measure the similarity between persistence diagrams.
△ Less
Submitted 6 April, 2025;
originally announced April 2025.
-
Performance rating in chess, tennis, and other contexts
Authors:
Mehmet S. Ismail
Abstract:
In this note, I introduce Estimated Performance Rating (PR$^e$), a novel system for evaluating player performance in sports and games. PR$^e$ addresses a key limitation of the Tournament Performance Rating (TPR) system, which is undefined for zero or perfect scores in a series of games. PR$^e$ is defined as the rating that solves an optimization problem related to scoring probability, making it ap…
▽ More
In this note, I introduce Estimated Performance Rating (PR$^e$), a novel system for evaluating player performance in sports and games. PR$^e$ addresses a key limitation of the Tournament Performance Rating (TPR) system, which is undefined for zero or perfect scores in a series of games. PR$^e$ is defined as the rating that solves an optimization problem related to scoring probability, making it applicable for any performance level. The main theorem establishes that the PR$^e$ of a player is equivalent to the TPR whenever the latter is defined. I then apply this system to historically significant win-streaks in association football, tennis, and chess. Beyond sports, PR$^e$ has broad applicability in domains where Elo ratings are used, from college rankings to the evaluation of large language models.
△ Less
Submitted 19 December, 2023;
originally announced December 2023.
-
Human and Machine Intelligence in n-Person Games with Partial Knowledge: Theory and Computation
Authors:
Mehmet S. Ismail
Abstract:
In this paper, I formalize intelligence measurement in games by introducing mechanisms that assign a real number -- interpreted as an intelligence score -- to each player in a game. This score quantifies the ex-post strategic ability of the players based on empirically observable information, such as the actions of the players, the game's outcome, strength of the players, and a reference oracle ma…
▽ More
In this paper, I formalize intelligence measurement in games by introducing mechanisms that assign a real number -- interpreted as an intelligence score -- to each player in a game. This score quantifies the ex-post strategic ability of the players based on empirically observable information, such as the actions of the players, the game's outcome, strength of the players, and a reference oracle machine such as a chess-playing artificial intelligence system. Specifically, I introduce two main concepts: first, the Game Intelligence (GI) mechanism, which quantifies a player's intelligence in a game by considering not only the game's outcome but also the "mistakes" made during the game according to the reference machine's intelligence. Second, I define gamingproofness, a practical and computational concept of strategyproofness. To illustrate the GI mechanism, I apply it to an extensive dataset comprising over a billion chess moves, including over a million moves made by top 20 grandmasters in history. Notably, Magnus Carlsen emerges with the highest GI score among all world championship games included in the dataset. In machine-vs-machine games, the well-known chess engine Stockfish comes out on top.
△ Less
Submitted 14 February, 2024; v1 submitted 27 February, 2023;
originally announced February 2023.
-
AI-powered mechanisms as judges: Breaking ties in chess
Authors:
Nejat Anbarci,
Mehmet S. Ismail
Abstract:
Recently, Artificial Intelligence (AI) technology use has been rising in sports to reach decisions of various complexity. At a relatively low complexity level, for example, major tennis tournaments replaced human line judges with Hawk-Eye Live technology to reduce staff during the COVID-19 pandemic. AI is now ready to move beyond such mundane tasks, however. A case in point and a perfect applicati…
▽ More
Recently, Artificial Intelligence (AI) technology use has been rising in sports to reach decisions of various complexity. At a relatively low complexity level, for example, major tennis tournaments replaced human line judges with Hawk-Eye Live technology to reduce staff during the COVID-19 pandemic. AI is now ready to move beyond such mundane tasks, however. A case in point and a perfect application ground is chess. To reduce the growing incidence of ties, many elite tournaments have resorted to fast chess tiebreakers. However, these tiebreakers significantly reduce the quality of games. To address this issue, we propose a novel AI-driven method for an objective tiebreaking mechanism. This method evaluates the quality of players' moves by comparing them to the optimal moves suggested by powerful chess engines. If there is a tie, the player with the higher quality measure wins the tiebreak. This approach not only enhances the fairness and integrity of the competition but also maintains the game's high standards. To show the effectiveness of our method, we apply it to a dataset comprising approximately 25,000 grandmaster moves from World Chess Championship matches spanning from 1910 to 2018, using Stockfish 16, a leading chess AI, for analysis.
△ Less
Submitted 18 July, 2024; v1 submitted 15 October, 2022;
originally announced October 2022.
-
Optimin achieves super-Nash performance
Authors:
Mehmet S. Ismail
Abstract:
Since the 1990s, AI systems have achieved superhuman performance in major zero-sum games where "winning" has an unambiguous definition. However, most social interactions are mixed-motive games, where measuring the performance of AI systems is a non-trivial task. In this paper, I propose a novel benchmark called super-Nash performance to assess the performance of AI systems in mixed-motive settings…
▽ More
Since the 1990s, AI systems have achieved superhuman performance in major zero-sum games where "winning" has an unambiguous definition. However, most social interactions are mixed-motive games, where measuring the performance of AI systems is a non-trivial task. In this paper, I propose a novel benchmark called super-Nash performance to assess the performance of AI systems in mixed-motive settings. I show that a solution concept called optimin achieves super-Nash performance in every n-person game, i.e., for every Nash equilibrium there exists an optimin where every player not only receives but also guarantees super-Nash payoffs even if the others deviate unilaterally and profitably from the optimin.
△ Less
Submitted 2 October, 2022;
originally announced October 2022.
-
Exploring the Constraints on Artificial General Intelligence: A Game-Theoretic No-Go Theorem
Authors:
Mehmet S. Ismail
Abstract:
The emergence of increasingly sophisticated artificial intelligence (AI) systems have sparked intense debate among researchers, policymakers, and the public due to their potential to surpass human intelligence and capabilities in all domains. In this paper, I propose a game-theoretic framework that captures the strategic interactions between a human agent and a potential superhuman machine agent.…
▽ More
The emergence of increasingly sophisticated artificial intelligence (AI) systems have sparked intense debate among researchers, policymakers, and the public due to their potential to surpass human intelligence and capabilities in all domains. In this paper, I propose a game-theoretic framework that captures the strategic interactions between a human agent and a potential superhuman machine agent. I identify four key assumptions: Strategic Unpredictability, Access to Machine's Strategy, Rationality, and Superhuman Machine. The main result of this paper is an impossibility theorem: these four assumptions are inconsistent when taken together, but relaxing any one of them results in a consistent set of assumptions. Two straightforward policy recommendations follow: first, policymakers should control access to specific human data to maintain Strategic Unpredictability; and second, they should grant select AI researchers access to superhuman machine research to ensure Access to Machine's Strategy holds. My analysis contributes to a better understanding of the context that can shape the theoretical development of superhuman AI.
△ Less
Submitted 9 November, 2023; v1 submitted 25 September, 2022;
originally announced September 2022.
-
Rationality and correctness in n-player games
Authors:
Lorenzo Bastianello,
Mehmet S. Ismail
Abstract:
There are two well-known sufficient conditions for Nash equilibrium in two-player games: mutual knowledge of rationality (MKR) and mutual knowledge of conjectures. MKR assumes that the concept of rationality is mutually known. In contrast, mutual knowledge of conjectures assumes that a given profile of conjectures is mutually known, which has long been recognized as a strong assumption. In this no…
▽ More
There are two well-known sufficient conditions for Nash equilibrium in two-player games: mutual knowledge of rationality (MKR) and mutual knowledge of conjectures. MKR assumes that the concept of rationality is mutually known. In contrast, mutual knowledge of conjectures assumes that a given profile of conjectures is mutually known, which has long been recognized as a strong assumption. In this note, we introduce a notion of "mutual assumption of rationality and correctness" (MARC), which conceptually aligns more closely with the MKR assumption. We present two main results. Our first result establishes that MARC holds in every two-person zero-sum game. In our second theorem, we show that MARC does not in general hold in n-player games.
△ Less
Submitted 12 December, 2023; v1 submitted 20 September, 2022;
originally announced September 2022.
-
Credible equilibrium
Authors:
Mehmet S. Ismail
Abstract:
Credible equilibrium is a solution concept that imposes a stronger credibility notion than subgame perfect equilibrium. A credible equilibrium is a refinement of subgame perfect equilibrium such that if a threat in a subgame g is "credible," then it must also be credible in every subgame g' that is "equivalent" to g. I show that (i) a credible equilibrium exists in multi-stage games, and (ii) if e…
▽ More
Credible equilibrium is a solution concept that imposes a stronger credibility notion than subgame perfect equilibrium. A credible equilibrium is a refinement of subgame perfect equilibrium such that if a threat in a subgame g is "credible," then it must also be credible in every subgame g' that is "equivalent" to g. I show that (i) a credible equilibrium exists in multi-stage games, and (ii) if every stage game has a unique Nash equilibrium, then the credible equilibrium is unique even in infinite horizon multi-stage games. Moreover, in perfect information games, credible equilibrium is equivalent to subgame perfect equilibrium.
△ Less
Submitted 10 June, 2022;
originally announced June 2022.
-
Fairer Chess: A Reversal of Two Opening Moves in Chess Creates Balance Between White and Black
Authors:
Steven J. Brams,
Mehmet S. Ismail
Abstract:
Unlike tic-tac-toe or checkers, in which optimal play leads to a draw, it is not known whether optimal play in chess ends in a win for White, a win for Black, or a draw. But after White moves first in chess, if Black has a double move followed by a double move of White and then alternating play, play is more balanced because White does not always tie or lead in moves. Symbolically, Balanced Altern…
▽ More
Unlike tic-tac-toe or checkers, in which optimal play leads to a draw, it is not known whether optimal play in chess ends in a win for White, a win for Black, or a draw. But after White moves first in chess, if Black has a double move followed by a double move of White and then alternating play, play is more balanced because White does not always tie or lead in moves. Symbolically, Balanced Alternation gives the following move sequence: After White's (W) initial move, first Black (B) and then White each have two moves in a row (BBWW), followed by the alternating sequence, beginning with W, which altogether can be written as WB/BW/WB/WB/WB... (the slashes separate alternating pairs of moves). Except for reversal of the 3rd and 4th moves from WB to BW, this is the standard chess sequence. Because Balanced Alternation lies between the standard sequence, which favors White, and a comparable sequence that favors Black, it is highly likely to produce a draw with optimal play, rendering chess fairer. This conclusion is supported by a computer analysis of chess openings and how they would play out under Balanced Alternation.
△ Less
Submitted 10 August, 2021; v1 submitted 5 August, 2021;
originally announced August 2021.
-
No-harm principle, rationality, and Pareto optimality in games
Authors:
Shaun Hargreaves Heap,
Mehmet S. Ismail
Abstract:
Mill's classic argument for liberty requires that people's exercise of freedom should be governed by a no-harm principle (NHP). In this paper, we develop the concept of a no-harm equilibrium in $n$-person games where players maximize utility subject to the constraint of the NHP. Our main result is in the spirit of the fundamental theorems of welfare economics. We show that for every initial `refer…
▽ More
Mill's classic argument for liberty requires that people's exercise of freedom should be governed by a no-harm principle (NHP). In this paper, we develop the concept of a no-harm equilibrium in $n$-person games where players maximize utility subject to the constraint of the NHP. Our main result is in the spirit of the fundamental theorems of welfare economics. We show that for every initial `reference point' in a game the associated no-harm equilibrium is Pareto efficient and, conversely, every Pareto efficient point can be supported as a no-harm equilibrium for some initial reference point.
△ Less
Submitted 2 November, 2022; v1 submitted 26 January, 2021;
originally announced January 2021.
-
The strategy of conflict and cooperation
Authors:
Mehmet S. Ismail
Abstract:
This paper introduces a unified framework called cooperative extensive form games, which (i) generalizes standard non-cooperative games, and (ii) allows for more complex coalition formation dynamics than previous concepts like coalition-proof Nash equilibrium. Central to this framework is a novel solution concept called cooperative equilibrium system (CES). CES differs from Nash equilibrium in two…
▽ More
This paper introduces a unified framework called cooperative extensive form games, which (i) generalizes standard non-cooperative games, and (ii) allows for more complex coalition formation dynamics than previous concepts like coalition-proof Nash equilibrium. Central to this framework is a novel solution concept called cooperative equilibrium system (CES). CES differs from Nash equilibrium in two important respects. First, a CES is immune to both unilateral and multilateral `credible' deviations. Second, unlike Nash equilibrium, whose stability relies on the assumption that the strategies of non-deviating players are held fixed, CES allows for the possibility that players may regroup and adjust their strategies in response to a deviation. The main result establishes that every cooperative extensive form game, possibly with imperfect information, possesses a CES. For games with perfect information, the proof is constructive. This framework is broadly applicable in contexts such as oligopolistic markets and dynamic political bargaining.
△ Less
Submitted 25 September, 2023; v1 submitted 20 August, 2018;
originally announced August 2018.
