-
Co-evolutionary Dynamics of Attack and Defence in Cybersecurity
Authors:
Adeela Bashir,
Zia Ush Shamszaman,
Zhao Song,
The Anh Han
Abstract:
In the evolving digital landscape, it is crucial to study the dynamics of cyberattacks and defences. This study uses an Evolutionary Game Theory (EGT) framework to investigate the evolutionary dynamics of attacks and defences in cyberspace. We develop a two-population asymmetric game between attacker and defender to capture the essential factors of costs, potential benefits, and the probability of…
▽ More
In the evolving digital landscape, it is crucial to study the dynamics of cyberattacks and defences. This study uses an Evolutionary Game Theory (EGT) framework to investigate the evolutionary dynamics of attacks and defences in cyberspace. We develop a two-population asymmetric game between attacker and defender to capture the essential factors of costs, potential benefits, and the probability of successful defences. Through mathematical analysis and numerical simulations, we find that systems with high defence intensities show stability with minimal attack frequencies, whereas low-defence environments show instability, and are vulnerable to attacks. Furthermore, we find five equilibria, where the strategy pair always defend and attack emerged as the most likely stable state as cyber domain is characterised by a continuous battle between defenders and attackers. Our theoretical findings align with real-world data from past cyber incidents, demonstrating the interdisciplinary impact, such as fraud detection, risk management and cybersecurity decision-making. Overall, our analysis suggests that adaptive cybersecurity strategies based on EGT can improve resource allocation, enhance system resilience, and reduce the overall risk of cyberattacks. By incorporating real-world data, this study demonstrates the applicability of EGT in addressing the evolving nature of cyber threats and the need for secure digital ecosystems through strategic planning and proactive defence measures.
△ Less
Submitted 25 May, 2025;
originally announced May 2025.
-
Do LLMs trust AI regulation? Emerging behaviour of game-theoretic LLM agents
Authors:
Alessio Buscemi,
Daniele Proverbio,
Paolo Bova,
Nataliya Balabanova,
Adeela Bashir,
Theodor Cimpeanu,
Henrique Correia da Fonseca,
Manh Hong Duong,
Elias Fernandez Domingos,
Antonio M. Fernandes,
Marcus Krellner,
Ndidi Bianca Ogbo,
Simon T. Powers,
Fernando P. Santos,
Zia Ush Shamszaman,
Zhao Song,
Alessandro Di Stefano,
The Anh Han
Abstract:
There is general agreement that fostering trust and cooperation within the AI development ecosystem is essential to promote the adoption of trustworthy AI systems. By embedding Large Language Model (LLM) agents within an evolutionary game-theoretic framework, this paper investigates the complex interplay between AI developers, regulators and users, modelling their strategic choices under different…
▽ More
There is general agreement that fostering trust and cooperation within the AI development ecosystem is essential to promote the adoption of trustworthy AI systems. By embedding Large Language Model (LLM) agents within an evolutionary game-theoretic framework, this paper investigates the complex interplay between AI developers, regulators and users, modelling their strategic choices under different regulatory scenarios. Evolutionary game theory (EGT) is used to quantitatively model the dilemmas faced by each actor, and LLMs provide additional degrees of complexity and nuances and enable repeated games and incorporation of personality traits. Our research identifies emerging behaviours of strategic AI agents, which tend to adopt more "pessimistic" (not trusting and defective) stances than pure game-theoretic agents. We observe that, in case of full trust by users, incentives are effective to promote effective regulation; however, conditional trust may deteriorate the "social pact". Establishing a virtuous feedback between users' trust and regulators' reputation thus appears to be key to nudge developers towards creating safe AI. However, the level at which this trust emerges may depend on the specific LLM used for testing. Our results thus provide guidance for AI regulation systems, and help predict the outcome of strategic LLM agents, should they be used to aid regulation itself.
△ Less
Submitted 11 April, 2025;
originally announced April 2025.
-
Media and responsible AI governance: a game-theoretic and LLM analysis
Authors:
Nataliya Balabanova,
Adeela Bashir,
Paolo Bova,
Alessio Buscemi,
Theodor Cimpeanu,
Henrique Correia da Fonseca,
Alessandro Di Stefano,
Manh Hong Duong,
Elias Fernandez Domingos,
Antonio Fernandes,
The Anh Han,
Marcus Krellner,
Ndidi Bianca Ogbo,
Simon T. Powers,
Daniele Proverbio,
Fernando P. Santos,
Zia Ush Shamszaman,
Zhao Song
Abstract:
This paper investigates the complex interplay between AI developers, regulators, users, and the media in fostering trustworthy AI systems. Using evolutionary game theory and large language models (LLMs), we model the strategic interactions among these actors under different regulatory regimes. The research explores two key mechanisms for achieving responsible governance, safe AI development and ad…
▽ More
This paper investigates the complex interplay between AI developers, regulators, users, and the media in fostering trustworthy AI systems. Using evolutionary game theory and large language models (LLMs), we model the strategic interactions among these actors under different regulatory regimes. The research explores two key mechanisms for achieving responsible governance, safe AI development and adoption of safe AI: incentivising effective regulation through media reporting, and conditioning user trust on commentariats' recommendation. The findings highlight the crucial role of the media in providing information to users, potentially acting as a form of "soft" regulation by investigating developers or regulators, as a substitute to institutional AI regulation (which is still absent in many regions). Both game-theoretic analysis and LLM-based simulations reveal conditions under which effective regulation and trustworthy AI development emerge, emphasising the importance of considering the influence of different regulatory regimes from an evolutionary game-theoretic perspective. The study concludes that effective governance requires managing incentives and costs for high quality commentaries.
△ Less
Submitted 12 March, 2025;
originally announced March 2025.
