-
A Conceptual Framework for AI-based Decision Systems in Critical Infrastructures
Authors:
Milad Leyli-abadi,
Ricardo J. Bessa,
Jan Viebahn,
Daniel Boos,
Clark Borst,
Alberto Castagna,
Ricardo Chavarriaga,
Mohamed Hassouna,
Bruno Lemetayer,
Giulia Leto,
Antoine Marot,
Maroua Meddeb,
Manuel Meyer,
Viola Schiaffonati,
Manuel Schneider,
Toni Waefler
Abstract:
The interaction between humans and AI in safety-critical systems presents a unique set of challenges that remain partially addressed by existing frameworks. These challenges stem from the complex interplay of requirements for transparency, trust, and explainability, coupled with the necessity for robust and safe decision-making. A framework that holistically integrates human and AI capabilities wh…
▽ More
The interaction between humans and AI in safety-critical systems presents a unique set of challenges that remain partially addressed by existing frameworks. These challenges stem from the complex interplay of requirements for transparency, trust, and explainability, coupled with the necessity for robust and safe decision-making. A framework that holistically integrates human and AI capabilities while addressing these concerns is notably required, bridging the critical gaps in designing, deploying, and maintaining safe and effective systems. This paper proposes a holistic conceptual framework for critical infrastructures by adopting an interdisciplinary approach. It integrates traditionally distinct fields such as mathematics, decision theory, computer science, philosophy, psychology, and cognitive engineering and draws on specialized engineering domains, particularly energy, mobility, and aeronautics. The flexibility in its adoption is also demonstrated through its instantiation on an already existing framework.
△ Less
Submitted 21 April, 2025;
originally announced April 2025.
-
Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approach
Authors:
Mohamed Hassouna,
Clara Holzhüter,
Malte Lehna,
Matthijs de Jong,
Jan Viebahn,
Bernhard Sick,
Christoph Scholz
Abstract:
The rising proportion of renewable energy in the electricity mix introduces significant operational challenges for power grid operators. Effective power grid management demands adaptive decision-making strategies capable of handling dynamic conditions. With the increase in complexity, more and more Deep Learning (DL) approaches have been proposed to find suitable grid topologies for congestion man…
▽ More
The rising proportion of renewable energy in the electricity mix introduces significant operational challenges for power grid operators. Effective power grid management demands adaptive decision-making strategies capable of handling dynamic conditions. With the increase in complexity, more and more Deep Learning (DL) approaches have been proposed to find suitable grid topologies for congestion management. In this work, we contribute to this research by introducing a novel Imitation Learning (IL) approach that leverages soft labels derived from simulated topological action outcomes, thereby capturing multiple viable actions per state. Unlike traditional IL methods that rely on hard labels to enforce a single optimal action, our method constructs soft labels over actions, by leveraging effective actions that prove suitable in resolving grid congestion. To further enhance decision-making, we integrate Graph Neural Networks (GNNs) to encode the structural properties of power grids, ensuring that the topology-aware representations contribute to better agent performance. Our approach significantly outperforms state-of-the-art baselines, all of which use only topological actions, as well as feedforward and GNN-based architectures with hard labels. Most notably, it achieves a 17% better performance compared to the greedy expert agent from which the imitation targets were derived.
△ Less
Submitted 19 March, 2025;
originally announced March 2025.
-
Graph Reinforcement Learning for Power Grids: A Comprehensive Survey
Authors:
Mohamed Hassouna,
Clara Holzhüter,
Pawel Lytaev,
Josephine Thomas,
Bernhard Sick,
Christoph Scholz
Abstract:
The rise of renewable energy and distributed generation requires new approaches to overcome the limitations of traditional methods. In this context, Graph Neural Networks are promising due to their ability to learn from graph-structured data. Combined with Reinforcement Learning, they can serve as control approaches to determine remedial network actions. This review analyses how Graph Reinforcemen…
▽ More
The rise of renewable energy and distributed generation requires new approaches to overcome the limitations of traditional methods. In this context, Graph Neural Networks are promising due to their ability to learn from graph-structured data. Combined with Reinforcement Learning, they can serve as control approaches to determine remedial network actions. This review analyses how Graph Reinforcement Learning (GRL) can improve representation learning and decision making in power grid use cases. Although GRL has demonstrated adaptability to unpredictable events and noisy data, it is primarily at a proof-of-concept stage. We highlight open challenges and limitations with respect to real-world applications.
△ Less
Submitted 26 August, 2024; v1 submitted 5 July, 2024;
originally announced July 2024.
-
Fault Detection for agents on power grid topology optimization: A Comprehensive analysis
Authors:
Malte Lehna,
Mohamed Hassouna,
Dmitry Degtyar,
Sven Tomforde,
Christoph Scholz
Abstract:
Optimizing the topology of transmission networks using Deep Reinforcement Learning (DRL) has increasingly come into focus. Various DRL agents have been proposed, which are mostly benchmarked on the Grid2Op environment from the Learning to Run a Power Network (L2RPN) challenges. The environments have many advantages with their realistic grid scenarios and underlying power flow backends. However, th…
▽ More
Optimizing the topology of transmission networks using Deep Reinforcement Learning (DRL) has increasingly come into focus. Various DRL agents have been proposed, which are mostly benchmarked on the Grid2Op environment from the Learning to Run a Power Network (L2RPN) challenges. The environments have many advantages with their realistic grid scenarios and underlying power flow backends. However, the interpretation of agent survival or failure is not always clear, as there are a variety of potential causes. In this work, we focus on the failures of the power grid simulation to identify patterns and detect them in advance. We collect the failed scenarios of three different agents on the WCCI 2022 L2RPN environment, totaling about 40k data points. By clustering, we are able to detect five distinct clusters, identifying common failure types. Further, we propose a multi-class prediction approach to detect failures beforehand and evaluate five different prediction models. Here, the Light Gradient-Boosting Machine (LightGBM) shows the best failure prediction performance, with an accuracy of 82%. It also accurately classifies whether a the grid survives or fails in 87% of cases. Finally, we provide a detailed feature importance analysis that identifies critical features and regions in the grid.
△ Less
Submitted 17 September, 2024; v1 submitted 24 June, 2024;
originally announced June 2024.
-
Customer Churn in Mobile Markets A Comparison of Techniques
Authors:
Mohammed Hassouna,
Ali Tarhini,
Tariq Elyas,
Mohammad Saeed AbouTrab
Abstract:
The high increase in the number of companies competing in mature markets makes customer retention an important factor for any company to survive. Thus, many methodologies (e.g., data mining and statistics) have been proposed to analyse and study customer retention. The validity of such methods is not yet proved though. This paper tries to fill this gap by empirically comparing two techniques: Cust…
▽ More
The high increase in the number of companies competing in mature markets makes customer retention an important factor for any company to survive. Thus, many methodologies (e.g., data mining and statistics) have been proposed to analyse and study customer retention. The validity of such methods is not yet proved though. This paper tries to fill this gap by empirically comparing two techniques: Customer churn-decision tree and logistic regression models. The paper proves the superiority of decision tree technique and stresses the needs for more advanced methods to churn modelling.
△ Less
Submitted 18 January, 2016;
originally announced July 2016.