-
Reinforcement Learning and Graph Neural Networks for Probabilistic Risk Assessment
Authors:
Joachim Grimstad,
Andrey Morozov
Abstract:
This paper presents a new approach to the solution of Probabilistic Risk Assessment (PRA) models using the combination of Reinforcement Learning (RL) and Graph Neural Networks (GNNs). The paper introduces and demonstrates the concept using one of the most popular PRA models - Fault Trees. This paper's original idea is to apply RL algorithms to solve a PRA model represented with a graph model. Give…
▽ More
This paper presents a new approach to the solution of Probabilistic Risk Assessment (PRA) models using the combination of Reinforcement Learning (RL) and Graph Neural Networks (GNNs). The paper introduces and demonstrates the concept using one of the most popular PRA models - Fault Trees. This paper's original idea is to apply RL algorithms to solve a PRA model represented with a graph model. Given enough training data, or through RL, such an approach helps train generic PRA solvers that can optimize and partially substitute classical PRA solvers that are based on existing formal methods. Such an approach helps to solve the problem of the fast-growing complexity of PRA models of modern technical systems.
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
Small Spacecraft for Global Greenhouse Gas Monitoring
Authors:
Victoria Mayorova,
Andrey Morozov,
Iliya Golyak,
Nikita Lazarev,
Valeriia Melnikova,
Dmitry Rachkin,
Victor Svirin,
Stepan Tenenbaum,
Igor Fufurin
Abstract:
This work is devoted to the capabilities analysis of constellation and small spacecraft developed using CubeSat technology to solve promising problems of the Earth remote sensing in the area of greenhouse gases emissions. This paper presents the scientific needs for such tasks, followed by descriptions and discussions of the micro-technology application both in the small satellite platform design…
▽ More
This work is devoted to the capabilities analysis of constellation and small spacecraft developed using CubeSat technology to solve promising problems of the Earth remote sensing in the area of greenhouse gases emissions. This paper presents the scientific needs for such tasks, followed by descriptions and discussions of the micro-technology application both in the small satellite platform design and in the payload design. The overview of analogical spacecraft is carried out. The design of a new spacecraft for determination the oxygen and carbon dioxide concentration in the air column along the line of sight of the spacecraft when it illuminated by reflected sunlight is introduced. A mock-up of the device was made for greenhouse gases remote sensing a Fourier Transform Infrared (FTIR) spectroradiometer is placed in the small spacecraft design. The results of long-term measurements of greenhouse gas concentrations using the developed Fourier spectrometer mock-up is presented.
△ Less
Submitted 15 December, 2022;
originally announced December 2022.
-
Model-based Fault Injection Experiments for the Safety Analysis of Exoskeleton System
Authors:
Tagir Fabarisov,
Ilshat Mamaev,
Andrey Morozov,
Klaus Janschek
Abstract:
Model-based fault injection methods are widely used for the evaluation of fault tolerance in safety-critical control systems. In this paper, we introduce a new model-based fault injection method implemented as a highlycustomizable Simulink block called FIBlock. It supports the injection of typical faults of essential heterogeneous components of Cyber-Physical Systems, such as sensors, computing ha…
▽ More
Model-based fault injection methods are widely used for the evaluation of fault tolerance in safety-critical control systems. In this paper, we introduce a new model-based fault injection method implemented as a highlycustomizable Simulink block called FIBlock. It supports the injection of typical faults of essential heterogeneous components of Cyber-Physical Systems, such as sensors, computing hardware, and network. The FIBlock GUI allows the user to select a fault type and configure multiple parameters to tune error magnitude, fault activation time, and fault exposure duration. Additional trigger inputs and outputs of the block enable the modeling of conditional faults. Furthermore, two or more FIBlocks connected with these trigger signals can model chained errors. The proposed fault injection method is demonstrated with a lower-limb EXO-LEGS exoskeleton, an assistive device for the elderly in everyday life. The EXO-LEGS model-based dynamic control is realized in the Simulink environment and allows easy integration of the aforementioned FIBlocks. Exoskeletons, in general, being a complex CPS with multiple sensors and actuators, are prone to hardware and software faults. In the case study, three types of faults were investigated: 1) sensor freeze, 2) stuck-at-0, 3) bit-flip. The fault injection experiments helped to determine faults that have the most significant effects on the overall system reliability and identify the fine line for the critical fault duration after that the controller could no longer mitigate faults.
△ Less
Submitted 4 January, 2021;
originally announced January 2021.
-
Reduction Methods on Probabilistic Control-flow Programs for Reliability Analysis
Authors:
Clemens Dubslaff,
Andrey Morozov,
Christel Baier,
Klaus Janschek
Abstract:
Modern safety-critical systems are heterogeneous, complex, and highly dynamic. They require reliability evaluation methods that go beyond the classical static methods such as fault trees, event trees, or reliability block diagrams. Promising dynamic reliability analysis methods employ probabilistic model checking on various probabilistic state-based models. However, such methods have to tackle the…
▽ More
Modern safety-critical systems are heterogeneous, complex, and highly dynamic. They require reliability evaluation methods that go beyond the classical static methods such as fault trees, event trees, or reliability block diagrams. Promising dynamic reliability analysis methods employ probabilistic model checking on various probabilistic state-based models. However, such methods have to tackle the well-known state-space explosion problem. To compete with this problem, reduction methods such as symmetry reduction and partial-order reduction have been successfully applied to probabilistic models by means of discrete Markov chains or Markov decision processes. Such models are usually specified using probabilistic programs provided in guarded command language. In this paper, we propose two automated reduction methods for probabilistic programs that operate on a purely syntactic level: reset value optimization and register allocation optimization. The presented techniques rely on concepts well known from compiler construction such as live range analysis and register allocation through interference graph coloring. Applied on a redundancy system model for an aircraft velocity control loop modeled in SIMULINK, we show effectiveness of our implementation of the reduction methods. We demonstrate that model-size reductions in three orders of magnitude are possible and show that we can achieve significant speedups for a reliability analysis.
△ Less
Submitted 14 April, 2020;
originally announced April 2020.
-
Breaking the Limits of Redundancy Systems Analysis
Authors:
Clemens Dubslaff,
Kai Ding,
Andrey Morozov,
Christel Baier,
Klaus Janschek
Abstract:
Redundancy mechanisms such as triple modular redundancy protect safety-critical components by replication and thus improve systems fault tolerance. However, the gained fault tolerance comes along with costs to be invested, e.g., increasing execution time, energy consumption, or packaging size, for which constraints have to be obeyed during system design. This turns the question of finding suitable…
▽ More
Redundancy mechanisms such as triple modular redundancy protect safety-critical components by replication and thus improve systems fault tolerance. However, the gained fault tolerance comes along with costs to be invested, e.g., increasing execution time, energy consumption, or packaging size, for which constraints have to be obeyed during system design. This turns the question of finding suitable combinations of components to be protected into a challenging task as the number of possible protection combinations grows exponentially in the number of components. We propose family-based approaches to tackle the combinatorial blowup in redundancy systems modeling and analysis phases. Based on systems designed in SIMULINK we show how to obtain models that include all possible protection combinations and present a tool chain that, given a probabilistic error model, generates discrete Markov chain families. Using symbolic techniques that enable concise family representation and analysis, we show how SIMULINK models of realistic size can be protected and analyzed with a single family-based analysis run while a one-by-one analysis of each protection combination would clearly exceed any realistic time constraints.
△ Less
Submitted 11 December, 2019;
originally announced December 2019.
-
Data-driven model for hydraulic fracturing design optimization: focus on building digital database and production forecast
Authors:
A. D. Morozov,
D. O. Popkov,
V. M. Duplyakov,
R. F. Mutalova,
A. A. Osiptsov,
A. L. Vainshtein,
E. V. Burnaev,
E. V. Shel,
G. V. Paderin
Abstract:
Growing amount of hydraulic fracturing (HF) jobs in the recent two decades resulted in a significant amount of measured data available for development of predictive models via machine learning (ML). In multistage fractured completions, post-fracturing production analysis reveals that different stages produce very non-uniformly due to a combination of geomechanics and fracturing design factors. Hen…
▽ More
Growing amount of hydraulic fracturing (HF) jobs in the recent two decades resulted in a significant amount of measured data available for development of predictive models via machine learning (ML). In multistage fractured completions, post-fracturing production analysis reveals that different stages produce very non-uniformly due to a combination of geomechanics and fracturing design factors. Hence, there is a significant room for improvement of current design practices. The workflow is essentially split into two stages. As a result of the first stage, the present paper summarizes the efforts into the creation of a digital database of field data from several thousands of multistage HF jobs on wells from circa 20 different oilfields in Western Siberia, Russia. In terms of the number of points (fracturing jobs), the present database is a rare case of a representative dataset of about 5000 data points. Each point in the data base contains the vector of 92 input variables (the reservoir, well and the frac design parameters) and the vector of production data, which is characterized by 16 parameters, including the target, cumulative oil production. Data preparation has been done using various ML techniques: the problem of missing values in the database is solved with collaborative filtering for data imputation; outliers are removed using visualisation of cluster data structure by t-SNE algorithm. The production forecast problem is solved via CatBoost algorithm. Prediction capability of the model is measured with the coefficient of determination (R^2) and reached 0.815. The inverse problem (selecting an optimum set of fracturing design parameters to maximize production) will be considered in the second part of the study to be published in another paper, along with a recommendation system for advising DESC and production stimulation engineers on an optimized fracturing design.
△ Less
Submitted 18 July, 2020; v1 submitted 28 October, 2019;
originally announced October 2019.
