Deep Reinforcement Learning for Online Error Detection in Cyber-Physical Systems
Authors:
Seyyedamirhossein Saeidi,
Forouzan Fallah,
Saeed Samieezafarghandi,
Hamed Farbeh
Abstract:
Reliability is one of the major design criteria in Cyber-Physical Systems (CPSs). This is because of the existence of some critical applications in CPSs and their failure is catastrophic. Therefore, employing strong error detection and correction mechanisms in CPSs is inevitable. CPSs are composed of a variety of units, including sensors, networks, and microcontrollers. Each of these units is prob…
▽ More
Reliability is one of the major design criteria in Cyber-Physical Systems (CPSs). This is because of the existence of some critical applications in CPSs and their failure is catastrophic. Therefore, employing strong error detection and correction mechanisms in CPSs is inevitable. CPSs are composed of a variety of units, including sensors, networks, and microcontrollers. Each of these units is probable to be in a faulty state at any time and the occurred fault can result in erroneous output. The fault may cause the units of CPS to malfunction and eventually crash. Traditional fault-tolerant approaches include redundancy time, hardware, information, and/or software. However, these approaches impose significant overheads besides their low error coverage, which limits their applicability. In addition, the interval between error occurrence and detection is too long in these approaches. In this paper, based on Deep Reinforcement Learning (DRL), a new error detection approach is proposed that not only detects errors with high accuracy but also can perform error detection at the moment due to very low inference time. The proposed approach can categorize different types of errors from normal data and predict whether the system will fail. The evaluation results illustrate that the proposed approach has improved more than 2x in terms of accuracy and more than 5x in terms of inference time compared to other approaches.
△ Less
Submitted 5 June, 2023; v1 submitted 3 February, 2023;
originally announced February 2023.
Integrated Fault Diagnosis and Control Design for DER Inverters using Machine Learning Methods
Authors:
Forouzan Fallah,
Amin Ramezani,
Ali Mehrizi-Sani
Abstract:
This paper employs a supervised machine learning (ML) algorithm to propose an integrated fault detection and diagnosis (FDD) and fault-tolerant control (FTC) strategy to detect, diagnose, and classify the grid faults and correct the input voltage before affecting the grid-connected distributed energy resources (DER) inverters. This controller can mitigate the impact of grid faults on inverters by…
▽ More
This paper employs a supervised machine learning (ML) algorithm to propose an integrated fault detection and diagnosis (FDD) and fault-tolerant control (FTC) strategy to detect, diagnose, and classify the grid faults and correct the input voltage before affecting the grid-connected distributed energy resources (DER) inverters. This controller can mitigate the impact of grid faults on inverters by predicting and modifying the time series of their input voltage. Simulation results show the effectiveness of the proposed controller and evaluate its operating performance.
△ Less
Submitted 21 February, 2022;
originally announced February 2022.
