-
On Linear Time-Invariant Systems Analysis via A Single Trajectory: A Linear Programming Approach
Authors:
Hassan Abdelraouf,
Fahad Albalawi,
Eric Feron
Abstract:
In this note, a novel methodology that can extract a number of analysis results for linear time-invariant systems (LTI) given only a single trajectory of the considered system is proposed. The superiority of the proposed technique relies on the fact that it provides an automatic and formal way to obtain valuable information about the controlled system by only having access to a single trajectory o…
▽ More
In this note, a novel methodology that can extract a number of analysis results for linear time-invariant systems (LTI) given only a single trajectory of the considered system is proposed. The superiority of the proposed technique relies on the fact that it provides an automatic and formal way to obtain valuable information about the controlled system by only having access to a single trajectory over a finite period of time (i.e., the system dynamics is assumed to be unknown). At first, we characterize the stability region of LTI systems given only a single trajectory dataset by constructing the associated Lyapunov function of the system. The Lyapunov function is found by formulating and solving a linear programming (LP) problem. Then, we extend the same methodology to a variety of essential analysis results for LTI systems such as deriving bounds on the output energy, deriving bounds on output peak, deriving $\mathbf{L}_2$ and RMS gains. To illustrate the efficacy of the proposed data-driven paradigm, a comparison analysis between the learned LTI system metrics and the true ones is provided.
△ Less
Submitted 21 September, 2021;
originally announced September 2021.
-
A Reinforcement Learning-based Economic Model Predictive Control Framework for Autonomous Operation of Chemical Reactors
Authors:
Khalid Alhazmi,
Fahad Albalawi,
S. Mani Sarathy
Abstract:
Economic model predictive control (EMPC) is a promising methodology for optimal operation of dynamical processes that has been shown to improve process economics considerably. However, EMPC performance relies heavily on the accuracy of the process model used. As an alternative to model-based control strategies, reinforcement learning (RL) has been investigated as a model-free control methodology,…
▽ More
Economic model predictive control (EMPC) is a promising methodology for optimal operation of dynamical processes that has been shown to improve process economics considerably. However, EMPC performance relies heavily on the accuracy of the process model used. As an alternative to model-based control strategies, reinforcement learning (RL) has been investigated as a model-free control methodology, but issues regarding its safety and stability remain an open research challenge. This work presents a novel framework for integrating EMPC and RL for online model parameter estimation of a class of nonlinear systems. In this framework, EMPC optimally operates the closed loop system while maintaining closed loop stability and recursive feasibility. At the same time, to optimize the process, the RL agent continuously compares the measured state of the process with the model's predictions (nominal states), and modifies model parameters accordingly. The major advantage of this framework is its simplicity; state-of-the-art RL algorithms and EMPC schemes can be employed with minimal modifications. The performance of the proposed framework is illustrated on a network of reactions with challenging dynamics and practical significance. This framework allows control, optimization, and model correction to be performed online and continuously, making autonomous reactor operation more attainable.
△ Less
Submitted 6 May, 2021;
originally announced May 2021.
-
QuPWM: Feature Extraction Method for MEG Epileptic Spike Detection
Authors:
Abderrazak Chahid,
Fahad Albalawi,
Turky Nayef Alotaiby,
Majed Hamad Al-Hameed,
Saleh Alshebeili,
Taous-Meriem Laleg-Kirati
Abstract:
Epilepsy is a neurological disorder classified as the second most serious neurological disease known to humanity, after stroke. Localization of the epileptogenic zone is an important step for epileptic patient treatment, which starts with epileptic spike detection. The common practice for spike detection of brain signals is via visual scanning of the recordings, which is a subjective and a very ti…
▽ More
Epilepsy is a neurological disorder classified as the second most serious neurological disease known to humanity, after stroke. Localization of the epileptogenic zone is an important step for epileptic patient treatment, which starts with epileptic spike detection. The common practice for spike detection of brain signals is via visual scanning of the recordings, which is a subjective and a very time-consuming task. Motivated by that, this paper focuses on using machine learning for automatic detection of epileptic spikes in magnetoencephalography (MEG) signals. First, we used the Position Weight Matrix (PWM) method combined with a uniform quantizer to generate useful features. Second, the extracted features are classified using a Support Vector Machine (SVM) for the purpose of epileptic spikes detection. The proposed technique shows great potential in improving the spike detection accuracy and reducing the feature vector size. Specifically, the proposed technique achieved average accuracy up to 98\% in using 5-folds cross-validation applied to a balanced dataset of 3104 samples. These samples are extracted from 16 subjects where eight are healthy and eight are epileptic subjects using a sliding frame of size of 100 samples-points with a step-size of 2 sample-points
△ Less
Submitted 3 July, 2019;
originally announced July 2019.