-
Integration of Multi-Mode Preference into Home Energy Management System Using Deep Reinforcement Learning
Authors:
Mohammed Sumayli,
Olugbenga Moses Anubi
Abstract:
Home Energy Management Systems (HEMS) have emerged as a pivotal tool in the smart home ecosystem, aiming to enhance energy efficiency, reduce costs, and improve user comfort. By enabling intelligent control and optimization of household energy consumption, HEMS plays a significant role in bridging the gap between consumer needs and energy utility objectives. However, much of the existing literatur…
▽ More
Home Energy Management Systems (HEMS) have emerged as a pivotal tool in the smart home ecosystem, aiming to enhance energy efficiency, reduce costs, and improve user comfort. By enabling intelligent control and optimization of household energy consumption, HEMS plays a significant role in bridging the gap between consumer needs and energy utility objectives. However, much of the existing literature construes consumer comfort as a mere deviation from the standard appliance settings. Such deviations are typically incorporated into optimization objectives via static weighting factors. These factors often overlook the dynamic nature of consumer behaviors and preferences. Addressing this oversight, our paper introduces a multi-mode Deep Reinforcement Learning-based HEMS (DRL-HEMS) framework, meticulously designed to optimize based on dynamic, consumer-defined preferences. Our primary goal is to augment consumer involvement in Demand Response (DR) programs by embedding dynamic multi-mode preferences tailored to individual appliances. In this study, we leverage a model-free, single-agent DRL algorithm to deliver a HEMS framework that is not only dynamic but also user-friendly. To validate its efficacy, we employed real-world data at 15-minute intervals, including metrics such as electricity price, ambient temperature, and appliances' power consumption. Our results show that the model performs exceptionally well in optimizing energy consumption within different preference modes. Furthermore, when compared to traditional algorithms based on Mixed-Integer Linear Programming (MILP), our model achieves nearly optimal performance while outperforming in computational efficiency.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
Optimal Teaming for Coordination with Bounded Rationality via Convex Optimization
Authors:
Zhewei Wang,
Olugbenga Moses Anubi,
Marcos M. Vasconcelos
Abstract:
Teaming is the process of establishing connections among agents within a system to enable collaboration toward achieving a collective goal. This paper examines teaming in the context of a network of agents learning to coordinate with bounded rationality. In our framework, the team structure is represented via a weighted graph, and the agents use log-linear learning. We formulate the design of the…
▽ More
Teaming is the process of establishing connections among agents within a system to enable collaboration toward achieving a collective goal. This paper examines teaming in the context of a network of agents learning to coordinate with bounded rationality. In our framework, the team structure is represented via a weighted graph, and the agents use log-linear learning. We formulate the design of the graph's weight matrix as a convex optimization problem whose objective is to maximize the probability of learning a Nash equilibrium while minimizing a connectivity cost. Despite its convexity, solving this optimization problem is computationally challenging, as the objective function involves the summation over the action profile space, which grows exponentially with the number of agents. Leveraging the underlying symmetry and convexity properties of the problem, when there are no sparsity constraints, we prove that there exists an optimal solution corresponding to a uniformly weighted graph, simplifying to a one-dimensional convex optimization problem. Additionally, we show that the optimal weight decreases monotonically with the agent's rationality, implying that when the agents become more rational the optimal team requires less connectivity.
△ Less
Submitted 5 April, 2025;
originally announced April 2025.
-
Moving-horizon False Data Injection Attack Design against Cyber-Physical Systems
Authors:
Yu Zheng,
Sridhar Babu Mudhangulla,
Olugbenga Moses Anubi
Abstract:
Systematic attack design is essential to understanding the vulnerabilities of cyber-physical systems (CPSs), to better design for resiliency. In particular, false data injection attacks (FDIAs) are well-known and have been shown to be capable of bypassing bad data detection (BDD) while causing targeted biases in resulting state estimates. However, their effectiveness against moving horizon estimat…
▽ More
Systematic attack design is essential to understanding the vulnerabilities of cyber-physical systems (CPSs), to better design for resiliency. In particular, false data injection attacks (FDIAs) are well-known and have been shown to be capable of bypassing bad data detection (BDD) while causing targeted biases in resulting state estimates. However, their effectiveness against moving horizon estimators (MHE) is not well understood. In fact, this paper shows that conventional FDIAs are generally ineffective against MHE. One of the main reasons is that the moving window renders the static FDIA recursively infeasible. This paper proposes a new attack methodology, moving-horizon FDIA (MH-FDIA), by considering both the performance of historical attacks and the current system's status. Theoretical guarantees for successful attack generation and recursive feasibility are given. Numerical simulations on the IEEE-14 bus system further validate the theoretical claims and show that the proposed MH-FDIA outperforms state-of-the-art counterparts in both stealthiness and effectiveness. In addition, \textcolor{blue}{an experiment on} a path-tracking control system of an autonomous vehicle shows the feasibility of the MH-FDIA in real-world nonlinear systems.
△ Less
Submitted 23 April, 2023;
originally announced April 2023.
-
Hierarchical Robust Adaptive Control for Wind Turbines with Actuator Fault
Authors:
Sina Ameli,
Olugbenga Moses Anubi
Abstract:
This paper solves the problem of regulating the rotor speed tracking error for wind turbines in the full-load region by an effective robust-adaptive control strategy. The developed controller compensates for the uncertainty in the control input effectiveness caused by a pitch actuator fault, unmeasurable wind disturbance, and nonlinearity in the model. Wind turbines have multi-layer structures suc…
▽ More
This paper solves the problem of regulating the rotor speed tracking error for wind turbines in the full-load region by an effective robust-adaptive control strategy. The developed controller compensates for the uncertainty in the control input effectiveness caused by a pitch actuator fault, unmeasurable wind disturbance, and nonlinearity in the model. Wind turbines have multi-layer structures such that the high-level structure is nonlinearly coupled through an aggregation of the low-level control authorities. Hence, the control design is divided into two stages. First, an $\mathcal{L}_2$ controller is designed to attenuate the influence of wind disturbance fluctuations on the rotor speed. Then, in the low-level layer, a controller is designed using a proposed adaptation mechanism to compensate for actuator faults. The theoretical results show that the closed-loop equilibrium point of the regulated rotor speed tracking error dynamics in the high level is finite-gain $\mathcal{L}_2$ stable, and the closed-loop error dynamics in the low level is globally asymptotically stable. Simulation results show that the developed controller significantly reduces the root mean square of the rotor speed error compared to some well-known works, despite the largely fluctuating wind disturbance, and the time-varying uncertainty in the control input effectiveness.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
Robust Control for a Class of Nonlinearly Coupled Hierarchical Systems with Actuator Faults
Authors:
Sina Ameli,
Olugbenga Moses Anubi
Abstract:
This paper proposes an approach to addresses the control challenges posed by a fault-induced uncertainty in both the dynamics and control input effectiveness of a class of hierarchical nonlinear systems in which the high-level dynamics is nonlinearly coupled with a multi-agent low-level dynamics. The high-level dynamics has a multiplicative uncertainty in the control input effectiveness and is sub…
▽ More
This paper proposes an approach to addresses the control challenges posed by a fault-induced uncertainty in both the dynamics and control input effectiveness of a class of hierarchical nonlinear systems in which the high-level dynamics is nonlinearly coupled with a multi-agent low-level dynamics. The high-level dynamics has a multiplicative uncertainty in the control input effectiveness and is subjected to an exogenous disturbance input. On the other hand, the low-level system is subjected to actuator faults causing a time-varying multiplicative uncertainty in the dynamical model and associated control effectiveness. Moreover, the nonlinear coupling between the high-level and the low-level dynamics makes the problem even more challenging. To address this problem, an online parameter estimation algorithm is designed, coupled with an adaptive splitting mechanism which automatically distributes the control action among low level multi-agent systems. A nonlinear $\mathcal{L}_2$-gain-based controller, and then a state-feedback controller are designed in the high-level, and the low-level, respectively, to recover the system from faults with high performance in the transient response, and reject the exogenous disturbance. The resulting analysis guarantees a robust tracking of the high-level reference command signal.
△ Less
Submitted 6 August, 2021; v1 submitted 28 June, 2021;
originally announced June 2021.
-
Low-bandwidth Modular Mathematical Modeling of DC Microgrid Systems for Control Development with Application to Shipboard Power Systems
Authors:
Mehrzad Mohammadi Bijaieh,
Satish Vedula,
Olugbenga Moses Anubi
Abstract:
In recent years, DC and AC microgrid (MG) systems have attracted a major attention due to various potential for integration of future technology into conventional systems and control. The integration of such technology requires appropriate tools for complex design, analysis and optimization. This paper presents a mathematical low-bandwidth modeling (LBM) approach that can be used for control devel…
▽ More
In recent years, DC and AC microgrid (MG) systems have attracted a major attention due to various potential for integration of future technology into conventional systems and control. The integration of such technology requires appropriate tools for complex design, analysis and optimization. This paper presents a mathematical low-bandwidth modeling (LBM) approach that can be used for control development in DC and further be extended to AC MG systems. In this work, first a simplified mathematical model of a medium voltage DC (MVDC) shipboard MG system is presented, next, the overall system-level connection convention is presented to display the overall mathematical coupling of the individual sub-systems, then, a simplified example of the control development is presented, and last, the overall system under a test scenario is implemented in Simulink Real-time.
△ Less
Submitted 4 June, 2021;
originally announced June 2021.
-
Degradation Aware Predictive Energy Management Strategy for Ship Power Systems
Authors:
Satish Vedula,
Mehrzad Mohammadi Bijaieh,
Ellis Oti Boateng,
Olugbenga Moses Anubi
Abstract:
Integration of modern defence weapons into ship power systems poses a challenge in terms of meeting the high ramp rate requirements of those loads. It might be demanding for the generators to meet the ramp rates of these loads. Failure to meet so, might lead to stability issues. This is addressed by conglomeration of generators and energy storage elements to handle the required power demand posed…
▽ More
Integration of modern defence weapons into ship power systems poses a challenge in terms of meeting the high ramp rate requirements of those loads. It might be demanding for the generators to meet the ramp rates of these loads. Failure to meet so, might lead to stability issues. This is addressed by conglomeration of generators and energy storage elements to handle the required power demand posed by loads. This paper proposes an energy management strategy based on model predictive control that incorporates the uncertainty in the load prediction. The proposed controller optimally coordinates the power split between the generators and energy storage elements to guarantee that the power demand is met taking into considerations the ramp rate limitations and the load uncertainty. A low bandwidth model consisting of a single generator and a single energy storage element is used to validate the results of the proposed energy management strategy. The results demonstrate the robustness of the controller under load prediction uncertainty and demonstrate the effect of load uncertainty on battery capacity loss.
△ Less
Submitted 25 May, 2021;
originally announced May 2021.
-
Model and Load Predictive Control for Design and Energy Management of Shipboard Power Systems
Authors:
Mehrzad Mohammadi Bijaieh,
Satish Vedula,
Olugbenga Moses Anubi
Abstract:
In current Medium Voltage DC (MVDC) Shipboard Power Systems (SPSs), multiple sources exist to supply power to a common dc bus. Conventionally, the power management of such systems is performed by controlling Power Generation Modules (PGMs) which include fuel operated generators and underlying converters. Moreover, energy management is performed by the emerging single or hybrid Energy Storage Syste…
▽ More
In current Medium Voltage DC (MVDC) Shipboard Power Systems (SPSs), multiple sources exist to supply power to a common dc bus. Conventionally, the power management of such systems is performed by controlling Power Generation Modules (PGMs) which include fuel operated generators and underlying converters. Moreover, energy management is performed by the emerging single or hybrid Energy Storage Systems (ESSs). This paper presents a model and load predictive control framework for power and energy management of SPSs. Here, MPC with load prediction is used for three main objectives: (1) to request power and energy from generators and energy storage elements according to their individual State of Power (SOP) and ramp-rate limitations, (2) to consider and integrate the generator cost and degradation, and (3) to reach a specific parking (final) State of Charge (SOC) for the ESSs at the end of the prediction horizon. The solution of the optimization problem is demonstrated using MATLAB and the functionality of the control framework is validated in real-time simulation environment.
△ Less
Submitted 20 May, 2021;
originally announced May 2021.
-
Attack-Resilient Weighted $\ell_1$ Observer with Prior Pruning
Authors:
Yu Zheng,
Olugbenga Moses Anubi
Abstract:
Security related questions for Cyber Physical Systems (CPS) have attracted much research attention in searching for novel methods for attack-resilient control and/or estimation. Specifically, false data injection attacks (FDIAs) have been shown to be capable of bypassing bad data detection (BDD), while arbitrarily compromising the integrity of state estimators and robust controller even with very…
▽ More
Security related questions for Cyber Physical Systems (CPS) have attracted much research attention in searching for novel methods for attack-resilient control and/or estimation. Specifically, false data injection attacks (FDIAs) have been shown to be capable of bypassing bad data detection (BDD), while arbitrarily compromising the integrity of state estimators and robust controller even with very sparse measurements corruption. Moreover, based on the inherent sparsity of pragmatic attack signals, $\ell_1$-minimization scheme has been used extensively to improve the design of attack-resilient estimators. For this, the theoretical maximum for the percentage of compromised nodes that can be accommodated has been shown to be $50\%$. In order to guarantee correct state recoveries for larger percentage of attacked nodes, researchers have begun to incorporate prior information into the underlying resilient observer design framework. For the most pragmatic cases, this prior information is often obtained through some data-driven machine learning process. Existing results have shown strong positive correlation between the tolerated attack percentages and the precision of the prior information. In this paper, we present a pruning method to improve the precision of the prior information, given corresponding stochastic uncertainty characteristics of the underlying machine learning model. Then a weighted $\ell_1$-minimization is proposed based on the pruned prior. The theoretical and simulation results show that the pruning method significantly improves the observer performance for much larger attack percentages, even when moderately accurate machine learning model used.
△ Less
Submitted 8 April, 2021;
originally announced April 2021.
-
Modulated MPC for Arm Inductor-less MVDC MMC with Reduced Computational Burden
Authors:
Sandro Martin,
Hui Li,
Olugbenga Moses Anubi
Abstract:
A modulated model predictive controller is designed for an inductor-less modular multilevel converter targeting an MVDC solid-state transformer application. The underlying optimization problem is formulated such that a unique closed-form solution is derived from a highly accurate dynamic system model, which significantly reduces computation time. Unlike other closed-form methods, the proposed cont…
▽ More
A modulated model predictive controller is designed for an inductor-less modular multilevel converter targeting an MVDC solid-state transformer application. The underlying optimization problem is formulated such that a unique closed-form solution is derived from a highly accurate dynamic system model, which significantly reduces computation time. Unlike other closed-form methods, the proposed controller achieves inductor-less current control, has a reduced sampling speed enabled by a novel model-based circulating energy compensator, and does not require tuned PI controllers to generate current references. Simulation and experimental results demonstrate that the proposed controller achieves transient power flow control and steady state circulating energy control despite the low system inertia.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
Attack-resilient observer pruning for path-tracking control of Wheeled Mobile Robot
Authors:
Yu Zheng,
Olugbenga Moses Anubi
Abstract:
Path-tracking control of wheeled mobile robot (WMR) has gained a lot of research attention, primarily because of its wide applicability -- for example intelligent wheelchairs, exploration-assistant remote WMR. Recent increase in remote and autonomous operations\requirements for WMR has led to more and more use of IoT devices within the control loop. Consequently, providing interfaces for malicious…
▽ More
Path-tracking control of wheeled mobile robot (WMR) has gained a lot of research attention, primarily because of its wide applicability -- for example intelligent wheelchairs, exploration-assistant remote WMR. Recent increase in remote and autonomous operations\requirements for WMR has led to more and more use of IoT devices within the control loop. Consequently, providing interfaces for malicious interactions through false data injection attacks (FDIA). Moreover, optimization-based FDIAs have been shown to cause catastrophic consequences in feedback control systems while by-passing any residual-based monitoring system. Since these attacks target system measurement process, this paper focuses on the problem of improving the resiliency of dynamical observers against FDIA. Specifically, we propose an attack-resilient pruning algorithm which attempts to exclude compromised channels from being processed by the observer. The proposed pruning algorithm improves attack-localization precision to $100\%$ with high probability, which correspondingly improves the resiliency of the underlying UKF to FDIA. The improvements due to the developed resilient pruning-based observer is validated through a numerical simulation of a two-layer path-tracking control platform of differential-driven wheeled mobile robot (DDWMR) under FDIA.
△ Less
Submitted 7 September, 2020;
originally announced September 2020.
-
Multi-Model Resilient Observer under False Data Injection Attacks
Authors:
Olugbenga Moses Anubi,
Charalambos Konstantinou,
Carlos A. Wong,
Satish Vedula
Abstract:
In this paper, we present the concept of boosting the resiliency of optimization-based observers for cyber-physical systems (CPS) using auxiliary sources of information. Due to the tight coupling of physics, communication and computation, a malicious agent can exploit multiple inherent vulnerabilities in order to inject stealthy signals into the measurement process. The problem setting considers t…
▽ More
In this paper, we present the concept of boosting the resiliency of optimization-based observers for cyber-physical systems (CPS) using auxiliary sources of information. Due to the tight coupling of physics, communication and computation, a malicious agent can exploit multiple inherent vulnerabilities in order to inject stealthy signals into the measurement process. The problem setting considers the scenario in which an attacker strategically corrupts portions of the data in order to force wrong state estimates which could have catastrophic consequences. The goal of the proposed observer is to compute the true states in-spite of the adversarial corruption. In the formulation, we use a measurement prior distribution generated by the auxiliary model to refine the feasible region of a traditional compressive sensing-based regression problem. A constrained optimization-based observer is developed using l1-minimization scheme. Numerical experiments show that the solution of the resulting problem recovers the true states of the system. The developed algorithm is evaluated through a numerical simulation example of the IEEE 14-bus system.
△ Less
Submitted 28 August, 2020;
originally announced August 2020.
-
Localization of Control Synthesis Problem for Large-Scale Interconnected System Using IQC and Dissipativity Theories
Authors:
Olugbenga Moses Anubi,
Layne Clemen
Abstract:
The synthesis problem for the compositional performance certification of interconnected systems is considered. A fairly unified description of control synthesis problem is given using integral quadratic constraints (IQC) and dissipativity. Starting with a given large-scale interconnected system and a global performance objective, an optimization problem is formulated to search for admissible dissi…
▽ More
The synthesis problem for the compositional performance certification of interconnected systems is considered. A fairly unified description of control synthesis problem is given using integral quadratic constraints (IQC) and dissipativity. Starting with a given large-scale interconnected system and a global performance objective, an optimization problem is formulated to search for admissible dissipativity properties of each subsystems. Local control laws are then synthesized to certify the relevant dissipativity properties. Moreover, the term localization is introduced to describe a finite collection of syntheses problems, for the local subsystems, which are a feasibility certificate for the global synthesis problem. Consequently, the problem of localizing the global problem to a smaller collection of disjointed sets of subsystems, called groups, is considered. This works looks promising as another way of looking at decentralized control and also as a way of doing performance specifications for components in a large-scale system.
△ Less
Submitted 13 April, 2015;
originally announced April 2015.