-
Towards Enabling Learning for Time-Varying finite horizon Sequential Decision-Making Problems*
Authors:
Dhananjay Tiwari,
Salar Basiri,
Srinivasa Salapaka
Abstract:
Parameterized Sequential Decision Making (Para-SDM) framework models a wide array of network design applications spanning supply-chain, transportation, and sensor networks. These problems entail sequential multi-stage optimization characterized by states, control actions, and cost functions dependent on designable parameters. The challenge is to determine both the sequential decision policy and pa…
▽ More
Parameterized Sequential Decision Making (Para-SDM) framework models a wide array of network design applications spanning supply-chain, transportation, and sensor networks. These problems entail sequential multi-stage optimization characterized by states, control actions, and cost functions dependent on designable parameters. The challenge is to determine both the sequential decision policy and parameters simultaneously to minimize cumulative stagewise costs. Many Para-SDM problems are NP-hard and often necessitate time-varying policies. Existing algorithms tackling finite-horizon time-varying Para-SDM problems struggle with scalability when faced with a large number of states. Conversely, the sole algorithm addressing infinite-horizon Para-SDM assumes time (stage)-invariance, yielding stationary policies. However, this approach proves scalable for time-invariant problems by leveraging deep neural networks to learn optimal stage-invariant state-action value functions, enabling handling of large-scale scenarios. This article proposes a novel approach that reinterprets finite-horizon, time-varying Para-SDM problems as equivalent time-invariant problems through topography lifting. Our method achieves nearly identical results to the time-varying solution while exhibiting improved performance times in various simulations, notably in the small cell network problem. This fresh perspective on Para-SDM problems expands the scope of addressable issues and holds promise for future scalability through the integration of learning methods.
△ Less
Submitted 2 April, 2025;
originally announced April 2025.
-
Inverter Output Impedance Estimation in Power Networks: A Variable Direction Forgetting Recursive-Least-Square Algorithm Based Approach
Authors:
Jaesang Park,
Alireza Askarian,
Srinivasa Salapaka
Abstract:
As inverter-based loads and energy sources become increasingly prevalent, accurate estimation of line impedance between inverters and the grid is essential for optimizing performance and enhancing control strategies. This paper presents a non-invasive method for estimating output-line impedance using measurements local to the inverter. It provides a specific method for signal conditioning of signa…
▽ More
As inverter-based loads and energy sources become increasingly prevalent, accurate estimation of line impedance between inverters and the grid is essential for optimizing performance and enhancing control strategies. This paper presents a non-invasive method for estimating output-line impedance using measurements local to the inverter. It provides a specific method for signal conditioning of signals measured at the inverter, which makes the measured data better suited to estimation algorithms. An algorithm based on the Variable Direction Forgetting Recursive Least Squares (VDF-RLS) method is introduced, which leverages these conditioned signals for precise impedance estimation. The signal conditioning process transforms measurements into the direct-quadrature (dq) coordinate frame, where the rotating frame frequency is determined to facilitate a simpler and more accurate estimation. This frequency is implemented using a secondary Phase-Locked Loop (PLL) to attenuate grid voltage measurement variations. By isolating the variation-sensitive q-axis and relying solely on the less sensitive d-axis, the method further minimizes the impact of variations. The VDF-RLS estimation method achieves rapid adaptation while ensuring stability in the absence of persistent excitation by selectively discarding outdated data during updates. Proposed conditioning and estimation methods are non-invasive; estimations are solely done using measured outputs, and no signal is injected into the power network. Simulation results demonstrate a significant improvement in impedance estimation stability, particularly in low-excitation conditions, where the VDF-RLS method achieves more than three time lower error compared to existing approaches such as constant forgetting RLS and the Kalman filter.
△ Less
Submitted 9 April, 2025; v1 submitted 17 October, 2024;
originally announced October 2024.
-
Multi-Mode Inverters: A Unified Control Design for Grid-Forming, Grid-Following, and Beyond
Authors:
Alireza Askarian,
Jaesang Park,
Srinivasa Salapaka
Abstract:
We present a novel, integrated control framework designed to achieve seamless transitions among a spectrum of inverter operation modes. The operation spectrum includes grid-forming (GFM), grid-following (GFL), static synchronous compensator (STATCOM), energy storage system (ESS), and voltage source inverter (VSI). The proposed control architecture offers guarantees of stability, robustness, and pe…
▽ More
We present a novel, integrated control framework designed to achieve seamless transitions among a spectrum of inverter operation modes. The operation spectrum includes grid-forming (GFM), grid-following (GFL), static synchronous compensator (STATCOM), energy storage system (ESS), and voltage source inverter (VSI). The proposed control architecture offers guarantees of stability, robustness, and performance regardless of the specific mode. The core concept involves establishing a unified algebraic structure for the feedback control system, where different modes are defined by the magnitude of closed-loop signals. As we demonstrate, this approach results in a two-dimensional continuum of operation modes and enables transition trajectories between operation modes by dynamically adjusting closed-loop variables towards corresponding setpoints. Stability, robustness, and fundamental limitation analyses are provided for the closed-loop system across any mode, as well as during transitions between modes. This design facilitates stable and enhanced on-grid integration, even during GFM operation and weak grid conditions. Ultimately, we demonstrate the key attributes of the proposed framework through simulations and experiments, showcasing its seamless transition in on-grid operation, functionality in islanded mode, and robustness to line impedance uncertainty.
△ Less
Submitted 10 October, 2024;
originally announced October 2024.
-
Function Gradient Approximation with Random Shallow ReLU Networks with Control Applications
Authors:
Andrew Lamperski,
Siddharth Salapaka
Abstract:
Neural networks are widely used to approximate unknown functions in control. A common neural network architecture uses a single hidden layer (i.e. a shallow network), in which the input parameters are fixed in advance and only the output parameters are trained. The typical formal analysis asserts that if output parameters exist to approximate the unknown function with sufficient accuracy, then des…
▽ More
Neural networks are widely used to approximate unknown functions in control. A common neural network architecture uses a single hidden layer (i.e. a shallow network), in which the input parameters are fixed in advance and only the output parameters are trained. The typical formal analysis asserts that if output parameters exist to approximate the unknown function with sufficient accuracy, then desired control performance can be achieved. A long-standing theoretical gap was that no conditions existed to guarantee that, for the fixed input parameters, required accuracy could be obtained by training the output parameters. Our recent work has partially closed this gap by demonstrating that if input parameters are chosen randomly, then for any sufficiently smooth function, with high-probability there are output parameters resulting in $O((1/m)^{1/2})$ approximation errors, where $m$ is the number of neurons. However, some applications, notably continuous-time value function approximation, require that the network approximates the both the unknown function and its gradient with sufficient accuracy. In this paper, we show that randomly generated input parameters and trained output parameters result in gradient errors of $O((\log(m)/m)^{1/2})$, and additionally, improve the constants from our prior work. We show how to apply the result to policy evaluation problems.
△ Less
Submitted 7 October, 2024;
originally announced October 2024.
-
Control Designs for Critical-Continegency Responsible Grid-Following Inverters and Seamless Transitions To and From Grid-Forming Modes
Authors:
Jaesang Park,
Alireza Askarian,
Srinivasa Salapaka
Abstract:
This article introduces two control frameworks: one for Grid-Following (GFL) inverters aiding Grid-Forming (GFM) inverters in voltage regulation during large contingency events and optimizing power transactions under normal conditions; and another for seamless transitions between grid-tied and grid-isolated setups, managing voltage transient characteristics. In microgrids, GFM inverters regulate v…
▽ More
This article introduces two control frameworks: one for Grid-Following (GFL) inverters aiding Grid-Forming (GFM) inverters in voltage regulation during large contingency events and optimizing power transactions under normal conditions; and another for seamless transitions between grid-tied and grid-isolated setups, managing voltage transient characteristics. In microgrids, GFM inverters regulate voltage, while GFL inverters handle power transactions. The proposed GFL control detects abrupt load/generation changes, adjusting power transactions using local storage to support GFM inverters during contingencies. Additionally, a transition control ensures smooth GFL-GFM shifts, reducing power and voltage fluctuations. Simulation results validate improved voltage regulation during contingencies and enhanced power tracking during slow changes, alongside minimized transient overshoot.
△ Less
Submitted 22 March, 2024;
originally announced March 2024.
-
Sparse Linear Regression with Constraints: A Flexible Entropy-based Framework
Authors:
Amber Srivastava,
Alisina Bayati,
Srinivasa Salapaka
Abstract:
This work presents a new approach to solve the sparse linear regression problem, i.e., to determine a k-sparse vector w in R^d that minimizes the cost ||y - Aw||^2_2. In contrast to the existing methods, our proposed approach splits this k-sparse vector into two parts -- (a) a column stochastic binary matrix V, and (b) a vector x in R^k. Here, the binary matrix V encodes the location of the k non-…
▽ More
This work presents a new approach to solve the sparse linear regression problem, i.e., to determine a k-sparse vector w in R^d that minimizes the cost ||y - Aw||^2_2. In contrast to the existing methods, our proposed approach splits this k-sparse vector into two parts -- (a) a column stochastic binary matrix V, and (b) a vector x in R^k. Here, the binary matrix V encodes the location of the k non-zero entries in w. Equivalently, it encodes the subset of k columns in the matrix A that map w to y. We demonstrate that this enables modeling several non-trivial application-specific structural constraints on w as constraints on V. The vector x comprises of the actual non-zero values in w. We use Maximum Entropy Principle (MEP) to solve the resulting optimization problem. In particular, we ascribe a probability distribution to the set of all feasible binary matrices V, and iteratively determine this distribution and the vector x such that the associated Shannon entropy gets minimized, and the regression cost attains a pre-specified value. The resulting algorithm employs homotopy from the convex entropy function to the non-convex cost function to avoid poor local minimum. We demonstrate the efficacy and flexibility of our proposed approach in incorporating a variety of practical constraints, that are otherwise difficult to model using the existing benchmark methods.
△ Less
Submitted 17 November, 2023; v1 submitted 14 November, 2023;
originally announced November 2023.
-
Enhanced Grid Following Inverter (E-GFL): A Unified Control Framework for Stiff and Weak Grids
Authors:
Alireza Askarian,
Jaesang Park,
Srinivasa Salapaka
Abstract:
This paper presents an extensive framework focused on the control design, along with stability and performance analysis, of Grid-Following Inverters (GFL). It aims to ensure their effective operation under both stiff and weak grid conditions. The proposed framework leverages the coupled algebraic structure of the transmission line dynamics in the $dq$ frame to express and then mitigate the effect…
▽ More
This paper presents an extensive framework focused on the control design, along with stability and performance analysis, of Grid-Following Inverters (GFL). It aims to ensure their effective operation under both stiff and weak grid conditions. The proposed framework leverages the coupled algebraic structure of the transmission line dynamics in the $dq$ frame to express and then mitigate the effect of coupled dynamics on the GFL inverter's stability and performance. Additionally, we simplify the coupled multi-input, multi-output (MIMO) closed-loop system of the GFL into two separate single-input, single-output (2-SISO) closed-loops for easier analysis and control design. We present the stability, robust stability, and performance of the original GFL MIMO closed-loop system through our proposed 2-SISO closed-loop framework. This approach simplifies both the control design and its analysis. Our framework effectively achieves grid synchronization and active damping of filter resonance via feedback control. This eliminates the need for separate phase-locked loop (PLL) and virtual impedance subsystems. We also utilize the Bode sensitivity integral to define the limits of GFL closed-loop stability margin and performance. These fundamental limits reveal the necessary trade-offs between various performance goals, including reference tracking, closed-loop bandwidth, robust synchronization, and the ability to withstand grid disturbances. Finally, we demonstrate the merits of our proposed framework through detailed simulations and experiments. These showcase its effectiveness in handling challenging scenarios, such as asymmetric grid faults, low voltage operation, and the balance between harmonic rejection and resonance suppression.
△ Less
Submitted 25 January, 2024; v1 submitted 5 April, 2023;
originally announced April 2023.
-
Towards Efficient Modularity in Industrial Drying: A Combinatorial Optimization Viewpoint
Authors:
Alisina Bayati,
Amber Srivastava,
Amir Malvandi,
Hao Feng,
Srinivasa Salapaka
Abstract:
The industrial drying process consumes approximately 12% of the total energy used in manufacturing, with the potential for a 40% reduction in energy usage through improved process controls and the development of new drying technologies. To achieve cost-efficient and high-performing drying, multiple drying technologies can be combined in a modular fashion with optimal sequencing and control paramet…
▽ More
The industrial drying process consumes approximately 12% of the total energy used in manufacturing, with the potential for a 40% reduction in energy usage through improved process controls and the development of new drying technologies. To achieve cost-efficient and high-performing drying, multiple drying technologies can be combined in a modular fashion with optimal sequencing and control parameters for each. This paper presents a mathematical formulation of this optimization problem and proposes a framework based on the Maximum Entropy Principle (MEP) to simultaneously solve for both optimal values of control parameters and optimal sequence. The proposed algorithm addresses the combinatorial optimization problem with a non-convex cost function riddled with multiple poor local minima. Simulation results on drying distillers dried grain (DDG) products show up to 12% improvement in energy consumption compared to the most efficient single-stage drying process. The proposed algorithm converges to local minima and is designed heuristically to reach the global minimum.
△ Less
Submitted 5 April, 2023; v1 submitted 4 October, 2022;
originally announced October 2022.
-
Control Design for Inverters: Beyond Steady-State Droop Laws
Authors:
Alireza Askarian,
Jaesang Park,
Srinivasa Salapaka
Abstract:
This paper presents a novel control structure and control synthesis method for regulating the output voltage/frequency and power injection of DC-AC inverters. The traditional droop method offers attractive solution to achieve compromise between clashing power and voltage/frequency regulation objectives. However, it relies on use of nonlinear power variables through slow outer control loop. In this…
▽ More
This paper presents a novel control structure and control synthesis method for regulating the output voltage/frequency and power injection of DC-AC inverters. The traditional droop method offers attractive solution to achieve compromise between clashing power and voltage/frequency regulation objectives. However, it relies on use of nonlinear power variables through slow outer control loop. In this paper we formulate the traditional droop method as a feedback control problem based on static power-flow equations and show how neglecting the dynamics of inverter and transmission line restricts the attainable closed-loop bandwidth and stability and robustness margin. Then we introduce a mapping between power variables and current in $dq$ frame under given PLL condition, allowing for replacing the fast acting current variables as a proxy for power. Consequently, we present a novel control structure and control synthesis method based on disturbance rejection framework, and demonstrate inherent droop like characteristics in underlying dynamics for special cases of resistive and inductive line. Moreover, we generalize the proposed control synthesis procedure to include a generalized complex line dynamical model and introduce concept of hybrid-sourced-intverter. Finally, we validate higher bandwidth and better transient performance of our proposed design through experimental validation.
△ Less
Submitted 5 May, 2021;
originally announced May 2021.
-
On Determining and Qualifying the Number of Superstates in Aggregation of Markov Chains
Authors:
Amber Srivastava,
Raj K. Velicheti,
Srinivasa M. Salapaka
Abstract:
Many studies involving large Markov chains require determining a smaller representative (aggregated) chains. Each {\em superstate} in the representative chain represents a {\em group of related} states in the original Markov chain. Typically, the choice of number of superstates in the aggregated chain is ambiguous, and based on the limited prior know-how. In this paper we present a structured meth…
▽ More
Many studies involving large Markov chains require determining a smaller representative (aggregated) chains. Each {\em superstate} in the representative chain represents a {\em group of related} states in the original Markov chain. Typically, the choice of number of superstates in the aggregated chain is ambiguous, and based on the limited prior know-how. In this paper we present a structured methodology of determining the best candidate for the number of superstates. We achieve this by comparing aggregated chains of different sizes. To facilitate this comparison we develop and quantify a notion of {\em marginal return}. Our notion captures the decrease in the {\em heterogeneity} within the group of the {\em related} states (i.e., states represented by the same superstate) upon a unit increase in the number of superstates in the aggregated chain. We use Maximum Entropy Principle to justify the notion of marginal return, as well as our quantification of heterogeneity. Through simulations on synthetic Markov chains, where the number of superstates are known apriori, we show that the aggregated chain with the largest marginal return identifies this number. In case of Markov chains that model real-life scenarios we show that the aggregated model with the largest marginal return identifies an inherent structure unique to the scenario being modelled; thus, substantiating on the efficacy of our proposed methodology.
△ Less
Submitted 18 February, 2021; v1 submitted 11 October, 2020;
originally announced October 2020.
-
Isochronous Architecture-Based Voltage-Active Power Droop for Multi-Inverter Systems
Authors:
Sourav Patel,
Soham Chakraborty,
Blake Lundstrom,
Srinivasa Salapaka,
Murti V. Salapaka
Abstract:
Advanced microgrids consisting of distributed energy resources interfaced with multi-inverter systems are becoming more common. Consequently, the effectiveness of voltage and frequency regulation in microgrids using conventional droop-based methodologies is challenged by uncertainty in the sizeand schedule of loads. This article proposes an isochronous architecture of parallel inverters with only…
▽ More
Advanced microgrids consisting of distributed energy resources interfaced with multi-inverter systems are becoming more common. Consequently, the effectiveness of voltage and frequency regulation in microgrids using conventional droop-based methodologies is challenged by uncertainty in the sizeand schedule of loads. This article proposes an isochronous architecture of parallel inverters with only voltage-active power droop (VP-D) control for improving active power sharing as well as plug-and-play of multi-inverter based distributed energyresources (DERs). In spite of not employing explicit control for frequency regulation, this architecture allows even sharing of reactive power while maintaining reduced circulating currents between inverters. The performance is achieved even when there are mismatches between commanded reference and power demanded from the actual load in the network. The isochronous architecture is implemented by employing a global positioning system (GPS) to disseminate timing signals that enable the microgrid to maintain nominal system frequency in the entire network. This enables direct control of active power through voltage source inverter (VSI) output voltage regulation, even in the presence of system disturbances. A small signal eigenvalue analysis of a multi-inverter system near the steady-state operating point is presented to evaluate the stability of the multi-inverter system with the proposed VP-D control. Simulation studies and hardware experiments on an 1.2 kVA prototype are conducted. The effectiveness of the proposed architecture towards active and reactive power sharing between inverters with load scenarios are demonstrated. Results of the hardware experiments corroborate the viability of the proposed VP-D control architecture.
△ Less
Submitted 12 March, 2020;
originally announced March 2020.
-
Multiway k-Cut in Static and Dynamic Graphs: A Maximum Entropy Principle Approach
Authors:
Mayank Baranwal,
Amber Srivastava,
Srinivasa Salapaka
Abstract:
This work presents a maximum entropy principle based algorithm for solving minimum multiway $k$-cut problem defined over static and dynamic {\em digraphs}. A multiway $k$-cut problem requires partitioning the set of nodes in a graph into $k$ subsets, such that each subset contains one prespecified node, and the corresponding total cut weight is minimized. These problems arise in many applications…
▽ More
This work presents a maximum entropy principle based algorithm for solving minimum multiway $k$-cut problem defined over static and dynamic {\em digraphs}. A multiway $k$-cut problem requires partitioning the set of nodes in a graph into $k$ subsets, such that each subset contains one prespecified node, and the corresponding total cut weight is minimized. These problems arise in many applications and are computationally complex (NP-hard). In the static setting this article presents an approach that uses a relaxed multiway $k$-cut cost function; we show that the resulting algorithm converges to a local minimum. This iterative algorithm is designed to avoid poor local minima with its run-time complexity as $\sim O(kIN^3)$, where $N$ is the number of vertices and $I$ is the number of iterations. In the dynamic setting, the edge-weight matrix has an associated dynamics with some of the edges in the graph capable of being influenced by an external input. The objective is to design the dynamics of the controllable edges so that multiway $k$-cut value remains small (or decreases) as the graph evolves under the dynamics. Also it is required to determine the time-varying partition that defines the minimum multiway $k$-cut value. Our approach is to choose a relaxation of multiway $k$-cut value, derived using maximum entropy principle, and treat it as a control Lyapunov function to design control laws that affect the weight dynamics. Simulations on practical examples of interactive foreground-background segmentation, minimum multiway $k$-cut optimization for non-planar graphs and dynamically evolving graphs that demonstrate the efficacy of the algorithm, are presented.
△ Less
Submitted 19 July, 2019;
originally announced July 2019.
-
Robust Distributed Control of DC Microgrids with Time-Varying Power Sharing
Authors:
Mayank Baranwal,
Alireza Askarian,
Srinivasa M. Salapaka
Abstract:
This paper addresses the problem of output voltage regulation for multiple DC/DC converters connected to a microgrid, and prescribes a scheme for sharing power among different sources. This architecture is structured in such a way that it admits quantifiable analysis of the closed-loop performance of the network of converters; the analysis simplifies to studying closed-loop performance of an equiv…
▽ More
This paper addresses the problem of output voltage regulation for multiple DC/DC converters connected to a microgrid, and prescribes a scheme for sharing power among different sources. This architecture is structured in such a way that it admits quantifiable analysis of the closed-loop performance of the network of converters; the analysis simplifies to studying closed-loop performance of an equivalent {\em single-converter} system. The proposed architecture allows for the proportion in which the sources provide power to vary with time; thus overcoming limitations of our previous designs. Additionally, the proposed control framework is suitable to both centralized and decentralized implementations, i.e., the same control architecture can be employed for voltage regulation irrespective of the availability of common load-current (or power) measurement, without the need to modify controller parameters. The performance becomes quantifiably better with better communication of the demanded load to all the controllers at all the converters (in the centralized case); however guarantees viability when such communication is absent. Case studies comprising of battery, PV and generic sources are presented and demonstrate the enhanced performance of prescribed optimal controllers for voltage regulation and power sharing.
△ Less
Submitted 11 January, 2017;
originally announced January 2017.
-
Robust Control Framework for Time-Varying Power-Sharing among Distributed Energy Resources
Authors:
Mayank Baranwal,
Srinivasa M. Salapaka
Abstract:
One of the most important challenges facing an electric grid is to incorporate renewables and distributed energy resources (DERs) to the grid. Because of the associated uncertainties in power generations and peak power demands, opportunities for improving the functioning and reliability of the grid lie in the design of an efficient, yet pragmatic distributed control framework with guaranteed robus…
▽ More
One of the most important challenges facing an electric grid is to incorporate renewables and distributed energy resources (DERs) to the grid. Because of the associated uncertainties in power generations and peak power demands, opportunities for improving the functioning and reliability of the grid lie in the design of an efficient, yet pragmatic distributed control framework with guaranteed robustness margins. This paper addresses the problem of output voltage regulation for multiple DC-DC converters connected to a grid, and prescribes a robust scheme for sharing power among different sources. More precisely, we develop a control architecture where, unlike most standard control frameworks, the desired power ratios appear as reference signals to individual converter systems, and not as internal parameters of the system of parallel converters. This makes the proposed approach suited for scenarios when the desired power ratios vary rapidly with time. Additionally, the proposed control framework is suitable to both centralized and decentralized implementations, i.e., the same control architecture can be employed for voltage regulation irrespective of the availability of common load-current (or power) measurement, without the need to modify controller parameters. The control design is obtained using robust optimal-control framework. Case studies presented show the enhanced performance of prescribed optimal controllers for voltage regulation and power sharing.
△ Less
Submitted 14 April, 2016;
originally announced April 2016.
-
Robust Decentralized Voltage Control of DC-DC Converters with Applications to Power Sharing and Ripple Sharing
Authors:
Mayank Baranwal,
Srinivasa M. Salapaka,
Murti V. Salapaka
Abstract:
This paper addresses the problem of output voltage regulation for multiple DC-DC converters connected to a grid, and prescribes a robust scheme for sharing power among different sources. Also it develops a method for sharing 120 Hz ripple among DC power sources in a prescribed proportion, which accommodates the different capabilities of DC power sources to sustain the ripple. We present a decentra…
▽ More
This paper addresses the problem of output voltage regulation for multiple DC-DC converters connected to a grid, and prescribes a robust scheme for sharing power among different sources. Also it develops a method for sharing 120 Hz ripple among DC power sources in a prescribed proportion, which accommodates the different capabilities of DC power sources to sustain the ripple. We present a decentralized control architecture, where a nested (inner-outer) control design is used at every converter. An interesting aspect of the proposed design is that the analysis and design of the entire multi-converter system can be done using an equivalent single converter system, where the multi-converter system inherits the performance and robustness achieved by a design for the single-converter system. Another key aspect of this work is that the voltage regulation problem is addressed as a disturbance-rejection problem, where {\em unknown} load current is viewed as an external signal, and thus, no prior information is required on the nominal loading conditions. The control design is obtained using robust optimal-control framework. Case studies presented show the enhanced performance of prescribed optimal controllers.
△ Less
Submitted 12 April, 2016;
originally announced April 2016.
