-
Distributed Difference of Convex Optimization
Authors:
Vivek Khatana,
Murti V. Salapaka
Abstract:
In this article, we focus on solving a class of distributed optimization problems involving $n$ agents with the local objective function at every agent $i$ given by the difference of two convex functions $f_i$ and $g_i$ (difference-of-convex (DC) form), where $f_i$ and $g_i$ are potentially nonsmooth. The agents communicate via a directed graph containing $n$ nodes. We create smooth approximations…
▽ More
In this article, we focus on solving a class of distributed optimization problems involving $n$ agents with the local objective function at every agent $i$ given by the difference of two convex functions $f_i$ and $g_i$ (difference-of-convex (DC) form), where $f_i$ and $g_i$ are potentially nonsmooth. The agents communicate via a directed graph containing $n$ nodes. We create smooth approximations of the functions $f_i$ and $g_i$ and develop a distributed algorithm utilizing the gradients of the smooth surrogates and a finite-time approximate consensus protocol. We term this algorithm as DDC-Consensus. The developed DDC-Consensus algorithm allows for non-symmetric directed graph topologies and can be synthesized distributively. We establish that the DDC-Consensus algorithm converges to a stationary point of the nonconvex distributed optimization problem. The performance of the DDC-Consensus algorithm is evaluated via a simulation study to solve a nonconvex DC-regularized distributed least squares problem. The numerical results corroborate the efficacy of the proposed algorithm.
△ Less
Submitted 23 July, 2024;
originally announced July 2024.
-
Causal Structure Recovery of Linear Dynamical Systems: An FFT based Approach
Authors:
Mishfad Shaikh Veedu,
James Melbourne,
Murti V. Salapaka
Abstract:
Learning causal effects from data is a fundamental and well-studied problem across science, especially when the cause-effect relationship is static in nature. However, causal effect is less explored when there are dynamical dependencies, i.e., when dependencies exist between entities across time. Identifying dynamic causal effects from time-series observations is computationally expensive when com…
▽ More
Learning causal effects from data is a fundamental and well-studied problem across science, especially when the cause-effect relationship is static in nature. However, causal effect is less explored when there are dynamical dependencies, i.e., when dependencies exist between entities across time. Identifying dynamic causal effects from time-series observations is computationally expensive when compared to the static scenario. We demonstrate that the computational complexity of recovering the causation structure for the vector auto-regressive (VAR) model is $O(Tn^3N^2)$, where $n$ is the number of nodes, $T$ is the number of samples, and $N$ is the largest time-lag in the dependency between entities. We report a method, with a reduced complexity of $O(Tn^3 \log N)$, to recover the causation structure to obtain frequency-domain (FD) representations of time-series. Since FFT accumulates all the time dependencies on every frequency, causal inference can be performed efficiently by considering the state variables as random variables at any given frequency. We additionally show that, for systems with interactions that are LTI, do-calculus machinery can be realized in the FD resulting in versions of the classical single-door (with cycles), front and backdoor criteria. We demonstrate, for a large class of problems, graph reconstruction using multivariate Wiener projections results in a significant computational advantage with $O(n)$ complexity over reconstruction algorithms such as the PC algorithm which has $O(n^q)$ complexity, where $q$ is the maximum neighborhood size. This advantage accrues due to some remarkable properties of the phase response of the frequency-dependent Wiener coefficients which is not present in any time-domain approach.
△ Less
Submitted 5 September, 2023;
originally announced September 2023.
-
Information Theoretically Optimal Sample Complexity of Learning Dynamical Directed Acyclic Graphs
Authors:
Mishfad Shaikh Veedu,
Deepjyoti Deka,
Murti V. Salapaka
Abstract:
In this article, the optimal sample complexity of learning the underlying interactions or dependencies of a Linear Dynamical System (LDS) over a Directed Acyclic Graph (DAG) is studied. We call such a DAG underlying an LDS as dynamical DAG (DDAG). In particular, we consider a DDAG where the nodal dynamics are driven by unobserved exogenous noise sources that are wide-sense stationary (WSS) in time…
▽ More
In this article, the optimal sample complexity of learning the underlying interactions or dependencies of a Linear Dynamical System (LDS) over a Directed Acyclic Graph (DAG) is studied. We call such a DAG underlying an LDS as dynamical DAG (DDAG). In particular, we consider a DDAG where the nodal dynamics are driven by unobserved exogenous noise sources that are wide-sense stationary (WSS) in time but are mutually uncorrelated, and have the same {power spectral density (PSD)}. Inspired by the static DAG setting, a metric and an algorithm based on the PSD matrix of the observed time series are proposed to reconstruct the DDAG. It is shown that the optimal sample complexity (or length of state trajectory) needed to learn the DDAG is $n=Θ(q\log(p/q))$, where $p$ is the number of nodes and $q$ is the maximum number of parents per node. To prove the sample complexity upper bound, a concentration bound for the PSD estimation is derived, under two different sampling strategies. A matching min-max lower bound using generalized Fano's inequality also is provided, thus showing the order optimality of the proposed algorithm.
△ Less
Submitted 31 March, 2024; v1 submitted 31 August, 2023;
originally announced August 2023.
-
Time-Varying Parameters in Sequential Decision Making Problems
Authors:
Amber Srivastava,
S. M. Salapaka
Abstract:
In this paper we address the class of Sequential Decision Making (SDM) problems that are characterized by time-varying parameters. These parameter dynamics are either pre-specified or manipulable. At any given time instant the decision policy -- that governs the sequential decisions -- along with all the parameter values determines the cumulative cost incurred by the underlying SDM. Thus, the obje…
▽ More
In this paper we address the class of Sequential Decision Making (SDM) problems that are characterized by time-varying parameters. These parameter dynamics are either pre-specified or manipulable. At any given time instant the decision policy -- that governs the sequential decisions -- along with all the parameter values determines the cumulative cost incurred by the underlying SDM. Thus, the objective is to determine the manipulable parameter dynamics as well as the time-varying decision policy such that the associated cost gets minimized at each time instant. To this end we develop a control-theoretic framework to design the unknown parameter dynamics such that it locates and tracks the optimal values of the parameters, and simultaneously determines the time-varying optimal sequential decision policy. Our methodology builds upon a Maximum Entropy Principle (MEP) based framework that addresses the static parameterized SDMs. More precisely, we utilize the resulting smooth approximation (from the above framework) of the cumulative cost as a control Lyapunov function. We show that under the resulting control law the parameters asymptotically track the local optimal, the proposed control law is Lipschitz continuous and bounded, as well as ensure that the decision policy of the SDM is optimal for a given set of parameter values. The simulations demonstrate the efficacy of our proposed methodology.
△ Less
Submitted 25 January, 2022;
originally announced January 2022.
-
Design of Experiments with Imputable Feature Data: An Entropy-Based Approach
Authors:
Raj K. Velicheti,
Amber Srivastava,
Srinivasa M. Salapaka
Abstract:
Tactical selection of experiments to estimate an underlying model is an innate task across various fields. Since each experiment has costs associated with it, selecting statistically significant experiments becomes necessary. Classic linear experimental design deals with experiment selection so as to minimize (functions of) variance in estimation of regression parameter. Typically, standard algori…
▽ More
Tactical selection of experiments to estimate an underlying model is an innate task across various fields. Since each experiment has costs associated with it, selecting statistically significant experiments becomes necessary. Classic linear experimental design deals with experiment selection so as to minimize (functions of) variance in estimation of regression parameter. Typically, standard algorithms for solving this problem assume that data associated with each experiment is fully known. This isn't often true since missing data is a common problem. For instance, remote sensors often miss data due to poor connection. Hence experiment selection under such scenarios is a widespread but challenging task. Though decoupling the tasks and using standard data imputation methods like matrix completion followed by experiment selection might seem a way forward, they perform sub-optimally since the tasks are naturally interdependent. Standard design of experiments is an NP hard problem, and the additional objective of imputing for missing data amplifies the computational complexity. In this paper, we propose a maximum-entropy-principle based framework that simultaneously addresses the problem of design of experiments as well as the imputation of missing data. Our algorithm exploits homotopy from a suitably chosen convex function to the non-convex cost function; hence avoiding poor local minima. Further, our proposed framework is flexible to incorporate additional application specific constraints. Simulations on various datasets show improvement in the cost value by over 60% in comparison to benchmark algorithms applied sequentially to the imputation and experiment selection problems.
△ Less
Submitted 29 March, 2021;
originally announced March 2021.
-
On Determining and Qualifying the Number of Superstates in Aggregation of Markov Chains
Authors:
Amber Srivastava,
Raj K. Velicheti,
Srinivasa M. Salapaka
Abstract:
Many studies involving large Markov chains require determining a smaller representative (aggregated) chains. Each {\em superstate} in the representative chain represents a {\em group of related} states in the original Markov chain. Typically, the choice of number of superstates in the aggregated chain is ambiguous, and based on the limited prior know-how. In this paper we present a structured meth…
▽ More
Many studies involving large Markov chains require determining a smaller representative (aggregated) chains. Each {\em superstate} in the representative chain represents a {\em group of related} states in the original Markov chain. Typically, the choice of number of superstates in the aggregated chain is ambiguous, and based on the limited prior know-how. In this paper we present a structured methodology of determining the best candidate for the number of superstates. We achieve this by comparing aggregated chains of different sizes. To facilitate this comparison we develop and quantify a notion of {\em marginal return}. Our notion captures the decrease in the {\em heterogeneity} within the group of the {\em related} states (i.e., states represented by the same superstate) upon a unit increase in the number of superstates in the aggregated chain. We use Maximum Entropy Principle to justify the notion of marginal return, as well as our quantification of heterogeneity. Through simulations on synthetic Markov chains, where the number of superstates are known apriori, we show that the aggregated chain with the largest marginal return identifies this number. In case of Markov chains that model real-life scenarios we show that the aggregated model with the largest marginal return identifies an inherent structure unique to the scenario being modelled; thus, substantiating on the efficacy of our proposed methodology.
△ Less
Submitted 18 February, 2021; v1 submitted 11 October, 2020;
originally announced October 2020.
-
Topology Learning of unknown Networked Linear Dynamical System excited by Cyclostationary inputs
Authors:
Harish Doddi,
Deepjyoti Deka,
Murti Salapaka
Abstract:
Topology learning of networked dynamical systems is an important problem with implications to optimal control, decision-making over networks, cybersecurity and safety. The majority of prior work in consistent topology estimation relies on dynamical systems excited by temporally uncorrelated processes. In this article, we present a novel algorithm for guaranteed topology learning of networks that a…
▽ More
Topology learning of networked dynamical systems is an important problem with implications to optimal control, decision-making over networks, cybersecurity and safety. The majority of prior work in consistent topology estimation relies on dynamical systems excited by temporally uncorrelated processes. In this article, we present a novel algorithm for guaranteed topology learning of networks that are excited by temporally (colored) cyclostationary processes, which encompasses a wide range of temporal correlation including wide-sense stationarity. Furthermore, unlike prior work, the framework applies to linear dynamic system with complex valued dependencies, and leverages group lasso regularization for effective learning of the network structure. In the second part of the article, we analyze conditions for consistent topology learning for bidirected tree networks when a subset of the network is unobserved. Here, the full topology along with unobserved nodes are recovered from observed node's time-series alone. Our theoretical contributions are validated on simulated data as well as on real-world climate data.
△ Less
Submitted 12 October, 2024; v1 submitted 26 September, 2020;
originally announced September 2020.
-
DC-DistADMM: ADMM Algorithm for Constrained Distributed Optimization over Directed Graphs
Authors:
Vivek Khatana,
Murti V. Salapaka
Abstract:
This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees. \textcolor{black}{The algorithm accrues all the benefits of the Alternating Direction Method of Multipliers (ADMM) approach}. It also overcomes the limitations of existing methods…
▽ More
This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees. \textcolor{black}{The algorithm accrues all the benefits of the Alternating Direction Method of Multipliers (ADMM) approach}. It also overcomes the limitations of existing methods on convex optimization problems with linear inequality, equality and set constraints by allowing directed communication topologies. Moreover, the algorithm can be synthesized distributively. The developed algorithm has: (i) a $O(1/k)$ rate of convergence, where $k$ is the iteration counter, when individual functions are convex but not-necessarily differentiable, and (ii) a geometric rate of convergence to any arbitrary small neighborhood of the optimal solution, when the objective functions are smooth and restricted strongly convex at the optimal solution. The efficacy of the algorithm is evaluated by a comparison with state-of-the-art constrained optimization algorithms in solving a constrained distributed $\ell_1$-regularized logistic regression problem, and unconstrained optimization algorithms in solving a $\ell_1$-regularized Huber loss minimization problem. Additionally, a comparison of the algorithm's performance with other algorithms in the literature that utilize multiple communication steps is provided.
△ Less
Submitted 24 August, 2022; v1 submitted 30 March, 2020;
originally announced March 2020.
-
Inequality Constraints in Facility Location and Other Similar Optimization Problems: An Entropy Based Approach
Authors:
Amber Srivastava,
Gabriel Barsi Haberfeld,
Naira Hovakimyan,
Srinivasa M Salapaka
Abstract:
In this paper we propose an annealing based framework to incorporate inequality constraints in optimization problems such as facility location, simultaneous facility location with path optimization, and the last mile delivery problem. These inequality constraints are used to model several application specific size and capacity limitations on the corresponding facilities, transportation paths and t…
▽ More
In this paper we propose an annealing based framework to incorporate inequality constraints in optimization problems such as facility location, simultaneous facility location with path optimization, and the last mile delivery problem. These inequality constraints are used to model several application specific size and capacity limitations on the corresponding facilities, transportation paths and the service vehicles. We design our algorithms in such a way that it allows to (possibly) violate the constraints during the initial stages of the algorithm, so as to facilitate a thorough exploration of the solution space; as the algorithm proceeds, this violation (controlled through the annealing parameter) is gradually lowered till the solution converges in the feasible region of the optimization problem. We present simulations on various datasets that demonstrate the efficacy of our algorithm.
△ Less
Submitted 9 February, 2020;
originally announced February 2020.
-
Topology Learning of Linear Dynamical Systems with Latent Nodes using Matrix Decomposition
Authors:
Mishfad S. V.,
Harish Doddi,
Murti V. Salapaka
Abstract:
In this article, we present a novel approach to reconstruct the topology of networked linear dynamical systems with latent nodes. The network is allowed to have directed loops and bi-directed edges. The main approach relies on the unique decomposition of the inverse of power spectral density matrix (IPSDM) obtained from observed nodes as a sum of sparse and low-rank matrices. We provide conditions…
▽ More
In this article, we present a novel approach to reconstruct the topology of networked linear dynamical systems with latent nodes. The network is allowed to have directed loops and bi-directed edges. The main approach relies on the unique decomposition of the inverse of power spectral density matrix (IPSDM) obtained from observed nodes as a sum of sparse and low-rank matrices. We provide conditions and methods for decomposing the IPSDM of the observed nodes into sparse and low-rank components. The sparse component yields the moral graph associated with the observed nodes, and the low-rank component retrieves parents, children and spouses (the Markov Blanket) of the hidden nodes. The article provides necessary and sufficient conditions for the unique decomposition of a given skew symmetric matrix into sum of a sparse skew symmetric and a low-rank skew symmetric matrices. It is shown that for a large class of systems, the unique decomposition of imaginary part of the IPSDM of observed nodes, a skew symmetric matrix, into the sparse and the low-rank components is sufficient to identify the moral graph of the observed nodes as well as the Markov Blanket of latent nodes. For a large class of systems, all spurious links in the moral graph formed by the observed nodes can be identified. Assuming conditions on hidden nodes required for identifiability, links between the hidden and observed nodes can be reconstructed, resulting in the retrieval of the exact topology of the network from the availability of IPSDM. Moreover, for finite number of data samples, we provide concentration bounds on the entry-wise distance between the true IPSDM and the estimated IPSDM.
△ Less
Submitted 28 June, 2021; v1 submitted 15 December, 2019;
originally announced December 2019.
-
Graphical Models in Meshed Distribution Grids: Topology estimation, change detection and limitations
Authors:
Deepjyoti Deka,
Saurav Talukdar,
Michael Chertkov,
Murti Salapaka
Abstract:
Graphical models are a succinct way to represent the structure in probability distributions. This article analyzes the graphical model of nodal voltages in non-radial power distribution grids. Using algebraic and structural properties of graphical models, algorithms exactly determining topology and detecting line changes for distribution grids are presented along with their theoretical limitations…
▽ More
Graphical models are a succinct way to represent the structure in probability distributions. This article analyzes the graphical model of nodal voltages in non-radial power distribution grids. Using algebraic and structural properties of graphical models, algorithms exactly determining topology and detecting line changes for distribution grids are presented along with their theoretical limitations. We show that if distribution grids have cycles/loops of size greater than three, then nodal voltages are sufficient for efficient topology estimation without additional assumptions on system parameters. In contrast, line failure or change detection using nodal voltages does not require any structural assumption. Under noisy measurements, we provide the first non-trivial bounds on the maximum noise that the system can tolerate for asymptotically correct topology recovery. The performance of the designed algorithms is validated with nonlinear AC power flow samples generated by Matpower on test grids, including scenarios with injection correlations and system noise.
△ Less
Submitted 26 February, 2020; v1 submitted 16 May, 2019;
originally announced May 2019.
-
Realizing Information Erasure in Finite Time
Authors:
James Melbourne,
Saurav Talukdar,
Murti Salapaka
Abstract:
In this article, we focus on erasure of a bit of information in finite time. Landauer's principle states that the average heat dissipation due to erasure of information is k_B T ln 2, which is achievable only in an asymptotic manner. Recent theoretical developments in non-equilibrium thermodynamics and stochastic control, predict a more general bound for finite time erasure dependent on the Wasser…
▽ More
In this article, we focus on erasure of a bit of information in finite time. Landauer's principle states that the average heat dissipation due to erasure of information is k_B T ln 2, which is achievable only in an asymptotic manner. Recent theoretical developments in non-equilibrium thermodynamics and stochastic control, predict a more general bound for finite time erasure dependent on the Wasserstein distances between the initial and final configurations. These predictions suggest improvements to experimental protocol with regards to minimizing average heat dissipation for bit erasure in finite time from a bistable well, under overdamped Langevin dynamics. We present a comparative study of a theoretically optimal protocol with an existing protocol, and highlight the closeness and deviation from optimality
△ Less
Submitted 24 September, 2018;
originally announced September 2018.
-
Error Bounds on a Mixed Entropy Inequality
Authors:
James Melbourne,
Saurav Talukdar,
Shreyas Bhaban,
Murti V. Salapaka
Abstract:
Motivated by the entropy computations relevant to the evaluation of decrease in entropy in bit reset operations, the authors investigate the deficit in an entropic inequality involving two independent random variables, one continuous and the other discrete. In the case where the continuous random variable is Gaussian, we derive strong quantitative bounds on the deficit in the inequality. More expl…
▽ More
Motivated by the entropy computations relevant to the evaluation of decrease in entropy in bit reset operations, the authors investigate the deficit in an entropic inequality involving two independent random variables, one continuous and the other discrete. In the case where the continuous random variable is Gaussian, we derive strong quantitative bounds on the deficit in the inequality. More explicitly it is shown that the decay of the deficit is sub-Gaussian with respect to the reciprocal of the standard deviation of the Gaussian variable. What is more, up to rational terms these results are shown to be sharp.
△ Less
Submitted 29 May, 2018;
originally announced May 2018.
-
The Differential Entropy of Mixtures: New Bounds and Applications
Authors:
James Melbourne,
Saurav Talukdar,
Shreyas Bhaban,
Mokshay Madiman,
Murti V. Salapaka
Abstract:
Mixture distributions are extensively used as a modeling tool in diverse areas from machine learning to communications engineering to physics, and obtaining bounds on the entropy of probability distributions is of fundamental importance in many of these applications. This article provides sharp bounds on the entropy concavity deficit, which is the difference between the entropy of the mixture and…
▽ More
Mixture distributions are extensively used as a modeling tool in diverse areas from machine learning to communications engineering to physics, and obtaining bounds on the entropy of probability distributions is of fundamental importance in many of these applications. This article provides sharp bounds on the entropy concavity deficit, which is the difference between the entropy of the mixture and the weighted sum of entropies of constituent components. Toward establishing lower and upper bounds on the concavity deficit, results that are of importance in their own right are obtained. In order to obtain nontrivial upper bounds, properties of the skew-divergence are developed and notions of "skew" $f$-divergences are introduced; a reverse Pinsker inequality and a bound on Jensen-Shannon divergence are obtained along the way. Complementary lower bounds are derived with special attention paid to the case that corresponds to independent summation of a continuous and a discrete random variable. Several applications of the bounds are delineated, including to mutual information of additive noise channels, thermodynamics of computation, and functional inequalities.
△ Less
Submitted 22 April, 2020; v1 submitted 29 May, 2018;
originally announced May 2018.
-
Topology Estimation in Bulk Power Grids: Guarantees on Exact Recovery
Authors:
Deepjyoti Deka,
Saurav Talukdar,
Michael Chertkov,
Murti Salapaka
Abstract:
The topology of a power grid affects its dynamic operation and settlement in the electricity market. Real-time topology identification can enable faster control action following an emergency scenario like failure of a line. This article discusses a graphical model framework for topology estimation in bulk power grids (both loopy transmission and radial distribution) using measurements of voltage c…
▽ More
The topology of a power grid affects its dynamic operation and settlement in the electricity market. Real-time topology identification can enable faster control action following an emergency scenario like failure of a line. This article discusses a graphical model framework for topology estimation in bulk power grids (both loopy transmission and radial distribution) using measurements of voltage collected from the grid nodes. The graphical model for the probability distribution of nodal voltages in linear power flow models is shown to include additional edges along with the operational edges in the true grid. Our proposed estimation algorithms first learn the graphical model and subsequently extract the operational edges using either thresholding or a neighborhood counting scheme. For grid topologies containing no three-node cycles (two buses do not share a common neighbor), we prove that an exact extraction of the operational topology is theoretically guaranteed. This includes a majority of distribution grids that have radial topologies. For grids that include cycles of length three, we provide sufficient conditions that ensure existence of algorithms for exact reconstruction. In particular, for grids with constant impedance per unit length and uniform injection covariances, this observation leads to conditions on geographical placement of the buses. The performance of algorithms is demonstrated in test case simulations.
△ Less
Submitted 15 July, 2017; v1 submitted 5 July, 2017;
originally announced July 2017.
-
Learning Exact Topology of a Loopy Power Grid from Ambient Dynamics
Authors:
Saurav Talukdar,
Deepjyoti Deka,
Blake Lundstrom,
Michael Chertkov,
Murti V. Salapaka
Abstract:
Estimation of the operational topology of the power grid is necessary for optimal market settlement and reliable dynamic operation of the grid. This paper presents a novel framework for topology estimation for general power grids (loopy or radial) using time-series measurements of nodal voltage phase angles that arise from the swing dynamics. Our learning framework utilizes multivariate Wiener fil…
▽ More
Estimation of the operational topology of the power grid is necessary for optimal market settlement and reliable dynamic operation of the grid. This paper presents a novel framework for topology estimation for general power grids (loopy or radial) using time-series measurements of nodal voltage phase angles that arise from the swing dynamics. Our learning framework utilizes multivariate Wiener filtering to unravel the interaction between fluctuations in voltage angles at different nodes and identifies operational edges by considering the phase response of the elements of the multivariate Wiener filter. The performance of our learning framework is demonstrated through simulations on standard IEEE test cases.
△ Less
Submitted 26 April, 2017;
originally announced April 2017.
-
Distributed Finite Time Termination of Ratio Consensus for Averaging in the presence of Delays
Authors:
Mangal Prakash,
Saurav Talukdar,
Sandeep Attree,
Sourav Patel,
Murti V. Salapaka
Abstract:
Distributed averaging of agent initial conditions is a well-studied problem in context of networked systems where coordination amongst the agents is of paramount importance. The asymptotic nature of convergence of distributed averaging protocols and presence of communication delays, however, makes it challenging to implement in practical settings. It is important that agents develop the ability to…
▽ More
Distributed averaging of agent initial conditions is a well-studied problem in context of networked systems where coordination amongst the agents is of paramount importance. The asymptotic nature of convergence of distributed averaging protocols and presence of communication delays, however, makes it challenging to implement in practical settings. It is important that agents develop the ability to detect on their own when average of the initial conditions of the agents is achieved within some pre-specified tolerance and stop further computations to avoid overhead expenses in the presence of delays. This article presents a distributed finite time stopping criterion for distributed averaging using ratio consensus on a fixed interconnection topology. The practical utility of the algorithm has been illustrated through simulations.
△ Less
Submitted 26 April, 2017;
originally announced April 2017.
-
Single Molecule Studies Under Constant Force Using Model Based Robust Control Design
Authors:
Shreyas Bhaban,
Saurav Talukdar,
Mingang Li,
Thomas Hays,
Peter Seiler,
Murti V. Salapaka
Abstract:
Optical tweezers have enabled important insights into intracellular transport through the investigation of motor proteins, with their ability to manipulate particles at the microscale, affording femto Newton force resolution. Its use to realize a constant force clamp has enabled vital insights into the behavior of motor proteins under different load conditions. However, the varying nature of distu…
▽ More
Optical tweezers have enabled important insights into intracellular transport through the investigation of motor proteins, with their ability to manipulate particles at the microscale, affording femto Newton force resolution. Its use to realize a constant force clamp has enabled vital insights into the behavior of motor proteins under different load conditions. However, the varying nature of disturbances and the effect of thermal noise pose key challenges to force regulation. Furthermore, often the main aim of many studies is to determine the motion of the motor and the statistics related to the motion, which can be at odds with the force regulation objective. In this article, we propose a mixed objective H2-Hinfinity optimization framework using a model-based design, that achieves the dual goals of force regulation and real time motion estimation with quantifiable guarantees. Here, we minimize the Hinfinity norm for the force regulation and error in step estimation while maintaining the H2 norm of the noise on step estimate within user specified bounds. We demonstrate the efficacy of the framework through extensive simulations and an experimental implementation using an optical tweezer setup with live samples of the motor protein kinesin; where regulation of forces below 1 pico Newton with errors below 10 percent is obtained while simultaneously providing real time estimates of motor motion.
△ Less
Submitted 22 September, 2017; v1 submitted 19 March, 2017;
originally announced March 2017.
-
Robust Distributed Control of DC Microgrids with Time-Varying Power Sharing
Authors:
Mayank Baranwal,
Alireza Askarian,
Srinivasa M. Salapaka
Abstract:
This paper addresses the problem of output voltage regulation for multiple DC/DC converters connected to a microgrid, and prescribes a scheme for sharing power among different sources. This architecture is structured in such a way that it admits quantifiable analysis of the closed-loop performance of the network of converters; the analysis simplifies to studying closed-loop performance of an equiv…
▽ More
This paper addresses the problem of output voltage regulation for multiple DC/DC converters connected to a microgrid, and prescribes a scheme for sharing power among different sources. This architecture is structured in such a way that it admits quantifiable analysis of the closed-loop performance of the network of converters; the analysis simplifies to studying closed-loop performance of an equivalent {\em single-converter} system. The proposed architecture allows for the proportion in which the sources provide power to vary with time; thus overcoming limitations of our previous designs. Additionally, the proposed control framework is suitable to both centralized and decentralized implementations, i.e., the same control architecture can be employed for voltage regulation irrespective of the availability of common load-current (or power) measurement, without the need to modify controller parameters. The performance becomes quantifiably better with better communication of the demanded load to all the controllers at all the converters (in the centralized case); however guarantees viability when such communication is absent. Case studies comprising of battery, PV and generic sources are presented and demonstrate the enhanced performance of prescribed optimal controllers for voltage regulation and power sharing.
△ Less
Submitted 11 January, 2017;
originally announced January 2017.
-
Distributed Finite Time Termination of Consensus in the Presence of Delays
Authors:
Mangal Prakash,
Saurav Talukdar,
Sandeep Attree,
Vikas Yadav,
Murti Salapaka
Abstract:
Linear consensus iterations guarantee asymptotic convergence, thereby, limiting their applicability in applications where consensus value needs to be used in real time to perform a system level task. It also leads to wastage of power and communication resources. In this article, an algorithm is proposed which enables each node to detect in a distributed manner and in finite number of iterations, w…
▽ More
Linear consensus iterations guarantee asymptotic convergence, thereby, limiting their applicability in applications where consensus value needs to be used in real time to perform a system level task. It also leads to wastage of power and communication resources. In this article, an algorithm is proposed which enables each node to detect in a distributed manner and in finite number of iterations, when every agent in the network is within a user specified threshold of the consensus value (approximate consensus) and hence terminate further communications and computations associated with consensus iterations. This article develops a distributed algorithm for achieving this approximate consensus in presence of random time-varying bounded communication delays. Moreover, the article instantiates the algorithm developed to distributively determine the average of the initial values held by agents in finite number of iterations. Specifically, this algorithm relies on distributively determining the maximum and minimum of values held by the agents. The approach presented here offers several advantages, including reduced computational complexity, and hence, is suited for hardware implementation. An experimental test bed of Raspberry-Pi agents that communicate wirelessly over neighborhoods is employed as a platform to demonstrate the effectiveness of the developed algorithm.
△ Less
Submitted 21 June, 2017; v1 submitted 30 December, 2016;
originally announced January 2017.
-
Clustering with Capacity and Size Constraints: A Deterministic Approach
Authors:
Mayank Baranwal,
Srinivasa M. Salapaka
Abstract:
This paper discusses a deterministic clustering approach to capacitated resource allocation problems. In particular, the Deterministic Annealing (DA) algorithm from the data-compression literature, which bears a distinct analogy to the phase transformation under annealing process in statistical physics, is adapted to address problems pertaining to clustering with several forms of size constraints.…
▽ More
This paper discusses a deterministic clustering approach to capacitated resource allocation problems. In particular, the Deterministic Annealing (DA) algorithm from the data-compression literature, which bears a distinct analogy to the phase transformation under annealing process in statistical physics, is adapted to address problems pertaining to clustering with several forms of size constraints. These constraints are addressed through appropriate modifications of the basic DA formulation by judiciously adjusting the free-energy function in the DA algorithm. At a given value of the annealing parameter, the iterations of the DA algorithm are of the form of a Descent Method, which motivate scaling principles for faster convergence.
△ Less
Submitted 21 June, 2016;
originally announced June 2016.
-
A Deterministic Annealing Approach to the Multiple Traveling Salesmen and Related Problems
Authors:
Mayank Baranwal,
Brian Roehl,
Srinivasa M. Salapaka
Abstract:
This paper presents a novel and efficient heuristic framework for approximating the solutions to the multiple traveling salesmen problem (m-TSP) and other variants on the TSP. The approach adopted in this paper is an extension of the Maximum-Entropy-Principle (MEP) and the Deterministic Annealing (DA) algorithm. The framework is presented as a general tool that can be suitably adapted to a number…
▽ More
This paper presents a novel and efficient heuristic framework for approximating the solutions to the multiple traveling salesmen problem (m-TSP) and other variants on the TSP. The approach adopted in this paper is an extension of the Maximum-Entropy-Principle (MEP) and the Deterministic Annealing (DA) algorithm. The framework is presented as a general tool that can be suitably adapted to a number of variants on the basic TSP. Additionally, unlike most other heuristics for the TSP, the framework presented in this paper is independent of the edges defined between any two pairs of nodes. This makes the algorithm particularly suited for variants such as the close-enough traveling salesman problem (CETSP) which are challenging due to added computational complexity. The examples presented in this paper illustrate the effectiveness of this new framework for use in TSP and many variants thereof.
△ Less
Submitted 14 April, 2016;
originally announced April 2016.
-
Robust Control Framework for Time-Varying Power-Sharing among Distributed Energy Resources
Authors:
Mayank Baranwal,
Srinivasa M. Salapaka
Abstract:
One of the most important challenges facing an electric grid is to incorporate renewables and distributed energy resources (DERs) to the grid. Because of the associated uncertainties in power generations and peak power demands, opportunities for improving the functioning and reliability of the grid lie in the design of an efficient, yet pragmatic distributed control framework with guaranteed robus…
▽ More
One of the most important challenges facing an electric grid is to incorporate renewables and distributed energy resources (DERs) to the grid. Because of the associated uncertainties in power generations and peak power demands, opportunities for improving the functioning and reliability of the grid lie in the design of an efficient, yet pragmatic distributed control framework with guaranteed robustness margins. This paper addresses the problem of output voltage regulation for multiple DC-DC converters connected to a grid, and prescribes a robust scheme for sharing power among different sources. More precisely, we develop a control architecture where, unlike most standard control frameworks, the desired power ratios appear as reference signals to individual converter systems, and not as internal parameters of the system of parallel converters. This makes the proposed approach suited for scenarios when the desired power ratios vary rapidly with time. Additionally, the proposed control framework is suitable to both centralized and decentralized implementations, i.e., the same control architecture can be employed for voltage regulation irrespective of the availability of common load-current (or power) measurement, without the need to modify controller parameters. The control design is obtained using robust optimal-control framework. Case studies presented show the enhanced performance of prescribed optimal controllers for voltage regulation and power sharing.
△ Less
Submitted 14 April, 2016;
originally announced April 2016.
-
Vehicle Routing Problem with Time Windows: A Deterministic Annealing approach
Authors:
Mayank Baranwal,
Pratik M. Parekh,
Lavanya Marla,
Srinivasa M. Salapaka,
Carolyn L. Beck
Abstract:
The Vehicle Routing Problem with Time-Windows (VRPTW) is an important problem in allocating resources on networks in time and space. We present in this paper a Deterministic Annealing (DA)-based approach to solving the VRPTW with its aspects of routing and scheduling, as well as to model additional constraints of heterogeneous vehicles and shipments. This is the first time, to our knowledge, that…
▽ More
The Vehicle Routing Problem with Time-Windows (VRPTW) is an important problem in allocating resources on networks in time and space. We present in this paper a Deterministic Annealing (DA)-based approach to solving the VRPTW with its aspects of routing and scheduling, as well as to model additional constraints of heterogeneous vehicles and shipments. This is the first time, to our knowledge, that a DA approach has been used for problems in the class of the VRPTW. We describe how the DA approach can be adapted to generate an effective heuristic approach to the VRPTW. Our DA approach is also designed to not get trapped in local minima, and demonstrates less sensitivity to initial solutions. The algorithm trades off routing and scheduling in an n-dimensional space using a tunable parameter that allows us to generate qualitatively good solutions. These solutions differ in the degree of intersection of the routes, making the case for transfer points where shipments can be exchanged. Simulation results on randomly generated instances show that the constraints are respected and demonstrate near optimal results (when verifiable) in terms of schedules and tour length of individual tours in each solution.
△ Less
Submitted 12 April, 2016;
originally announced April 2016.
-
Robust Decentralized Voltage Control of DC-DC Converters with Applications to Power Sharing and Ripple Sharing
Authors:
Mayank Baranwal,
Srinivasa M. Salapaka,
Murti V. Salapaka
Abstract:
This paper addresses the problem of output voltage regulation for multiple DC-DC converters connected to a grid, and prescribes a robust scheme for sharing power among different sources. Also it develops a method for sharing 120 Hz ripple among DC power sources in a prescribed proportion, which accommodates the different capabilities of DC power sources to sustain the ripple. We present a decentra…
▽ More
This paper addresses the problem of output voltage regulation for multiple DC-DC converters connected to a grid, and prescribes a robust scheme for sharing power among different sources. Also it develops a method for sharing 120 Hz ripple among DC power sources in a prescribed proportion, which accommodates the different capabilities of DC power sources to sustain the ripple. We present a decentralized control architecture, where a nested (inner-outer) control design is used at every converter. An interesting aspect of the proposed design is that the analysis and design of the entire multi-converter system can be done using an equivalent single converter system, where the multi-converter system inherits the performance and robustness achieved by a design for the single-converter system. Another key aspect of this work is that the voltage regulation problem is addressed as a disturbance-rejection problem, where {\em unknown} load current is viewed as an external signal, and thus, no prior information is required on the nominal loading conditions. The control design is obtained using robust optimal-control framework. Case studies presented show the enhanced performance of prescribed optimal controllers.
△ Less
Submitted 12 April, 2016;
originally announced April 2016.
-
Model Identification of a Network as Compressing Sensing
Authors:
D. Materassi,
G. Innocenti,
L. Giarré,
M. Salapaka
Abstract:
In many applications, it is important to derive information about the topology and the internal connections of dynamical systems interacting together. Examples can be found in fields as diverse as Economics, Neuroscience and Biochemistry. The paper deals with the problem of deriving a descriptive model of a network, collecting the node outputs as time series with no use of a priori insight on the…
▽ More
In many applications, it is important to derive information about the topology and the internal connections of dynamical systems interacting together. Examples can be found in fields as diverse as Economics, Neuroscience and Biochemistry. The paper deals with the problem of deriving a descriptive model of a network, collecting the node outputs as time series with no use of a priori insight on the topology, and unveiling an unknown structure as the estimate of a "sparse Wiener filter". A geometric interpretation of the problem in a pre-Hilbert space for wide-sense stochastic processes is provided. We cast the problem as the optimization of a cost function where a set of parameters are used to operate a trade-off between accuracy and complexity in the final model. The problem of reducing the complexity is addressed by fixing a certain degree of sparsity and finding the solution that "better" satisfies the constraints according to the criterion of approximation. Applications starting from real data and numerical simulations are provided.
△ Less
Submitted 3 March, 2011;
originally announced March 2011.
-
A Reconstruction algorithm for an unknown network
Authors:
Donatello Materassi,
Murti V. Salapaka
Abstract:
The interest for networks of dynamical systems has been increasing in the past years, especially because of their capability of modeling and describing a large variety of phenomena and behaviors. We propose a technique, based on Wiener filtering, which provides general theoretical guarantees for the detection of links in a network of dynamical systems. For a large class of network that we name "se…
▽ More
The interest for networks of dynamical systems has been increasing in the past years, especially because of their capability of modeling and describing a large variety of phenomena and behaviors. We propose a technique, based on Wiener filtering, which provides general theoretical guarantees for the detection of links in a network of dynamical systems. For a large class of network that we name "self-kin" sufficient conditions for a correct detection of a link are formulated. For networks not belonging to this class we give conditions for correct detection of links belonging to the smallest self-kin network containing the actual one.
△ Less
Submitted 16 April, 2010; v1 submitted 1 April, 2010;
originally announced April 2010.
