-
Control analysis and synthesis for general control-affine systems
Authors:
Cyprien Tamekue,
ShiNung Ching
Abstract:
This paper provides controllability analysis and control synthesis for general control-affine systems, potentially subject to a bounded perturbation. We establish sufficient controllability conditions based on a proper generalization of the controllability Gramian for linear systems. Under these sufficient conditions, control syntheses are developed. We provide two control input constructions for…
▽ More
This paper provides controllability analysis and control synthesis for general control-affine systems, potentially subject to a bounded perturbation. We establish sufficient controllability conditions based on a proper generalization of the controllability Gramian for linear systems. Under these sufficient conditions, control syntheses are developed. We provide two control input constructions for a given system, either of which can steer the system from a given initial state to any desired target state within a finite time horizon. As in our analysis, in the case of linearity, these syntheses are reduced to common control inputs based on the controllability of Gramian. Additionally, we derive a sharp upper bound on the $L^2$-norm of these control functions, allowing us to derive insights into the energy required to enact control. The work advances the theory of nonlinear controllability and provides an analytical framework that facilitates numerical verification and practical implementation.
△ Less
Submitted 7 March, 2025;
originally announced March 2025.
-
On the control of recurrent neural networks using constant inputs
Authors:
Cyprien Tamekue,
Ruiqi Chen,
ShiNung Ching
Abstract:
This paper investigates the controllability properties of a general class of recurrent neural networks that are widely used for hypothesis generation in theoretical neuroscience, including the modeling of large-scale human brain dynamics. Our study focuses on the control synthesis of such networks using constant and piecewise constant inputs, motivated by emerging applications in non-invasive neur…
▽ More
This paper investigates the controllability properties of a general class of recurrent neural networks that are widely used for hypothesis generation in theoretical neuroscience, including the modeling of large-scale human brain dynamics. Our study focuses on the control synthesis of such networks using constant and piecewise constant inputs, motivated by emerging applications in non-invasive neurostimulation such as transcranial direct current stimulation (tDCS). The neural network model considered is a continuous Hopfield-type system with nonlinear activation functions and arbitrary input matrices representing interactions among multiple brain regions. Our main contribution is the formulation and solution of a control synthesis problem for these nonlinear systems. We provide a proper generalization of the variation of the constants formula that constitutes a novel representation of the system's state trajectory. This representation admits a verifiable condition on the existence of the constant control input to solve a short-time two-point boundary value problem in the state space. This formulation admits a synthesis for the input in question, which can be realized using modern algorithmic optimization tools. In the case of linear activation functions, this analysis and synthesis reduces to the verification of algebraic conditions on the system matrices. Simulation results are presented to illustrate the theoretical findings and demonstrate the efficacy of the proposed control strategies. These results offer a novel control synthesis for an important class of neural network models that may, in turn, enable the design of brain stimulation protocols to modulate whole-brain activity in therapeutic and cognitive enhancement applications.
△ Less
Submitted 22 October, 2024;
originally announced October 2024.
-
Strong anti-Hebbian plasticity alters the convexity of network attractor landscapes
Authors:
Lulu Gong,
Xudong Chen,
ShiNung Ching
Abstract:
In this paper, we study recurrent neural networks in the presence of pairwise learning rules. We are specifically interested in how the attractor landscapes of such networks become altered as a function of the strength and nature (Hebbian vs. anti-Hebbian) of learning, which may have a bearing on the ability of such rules to mediate large-scale optimization problems. Through formal analysis, we sh…
▽ More
In this paper, we study recurrent neural networks in the presence of pairwise learning rules. We are specifically interested in how the attractor landscapes of such networks become altered as a function of the strength and nature (Hebbian vs. anti-Hebbian) of learning, which may have a bearing on the ability of such rules to mediate large-scale optimization problems. Through formal analysis, we show that a transition from Hebbian to anti-Hebbian learning brings about a pitchfork bifurcation that destroys convexity in the network attractor landscape. In larger-scale settings, this implies that anti-Hebbian plasticity will bring about multiple stable equilibria, and such effects may be outsized at interconnection or `choke' points. Furthermore, attractor landscapes are more sensitive to slower learning rates than faster ones. These results provide insight into the types of objective functions that can be encoded via different pairwise plasticity rules.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
-
The effects of leaflet material properties on the simulated function of regurgitant mitral valves
Authors:
Wensi Wu,
Stephen Ching,
Patricia Sabin,
Devin W. Laurence,
Steve A. Maas,
Andras Lasso,
Jeffrey A. Weiss,
Matthew A. Jolley
Abstract:
Advances in three-dimensional imaging provide the ability to construct and analyze finite element (FE) models to evaluate the biomechanical behavior and function of atrioventricular valves. However, while obtaining patient-specific valve geometry is now possible, non-invasive measurement of patient-specific leaflet material properties remains nearly impossible. Both valve geometry and tissue prope…
▽ More
Advances in three-dimensional imaging provide the ability to construct and analyze finite element (FE) models to evaluate the biomechanical behavior and function of atrioventricular valves. However, while obtaining patient-specific valve geometry is now possible, non-invasive measurement of patient-specific leaflet material properties remains nearly impossible. Both valve geometry and tissue properties play a significant role in governing valve dynamics, leading to the central question of whether clinically relevant insights can be attained from FE analysis of atrioventricular valves without precise knowledge of tissue properties. As such we investigated 1) the influence of tissue extensibility and 2) the effects of constitutive model parameters and leaflet thickness on simulated valve function and mechanics. We compared metrics of valve function (e.g., leaflet coaptation and regurgitant orifice area) and mechanics (e.g., stress and strain) across one normal and three regurgitant mitral valve (MV) models with common mechanisms of regurgitation (annular dilation, leaflet prolapse, leaflet tethering) of both moderate and severe degree. We developed a novel fully-automated approach to accurately quantify regurgitant orifice areas of complex valve geometries. We found that the relative ordering of the mechanical and functional metrics was maintained across a group of valves using material properties up to 15% softer than the representative adult mitral constitutive model. Our findings suggest that FE simulations can be used to qualitatively compare how differences and alterations in valve structure affect relative atrioventricular valve function even in populations where material properties are not precisely known.
△ Less
Submitted 25 April, 2023; v1 submitted 9 February, 2023;
originally announced February 2023.
-
Non-Stationary Representation Learning in Sequential Linear Bandits
Authors:
Yuzhen Qin,
Tommaso Menara,
Samet Oymak,
ShiNung Ching,
Fabio Pasqualetti
Abstract:
In this paper, we study representation learning for multi-task decision-making in non-stationary environments. We consider the framework of sequential linear bandits, where the agent performs a series of tasks drawn from distinct sets associated with different environments. The embeddings of tasks in each set share a low-dimensional feature extractor called representation, and representations are…
▽ More
In this paper, we study representation learning for multi-task decision-making in non-stationary environments. We consider the framework of sequential linear bandits, where the agent performs a series of tasks drawn from distinct sets associated with different environments. The embeddings of tasks in each set share a low-dimensional feature extractor called representation, and representations are different across sets. We propose an online algorithm that facilitates efficient decision-making by learning and transferring non-stationary representations in an adaptive fashion. We prove that our algorithm significantly outperforms the existing ones that treat tasks independently. We also conduct experiments using both synthetic and real data to validate our theoretical insights and demonstrate the efficacy of our algorithm.
△ Less
Submitted 16 April, 2022; v1 submitted 13 January, 2022;
originally announced January 2022.
-
Input Novelty as a Control Metric for Time Varying Linear Systems
Authors:
Gautam Kumar,
Delsin Menolascino,
ShiNung Ching
Abstract:
This paper introduces a framework for quantitative characterization of the controllability of time-varying linear systems (or networks) in terms of input novelty. The motivation for such an approach comes from the study of biophysical sensory networks in the brain, wherein responsiveness to both energy and salience (or novelty) are presumably critical for mediating behavior and function. Here, we…
▽ More
This paper introduces a framework for quantitative characterization of the controllability of time-varying linear systems (or networks) in terms of input novelty. The motivation for such an approach comes from the study of biophysical sensory networks in the brain, wherein responsiveness to both energy and salience (or novelty) are presumably critical for mediating behavior and function. Here, we use an inner product to define the angular separation of the current input with respect to the past input history. Then, by constraining input energy, we define a non-convex optimal control problem to obtain the minimally novel input that effects a given state transfer. We provide analytical conditions for existence and uniqueness in continuous-time, as well as an explicit closed-form expression for the solution. In discrete time, we show that a relaxed convex optimization formulation provides the global optimal solution of the original non-convex problem. Finally, we show how the minimum novelty control can be used as a metric to study control properties of large scale recurrent neuronal networks and other complex linear systems. In particular, we highlight unique aspects of a system's controllability that are captured through the novelty-based metric. The result suggests that a multifaceted approach, combining energy-based analysis with other specific metrics, may be useful for obtaining more complete controllability characterizations.
△ Less
Submitted 21 November, 2014;
originally announced November 2014.
-
Controlling Linear Networks with Minimally Novel Inputs
Authors:
Gautam Kumar,
Delsin Menolascino,
MohammadMehdi Kafashan,
ShiNung Ching
Abstract:
In this paper, we propose a novelty-based metric for quantitative characterization of the controllability of complex networks. This inherently bounded metric describes the average angular separation of an input with respect to the past input history. We use this metric to find the minimally novel input that drives a linear network to a desired state using unit average energy. Specifically, the min…
▽ More
In this paper, we propose a novelty-based metric for quantitative characterization of the controllability of complex networks. This inherently bounded metric describes the average angular separation of an input with respect to the past input history. We use this metric to find the minimally novel input that drives a linear network to a desired state using unit average energy. Specifically, the minimally novel input is defined as the solution of a continuous time, non-convex optimal control problem based on the introduced metric. We provide conditions for existence and uniqueness, and an explicit, closed-form expression for the solution. We support our theoretical results by characterizing the minimally novel inputs for an example of a recurrent neuronal network.
△ Less
Submitted 26 September, 2014;
originally announced September 2014.
-
Analysis of Recurrent Linear Networks for Enabling Compressed Sensing of Time-Varying Signals
Authors:
MohammadMehdi Kafashan,
Anirban Nandi,
ShiNung Ching
Abstract:
Recent interest has developed around the problem of dynamic compressed sensing, or the recovery of time-varying, sparse signals from limited observations. In this paper, we study how the dynamics of recurrent networks, formulated as general dynamical systems, mediate the recoverability of such signals. We specifically consider the problem of recovering a high-dimensional network input, over time,…
▽ More
Recent interest has developed around the problem of dynamic compressed sensing, or the recovery of time-varying, sparse signals from limited observations. In this paper, we study how the dynamics of recurrent networks, formulated as general dynamical systems, mediate the recoverability of such signals. We specifically consider the problem of recovering a high-dimensional network input, over time, from observation of only a subset of the network states (i.e., the network output). Our goal is to ascertain how the network dynamics lead to performance advantages, particularly in scenarios where both the input and output are corrupted by disturbance and noise, respectively. For this scenario, we develop bounds on the recovery performance in terms of the dynamics. Conditions for exact recovery in the absence of noise are also formulated. Through several examples, we use the results to highlight how different network characteristics may trade off toward enabling dynamic compressed sensing and how such tradeoffs may manifest naturally in certain classes of neuronal networks.
△ Less
Submitted 6 November, 2015; v1 submitted 1 August, 2014;
originally announced August 2014.
-
On the output of nonlinear systems excited by discrete prolate spheroidal sequences
Authors:
Kyle Q. Lepage,
ShiNung Ching
Abstract:
The discrete prolate spheroidal sequences (DPSSs) - a set of optimally bandlimited sequences with unique properties - are important to applications in both science and engineering. In this work, properties of nonlinear system response due to DPSS excitation are reported. In particular, this output is shown to be approximately orthogonal after passing through a nonlinear, multiple-input multiple-ou…
▽ More
The discrete prolate spheroidal sequences (DPSSs) - a set of optimally bandlimited sequences with unique properties - are important to applications in both science and engineering. In this work, properties of nonlinear system response due to DPSS excitation are reported. In particular, this output is shown to be approximately orthogonal after passing through a nonlinear, multiple-input multiple-output system with memory under quite general conditions. This work quantifies these conditions in terms of constraints upon the higher-order generalized transfer functions characterizing the Volterra expansion of a MIMO system, the Volterra order of the system, and the DPSS bandwidth parameter W and time-bandwidth parameter NW. The approximate system output orthogonality allows multiple input, multiple-output parameter identification of edge structure in interconnected nonlinear systems using simultaneous, DPSS excitation. This narrowband method of system identification is particularly appealing when compared to classical broadband system excitation in sensitive, neural engineering applications involving electrical stimulation of multiple brain regions. Through the comparison of inner-product and kernel-based narrowband detectors, the utility of this work is demonstrated when identifying narrowband system response of a third-order Volterra system from noisy observations.
△ Less
Submitted 6 October, 2014; v1 submitted 19 November, 2013;
originally announced November 2013.