Showing 1–26 of 26 results for author: Aguirre, L

Modeling and Analysis of Phase-locked loops: a non reductionist approach

Authors: José Roberto Castilho Piqueira, Felipe Freitas, Luis Antonio Aguirre

Abstract: Phase-locked loop (PLL), conceived in 1932 by H. Bellescize, has been the basic electronic component in the development of communication technology from the early analog radio receptors to modern digital civil and military facilities. Traditionally, the analysis is conducted by modeling the dynamical behavior of phase and frequency errors, hence following a phase reduction approach. One of the mai… ▽ More Phase-locked loop (PLL), conceived in 1932 by H. Bellescize, has been the basic electronic component in the development of communication technology from the early analog radio receptors to modern digital civil and military facilities. Traditionally, the analysis is conducted by modeling the dynamical behavior of phase and frequency errors, hence following a phase reduction approach. One of the main goals of the present work is to describe and investigate the dynamics of a PLL node by representing it in full state-space, here called non reductionist model, without the usual design simplifications i.e., considering different input and output frequencies and not neglecting the higher frequencies components generated in the phase detection process. On the one hand, this approach complicates the use of analytical tools but on the other hand it permits an efficient numerical approach that can be used for precise definition of regions in parameters space that show the boundaries between synchronization and non synchronization regimes, even when noise is considered. Results show that the PLL node can be simulated in a more realistic way using the state-space model and that a number of design-relevant aspects can now be investigated numerically. △ Less

Submitted 25 November, 2024; originally announced November 2024.

Comments: The paper is not submitted to any journal

Detecting Phase Synchronization in Latent Variable Subspace: Non-generating Partitions and Symbol Sequence Statistics

Authors: Henrique Carvalho de Castro, Luis Aguirre

Abstract: The detection of phase synchronization of coupled chaotic oscillators which are not phase-coherent is known to be a challenging task. In this work a method to detect and measure phase synchronization is presented. The procedure uses symbol sequence statistics together with Principal Component Analysis (PCA) and is applied in the phase synchronization analysis of pairs of coupled chaotic systems wi… ▽ More The detection of phase synchronization of coupled chaotic oscillators which are not phase-coherent is known to be a challenging task. In this work a method to detect and measure phase synchronization is presented. The procedure uses symbol sequence statistics together with Principal Component Analysis (PCA) and is applied in the phase synchronization analysis of pairs of coupled chaotic systems with different characteristics. Using PCA, we extract a 3D space (called latent space) from the original 6D space of the coupled oscillators. When the oscillators are in complete synchronization, the latent space represents the dynamics of an isolated oscillator. However, as synchronization deteriorates, the latent space becomes increasingly disorganized, although it does retain some level of organization during phase synchronization. A 2D Poincaré-type section is defined in the latent space and the corresponding 1D map is used to define a non-generating partition such that an arbitrary symbol sequence is forbidden for any synchronized regime. It is shown that the probability of occurrence of such a symbol sequence is closely related to the quality of phase synchronization. The procedure does not require a phase definition or complicated partitioning algorithms, which is performed by a simple threshold-crossing technique. This method requires data from different levels of synchronization to be able to determine the required non-generating partition. △ Less

Submitted 8 November, 2023; originally announced November 2023.

Comments: The following article has been submitted to Chaos, an Interdisciplinary Journal of Nonlinear Science

Functional observability and target state estimation in large-scale networks

Authors: Arthur N. Montanari, Chao Duan, Luis A. Aguirre, Adilson E. Motter

Abstract: The quantitative understanding and precise control of complex dynamical systems can only be achieved by observing their internal states via measurement and/or estimation. In large-scale dynamical networks, it is often difficult or physically impossible to have enough sensor nodes to make the system fully observable. Even if the system is in principle observable, high-dimensionality poses fundament… ▽ More The quantitative understanding and precise control of complex dynamical systems can only be achieved by observing their internal states via measurement and/or estimation. In large-scale dynamical networks, it is often difficult or physically impossible to have enough sensor nodes to make the system fully observable. Even if the system is in principle observable, high-dimensionality poses fundamental limits on the computational tractability and performance of a full-state observer. To overcome the curse of dimensionality, we instead require the system to be functionally observable, meaning that a targeted subset of state variables can be reconstructed from the available measurements. Here, we develop a graph-based theory of functional observability, which leads to highly scalable algorithms to i) determine the minimal set of required sensors and ii) design the corresponding state observer of minimum order. Compared to the full-state observer, the proposed functional observer achieves the same estimation quality with substantially less sensing and computational resources, making it suitable for large-scale networks. We apply the proposed methods to the detection of cyber-attacks in power grids from limited phase measurement data and the inference of the prevalence rate of infection during an epidemic under limited testing conditions. The applications demonstrate that the functional observer can significantly scale up our ability to explore otherwise inaccessible dynamical processes on complex networks. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Comments: Codes are available in GitHub (https://github.com/montanariarthur/FunctionalObservability)

Journal ref: Proc. Natl. Acad. Sci. U.S.A. 119, e2113750119 (2022)

Nonlinearity Compensation Based on Identified NARX Polynomials Models

Authors: Lucas A. Tavares, Petrus E. O. G. B. Abreu, Luis A. Aguirre

Abstract: This paper deals with the compensation of nonlinearities in dynamical systems using nonlinear polynomial autoregressive models with exogenous inputs (NARX). The compensation approach is formulated for static and dynamical contexts, as well as its adaptation to hysteretic systems. In all of these scenarios, identified NARX models are used. The core idea is to rewrite the model as an algebraic polyn… ▽ More This paper deals with the compensation of nonlinearities in dynamical systems using nonlinear polynomial autoregressive models with exogenous inputs (NARX). The compensation approach is formulated for static and dynamical contexts, as well as its adaptation to hysteretic systems. In all of these scenarios, identified NARX models are used. The core idea is to rewrite the model as an algebraic polynomial whose roots are potential compensation inputs. A procedure is put forward to choose the most adequate root, in cases where more than one is possible. Both numerical and experimental results are presented to illustrate the method. In the experimental case the method is compared to other approaches. The results show that the proposed methodology can provide compensation input signals that practically linearize the studied systems using simple and representative models with no more than five terms. △ Less

Submitted 24 November, 2020; originally announced November 2020.

Identification of NARX Models for Compensation Design

Authors: Lucas A. Tavares, Petrus E. O. G. B. Abreu, Luis A. Aguirre

Abstract: This report presents the modeling results for three systems, two numerical and one experimental. In the numerical examples, we use mathematical models previously obtained in the literature as the systems to be identified. The first numerical example is a heating system with a polynomial nonlinearity that is described by a Hammerstein model. The second is a Bouc-Wen model that represents the hyster… ▽ More This report presents the modeling results for three systems, two numerical and one experimental. In the numerical examples, we use mathematical models previously obtained in the literature as the systems to be identified. The first numerical example is a heating system with a polynomial nonlinearity that is described by a Hammerstein model. The second is a Bouc-Wen model that represents the hysteretic behavior in a piezoelectric actuator. Finally, the experimental example is a pneumatic valve that presents a variety of nonlinearities, including hysteresis. For each example, a Nonlinear AutoRegressive model with eXogenous inputs (NARX) is identified using two well-established techniques together, the Error Reduction Ratio (ERR) method to hierarchically select the regressors and the Akaike's Information Criterion (AIC) to truncate the number of terms. Using both approaches, the structure selection is achieved. The design of the excitation input is based on preserving the frequencies of interest and force the system to achieve different points of operation. Hence, having the structure previously selected with ERR and AIC, we use the Extended Least Squares (ELS) algorithm to estimate the parameters. The results show that it is possible to identify the referred systems with no more than five terms. These identified models will be used for nonlinearity compensation in future works. △ Less

Submitted 2 July, 2021; v1 submitted 19 November, 2020; originally announced November 2020.

Comments: A spelling mistake in the title is corrected

Including steady-state information in nonlinear models: an application to the development of soft-sensors

Authors: Leandro Freitas, Bruno H. G. Barbosa, Luis A. Aguirre

Abstract: When the dynamical data of a system only convey dynamic information over a limited operating range, the identification of models with good performance over a wider operating range is very unlikely. Nevertheless, models with such characteristic are desirable to implement modern control systems. To overcome such a shortcoming, this paper describes a methodology to train models from dynamical data an… ▽ More When the dynamical data of a system only convey dynamic information over a limited operating range, the identification of models with good performance over a wider operating range is very unlikely. Nevertheless, models with such characteristic are desirable to implement modern control systems. To overcome such a shortcoming, this paper describes a methodology to train models from dynamical data and steady-state information, which is assumed available. The novelty is that the procedure can be applied to models with rather complex structures such as multilayer perceptron neural networks in a bi-objective fashion without the need to compute fixed points neither analytically nor numerically. As a consequence, the required computing time is greatly reduced. The capabilities of the proposed method are explored in numerical examples and the development of soft-sensors for downhole pressure estimation for a real deep-water offshore oil well. The results indicate that the procedure yields suitable soft-sensors with good dynamical and static performance and, in the case of models that are nonlinear in the parameters, the gain in computation time is about three orders of magnitude considering existing approaches. △ Less

Submitted 3 September, 2020; originally announced September 2020.

Irradiated ocean planets bridge super-Earth and sub-Neptune populations

Authors: Olivier Mousis, Magali Deleuil, Artyom Aguichine, Emmanuel Marcq, Joseph Naar, Lorena Acuña Aguirre, Bastien Brugger, Thomas Goncalves

Abstract: Small planets ($\sim$1--3.9 $\Rearth$) constitute more than half of the inventory of the 4000-plus exoplanets discovered so far. Smaller planets are sufficiently dense to be rocky, but those with radii larger than $\sim$1.6 $\Rearth$ are thought to display in many cases hydrogen/helium gaseous envelopes up to $\sim$30\% of the planetary mass. These low-mass planets are highly irradiated and the qu… ▽ More Small planets ($\sim$1--3.9 $\Rearth$) constitute more than half of the inventory of the 4000-plus exoplanets discovered so far. Smaller planets are sufficiently dense to be rocky, but those with radii larger than $\sim$1.6 $\Rearth$ are thought to display in many cases hydrogen/helium gaseous envelopes up to $\sim$30\% of the planetary mass. These low-mass planets are highly irradiated and the question of their origin, evolution, and possible links remains open. Here we show that close-in ocean planets affected by greenhouse effect display hydrospheres in supercritical state, which generate inflated atmospheres without invoking the presence of large hydrogen/helium gaseous envelopes. We present a new set of mass-radius relationships for ocean planets with different compositions and different equilibrium temperatures, which are found to be well adapted to low-density sub-Neptune planets. Our model suggests that super-Earths and water-rich sub-Neptunes could belong to the same family of planets, i.e. hydrogen/helium-free planets, with differences between their interiors simply resulting from the variation in the water content. △ Less

Submitted 26 May, 2020; v1 submitted 12 February, 2020; originally announced February 2020.

Comments: Accepted for publication in The Astrophysical Journal Letters

Identification and nonlinearity compensation of hysteresis using NARX models

Authors: Petrus E. O. G. B. Abreu, Lucas A. Tavares, Bruno O. S. Teixeira, Luis A. Aguirre

Abstract: This paper deals with two problems: the identification and compensation of hysteresis nonlinearity in dynamical systems using nonlinear polynomial autoregressive models with exogenous inputs (NARX). First, based on gray-box identification techniques, some constraints on the structure and parameters of NARX models are proposed to ensure that the identified models display a key-feature of hysteresis… ▽ More This paper deals with two problems: the identification and compensation of hysteresis nonlinearity in dynamical systems using nonlinear polynomial autoregressive models with exogenous inputs (NARX). First, based on gray-box identification techniques, some constraints on the structure and parameters of NARX models are proposed to ensure that the identified models display a key-feature of hysteresis. In addition, a more general framework is developed to explain how hysteresis occurs in such models. Second, two strategies to design hysteresis compensators are presented. In one strategy the compensation law is obtained through simple algebraic manipulations performed on the identified models. It has been found that the compensators based on gray-box models outperform the cases with models identified using black-box techniques. In the second strategy, the compensation law is directly identified from the data. Both numerical and experimental results are presented to illustrate the efficiency of the proposed procedures. △ Less

Submitted 10 January, 2020; originally announced January 2020.

Multi-objective Evolutionary Approach to Grey-Box Identification of Buck Converter

Authors: Faizal Hafiz, Akshya Swain, Eduardo M. A. M. Mendes, Luis Aguirre

Abstract: The present study proposes a simple grey-box identification approach to model a real DC-DC buck converter operating in continuous conduction mode. The problem associated with the information void in the observed dynamical data, which is often obtained over a relatively narrow input range, is alleviated by exploiting the known static behavior of buck converter as a priori knowledge. A simple method… ▽ More The present study proposes a simple grey-box identification approach to model a real DC-DC buck converter operating in continuous conduction mode. The problem associated with the information void in the observed dynamical data, which is often obtained over a relatively narrow input range, is alleviated by exploiting the known static behavior of buck converter as a priori knowledge. A simple method is developed based on the concept of term clusters to determine the static response of the candidate models. The error in the static behavior is then directly embedded into the multi-objective framework for structure selection. In essence, the proposed approach casts grey-box identification problem into a multi-objective framework to balance bias-variance dilemma of model building while explicitly integrating a priori knowledge into the structure selection process. The results of the investigation, considering the case of practical buck converter, demonstrate that it is possible to identify parsimonious models which can capture both the dynamic and static behavior of the system over a wide input range. △ Less

Submitted 20 February, 2020; v1 submitted 10 September, 2019; originally announced September 2019.

A Bird's Eye View of Nonlinear System Identification

Authors: Luis Antonio Aguirre

Abstract: This text aims at providing a bird's eye view of system identification with special attention to nonlinear systems. The driving force is to give a feeling for the philosophical problems facing those that build mathematical models from data. Special attention will be given to grey-box approaches in nonlinear system identification. In this text, grey-box methods use auxiliary information such as the… ▽ More This text aims at providing a bird's eye view of system identification with special attention to nonlinear systems. The driving force is to give a feeling for the philosophical problems facing those that build mathematical models from data. Special attention will be given to grey-box approaches in nonlinear system identification. In this text, grey-box methods use auxiliary information such as the system steady-state data, possible symmetries, some bifurcations and the presence of hysteresis. The text ends with a sample of applications. No attempt is made to be thorough nor to survey such an extensive and mature field as system identification. In most parts references will be provided for a more detailed study. △ Less

Submitted 20 February, 2022; v1 submitted 15 July, 2019; originally announced July 2019.

Comments: 68 pages, 15 figures

MSC Class: 93-02

Beyond exploding and vanishing gradients: analysing RNN training using attractors and smoothness

Authors: Antônio H. Ribeiro, Koen Tiels, Luis A. Aguirre, Thomas B. Schön

Abstract: The exploding and vanishing gradient problem has been the major conceptual principle behind most architecture and training improvements in recurrent neural networks (RNNs) during the last decade. In this paper, we argue that this principle, while powerful, might need some refinement to explain recent developments. We refine the concept of exploding gradients by reformulating the problem in terms o… ▽ More The exploding and vanishing gradient problem has been the major conceptual principle behind most architecture and training improvements in recurrent neural networks (RNNs) during the last decade. In this paper, we argue that this principle, while powerful, might need some refinement to explain recent developments. We refine the concept of exploding gradients by reformulating the problem in terms of the cost function smoothness, which gives insight into higher-order derivatives and the existence of regions with many close local minima. We also clarify the distinction between vanishing gradients and the need for the RNN to learn attractors to fully use its expressive power. Through the lens of these refinements, we shed new light on recent developments in the RNN field, namely stable RNN and unitary (or orthogonal) RNNs. △ Less

Submitted 5 March, 2020; v1 submitted 20 June, 2019; originally announced June 2019.

Comments: To appear in the Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS), 2020. PMLR: Volume 108. This paper was previously titled "The trade-off between long-term memory and smoothness for recurrent networks". The current version subsumes all previous versions

On the smoothness of nonlinear system identification

Authors: Antônio H. Ribeiro, Koen Tiels, Jack Umenberger, Thomas B. Schön, Luis A. Aguirre

Abstract: We shed new light on the \textit{smoothness} of optimization problems arising in prediction error parameter estimation of linear and nonlinear systems. We show that for regions of the parameter space where the model is not contractive, the Lipschitz constant and $β$-smoothness of the objective function might blow up exponentially with the simulation length, making it hard to numerically find minim… ▽ More We shed new light on the \textit{smoothness} of optimization problems arising in prediction error parameter estimation of linear and nonlinear systems. We show that for regions of the parameter space where the model is not contractive, the Lipschitz constant and $β$-smoothness of the objective function might blow up exponentially with the simulation length, making it hard to numerically find minima within those regions or, even, to escape from them. In addition to providing theoretical understanding of this problem, this paper also proposes the use of multiple shooting as a viable solution. The proposed method minimizes the error between a prediction model and the observed values. Rather than running the prediction model over the entire dataset, multiple shooting splits the data into smaller subsets and runs the prediction model over each subset, making the simulation length a design parameter and making it possible to solve problems that would be infeasible using a standard approach. The equivalence to the original problem is obtained by including constraints in the optimization. The new method is illustrated by estimating the parameters of nonlinear systems with chaotic or unstable behavior, as well as neural networks. We also present a comparative analysis of the proposed method with multi-step-ahead prediction error minimization. △ Less

Submitted 7 August, 2020; v1 submitted 2 May, 2019; originally announced May 2019.

Journal ref: Automatica, vol. 121, 109158, Nov. 2020

Particle filtering of dynamical networks: Highlighting observability issues

Authors: Arthur N. Montanari, Luis A. Aguirre

Abstract: In a network of high-dimensionality, it is not feasible to measure every single node. Thus, an important goal in the literature is to define the optimal choice of sensor nodes that provides a reliable state reconstruction of the network system state-space. This is an observability problem. In this paper, we propose a particle filtering (PF) framework as a way to assess observability properties of… ▽ More In a network of high-dimensionality, it is not feasible to measure every single node. Thus, an important goal in the literature is to define the optimal choice of sensor nodes that provides a reliable state reconstruction of the network system state-space. This is an observability problem. In this paper, we propose a particle filtering (PF) framework as a way to assess observability properties of a dynamical network, where each node is composed by an individual dynamical system. The PF framework is applied on two benchmarks, networks of Kuramoto and Rössler oscillators, to investigate how the interplay between dynamics and topology impacts the network observability. Based on the numerical results, we conjecture that, when the network nodal dynamics are heterogeneous, better observability is conveyed for sets of sensor nodes that share some dynamical affinity to its neighbourhood. Moreover, we also investigate how the choice of an internal measured variable of a multidimensional sensor node affects the PF performance. The PF framework effectiveness as an observability measure is compared to a well-consolidated nonlinear observability metric for a small network case and some chaotic systems benchmarks. △ Less

Submitted 11 December, 2018; originally announced December 2018.

Matrix Completion With Variational Graph Autoencoders: Application in Hyperlocal Air Quality Inference

Authors: Tien Huu Do, Duc Minh Nguyen, Evaggelia Tsiligianni, Angel Lopez Aguirre, Valerio Panzica La Manna, Frank Pasveer, Wilfried Philips, Nikos Deligiannis

Abstract: Inferring air quality from a limited number of observations is an essential task for monitoring and controlling air pollution. Existing inference methods typically use low spatial resolution data collected by fixed monitoring stations and infer the concentration of air pollutants using additional types of data, e.g., meteorological and traffic information. In this work, we focus on street-level ai… ▽ More Inferring air quality from a limited number of observations is an essential task for monitoring and controlling air pollution. Existing inference methods typically use low spatial resolution data collected by fixed monitoring stations and infer the concentration of air pollutants using additional types of data, e.g., meteorological and traffic information. In this work, we focus on street-level air quality inference by utilizing data collected by mobile stations. We formulate air quality inference in this setting as a graph-based matrix completion problem and propose a novel variational model based on graph convolutional autoencoders. Our model captures effectively the spatio-temporal correlation of the measurements and does not depend on the availability of additional information apart from the street-network topology. Experiments on a real air quality dataset, collected with mobile stations, shows that the proposed model outperforms state-of-the-art approaches. △ Less

Submitted 5 November, 2018; originally announced November 2018.

Finitary Process Evolution I: Information Geometry of Configuration Space and the Process-Replicator Dynamics

Authors: Leonardo Aguirre

Abstract: This report presents some fundamental mathematical results towards elucidating the information-geometric underpinnings of evolutionary modelling schemes for (quasi-)stationary discrete stochastic processes. The model class under consideration is that of finite causal-state processes, known from the computational mechanics programme, along with their minimal unifilar hidden Markov generators. The r… ▽ More This report presents some fundamental mathematical results towards elucidating the information-geometric underpinnings of evolutionary modelling schemes for (quasi-)stationary discrete stochastic processes. The model class under consideration is that of finite causal-state processes, known from the computational mechanics programme, along with their minimal unifilar hidden Markov generators. The respective configuration space is exhibited as a collection of combinatorially related Riemannian manifolds wherein the metric tensor field is an infinitesimal version of the relative entropy rate. Furthermore, a certain evolutionary inference iteration is defined which can be executed by generator-carrying agents and generalizes the Wright-Fisher model from population genetics. The induced dynamics on configuration space is studied from the large deviation point of view and it is shown that the associated asymptotic expectation dynamics follows the Riemannian gradient flow of a given fitness potential. In fact, this flow can formally be viewed as an information-geometric generalization of the replicator dynamics from population biology. △ Less

Submitted 25 July, 2018; v1 submitted 12 July, 2018; originally announced July 2018.

Comments: 52 pages, 5 figures

MSC Class: Primary 60D05; Secondary 60F05; 60F10; 60G10; 92D25

Structural, Dynamical and Symbolic Observability: From Dynamical Systems to Networks

Authors: Luis A. Aguirre, Leonardo L. Portes, Christophe Letellier

Abstract: The concept of observability of linear systems initiated with Kalman in the mid 1950s. Roughly a decade later, the observability of nonlinear systems appeared. By such definitions a system is either observable or not. Continuous measures of observability for linear systems were proposed in the 1970s and two decades ago were adapted to deal with nonlinear dynamical systems. Related topics developed… ▽ More The concept of observability of linear systems initiated with Kalman in the mid 1950s. Roughly a decade later, the observability of nonlinear systems appeared. By such definitions a system is either observable or not. Continuous measures of observability for linear systems were proposed in the 1970s and two decades ago were adapted to deal with nonlinear dynamical systems. Related topics developed either independently or as a consequence of these. Observability has been recognized as an important feature to study complex networks, but as for dynamical systems in the beginning the focus has been on determining conditions for a network to be observable. In this relatively new field previous and new results on observability merge either producing new terminology or using terms, with well established meaning in other fields, to refer to new concepts. Motivated by the fact that twenty years have passed since some of these concepts were introduced in the field of nonlinear dynamics, in this paper (i)~various aspects of observability will be reviewed, and (ii)~it will be discussed in which ways networks could be ranked in terms of observability. The aim is to make a clear distinction between concepts and to understand what does each one contribute to the analysis and monitoring of networks. Some of the main ideas are illustrated with simulations. △ Less

Submitted 23 June, 2018; originally announced June 2018.

Journal ref: PLoS ONE, 13(10):e0206180, 2018

A nonlinear graph-based theory for dynamical network observability

Authors: Christophe Letellier, Irene Sendiña-Nadal, Luis A. Aguirre

Abstract: A faithful description of the state of a complex dynamical network would require, in principle, the measurement of all its $d$ variables, an infeasible task for systems with practical limited access and composed of many nodes with high dimensional dynamics. However, even if the network dynamics is observable from a reduced set of measured variables, how to reliably identifying such a minimum set o… ▽ More A faithful description of the state of a complex dynamical network would require, in principle, the measurement of all its $d$ variables, an infeasible task for systems with practical limited access and composed of many nodes with high dimensional dynamics. However, even if the network dynamics is observable from a reduced set of measured variables, how to reliably identifying such a minimum set of variables providing full observability remains an unsolved problem. From the Jacobian matrix of the governing equations of nonlinear systems, we construct a {\it pruned fluence graph} in which the nodes are the state variables and the links represent {\it only the linear} dynamical interdependences encoded in the Jacobian matrix after ignoring nonlinear relationships. From this graph, we identify the largest connected sub-graphs where there is a path from every node to every other node and there are not outcoming links. In each one of those sub-graphs, at least one node must be measured to correctly monitor the state of the system in a $d$-dimensional reconstructed space. Our procedure is here validated by investigating large-dimensional reaction networks for which the determinant of the observability matrix can be rigorously computed. △ Less

Submitted 5 March, 2018; v1 submitted 2 March, 2018; originally announced March 2018.

Comments: 5 pages, 2 figures; added references

Journal ref: Phys. Rev. E 98, 020303 (2018)

Mixed measurements and the detection of phase synchronization in networks

Authors: Leonardo L. Portes, Luis A. Aguirre

Abstract: Multivariate singular spectrum analysis (M-SSA), with a varimax rotation of eigenvectors, was recently proposed to provide detailed information about phase synchronization in networks of nonlinear oscillators without any a priori need for phase estimation. The discriminatory power of M-SSA is often enhanced by using only the time series of the variable that provides the best observability of the n… ▽ More Multivariate singular spectrum analysis (M-SSA), with a varimax rotation of eigenvectors, was recently proposed to provide detailed information about phase synchronization in networks of nonlinear oscillators without any a priori need for phase estimation. The discriminatory power of M-SSA is often enhanced by using only the time series of the variable that provides the best observability of the node dynamics. In practice, however, diverse factors could prevent one to have access to this variable in some nodes and other variables should be used, resulting in a mixed set of variables. In the present work, the impact of this mixed measurement approach on the M-SSA is numerically investigated in networks of Rössler systems and cord oscillators. The results are threefold. First, a node measured by a poor variable, in terms of observability, becomes virtually invisible to the technique. Second, a side effect of using a poor variable is that the characterization of phase synchronization clustering of the {\it other}\, nodes is hindered by a small amount. This suggests that, given a network, synchronization analysis with M-SSA could be more reliable by not measuring those nodes that are accessible only through poor variables. Third, global phase synchronization could be detected even using only poor variables, given enough of them are measured. These insights could be useful in defining measurement strategies for both experimental design and real world applications for use with M-SSA. △ Less

Submitted 31 October, 2017; originally announced October 2017.

Comments: 22 pages, 9 figures

Journal ref: Nonlinear Dynamics, 96(3):2197--2209, 2019

Lasso Regularization Paths for NARMAX Models via Coordinate Descent

Authors: Antônio H. Ribeiro, Luis A. Aguirre

Abstract: We propose a new algorithm for estimating NARMAX models with $L_1$ regularization for models represented as a linear combination of basis functions. Due to the $L_1$-norm penalty the Lasso estimation tends to produce some coefficients that are exactly zero and hence gives interpretable models. The novelty of the contribution is the inclusion of error regressors in the Lasso estimation (which yield… ▽ More We propose a new algorithm for estimating NARMAX models with $L_1$ regularization for models represented as a linear combination of basis functions. Due to the $L_1$-norm penalty the Lasso estimation tends to produce some coefficients that are exactly zero and hence gives interpretable models. The novelty of the contribution is the inclusion of error regressors in the Lasso estimation (which yields a nonlinear regression problem). The proposed algorithm uses cyclical coordinate descent to compute the parameters of the NARMAX models for the entire regularization path. It deals with the error terms by updating the regressor matrix along with the parameter vector. In comparative timings we find that the modification does not reduce the computational efficiency of the original algorithm and can provide the most important regressors in very few inexpensive iterations. The method is illustrated for linear and polynomial models by means of two examples. △ Less

Submitted 26 February, 2018; v1 submitted 2 October, 2017; originally announced October 2017.

Comments: 2018 American Control Conference

"Parallel Training Considered Harmful?": Comparing series-parallel and parallel feedforward network training

Authors: Antônio H. Ribeiro, Luis A. Aguirre

Abstract: Neural network models for dynamic systems can be trained either in parallel or in series-parallel configurations. Influenced by early arguments, several papers justify the choice of series-parallel rather than parallel configuration claiming it has a lower computational cost, better stability properties during training and provides more accurate results. Other published results, on the other hand,… ▽ More Neural network models for dynamic systems can be trained either in parallel or in series-parallel configurations. Influenced by early arguments, several papers justify the choice of series-parallel rather than parallel configuration claiming it has a lower computational cost, better stability properties during training and provides more accurate results. Other published results, on the other hand, defend parallel training as being more robust and capable of yielding more accu- rate long-term predictions. The main contribution of this paper is to present a study comparing both methods under the same unified framework. We focus on three aspects: i) robustness of the estimation in the presence of noise; ii) computational cost; and, iii) convergence. A unifying mathematical framework and simulation studies show situations where each training method provides better validation results, being parallel training better in what is believed to be more realistic scenarios. An example using measured data seems to reinforce such claim. We also show, with a novel complexity analysis and numerical examples, that both methods have similar computational cost, being series series-parallel training, however, more amenable to parallelization. Some informal discussion about stability and convergence properties is presented and explored in the examples. △ Less

Submitted 14 August, 2018; v1 submitted 21 June, 2017; originally announced June 2017.

Journal ref: Neurocomputing 316:222--231, (2018)

Control and Observability Aspects of Phase Synchronization

Authors: Luis Antonio Aguirre, Leandro Freitas

Abstract: This paper addresses important control and observability aspects of the phase synchronization of two oscillators. To this aim a feedback control framework is proposed based on which issues related to master-slave synchronization are analyzed. Comparing results using Cartesian and cylindrical coordinates in the context of the proposed framework it is argued that: i)~observability does not play a si… ▽ More This paper addresses important control and observability aspects of the phase synchronization of two oscillators. To this aim a feedback control framework is proposed based on which issues related to master-slave synchronization are analyzed. Comparing results using Cartesian and cylindrical coordinates in the context of the proposed framework it is argued that: i)~observability does not play a significant role in phase synchronization, although it is granted that it might be relevant for complete synchronization; and ii)~a practical difficulty is faced when phase synchronization is aimed at but the control action is not a direct function of the phase error. A procedure for overcoming such a problem is proposed. The only assumption made is that the phase can be estimated using the arctangent function. The main aspects of the paper are illustrated using the Poincaré equations, van der Pol and Rössler oscillators in dynamical regimes for which the phase is well defined. △ Less

Submitted 20 June, 2017; originally announced June 2017.

Comments: 33 pages, 10 figures, 2 tables

MSC Class: 34D06; 93B93

Journal ref: Nonlinear Dyn (2018) 91:2203-2217

Observability and Synchronization of Neuron Models

Authors: Luis A. Aguirre, Leonardo L. Portes, Christophe Letellier

Abstract: Observability is the property that enables to distinguish two different locations in $n$-dimensional state space from a reduced number of measured variables, usually just one. In high-dimensional systems it is therefore important to make sure that the variable recorded to perform the analysis conveys good observability of the system dynamics. In the case of networks composed of neuron models, the… ▽ More Observability is the property that enables to distinguish two different locations in $n$-dimensional state space from a reduced number of measured variables, usually just one. In high-dimensional systems it is therefore important to make sure that the variable recorded to perform the analysis conveys good observability of the system dynamics. In the case of networks composed of neuron models, the observability of the network depends nontrivially on the observability of the node dynamics and on the topology of the network. The aim of this paper is twofold. First, a study of observability is conducted using four well-known neuron models by computing three different observability coefficients. This not only clarifies observability properties of the models but also shows the limitations of applicability of each type of coefficients in the context of such models. Second, a multivariate singular spectrum analysis (M-SSA) is performed to detect phase synchronization in networks composed by neuron models. This tool, to the best of the authors' knowledge has not been used in the context of networks of neuron models. It is shown that it is possible to detect phase synchronization i)~without having to measure all the state variables, but only one from each node, and ii)~without having to estimate the phase. △ Less

Submitted 29 May, 2017; originally announced May 2017.

Journal ref: Chaos, 65:83--99, 2017

Joint Maximum a Posteriori State Path and Parameter Estimation in Stochastic Differential Equations

Authors: Dimas Abreu Archanjo Dutra, Bruno Otávio Soares Teixeira, Luis Antonio Aguirre

Abstract: In this article, we introduce the joint maximum a posteriori state path and parameter estimator (JME) for continuous-time systems described by stochastic differential equations (SDEs). This estimator can be applied to nonlinear systems with discrete-time (sampled) measurements with a wide range of measurement distributions. We also show that the minimum-energy state path and parameter estimator (M… ▽ More In this article, we introduce the joint maximum a posteriori state path and parameter estimator (JME) for continuous-time systems described by stochastic differential equations (SDEs). This estimator can be applied to nonlinear systems with discrete-time (sampled) measurements with a wide range of measurement distributions. We also show that the minimum-energy state path and parameter estimator (MEE) obtains the joint maximum a posteriori noise path, initial conditions, and parameters. These estimators are demonstrated in simulated experiments, in which they are compared to the prediction error method (PEM) using the unscented Kalman filter and smoother. The experiments show that the MEE is biased for the damping parameters of the drift function. Furthermore, for robust estimation in the presence of outliers, the JME attains lower state estimation errors than the PEM. △ Less

Submitted 5 April, 2017; originally announced April 2017.

Gaudin subalgebras and wonderful models

Authors: Leonardo Aguirre, Giovanni Felder, Alexander P. Veselov

Abstract: Gaudin hamiltonians form families of r-dimensional abelian Lie subalgebras of the holonomy Lie algebra of the arrangement of reflection hyperplanes of a Coxeter group of rank r. We consider the set of principal Gaudin subalgebras, which is the closure in the appropriate Grassmannian of the set of spans of Gaudin hamiltonians. We show that principal Gaudin subalgebras form a smooth projective varie… ▽ More Gaudin hamiltonians form families of r-dimensional abelian Lie subalgebras of the holonomy Lie algebra of the arrangement of reflection hyperplanes of a Coxeter group of rank r. We consider the set of principal Gaudin subalgebras, which is the closure in the appropriate Grassmannian of the set of spans of Gaudin hamiltonians. We show that principal Gaudin subalgebras form a smooth projective variety isomorphic to the De Concini-Procesi compactification of the projectivized complement of the arrangement of reflection hyperplanes. △ Less

Submitted 5 January, 2015; v1 submitted 6 September, 2014; originally announced September 2014.

Comments: 13 pages, 2 figures; added detailed description of the B_2 and B_3 cases in the new version

MSC Class: Primary 81R12; Secondary 20F55; 14H70; 14N20

Maximum a Posteriori State Path Estimation: Discretization Limits and their Interpretation

Authors: Dimas Abreu Dutra, Bruno Otávio Soares Teixeira, Luis Antonio Aguirre

Abstract: Continuous-discrete models with dynamics described by stochastic differential equations are used in a wide variety of applications. For these systems, the maximum a posteriori (MAP) state path can be defined as the curves around which lie the infinitesimal tubes with greatest posterior probability, which can be found by maximizing a merit function built upon the Onsager--Machlup functional. A comm… ▽ More Continuous-discrete models with dynamics described by stochastic differential equations are used in a wide variety of applications. For these systems, the maximum a posteriori (MAP) state path can be defined as the curves around which lie the infinitesimal tubes with greatest posterior probability, which can be found by maximizing a merit function built upon the Onsager--Machlup functional. A common approach used in the engineering literature to obtain the MAP state path is to discretize the dynamics and obtain the MAP state path for the discretized system. In this paper, we prove that if the trapezoidal scheme is used for discretization, then the discretized MAP state path estimation converges hypographically to the continuous-discrete MAP state path estimation as the discretization gets finer. However, if the stochastic Euler scheme is used instead, then the discretized estimation converges to the minimum energy estimation. The minimum energy estimates are, in turn, proved to be the state paths associated with the MAP noise paths, which in some cases differ from the MAP state paths. Therefore, the discretized MAP state paths can have different interpretations depending on the discretization scheme used. △ Less

Submitted 20 March, 2014; originally announced March 2014.

Comments: Accepted for publication in Automatica on February 16th 2014

Journal ref: Automatica, Volume 50, Issue 5, May 2014, Pages 1360--1368

Gaudin subalgebras and stable rational curves

Authors: Leonardo Aguirre, Giovanni Felder, Alexander P. Veselov

Abstract: Gaudin subalgebras are abelian Lie subalgebras of maximal dimension spanned by generators of the Kohno-Drinfeld Lie algebra t_n. We show that Gaudin subalgebras form a variety isomorphic to the moduli space of stable curves of genus zero with n+1 marked points. In particular, this gives an embedding of the moduli space in a Grassmannian of (n-1)-planes in an n(n-1)/2-dimensional space. We show tha… ▽ More Gaudin subalgebras are abelian Lie subalgebras of maximal dimension spanned by generators of the Kohno-Drinfeld Lie algebra t_n. We show that Gaudin subalgebras form a variety isomorphic to the moduli space of stable curves of genus zero with n+1 marked points. In particular, this gives an embedding of the moduli space in a Grassmannian of (n-1)-planes in an n(n-1)/2-dimensional space. We show that the sheaf of Gaudin subalgebras over the moduli space is isomorphic to a sheaf of twisted first order differential operators. For each representation of the Kohno--Drinfeld Lie algebra with fixed central character, we obtain a sheaf of commutative algebras whose spectrum is a coisotropic subscheme of a twisted version of the logarithmic cotangent bundle of the moduli space. △ Less

Submitted 17 November, 2010; v1 submitted 19 April, 2010; originally announced April 2010.

Comments: 16 pages. References added, misprints corrected

MSC Class: 14H10; 14H70; 17B99; 20C30

Journal ref: Compositio Math. 147 (2011) 1463-1478