-
When fractional quasi p-norms concentrate
Authors:
Ivan Y. Tyukin,
Bogdan Grechuk,
Evgeny M. Mirkes,
Alexander N. Gorban
Abstract:
Concentration of distances in high dimension is an important factor for the development and design of stable and reliable data analysis algorithms. In this paper, we address the fundamental long-standing question about the concentration of distances in high dimension for fractional quasi $p$-norms, $p\in(0,1)$. The topic has been at the centre of various theoretical and empirical controversies. He…
▽ More
Concentration of distances in high dimension is an important factor for the development and design of stable and reliable data analysis algorithms. In this paper, we address the fundamental long-standing question about the concentration of distances in high dimension for fractional quasi $p$-norms, $p\in(0,1)$. The topic has been at the centre of various theoretical and empirical controversies. Here we, for the first time, identify conditions when fractional quasi $p$-norms concentrate and when they don't. We show that contrary to some earlier suggestions, for broad classes of distributions, fractional quasi $p$-norms admit exponential and uniform in $p$ concentration bounds. For these distributions, the results effectively rule out previously proposed approaches to alleviate concentration by "optimal" setting the values of $p$ in $(0,1)$. At the same time, we specify conditions and the corresponding families of distributions for which one can still control concentration rates by appropriate choices of $p$. We also show that in an arbitrarily small vicinity of a distribution from a large class of distributions for which uniform concentration occurs, there are uncountably many other distributions featuring anti-concentration properties. Importantly, this behavior enables devising relevant data encoding or representation schemes favouring or discouraging distance concentration. The results shed new light on this long-standing problem and resolve the tension around the topic in both theory and empirical evidence reported in the literature.
△ Less
Submitted 26 May, 2025;
originally announced May 2025.
-
Physics-informed neural networks for aggregation kinetics
Authors:
Farzona Mukhamedova,
Ivan Tyukin,
Nikolai Brilliantov
Abstract:
We introduce a novel physics-informed approach for accurately modeling aggregation kinetics which provides a comprehensive solution in a single run by outputting all model parameters simultaneously, a clear advancement over traditional single-output networks that require multiple executions. This method effectively captures the density distributions of both large and small clusters, showcasing a n…
▽ More
We introduce a novel physics-informed approach for accurately modeling aggregation kinetics which provides a comprehensive solution in a single run by outputting all model parameters simultaneously, a clear advancement over traditional single-output networks that require multiple executions. This method effectively captures the density distributions of both large and small clusters, showcasing a notable improvement in predicting small particles, which have historically posed challenges in computational models. This approach yields significant advancements in computational efficiency and accuracy for solving the Smoluchowski equations by minimizing the interval over which the physics-informed loss function operates, allowing for efficient computation over extended time-frames with minimal increase in computational cost. Due to the the independence of predefined shapes for bias or weight outputs, it removes the dependency on prior assumptions about output structures. Furthermore, our physics-informed framework exhibits high compatibility with the generalized Brownian kernel, maintaining robust accuracy for this previously unaddressed kernel type. The framework's notable novelty also lies in addressing four different kernels with one neural network architecture. Therefore with high computational efficiency, combined with low error margins it indicates significant potential for long-term predictions and integration into broader computational systems.
△ Less
Submitted 15 October, 2024; v1 submitted 8 October, 2024;
originally announced October 2024.
-
Fast social-like learning of complex behaviors based on motor motifs
Authors:
Carlos Calvo Tapia,
Ivan Y. Tyukin,
Valeriy A. Makarov Slizneva
Abstract:
Social learning is widely observed in many species. Less experienced agents copy successful behaviors, exhibited by more experienced individuals. Nevertheless, the dynamical mechanisms behind this process remain largely unknown. Here we assume that a complex behavior can be decomposed into a sequence of $n$ motor motifs. Then a neural network capable of activating motor motifs in a given sequence…
▽ More
Social learning is widely observed in many species. Less experienced agents copy successful behaviors, exhibited by more experienced individuals. Nevertheless, the dynamical mechanisms behind this process remain largely unknown. Here we assume that a complex behavior can be decomposed into a sequence of $n$ motor motifs. Then a neural network capable of activating motor motifs in a given sequence can drive an agent. To account for $(n-1)!$ possible sequences of motifs in a neural network, we employ the winner-less competition approach. We then consider a teacher-learner situation: one agent exhibits a complex movement, while another one aims at mimicking the teacher's behavior. Despite the huge variety of possible motif sequences we show that the learner, equipped with the provided learning model, can rewire ``on the fly'' its synaptic couplings in no more than $(n-1)$ learning cycles and converge exponentially to the durations of the teacher's motifs. We validate the learning model on mobile robots. Experimental results show that indeed the learner is capable of copying the teacher's behavior composed of six motor motifs in a few learning cycles. The reported mechanism of learning is general and can be used for replicating different functions, including, for example, sound patterns or speech.
△ Less
Submitted 3 February, 2024;
originally announced February 2024.
-
Knowledge-Informed Neuro-Integrators for Aggregation Kinetics
Authors:
Dmitrii Lukashevich,
Ivan Tyukin,
Nikolay Brilliantov
Abstract:
We report a novel approach for the efficient computation of solutions of a broad class of large-scale systems of non-linear ordinary differential equations, describing aggregation kinetics. The method is based on a new take on the dimensionality reduction for this class of equations which can be naturally implemented by a cascade of small feed-forward artificial neural networks. We show that this…
▽ More
We report a novel approach for the efficient computation of solutions of a broad class of large-scale systems of non-linear ordinary differential equations, describing aggregation kinetics. The method is based on a new take on the dimensionality reduction for this class of equations which can be naturally implemented by a cascade of small feed-forward artificial neural networks. We show that this cascade, of otherwise static models, is capable of predicting solutions of the original large-scale system over large intervals of time, using the information about the solution computed over much smaller intervals. The computational cost of the method depends very mildly on the temporal horizon, which is a major improvement over the current state-of-the-art methods, whose complexity increases super-linearly with the system's size and proportionally to the simulation time. In cases when prior information about the values of solutions over a relatively small interval of time is already available, the method's computational complexity does not depend explicitly on the system's size. The successful application of the new method is illustrated for spatially-homogeneous systems, with a source of monomers, for a number of the most representative reaction rates kernels.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Demystification of Few-shot and One-shot Learning
Authors:
Ivan Y. Tyukin,
Alexander N. Gorban,
Muhammad H. Alkhudaydi,
Qinghua Zhou
Abstract:
Few-shot and one-shot learning have been the subject of active and intensive research in recent years, with mounting evidence pointing to successful implementation and exploitation of few-shot learning algorithms in practice. Classical statistical learning theories do not fully explain why few- or one-shot learning is at all possible since traditional generalisation bounds normally require large t…
▽ More
Few-shot and one-shot learning have been the subject of active and intensive research in recent years, with mounting evidence pointing to successful implementation and exploitation of few-shot learning algorithms in practice. Classical statistical learning theories do not fully explain why few- or one-shot learning is at all possible since traditional generalisation bounds normally require large training and testing samples to be meaningful. This sharply contrasts with numerous examples of successful one- and few-shot learning systems and applications.
In this work we present mathematical foundations for a theory of one-shot and few-shot learning and reveal conditions specifying when such learning schemes are likely to succeed. Our theory is based on intrinsic properties of high-dimensional spaces. We show that if the ambient or latent decision space of a learning machine is sufficiently high-dimensional than a large class of objects in this space can indeed be easily learned from few examples provided that certain data non-concentration conditions are met.
△ Less
Submitted 29 May, 2021; v1 submitted 25 April, 2021;
originally announced April 2021.
-
Universal principles justify the existence of concept cells
Authors:
Carlos Calvo Tapia,
Ivan Tyukin,
Valeri A. Makarov
Abstract:
It is largely believed that complex cognitive phenomena require the perfect orchestrated collaboration of many neurons. However, this is not what converging experimental evidence suggests. Single neurons, the so-called concept cells, may be responsible for complex tasks performed by an individual. Here, starting from a few first principles, we layout physical foundations showing that concept cells…
▽ More
It is largely believed that complex cognitive phenomena require the perfect orchestrated collaboration of many neurons. However, this is not what converging experimental evidence suggests. Single neurons, the so-called concept cells, may be responsible for complex tasks performed by an individual. Here, starting from a few first principles, we layout physical foundations showing that concept cells are not only possible but highly likely, given that neurons work in a high dimensional space.
△ Less
Submitted 4 December, 2019;
originally announced December 2019.
-
Fast Sampling of Evolving Systems with Periodic Trajectories
Authors:
I. Yu. Tyukin,
A. N. Gorban,
T. A. Tyukina,
J. Al Ameri,
Yu. A. Korablev
Abstract:
We propose a novel method for fast and scalable evaluation of periodic solutions of systems of ordinary differential equations for a given set of parameter values and initial conditions. The equations governing the system dynamics are supposed to be of a special class, albeit admitting nonlinear parametrization and state nonlinearities. The method enables to represent a given periodic solution as…
▽ More
We propose a novel method for fast and scalable evaluation of periodic solutions of systems of ordinary differential equations for a given set of parameter values and initial conditions. The equations governing the system dynamics are supposed to be of a special class, albeit admitting nonlinear parametrization and state nonlinearities. The method enables to represent a given periodic solution as sums of computable integrals and functions that are explicitly dependent on parameters of interest and initial conditions. This allows invoking parallel computational streams in order to increase speed of calculations. Performance and practical implications of the method are illustrated with examples including classical predator-prey system and models of neuronal cells.
△ Less
Submitted 27 May, 2016; v1 submitted 10 November, 2015;
originally announced November 2015.
-
Approximation with Random Bases: Pro et Contra
Authors:
Alexander N. Gorban,
Ivan Yu. Tyukin,
Danil V. Prokhorov,
Konstantin I. Sofeikov
Abstract:
In this work we discuss the problem of selecting suitable approximators from families of parameterized elementary functions that are known to be dense in a Hilbert space of functions. We consider and analyze published procedures, both randomized and deterministic, for selecting elements from these families that have been shown to ensure the rate of convergence in $L_2$ norm of order $O(1/N)$, wher…
▽ More
In this work we discuss the problem of selecting suitable approximators from families of parameterized elementary functions that are known to be dense in a Hilbert space of functions. We consider and analyze published procedures, both randomized and deterministic, for selecting elements from these families that have been shown to ensure the rate of convergence in $L_2$ norm of order $O(1/N)$, where $N$ is the number of elements. We show that both randomized and deterministic procedures are successful if additional information about the families of functions to be approximated is provided. In the absence of such additional information one may observe exponential growth of the number of terms needed to approximate the function and/or extreme sensitivity of the outcome of the approximation to parameters. Implications of our analysis for applications of neural networks in modeling and control are illustrated with examples.
△ Less
Submitted 24 October, 2015; v1 submitted 15 June, 2015;
originally announced June 2015.
-
Leaders do not look back, or do they?
Authors:
Alexander N. Gorban,
Nick Jarman,
Erik Steur,
Cees van Leeuwen,
Ivan Tyukin
Abstract:
We study the effect of adding to a directed chain of interconnected systems a directed feedback from the last element in the chain to the first. The problem is closely related to the fundamental question of how a change in network topology may influence the behavior of coupled systems. We begin the analysis by investigating a simple linear system. The matrix that specifies the system dynamics is t…
▽ More
We study the effect of adding to a directed chain of interconnected systems a directed feedback from the last element in the chain to the first. The problem is closely related to the fundamental question of how a change in network topology may influence the behavior of coupled systems. We begin the analysis by investigating a simple linear system. The matrix that specifies the system dynamics is the transpose of the network Laplacian matrix, which codes the connectivity of the network. Our analysis shows that for any nonzero complex eigenvalue $λ$ of this matrix, the following inequality holds: $\frac{|\Im λ|}{|\Re λ|} \leq \cot\fracπ{n}$. This bound is sharp, as it becomes an equality for an eigenvalue of a simple directed cycle with uniform interaction weights. The latter has the slowest decay of oscillations among all other network configurations with the same number of states. The result is generalized to directed rings and chains of identical nonlinear oscillators. For directed rings, a lower bound $σ_c$ for the connection strengths that guarantees asymptotic synchronization is found to follow a similar pattern: $σ_c=\frac{1}{1-\cos\left( 2π/n\right)} $. Numerical analysis revealed that, depending on the network size $n$, multiple dynamic regimes co-exist in the state space of the system. In addition to the fully synchronous state a rotating wave solution occurs. The effect is observed in networks exceeding a certain critical size. The emergence of a rotating wave highlights the importance of long chains and loops in networks of oscillators: the larger the size of chains and loops, the more sensitive the network dynamics becomes to removal or addition of a single connection.
△ Less
Submitted 21 May, 2015; v1 submitted 6 May, 2015;
originally announced May 2015.
-
Adaptive observers for nonlinearly parameterized systems subjected to parametric constraints
Authors:
I. Yu. Tyukin,
P. A. Rogachev,
H. Nijmeijer
Abstract:
We consider the problem of adaptive observer design in the settings when the system is allowed to be nonlinear in the parameters, and furthermore they are to satisfy additional feasibility constraints. A solution to the problem is proposed that is based on the idea of universal observers and non-uniform small-gain theorem. The procedure is illustrated with an example.
We consider the problem of adaptive observer design in the settings when the system is allowed to be nonlinear in the parameters, and furthermore they are to satisfy additional feasibility constraints. A solution to the problem is proposed that is based on the idea of universal observers and non-uniform small-gain theorem. The procedure is illustrated with an example.
△ Less
Submitted 17 December, 2014;
originally announced December 2014.
-
Further Results on Lyapunov-Like Conditions of Forward Invariance and Boundedness for a Class of Unstable Systems
Authors:
A. N. Gorban,
I. Yu. Tyukin,
H. Nijmeijer
Abstract:
We provide several characterizations of convergence to unstable equilibria in nonlinear systems. Our current contribution is three-fold. First we present simple algebraic conditions for establishing local convergence of non-trivial solutions of nonlinear systems to unstable equilibria. The conditions are based on the earlier work (A.N. Gorban, I.Yu. Tyukin, E. Steur, and H. Nijmeijer, SIAM Journal…
▽ More
We provide several characterizations of convergence to unstable equilibria in nonlinear systems. Our current contribution is three-fold. First we present simple algebraic conditions for establishing local convergence of non-trivial solutions of nonlinear systems to unstable equilibria. The conditions are based on the earlier work (A.N. Gorban, I.Yu. Tyukin, E. Steur, and H. Nijmeijer, SIAM Journal on Control and Optimization, Vol. 51, No. 3, 2013) and can be viewed as an extension of the Lyapunov's first method in that they apply to systems in which the corresponding Jacobian has one zero eigenvalue. Second, we show that for a relevant subclass of systems, persistency of excitation of a function of time in the right-hand side of the equations governing dynamics of the system ensure existence of an attractor basin such that solutions passing through this basin in forward time converge to the origin exponentially. Finally we demonstrate that conditions developed in (A.N. Gorban, I.Yu. Tyukin, E. Steur, and H. Nijmeijer, SIAM Journal on Control and Optimization, Vol. 51, No. 3, 2013) may be remarkably tight.
△ Less
Submitted 1 December, 2014;
originally announced December 2014.
-
Supplementary material for: Adaptive Observers and Parameter Estimation for a Class of Systems Nonlinear in the Parameters
Authors:
Ivan Tyukin,
Erik Steur,
Henk Nijmeijer,
Cees van Leeuwen
Abstract:
This supplement illustrates application of adaptive observer design from (Tyukin et al, 2013) for systems which are not uniquely identifiable. It also provides an example of adaptive observer design for a magnetic bearings benchmark system (Lin, Knospe, 2000).
This supplement illustrates application of adaptive observer design from (Tyukin et al, 2013) for systems which are not uniquely identifiable. It also provides an example of adaptive observer design for a magnetic bearings benchmark system (Lin, Knospe, 2000).
△ Less
Submitted 16 April, 2013; v1 submitted 15 April, 2013;
originally announced April 2013.
-
Explicit Reduced-Order Integral Formulations of State and Parameter Estimation Problems for a Class of Nonlinear Systems
Authors:
I. Yu. Tyukin,
A. N. Gorban
Abstract:
We propose a technique for reformulation of state and parameter estimation problems as that of matching explicitly computable definite integrals with known kernels to data. The technique applies for a class of systems of nonlinear ordinary differential equations and is aimed to exploit parallel computational streams in order to increase speed of calculations. The idea is based on the classical ada…
▽ More
We propose a technique for reformulation of state and parameter estimation problems as that of matching explicitly computable definite integrals with known kernels to data. The technique applies for a class of systems of nonlinear ordinary differential equations and is aimed to exploit parallel computational streams in order to increase speed of calculations. The idea is based on the classical adaptive observers design. It has been shown that in case the data is periodic it may be possible to reduce dimensionality of the inference problem to that of the dimension of the vector of parameters entering the right-hand side of the model nonlinearly. Performance and practical implications of the method are illustrated on a benchmark model governing dynamics of voltage in generated in barnacle giant muscle.
△ Less
Submitted 10 September, 2013; v1 submitted 5 April, 2013;
originally announced April 2013.
-
Observers for canonic models of neural oscillators
Authors:
David Fairhurst,
Ivan Tyukin,
Henk Nijmeijer,
Cees van Leeuwen
Abstract:
We consider the problem of state and parameter estimation for a wide class of nonlinear oscillators. Observable variables are limited to a few components of state vector and an input signal. The problem of state and parameter reconstruction is viewed within the classical framework of observer design. This framework offers computationally-efficient solutions to the problem of state and parameter re…
▽ More
We consider the problem of state and parameter estimation for a wide class of nonlinear oscillators. Observable variables are limited to a few components of state vector and an input signal. The problem of state and parameter reconstruction is viewed within the classical framework of observer design. This framework offers computationally-efficient solutions to the problem of state and parameter reconstruction of a system of nonlinear differential equations, provided that these equations are in the so-called adaptive observer canonic form. We show that despite typical neural oscillators being locally observable they are not in the adaptive canonic observer form. Furthermore, we show that no parameter-independent diffeomorphism exists such that the original equations of these models can be transformed into the adaptive canonic observer form. We demonstrate, however, that for the class of Hindmarsh-Rose and FitzHugh-Nagumo models, parameter-dependent coordinate transformations can be used to render these systems into the adaptive observer canonical form. This allows reconstruction, at least partially and up to a (bi)linear transformation, of unknown state and parameter values with exponential rate of convergence. In order to avoid the problem of only partial reconstruction and to deal with more general nonlinear models in which the unknown parameters enter the system nonlinearly, we present a new method for state and parameter reconstruction for these systems. The method combines advantages of standard Lyapunov-based design with more flexible design and analysis techniques based on the non-uniform small-gain theorems. Effectiveness of the method is illustrated with simple numerical examples.
△ Less
Submitted 18 June, 2010; v1 submitted 1 May, 2009;
originally announced May 2009.
-
Adaptive Observers and Parameter Estimation for a Class of Systems Nonlinear in the Parameters
Authors:
Ivan Y. Tyukin,
Erik Steur,
Henk Nijmeijer,
Cees van Leeuwen
Abstract:
We consider the problem of asymptotic reconstruction of the state and parameter values in systems of ordinary differential equations. A solution to this problem is proposed for a class of systems of which the unknowns are allowed to be nonlinearly parameterized functions of state and time. Reconstruction of state and parameter values is based on the concepts of weakly attracting sets and non-unifo…
▽ More
We consider the problem of asymptotic reconstruction of the state and parameter values in systems of ordinary differential equations. A solution to this problem is proposed for a class of systems of which the unknowns are allowed to be nonlinearly parameterized functions of state and time. Reconstruction of state and parameter values is based on the concepts of weakly attracting sets and non-uniform convergence and is subjected to persistency of excitation conditions. In absence of nonlinear parametrization the resulting observers reduce to standard estimation schemes. In this respect, the proposed method constitutes a generalization of the conventional canonical adaptive observer design.
△ Less
Submitted 21 June, 2013; v1 submitted 13 March, 2009;
originally announced March 2009.
-
Lyapunov-like Conditions of Forward Invariance and Boundedness for a Class of Unstable Systems
Authors:
A. Gorban,
I. Tyukin,
E. Steur,
H. Nijmeijer
Abstract:
We provide Lyapunov-like characterizations of boundedness and convergence of non-trivial solutions for a class of systems with unstable invariant sets. Examples of systems to which the results may apply include interconnections of stable subsystems with one-dimensional unstable dynamics or critically stable dynamics. Systems of this type arise in problems of nonlinear output regulation, parameter…
▽ More
We provide Lyapunov-like characterizations of boundedness and convergence of non-trivial solutions for a class of systems with unstable invariant sets. Examples of systems to which the results may apply include interconnections of stable subsystems with one-dimensional unstable dynamics or critically stable dynamics. Systems of this type arise in problems of nonlinear output regulation, parameter estimation and adaptive control.
In addition to providing boundedness and convergence criteria the results allow to derive domains of initial conditions corresponding to solutions leaving a given neighborhood of the origin at least once. In contrast to other works addressing convergence issues in unstable systems, our results require neither input-output characterizations for the stable part nor estimates of convergence rates. The results are illustrated with examples, including the analysis of phase synchronization of neural oscillators with heterogenous coupling.
△ Less
Submitted 11 June, 2013; v1 submitted 22 January, 2009;
originally announced January 2009.
-
Adaptive classification of temporal signals in fixed-weights recurrent neural networks: an existence proof
Authors:
Ivan Tyukin,
Danil Prokhorov,
Cees van Leeuwen
Abstract:
We address the important theoretical question why a recurrent neural network with fixed weights can adaptively classify time-varied signals in the presence of additive noise and parametric perturbations. We provide a mathematical proof assuming that unknown parameters are allowed to enter the signal nonlinearly and the noise amplitude is sufficiently small.
We address the important theoretical question why a recurrent neural network with fixed weights can adaptively classify time-varied signals in the presence of additive noise and parametric perturbations. We provide a mathematical proof assuming that unknown parameters are allowed to enter the signal nonlinearly and the noise amplitude is sufficiently small.
△ Less
Submitted 23 May, 2007;
originally announced May 2007.
-
Non-uniform Small-gain Theorems for Systems with Unstable Invariant Sets
Authors:
Ivan Tyukin,
Erik Steur,
Henk Nijmeijer,
Cees van Leeuwen
Abstract:
We consider the problem of asymptotic convergence to invariant sets in interconnected nonlinear dynamic systems. Standard approaches often require that the invariant sets be uniformly attracting. e.g. stable in the Lyapunov sense. This, however, is neither a necessary requirement, nor is it always useful. Systems may, for instance, be inherently unstable (e.g. intermittent, itinerant, meta-stabl…
▽ More
We consider the problem of asymptotic convergence to invariant sets in interconnected nonlinear dynamic systems. Standard approaches often require that the invariant sets be uniformly attracting. e.g. stable in the Lyapunov sense. This, however, is neither a necessary requirement, nor is it always useful. Systems may, for instance, be inherently unstable (e.g. intermittent, itinerant, meta-stable) or the problem statement may include requirements that cannot be satisfied with stable solutions. This is often the case in general optimization problems and in nonlinear parameter identification or adaptation. Conventional techniques for these cases rely either on detailed knowledge of the system's vector-fields or require boundeness of its states. The presently proposed method relies only on estimates of the input-output maps and steady-state characteristics. The method requires the possibility of representing the system as an interconnection of a stable, contracting, and an unstable, exploratory part. We illustrate with examples how the method can be applied to problems of analyzing the asymptotic behavior of locally unstable systems as well as to problems of parameter identification and adaptation in the presence of nonlinear parametrizations. The relation of our results to conventional small-gain theorems is discussed.
△ Less
Submitted 14 December, 2006;
originally announced December 2006.
-
Decentralized adaptation in interconnected uncertain systems with nonlinear parametrization
Authors:
Ivan Tyukin,
Cees van Leeuwen
Abstract:
We propose a technique for the design and analysis of decentralized adaptation algorithms in interconnected dynamical systems. Our technique does not require Lyapunov stability of the target dynamics and allows nonlinearly parameterized uncertainties. We show that for the considered class of systems, conditions for reaching the control goals can be formulated in terms of the nonlinear L_2-gains…
▽ More
We propose a technique for the design and analysis of decentralized adaptation algorithms in interconnected dynamical systems. Our technique does not require Lyapunov stability of the target dynamics and allows nonlinearly parameterized uncertainties. We show that for the considered class of systems, conditions for reaching the control goals can be formulated in terms of the nonlinear L_2-gains of target dynamics of each interconnected subsystem. Equations for decentralized controllers and corresponding adaptation algorithms are also explicitly provided.
△ Less
Submitted 9 June, 2006;
originally announced June 2006.
-
Adaptation and nonlinear parametrization: nonlinear dynamics prospective
Authors:
Ivan Tyukin,
Cees van Leeuwen
Abstract:
We consider adaptive control problem in presence of nonlinear parametrization of uncertainties in the model. It is shown that despite traditional approaches require for domination in the control loop during adaptation, it is not often necessary to use such energy inefficient compensators it in wide range of applications. In particular, we show that recently introduced adaptive control algorithms…
▽ More
We consider adaptive control problem in presence of nonlinear parametrization of uncertainties in the model. It is shown that despite traditional approaches require for domination in the control loop during adaptation, it is not often necessary to use such energy inefficient compensators it in wide range of applications. In particular, we show that recently introduced adaptive control algorithms in finite form which are applicable to monotonic parameterized systems can be extended to general smooth non-monotonic parametrization. These schemes do not require any damping or domination in control inputs.
△ Less
Submitted 21 December, 2004;
originally announced December 2004.
-
Adaptive Regulation to Invariant Sets
Authors:
Ivan Tyukin,
Denis Efimov,
Cees van Leeuwen
Abstract:
A new framework for adaptive regulation to invariant sets is proposed. Reaching the target dynamics (invariant set) is to be ensured by state feedback while adaptation to parametric uncertainties is provided by additional adaptation algorithm. We show that for a sufficiently large class of nonlinear systems it is possible to adaptively steer the system trajectories to the desired non-equilibrium…
▽ More
A new framework for adaptive regulation to invariant sets is proposed. Reaching the target dynamics (invariant set) is to be ensured by state feedback while adaptation to parametric uncertainties is provided by additional adaptation algorithm. We show that for a sufficiently large class of nonlinear systems it is possible to adaptively steer the system trajectories to the desired non-equilibrium state without requiring knowledge or existence of a specific strict Lyapunov function.
△ Less
Submitted 21 December, 2004;
originally announced December 2004.
-
Parameter estimation and control for a class of systems with nonlinear parametrization
Authors:
Ivan Tyukin,
Danil Prokhorov,
Cees van Leeuwen
Abstract:
We propose novel parameter estimation algorithms for a class of dynamical systems with nonlinear parametrization. The class is initially restricted to smooth monotonic functions with respect to a linear functional of the parameters. We show that under this restriction standard persistent excitation suffices to ensure exponentially fast convergence of the estimates to the actual values of unknown…
▽ More
We propose novel parameter estimation algorithms for a class of dynamical systems with nonlinear parametrization. The class is initially restricted to smooth monotonic functions with respect to a linear functional of the parameters. We show that under this restriction standard persistent excitation suffices to ensure exponentially fast convergence of the estimates to the actual values of unknown parameters. Subsequently, our approach is extended to cases in which the monotonicity assumption holds only locally. We show that excitation with high-frequency of oscillations is sufficient to ensure convergence. Two practically relevant examples are given in order to illustrate the effectiveness of the approach.
△ Less
Submitted 8 September, 2004;
originally announced September 2004.
-
Adaptive Algorithms in Finite Forms
Authors:
I. Y. Tyukin,
D. V. Prokhorov,
Cees van Leeuwen
Abstract:
We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired performance characteristics and a class of nonlinearly parameterized systems, first to augment the tuning error function and design the adaptation scheme in the form of…
▽ More
We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired performance characteristics and a class of nonlinearly parameterized systems, first to augment the tuning error function and design the adaptation scheme in the form of ordinary differential equations. The resulting augmentation is allowed to depend on state derivatives. To deal with these, we suggest the realization of the adaptation scheme in an algebraic-integral form. Because of the explicit dependance on the state of the original system such adaptation schemes are referred to as adaptive algorithms in it finite form instead of differential ones. Sufficient conditions for the existence of finite form realizations are proposed. These conditions lead to the necessity to find a solution of a system of partial differential equations, which in general is not an easy task. In order to resolve this problem we suggest to embed the original system dynamics into one of a higher order, thus replacing it by a simple integration of a function with respect to a single scalar argument. Several full-state feedback finite form realizations are presented and illustrated with examples.
△ Less
Submitted 5 November, 2003; v1 submitted 15 September, 2003;
originally announced September 2003.
-
Parameter Estimation of Sigmoid Superpositions: Dynamical System Approach
Authors:
Ivan Tyukin,
Cees van Leeuwen,
Danil Prokhorov
Abstract:
Superposition of sigmoid function over a finite time interval is shown to be equivalent to the linear combination of the solutions of a linearly parameterized system of logistic differential equations. Due to the linearity with respect to the parameters of the system, it is possible to design an effective procedure for parameter adjustment. Stability properties of this procedure are analyzed. St…
▽ More
Superposition of sigmoid function over a finite time interval is shown to be equivalent to the linear combination of the solutions of a linearly parameterized system of logistic differential equations. Due to the linearity with respect to the parameters of the system, it is possible to design an effective procedure for parameter adjustment. Stability properties of this procedure are analyzed. Strategies shown in earlier studies to facilitate learning such as randomization of a learning sequence and adding specially designed disturbances during the learning phase are requirements for guaranteeing convergence in the learning scheme proposed.
△ Less
Submitted 17 February, 2003; v1 submitted 9 July, 2002;
originally announced July 2002.
