-
Adaptive Extremum Seeking Control via the RMSprop Optimizer
Authors:
Patrick McNamee,
Zahra Nili Ahmadabadi
Abstract:
Extremum Seeking Control (ESC) is a well-known set of continuous time algorithms for model-free optimization of a cost function. One issue for ESCs is the convergence rates of parameters to extrema of unknown cost functions. The local convergence rate depends on the second, or sometimes higher, order derivatives of the unknown cost function. To mitigate this dependency, we propose the use of the R…
▽ More
Extremum Seeking Control (ESC) is a well-known set of continuous time algorithms for model-free optimization of a cost function. One issue for ESCs is the convergence rates of parameters to extrema of unknown cost functions. The local convergence rate depends on the second, or sometimes higher, order derivatives of the unknown cost function. To mitigate this dependency, we propose the use of the RMSprop optimizer for ESCs as RMSprop is an adaptive gradient-based optimizer which attempts to have a normalized convergence rate in all parameters. Practical stability results are given for this RMSprop ESC (RMSpESC). In particular notability, the proof of practical stability uses Lyapunov function based on observed contracting, attractive sets. Versions of this Lyapunov function could be applied to other areas of applications, in particular for interconnected systems.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Extremum Seeking is Stable for Scalar Maps that are Strictly but Not Strongly Convex
Authors:
Patrick McNamee,
Miroslav Krstić,
Zahra Nili Ahmadabadi
Abstract:
For a map that is strictly but not strongly convex, model-based gradient extremum seeking has an eigenvalue of zero at the extremum, i.e., it fails at exponential convergence. Interestingly, perturbation-based model-free extremum seeking has a negative Jacobian, in the average, meaning that its (practical) convergence is exponential, even though the map's Hessian is zero at the extremum. While the…
▽ More
For a map that is strictly but not strongly convex, model-based gradient extremum seeking has an eigenvalue of zero at the extremum, i.e., it fails at exponential convergence. Interestingly, perturbation-based model-free extremum seeking has a negative Jacobian, in the average, meaning that its (practical) convergence is exponential, even though the map's Hessian is zero at the extremum. While these observations for the gradient algorithm are not trivial, we focus in this paper on an even more nontrivial study of the same phenomenon for Newton-based extremum seeking control (NESC).
NESC is a second-order method which corrects for the unknown Hessian of the unknown map, not only in order to speed up parameter convergence, but also (1) to make the convergence rate user-assignable in spite of the unknown Hessian, and (2) to equalize the convergence rates in different directions for multivariable maps. Previous NESC work established stability only for maps whose Hessians are strictly positive definite everywhere, so the Hessian is invertible everywhere. For a scalar map, we establish the rather unexpected property that, even when the map behind is strictly convex but not strongly convex, i.e., when the Hessian may be zero, NESC guarantees practical asymptotic stability, semiglobally. While a model-based Newton-based algorithm would run into non-invertibility of the Hessian, the perturbation-based NESC, surprisingly, avoids this challenge by leveraging the fact that the average of the perturbation-based Hessian estimate is always positive, even though the actual Hessian may be zero.
△ Less
Submitted 15 November, 2024; v1 submitted 21 May, 2024;
originally announced May 2024.
-
On proximal relations in transformation semigroups arising from generalized shifts
Authors:
Fatemah Ayatollah Zadeh Shirazi,
Amir Fallahpour,
Mohammad Reza Mardanbeigi,
Zahra Nili Ahmadabadi
Abstract:
For a finite discrete topological space $X$ with at least two elements, a nonempty set $Γ$, and a map $\varphi:Γ\toΓ$, $σ_\varphi:X^Γ\to X^Γ$ with $σ_\varphi((x_α)_{α\inΓ})= (x_{\varphi(α)})_{α\inΓ}$ (for $(x_α)_{α\inΓ}\in X^Γ$) is a generalized shift. In this text for $\mathcal{S}=\{σ_ψ:ψ\inΓ^Γ\}$ and $\mathcal{H}=\{σ_ψ: Γ\mathop{\rightarrow}\limits^ψΓ$ is bijective$\}$ we study proximal relation…
▽ More
For a finite discrete topological space $X$ with at least two elements, a nonempty set $Γ$, and a map $\varphi:Γ\toΓ$, $σ_\varphi:X^Γ\to X^Γ$ with $σ_\varphi((x_α)_{α\inΓ})= (x_{\varphi(α)})_{α\inΓ}$ (for $(x_α)_{α\inΓ}\in X^Γ$) is a generalized shift. In this text for $\mathcal{S}=\{σ_ψ:ψ\inΓ^Γ\}$ and $\mathcal{H}=\{σ_ψ: Γ\mathop{\rightarrow}\limits^ψΓ$ is bijective$\}$ we study proximal relations of transformation semigroups $(\mathcal{S},X^Γ)$ and $(\mathcal{H},X^Γ)$. Regarding proximal relation we prove: \[P({\mathcal S},X^Γ)=\{((x_α)_{α\inΓ},(y_α)_{α\inΓ}) \in X^Γ\times X^Γ: \existsβ\inΓ\:(x_β=y_β)\}\] and $P({\mathcal H},X^Γ)\subseteq \{((x_α)_{α\inΓ},(y_α)_{α\inΓ}) \in X^Γ\times X^Γ: \{β\inΓ:x_β=y_β\}$ is infinite~$\}\cup\{ (x,x):x\in \mathcal{X}\}$. \\ Moreover, for infinite $Γ$, both transformation semigroups $({\mathcal S},X^Γ)$ and $({\mathcal H},X^Γ)$ are regionally proximal, i.e., $Q({\mathcal S},X^Γ)=Q({\mathcal H},X^Γ)=X^Γ\times X^Γ$, also for sydetically proximal relation we have $L({\mathcal H},X^Γ)=\{((x_α)_{α\inΓ},(y_α)_{α\inΓ}) \in X^Γ\times X^Γ: \{γ\inΓ:x_γ\neq y_γ\}$ is finite$\}$.
△ Less
Submitted 28 September, 2019;
originally announced September 2019.
-
Possible heights of graph transformation groups
Authors:
Fatemah Ayatollah Zadeh Shirazi,
Arezoo Hosseini,
Zahra Nili Ahmadabadi
Abstract:
In the following text we prove that for all finite $p\geq0$ there exists a topological graph $X$ such that $\{p,p+1,p+2,\ldots\}\cup\{+\infty\}$ is the collection of all possible heights for transformation groups with phase space $X$. Moreover for all topological graph $X$ with $p$ as height of transformation group $(Homeo(X),X)$, $\{p,p+1,p+2,\ldots\}\cup\{+\infty\}$ again is the collection of al…
▽ More
In the following text we prove that for all finite $p\geq0$ there exists a topological graph $X$ such that $\{p,p+1,p+2,\ldots\}\cup\{+\infty\}$ is the collection of all possible heights for transformation groups with phase space $X$. Moreover for all topological graph $X$ with $p$ as height of transformation group $(Homeo(X),X)$, $\{p,p+1,p+2,\ldots\}\cup\{+\infty\}$ again is the collection of all possible heights for transformation groups with phase space $X$.
△ Less
Submitted 2 September, 2021; v1 submitted 30 October, 2017;
originally announced October 2017.
-
Set-theoretical entropies of generalized shifts
Authors:
Zahra Nili Ahmadabadi,
Fatemah Ayatollah Zadeh Shirazi
Abstract:
In the following text for arbitrary $X$ with at least two elements, nonempty set $Γ$ and self-map $\varphi:Γ\toΓ$ we prove the set-theoretical entropy of generalized shift $σ_\varphi:X^Γ\to X^Γ$ ($σ_\varphi((x_α)_{α\inΓ})=(x_{\varphi(α)})_{α\inΓ}$ (for $(x_α)_{α\inΓ}\in X^Γ$)) is either zero or infinity, moreover it is zero if and only if $\varphi$ is quasi-periodic. We continue our study on contr…
▽ More
In the following text for arbitrary $X$ with at least two elements, nonempty set $Γ$ and self-map $\varphi:Γ\toΓ$ we prove the set-theoretical entropy of generalized shift $σ_\varphi:X^Γ\to X^Γ$ ($σ_\varphi((x_α)_{α\inΓ})=(x_{\varphi(α)})_{α\inΓ}$ (for $(x_α)_{α\inΓ}\in X^Γ$)) is either zero or infinity, moreover it is zero if and only if $\varphi$ is quasi-periodic. We continue our study on contravariant set-theoretical entropy of generalized shift and motivate the text using counterexamples dealing with algebraic, topological, set-theoretical and contravariant set-theoretical positive entropies of generalized shifts.
△ Less
Submitted 1 February, 2018; v1 submitted 5 September, 2017;
originally announced September 2017.
-
Distributional chaotic generalized shifts
Authors:
Zahra Nili Ahmadabadi,
Fatemah Ayatollah Zadeh Shirazi
Abstract:
Suppose $X$ is a finite discrete space with at least two elements, $Γ$ is a nonempty countable set, and consider self--map $\varphi:Γ\toΓ$. We prove that the generalized shift $σ_\varphi:X^Γ\to X^Γ$ with $σ_\varphi((x_α)_{α\inΓ})=(x_{\varphi(α)})_{α\inΓ}$ (for $(x_α)_{α\inΓ}\in X^Γ$) is:
$\bullet$ distributional chaotic (uniform, type 1, type 2) if and only if $\varphi:Γ\toΓ$ has at least a non-…
▽ More
Suppose $X$ is a finite discrete space with at least two elements, $Γ$ is a nonempty countable set, and consider self--map $\varphi:Γ\toΓ$. We prove that the generalized shift $σ_\varphi:X^Γ\to X^Γ$ with $σ_\varphi((x_α)_{α\inΓ})=(x_{\varphi(α)})_{α\inΓ}$ (for $(x_α)_{α\inΓ}\in X^Γ$) is:
$\bullet$ distributional chaotic (uniform, type 1, type 2) if and only if $\varphi:Γ\toΓ$ has at least a non-quasi-periodic point,
$\bullet$ dense distributional chaotic if and only if $\varphi:Γ\toΓ$ does not have any periodic point,
$\bullet$ transitive distributional chaotic if and only if $\varphi:Γ\toΓ$ is one--to--one without any periodic point.
We complete the text by counterexamples.
△ Less
Submitted 3 August, 2020; v1 submitted 16 August, 2017;
originally announced August 2017.
-
Specification properties on uniform spaces
Authors:
Fatemah Ayatollah Zadeh Shirazi,
Zahra Nili Ahmadabadi,
Bahman Taherkhani,
Khosro Tajbakhsh
Abstract:
In the following text we introduce specification property (stroboscopical property) for dynamical systems on uniform space. We focus on two classes of dynamical systems: generalized shifts and dynamical systems with Alexandroff compactification of a discrete space as phase space. We prove that for a discrete finite topological space $X$ with at least two elements, a nonempty set $Γ$ and a self--ma…
▽ More
In the following text we introduce specification property (stroboscopical property) for dynamical systems on uniform space. We focus on two classes of dynamical systems: generalized shifts and dynamical systems with Alexandroff compactification of a discrete space as phase space. We prove that for a discrete finite topological space $X$ with at least two elements, a nonempty set $Γ$ and a self--map $\varphi:Γ\toΓ$ the generalized shift dynamical system $(X^Γ,σ_\varphi)$: \begin{itemize} \item has (almost) weak specification property if and only if $\varphi:Γ\toΓ$
does not have any periodic point,
\item has (uniform) stroboscopical property if and only if $\varphi:Γ\toΓ$
is one-to-one. \end{itemize}
△ Less
Submitted 25 July, 2018; v1 submitted 7 March, 2017;
originally announced March 2017.
