-
Fluctuation analysis for a class of nonlinear systems with fast periodic sampling and small state-dependent white noise
Authors:
Shivam Dhama,
Chetan D. Pahlajani
Abstract:
We consider a nonlinear differential equation under the combined influence of small state-dependent Brownian perturbations of size $\varepsilon$, and fast periodic sampling with period $δ$; $0<\varepsilon, δ\ll 1$. Thus, state samples (measurements) are taken every $δ$ time units, and the instantaneous rate of change of the state depends on its current value as well as its most recent sample. We s…
▽ More
We consider a nonlinear differential equation under the combined influence of small state-dependent Brownian perturbations of size $\varepsilon$, and fast periodic sampling with period $δ$; $0<\varepsilon, δ\ll 1$. Thus, state samples (measurements) are taken every $δ$ time units, and the instantaneous rate of change of the state depends on its current value as well as its most recent sample. We show that the resulting stochastic process indexed by $\varepsilon,δ$, can be approximated, as $\varepsilon,δ\searrow 0$, by an ordinary differential equation (ODE) with vector field obtained by replacing the most recent sample by the current value of the state. We next analyze the fluctuations of the stochastic process about the limiting ODE. Our main result asserts that, for the case when $δ\searrow 0$ at the same rate as, or faster than, $\varepsilon \searrow 0$, the rescaled fluctuations can be approximated in a suitable strong (pathwise) sense by a limiting stochastic differential equation (SDE). This SDE varies depending on the exact rates at which $\varepsilon,δ\searrow 0$. The key contribution here involves computing the effective drift term capturing the interplay between noise and sampling in the limiting SDE. The results essentially provide a first-order perturbation expansion, together with error estimates, for the stochastic process of interest. Connections with the performance analysis of feedback control systems with sampling are discussed and illustrated numerically through a simple example.
△ Less
Submitted 19 May, 2022;
originally announced May 2022.
-
Approximation of linear controlled dynamical systems with small random noise and fast periodic sampling
Authors:
Shivam Dhama,
Chetan D. Pahlajani
Abstract:
In this paper, we study the dynamics of a linear control system with given state feedback control law in the presence of fast periodic sampling at temporal frequency $1/δ$ ($0 < δ\ll 1$), together with small white noise perturbations of size $\varepsilon$ ($0<\varepsilon \ll 1$) in the state dynamics. For the ensuing continuous-time stochastic process indexed by two small parameters…
▽ More
In this paper, we study the dynamics of a linear control system with given state feedback control law in the presence of fast periodic sampling at temporal frequency $1/δ$ ($0 < δ\ll 1$), together with small white noise perturbations of size $\varepsilon$ ($0<\varepsilon \ll 1$) in the state dynamics. For the ensuing continuous-time stochastic process indexed by two small parameters $\varepsilon,δ$, we obtain effective ordinary and stochastic differential equations describing the mean behavior and the typical fluctuations about the mean in the limit as $\varepsilon,δ\searrow 0$. The effective fluctuation process is found to vary, depending on whether $δ\searrow 0$ faster than/at the same rate as/slower than $\varepsilon \searrow 0$. The most interesting case is found to be the one where $δ,\varepsilon$ are comparable in size; here, the limiting stochastic differential equation for the fluctuations has both a diffusive term due to the small noise and an effective drift term which captures the cumulative effect of the fast sampling. In this regime, our results yield a time-inhomogeneous Markov process which provides a strong (pathwise) approximation of the original non-Markovian process, together with estimates on the ensuing error. A simple example involving an infinite time horizon linear quadratic regulation problem illustrates the results.
△ Less
Submitted 14 October, 2021; v1 submitted 20 January, 2020;
originally announced January 2020.
-
Randomly perturbed switching dynamics of a DC/DC converter
Authors:
Chetan D. Pahlajani
Abstract:
In this paper, we study the effect of small Brownian noise on a switching dynamical system which models a first-order DC/DC buck converter. The state vector of this system comprises a continuous component whose dynamics switch, based on the ON/OFF configuration of the circuit, between two ordinary differential equations (ODE), and a discrete component which keeps track of the ON/OFF configurations…
▽ More
In this paper, we study the effect of small Brownian noise on a switching dynamical system which models a first-order DC/DC buck converter. The state vector of this system comprises a continuous component whose dynamics switch, based on the ON/OFF configuration of the circuit, between two ordinary differential equations (ODE), and a discrete component which keeps track of the ON/OFF configurations. Assuming that the parameters and initial conditions of the unperturbed system have been tuned to yield a stable periodic orbit, we study the stochastic dynamics of this system when the forcing input in the ON state is subject to small white noise fluctuations of size $\varepsilon$, $0<\varepsilon \ll 1$. For the ensuing stochastic system whose dynamics switch at random times between a small noise stochastic differential equation (SDE) and an ODE, we prove a functional law of large numbers which states that in the limit of vanishing noise, the stochastic system converges to the underlying deterministic one on time horizons of order $\mathscr{O}(1/\varepsilon^ν)$, $0 \le ν< 2/3$.
△ Less
Submitted 5 January, 2016;
originally announced January 2016.
-
Stochastic receding horizon control of nonlinear stochastic systems with probabilistic state constraints
Authors:
Shridhar K. Shah,
Herbert G. Tanner,
Chetan D. Pahlajani
Abstract:
The paper describes a receding horizon control design framework for continuous-time stochastic nonlinear systems subject to probabilistic state constraints. The intention is to derive solutions that are implementable in real-time on currently available mobile processors. The approach consists of decomposing the problem into designing receding horizon reference paths based on the drift component of…
▽ More
The paper describes a receding horizon control design framework for continuous-time stochastic nonlinear systems subject to probabilistic state constraints. The intention is to derive solutions that are implementable in real-time on currently available mobile processors. The approach consists of decomposing the problem into designing receding horizon reference paths based on the drift component of the system dynamics, and then implementing a stochastic optimal controller to allow the system to stay close and follow the reference path. In some cases, the stochastic optimal controller can be obtained in closed form; in more general cases, pre-computed numerical solutions can be implemented in real-time without the need for on-line computation. The convergence of the closed loop system is established assuming no constraints on control inputs, and simulation results are provided to corroborate the theoretical predictions.
△ Less
Submitted 16 November, 2012;
originally announced November 2012.
-
Networked Decision Making for Poisson Processes: Application to nuclear detection
Authors:
Chetan D. Pahlajani,
Ioannis Poulakakis,
Herbert G. Tanner
Abstract:
This paper addresses a detection problem where several spatially distributed sensors independently observe a time-inhomogeneous stochastic process. The task is to decide between two hypotheses regarding the statistics of the observed process at the end of a fixed time interval. In the proposed method, each of the sensors transmits once to a fusion center a locally processed summary of its informat…
▽ More
This paper addresses a detection problem where several spatially distributed sensors independently observe a time-inhomogeneous stochastic process. The task is to decide between two hypotheses regarding the statistics of the observed process at the end of a fixed time interval. In the proposed method, each of the sensors transmits once to a fusion center a locally processed summary of its information in the form of a likelihood ratio. The fusion center then combines these messages to arrive at an optimal decision in the Neyman-Pearson framework. The approach is motivated by applications arising in the detection of mobile radioactive sources, and offers a pathway toward the development of novel fixed- interval detection algorithms that combine decentralized processing with optimal centralized decision making.
△ Less
Submitted 4 October, 2012;
originally announced October 2012.
