-
General class of mixture of some densities
Authors:
Salah Hamza Abid
Abstract:
In this paper, a general class of mixture of some densities is proposed. The proposed class contains some of classical and weighted distributions as special cases. Formulas for each of cumulative distribution function, reliability function, hazard rate function, rth raw moments function, characteristic function, stress-strength reliability and Tsallis entropy of order are derived.
In this paper, a general class of mixture of some densities is proposed. The proposed class contains some of classical and weighted distributions as special cases. Formulas for each of cumulative distribution function, reliability function, hazard rate function, rth raw moments function, characteristic function, stress-strength reliability and Tsallis entropy of order are derived.
△ Less
Submitted 12 March, 2021;
originally announced March 2021.
-
Renyi Entropy of Multivariate Autoregressive Moving Average Control Systems
Authors:
Salah Hamza Abid,
Uday J. Quaez
Abstract:
The Renyi entropy is an important measure of the information, it is proposed by Renyi in the context of entropy theory as a generalization of Shannon entropy. We study in detail this measure of multivariate autoregressive moving average (ARMA) control systems. The characteristic function of output process is represented from the terms of its residual characteristic functions. Simple expression to…
▽ More
The Renyi entropy is an important measure of the information, it is proposed by Renyi in the context of entropy theory as a generalization of Shannon entropy. We study in detail this measure of multivariate autoregressive moving average (ARMA) control systems. The characteristic function of output process is represented from the terms of its residual characteristic functions. Simple expression to compute the Renyi entropy for the output process of these systems is derived. In addition, we investigate the covariance matrix for finding the upper bound of the entropy. Finally, we present three separate examples that serve to illustrate the behavior of information in a multivariate ARMA control system where the control and noise distributed as Gaussian, Cauchy and Laplace processes.
△ Less
Submitted 12 March, 2021;
originally announced March 2021.
-
Renyi and Shannon Entropies of Finite Mixtures of Multivariate Skew t-distributions
Authors:
Salah H. Abid,
Uday J. Quaez
Abstract:
Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend these tools to the class of multivariate skew t-distributions and then to more families of finite mixture of multivariate skew t distributions. In particular, by…
▽ More
Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend these tools to the class of multivariate skew t-distributions and then to more families of finite mixture of multivariate skew t distributions. In particular, by using generalized Holder inequality and some properties of multinomial theorem, we find upper and lower bounds of entropies for these families. An approximate value of these entropies can be calculated. In addition, an asymptotic expression for Renyi entropy is given by approximation and by using some inequalities and properties of Lp spaces. Finally, we give a real data examples to illustrate the behavior of entropy of the mixture model under consideration.
△ Less
Submitted 29 January, 2019;
originally announced January 2019.
-
Capacity of Control for Stochastic Dynamical Systems Perturbed by Mixed Fractional Brownian Motion with Delay in Control
Authors:
Salah H. Abid,
Uday J. Quaez
Abstract:
In this paper, we discuss the relationships between capacity of control in entropy theory and intrinsic properties in control theory for a class of finite dimensional stochastic dynamical systems described by a linear stochastic differential equations driven by mixed fractional Brownian motion with delay in control. Stochastic dynamical systems can be described as an information channel between th…
▽ More
In this paper, we discuss the relationships between capacity of control in entropy theory and intrinsic properties in control theory for a class of finite dimensional stochastic dynamical systems described by a linear stochastic differential equations driven by mixed fractional Brownian motion with delay in control. Stochastic dynamical systems can be described as an information channel between the space of control signals and the state space. We study this control to state information capacity of this channel in continuous time. We turned out that, the capacity of control depends on the time of final state in dynamical systems. By using the analysis and representation of fractional Gaussian process, the closed form of continuous optimal control law is derived. The reached optimal control law maximizes the mutual information between control signals and future state over a finite time horizon. The results obtained here are motivated by control to state information capacity for linear systems in both types deterministic and stochastic models that are widely used to understand information flows in wireless network information theory.
The contribution of this paper is that we propose some new relationships between control theory and entropy theoretic properties of stochastic dynamical systems with delay in control. Finally, we present an example that serve to illustrate the relationships between capacity of control and intrinsic properties in control theory.
△ Less
Submitted 29 January, 2019;
originally announced January 2019.
