-
Extension of Yager's negation of probability distribution based on uncertainty measures
Authors:
Santosh Kumar Chaudhary,
Pradeep Kumar Sahu,
Nitin Gupta
Abstract:
Existing research on negations primarily focuses on entropy and extropy. Recently, new functions such as varentropy and varextropy have been developed, which can be considered as
extensions of entropy and extropy. However, the impact of negation on these extended measures, particularly varentropy and varextropy, has not been extensively explored. To address
this gap, this paper investigates th…
▽ More
Existing research on negations primarily focuses on entropy and extropy. Recently, new functions such as varentropy and varextropy have been developed, which can be considered as
extensions of entropy and extropy. However, the impact of negation on these extended measures, particularly varentropy and varextropy, has not been extensively explored. To address
this gap, this paper investigates the effect of negation on Shannon entropy, varentropy, and varextropy. We explore how the negation of a probability distribution influences these
measures, showing that the negated distribution consistently leads to higher values of Shannon entropy, varentropy, and varextropy compared to the original distribution.
Additionally, we prove that the negation of a probability distribution maximizes these measures during the process. The paper provides theoretical proofs and a detailed analysis of
the behaviour of these measures, contributing to a better understanding of the interplay between probability distributions, negation, and information-theoretic quantities.
△ Less
Submitted 7 April, 2025;
originally announced April 2025.
-
On General Weighted Extropy of Percentile Ranked Set Sampling
Authors:
Pradeep Kumar Sahu,
Nitin Gupta
Abstract:
The extropy measure, first proposed by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has attracted considerable attention in recent years. Our study introduces a fresh approach to representing weighted extropy in the framework of percentile ranked set sampling. Furthermore, we provide additional insights such as stochastic orders, characterizations, and bounds. Our findin…
▽ More
The extropy measure, first proposed by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has attracted considerable attention in recent years. Our study introduces a fresh approach to representing weighted extropy in the framework of percentile ranked set sampling. Furthermore, we provide additional insights such as stochastic orders, characterizations, and bounds. Our findings illuminate the comparison between the weighted extropy of percentile ranked set sampling and its equivalent in simple random sampling.
△ Less
Submitted 18 May, 2024;
originally announced May 2024.
-
On General Weighted Extropy of Extreme Ranked Set Sampling
Authors:
Pradeep Kumar Sahu,
Nitin Gupta
Abstract:
The extropy measure, introduced by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has garnered significant interest over the past years. In this study, we present a novel representation for the weighted extropy within the context of extreme ranked set sampling. Additionally, we offer related findings such as stochastic orders, characterizations, and precise bounds. Our res…
▽ More
The extropy measure, introduced by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has garnered significant interest over the past years. In this study, we present a novel representation for the weighted extropy within the context of extreme ranked set sampling. Additionally, we offer related findings such as stochastic orders, characterizations, and precise bounds. Our results shed light onthe comparison between the weighted extropy of extreme ranked set sampling and its counterpart in simple random sampling.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
On weighted cumulative residual extropy and weighted negative cumulative extropy
Authors:
Nitin Gupta,
Santosh Kumar Chaudhary,
Pradeep Kumar Sahu
Abstract:
In this paper, we define general weighted cumulative residual extropy (GWCRJ) and general weighted negative cumulative extropy (GWNCJ). We obtain its simple estimators for complete and right censored data. We obtain some results on GWCREJ and GWNCJ. We establish its connection to reliability theory and coherent systems. We also propose empirical estimators of weighted negative cumulative extropy (…
▽ More
In this paper, we define general weighted cumulative residual extropy (GWCRJ) and general weighted negative cumulative extropy (GWNCJ). We obtain its simple estimators for complete and right censored data. We obtain some results on GWCREJ and GWNCJ. We establish its connection to reliability theory and coherent systems. We also propose empirical estimators of weighted negative cumulative extropy (WNCJ).
△ Less
Submitted 24 November, 2022;
originally announced November 2022.
-
On general weighted cumulative past extropy
Authors:
Pradeep Kumar Sahu,
Nitin Gupta
Abstract:
In this paper, we study some properties and characterization of the general weighted cumulative past extropy (n-WCPJ). Many results including some bounds, inequalities, and effects of linear transformations are obtained. We study the characterization of n-WCPJ based on the largest order statistics. Conditional WCPJ and some of its properties are discussed.
In this paper, we study some properties and characterization of the general weighted cumulative past extropy (n-WCPJ). Many results including some bounds, inequalities, and effects of linear transformations are obtained. We study the characterization of n-WCPJ based on the largest order statistics. Conditional WCPJ and some of its properties are discussed.
△ Less
Submitted 8 May, 2023; v1 submitted 14 October, 2022;
originally announced October 2022.
-
A novel difference equation approach for the stability and robustness of compact schemes for variable coefficient PDEs
Authors:
Anindya Goswami,
Kuldip Singh Patel,
Pradeep Kumar Sahu
Abstract:
Fourth-order accurate compact schemes for variable coefficient convection diffusion equations are considered. A sufficient condition for the stability of the fully discrete problem is derived using a difference equation based approach. The constant coefficient problems are considered as a special case, and the unconditional stability of compact schemes for such case is proved theoretically. The co…
▽ More
Fourth-order accurate compact schemes for variable coefficient convection diffusion equations are considered. A sufficient condition for the stability of the fully discrete problem is derived using a difference equation based approach. The constant coefficient problems are considered as a special case, and the unconditional stability of compact schemes for such case is proved theoretically. The condition number of the amplification matrix is also analyzed, and an estimate for the same is derived. The examples are provided to support the assumption taken to assure stability.
△ Less
Submitted 28 January, 2024; v1 submitted 6 September, 2022;
originally announced September 2022.
-
Optimal Posteriors for Chi-squared Divergence based PAC-Bayesian Bounds and Comparison with KL-divergence based Optimal Posteriors and Cross-Validation Procedure
Authors:
Puja Sahu,
Nandyala Hemachandra
Abstract:
We investigate optimal posteriors for recently introduced \cite{begin2016pac} chi-squared divergence based PAC-Bayesian bounds in terms of nature of their distribution, scalability of computations, and test set performance. For a finite classifier set, we deduce bounds for three distance functions: KL-divergence, linear and squared distances. Optimal posterior weights are proportional to deviation…
▽ More
We investigate optimal posteriors for recently introduced \cite{begin2016pac} chi-squared divergence based PAC-Bayesian bounds in terms of nature of their distribution, scalability of computations, and test set performance. For a finite classifier set, we deduce bounds for three distance functions: KL-divergence, linear and squared distances. Optimal posterior weights are proportional to deviations of empirical risks, usually with subset support. For uniform prior, it is sufficient to search among posteriors on classifier subsets ordered by these risks. We show the bound minimization for linear distance as a convex program and obtain a closed-form expression for its optimal posterior. Whereas that for squared distance is a quasi-convex program under a specific condition, and the one for KL-divergence is non-convex optimization (a difference of convex functions). To compute such optimal posteriors, we derive fast converging fixed point (FP) equations. We apply these approaches to a finite set of SVM regularization parameter values to yield stochastic SVMs with tight bounds. We perform a comprehensive performance comparison between our optimal posteriors and known KL-divergence based posteriors on a variety of UCI datasets with varying ranges and variances in risk values, etc. Chi-squared divergence based posteriors have weaker bounds and worse test errors, hinting at an underlying regularization by KL-divergence based posteriors. Our study highlights the impact of divergence function on the performance of PAC-Bayesian classifiers. We compare our stochastic classifiers with cross-validation based deterministic classifier. The latter has better test errors, but ours is more sample robust, has quantifiable generalization guarantees, and is computationally much faster.
△ Less
Submitted 13 August, 2020;
originally announced August 2020.
