-
The e-value and the Full Bayesian Significance Test: Logical Properties and Philosophical Consequences
Authors:
Julio Michael Stern,
Carlos Alberto de Braganca Pereira,
Marcelo de Souza Lauretto,
Luis Gustavo Esteves,
Rafael Izbicki,
Rafael Bassi Stern,
Marcio Alves Diniz,
Wagner de Souza Borges
Abstract:
This article gives a conceptual review of the e-value, ev(H|X) -- the epistemic value of hypothesis H given observations X. This statistical significance measure was developed in order to allow logically coherent and consistent tests of hypotheses, including sharp or precise hypotheses, via the Full Bayesian Significance Test (FBST). Arguments of analysis allow a full characterization of this stat…
▽ More
This article gives a conceptual review of the e-value, ev(H|X) -- the epistemic value of hypothesis H given observations X. This statistical significance measure was developed in order to allow logically coherent and consistent tests of hypotheses, including sharp or precise hypotheses, via the Full Bayesian Significance Test (FBST). Arguments of analysis allow a full characterization of this statistical test by its logical or compositional properties, showing a mutual complementarity between results of mathematical statistics and the logical desiderata lying at the foundations of this theory.
△ Less
Submitted 22 June, 2024; v1 submitted 16 May, 2022;
originally announced May 2022.
-
Logical coherence in Bayesian simultaneous three-way hypothesis tests
Authors:
Bernardo F. Reimann,
Rafael Izbicki,
Julio M. Stern,
Rafael B. Stern,
Luis G. Esteves
Abstract:
This paper studies whether Bayesian simultaneous three-way hypothesis tests can be logically coherent. Two types of results are obtained. First, under the standard error-wise constant loss, only for a limited set of models can a Bayes simultaneous test be logically coherent. Second, if more general loss functions are used, then it is possible to obtain Bayes simultaneous tests that are always logi…
▽ More
This paper studies whether Bayesian simultaneous three-way hypothesis tests can be logically coherent. Two types of results are obtained. First, under the standard error-wise constant loss, only for a limited set of models can a Bayes simultaneous test be logically coherent. Second, if more general loss functions are used, then it is possible to obtain Bayes simultaneous tests that are always logically coherent. An explicit example of such a loss function is provided.
△ Less
Submitted 4 April, 2022;
originally announced April 2022.
-
Teaching decision theory proof strategies using a crowdsourcing problem
Authors:
Luis G. Esteves,
Rafael Izbicki,
Rafael B. Stern
Abstract:
Teaching how to derive minimax decision rules can be challenging because of the lack of examples that are simple enough to be used in the classroom. Motivated by this challenge, we provide a new example that illustrates the use of standard techniques in the derivation of optimal decision rules under the Bayes and minimax approaches. We discuss how to predict the value of an unknown quantity,…
▽ More
Teaching how to derive minimax decision rules can be challenging because of the lack of examples that are simple enough to be used in the classroom. Motivated by this challenge, we provide a new example that illustrates the use of standard techniques in the derivation of optimal decision rules under the Bayes and minimax approaches. We discuss how to predict the value of an unknown quantity, $θ\! \in \! \{0,1\}$, given the opinions of $n$ experts. An important example of such crowdsourcing problem occurs in modern cosmology, where $θ$ indicates whether a given galaxy is merging or not, and $Y_1, \ldots, Y_n$ are the opinions from $n$ astronomers regarding $θ$. We use the obtained prediction rules to discuss advantages and disadvantages of the Bayes and minimax approaches to decision theory. The material presented here is intended to be taught to first-year graduate students.
△ Less
Submitted 18 May, 2019;
originally announced May 2019.
-
Logically-consistent hypothesis testing in the hexagon of oppositions
Authors:
Julio M. Stern,
Luis G. Esteves,
Rafael Izbicki,
Rafael B. Stern
Abstract:
Although logical consistency is desirable in scientific research, standard statistical hypothesis tests are typically logically inconsistent. In order to address this issue, previous work introduced agnostic hypothesis tests and proved that they can be logically consistent while retaining statistical optimality properties. This paper characterizes the credal modalities in agnostic hypothesis tests…
▽ More
Although logical consistency is desirable in scientific research, standard statistical hypothesis tests are typically logically inconsistent. In order to address this issue, previous work introduced agnostic hypothesis tests and proved that they can be logically consistent while retaining statistical optimality properties. This paper characterizes the credal modalities in agnostic hypothesis tests and uses the hexagon of oppositions to explain the logical relations between these modalities. Geometric solids that are composed of hexagons of oppositions illustrate the conditions for these modalities to be logically consistent. Prisms composed of hexagons of oppositions show how the credal modalities obtained from two agnostic tests vary according to their threshold values. Nested hexagons of oppositions summarize logical relations between the credal modalities in these tests and prove new relations.
△ Less
Submitted 18 May, 2019;
originally announced May 2019.
-
Interpretable hypothesis tests
Authors:
Victor Coscrato,
Luís Gustavo Esteves,
Rafael Izbicki,
Rafael Bassi Stern
Abstract:
Although hypothesis tests play a prominent role in Science, their interpretation can be challenging. Three issues are (i) the difficulty in making an assertive decision based on the output of an hypothesis test, (ii) the logical contradictions that occur in multiple hypothesis testing, and (iii) the possible lack of practical importance when rejecting a precise hypothesis. These issues can be addr…
▽ More
Although hypothesis tests play a prominent role in Science, their interpretation can be challenging. Three issues are (i) the difficulty in making an assertive decision based on the output of an hypothesis test, (ii) the logical contradictions that occur in multiple hypothesis testing, and (iii) the possible lack of practical importance when rejecting a precise hypothesis. These issues can be addressed through the use of agnostic tests and pragmatic hypotheses.
△ Less
Submitted 13 April, 2019;
originally announced April 2019.
-
Pragmatic hypotheses in the evolution of science
Authors:
Luis G. Esteves,
Rafael Izbicki,
Rafael B. Stern,
Julio M. Stern
Abstract:
This paper introduces pragmatic hypotheses and relates this concept to the spiral of scientific evolution. Previous works determined a characterization of logically consistent statistical hypothesis tests and showed that the modal operators obtained from this test can be represented in the hexagon of oppositions. However, despite the importance of precise hypothesis in science, they cannot be acce…
▽ More
This paper introduces pragmatic hypotheses and relates this concept to the spiral of scientific evolution. Previous works determined a characterization of logically consistent statistical hypothesis tests and showed that the modal operators obtained from this test can be represented in the hexagon of oppositions. However, despite the importance of precise hypothesis in science, they cannot be accepted by logically consistent tests. Here, we show that this dilemma can be overcome by the use of pragmatic versions of precise hypotheses. These pragmatic versions allow a level of imprecision in the hypothesis that is small relative to other experimental conditions. The introduction of pragmatic hypotheses allows the evolution of scientific theories based on statistical hypothesis testing to be interpreted using the narratological structure of hexagonal spirals, as defined by Pierre Gallais.
△ Less
Submitted 24 December, 2018;
originally announced December 2018.
