Showing 1–2 of 2 results for author: Kulinskaya, E
-
Testing for Homogeneity in Meta-Analysis I. The One Parameter Case: Standardized Mean Difference
Authors:
Elena Kulinskaya,
Michael B. Dollinger,
Kirsten Bjørkestøl
Abstract:
Meta-analysis seeks to combine the results of several experiments in order to improve the accuracy of decisions. It is common to use a test for homogeneity to determine if the results of the several experiments are sufficiently similar to warrant their combination into an overall result. Cochran's Q statistic is frequently used for this homogeneity test. It is often assumed that Q follows a chi-…
▽ More
Meta-analysis seeks to combine the results of several experiments in order to improve the accuracy of decisions. It is common to use a test for homogeneity to determine if the results of the several experiments are sufficiently similar to warrant their combination into an overall result. Cochran's Q statistic is frequently used for this homogeneity test. It is often assumed that Q follows a chi-square distribution under the null hypothesis of homogeneity, but it has long been known that this asymptotic distribution for Q is not accurate for moderate sample sizes. Here we present formulas for the mean and variance of Q under the null hypothesis which represent O(1/n) corrections to the corresponding chi-square moments in the one parameter case. The formulas are fairly complicated, and so we provide a program (available at http://www.imperial.ac.uk/stathelp/researchprojects/metaanalysis) for making the necessary calculations. We apply the results to the standardized mean difference (Cohen's d-statistic) and consider two approximations: a gamma distribution with estimated shape and scale parameters and the chi-square distribution with fractional degrees of freedom equal to the estimated mean of Q. We recommend the latter distribution as an approximate distribution for Q to use for testing the null hypothesis.
△ Less
Submitted 1 August, 2009; v1 submitted 16 June, 2009;
originally announced June 2009.
-
On two-sided p-values for non-symmetric distributions
Authors:
Elena Kulinskaya
Abstract:
Two-sided statistical tests and p-values are well defined only when the test statistic in question has a symmetric distribution. A new two-sided p-value called conditional p-value $P_C$ is introduced here. It is closely related to the doubled p-value and has an intuitive appeal. Its use is advocated for both continuous and discrete distributions. An important advantage of this p-value is that eq…
▽ More
Two-sided statistical tests and p-values are well defined only when the test statistic in question has a symmetric distribution. A new two-sided p-value called conditional p-value $P_C$ is introduced here. It is closely related to the doubled p-value and has an intuitive appeal. Its use is advocated for both continuous and discrete distributions. An important advantage of this p-value is that equivalent 1-sided tests are transformed into $P_C$-equivalent 2-sided tests. It is compared to the widely used doubled and minimum likelihood p-values. Examples include the variance test, the binomial and the Fisher's exact test.
△ Less
Submitted 12 October, 2008;
originally announced October 2008.
