-
Improved small-sample inference for functions of parameters in the k-sample multinomial problem
Authors:
Michael C Sachs,
Erin E Gabriel,
Michael P Fay
Abstract:
When the target parameter for inference is a real-valued, continuous function of probabilities in the $k$-sample multinomial problem, variance estimation may be challenging. In small samples or when the function is nondifferentiable at the true parameter, methods like the nonparametric bootstrap or delta method may perform poorly. We develop an exact inference method that applies to this general s…
▽ More
When the target parameter for inference is a real-valued, continuous function of probabilities in the $k$-sample multinomial problem, variance estimation may be challenging. In small samples or when the function is nondifferentiable at the true parameter, methods like the nonparametric bootstrap or delta method may perform poorly. We develop an exact inference method that applies to this general situation. We prove that our proposed exact p-value correctly bounds the type I error rate and the associated confidence intervals provide at least nominal coverage; however, they are generally difficult to implement. Thus, we propose a Monte Carlo implementation to estimate the exact p-value and confidence intervals that we show to be consistent as the number of iterations grows. Our approach is general in that it applies to any real-valued continuous function of multinomial probabilities from an arbitrary number of samples and with different numbers of categories.
△ Less
Submitted 10 May, 2025; v1 submitted 27 June, 2024;
originally announced June 2024.
-
Mediation Analyses for the Effect of Antibodies in Vaccination
Authors:
Michael P. Fay,
Dean A. Follmann
Abstract:
We review standard mediation assumptions as they apply to identifying antibody effects in a randomized vaccine trial and propose new study designs to allow identification of an estimand that was previously unidentifiable. For these mediation analyses, we partition the total ratio effect (one minus the vaccine effect) from a randomized vaccine trial into indirect (effects through antibodies) and di…
▽ More
We review standard mediation assumptions as they apply to identifying antibody effects in a randomized vaccine trial and propose new study designs to allow identification of an estimand that was previously unidentifiable. For these mediation analyses, we partition the total ratio effect (one minus the vaccine effect) from a randomized vaccine trial into indirect (effects through antibodies) and direct effects (other effects). Identifying $λ$, the proportion of the total effect due to an indirect effect, depends on a cross-world quantity, the potential outcome among vaccinated individuals with antibody levels as if given placebo, or vice versa. We review assumptions for identifying $λ$ and show that there are two versions of $λ$, unless the effect of adding antibodies to the placebo arm is equal in magnitude to the effect of subtracting antibodies from the vaccine arm. We focus on the case when individuals in the placebo arm are unlikely to have the needed antibodies. In that case, if a standard assumption (given confounders, potential mediators and potential outcomes are independent) is true, only one version of $λ$ is identifiable, and if not neither is identifiable. We propose alternatives for identifying the other version of $λ$, using experimental design to identify a formerly cross-world quantity. Two alternative experimental designs use a three arm trial with the extra arm being passive immunization (administering monoclonal antibodies), with or without closeout vaccination. Another alternative is to combine information from a placebo-controlled vaccine trial with a placebo-controlled passive immunization trial.
△ Less
Submitted 6 June, 2023; v1 submitted 12 August, 2022;
originally announced August 2022.
-
Practical Valid Inferences for the Two-Sample Binomial Problem
Authors:
Michael P. Fay,
Sally A. Hunsberger
Abstract:
Our interest is whether two binomial parameters differ, which parameter is larger, and by how much. This apparently simple problem was addressed by Fisher in the 1930's, and has been the subject of many review papers since then. Yet there continues to be new work on this issue and no consensus solution. Previous reviews have focused primarily on testing and the properties of validity and power, or…
▽ More
Our interest is whether two binomial parameters differ, which parameter is larger, and by how much. This apparently simple problem was addressed by Fisher in the 1930's, and has been the subject of many review papers since then. Yet there continues to be new work on this issue and no consensus solution. Previous reviews have focused primarily on testing and the properties of validity and power, or primarily on confidence intervals, their coverage, and expected length. Here we evaluate both. For example, we consider whether a p-value and its matching confidence interval are compatible, meaning that the p-value rejects at level $α$ if and only if the $1-α$ confidence interval excludes all null parameter values. For focus, we only examine non-asymptotic inferences, so that most of the p-values and confidence intervals are valid (i.e., exact) by construction. Within this focus, we review different methods emphasizing many of the properties and interpretational aspects we desire from applied frequentist inference: validity, accuracy, good power, equivariance, compatibility, coherence, and parameterization and direction of effect. We show that no one method can meet all the desirable properties and give recommendations based on which properties are given more importance.
△ Less
Submitted 24 March, 2021; v1 submitted 10 April, 2019;
originally announced April 2019.
-
Valid and Approximately Valid Confidence Intervals for Current Status Data
Authors:
Sungwook Kim,
Michael P. Fay,
Michael A. Proschan
Abstract:
We introduce a new framework for creating point-wise confidence intervals for the distribution of event times for current status data. Existing methods are based on asymptotics. Our framework is based on binomial properties and motivates confidence intervals that are very simple to apply and are valid, i.e., guarantee nominal coverage. Although these confidence intervals are necessarily conservati…
▽ More
We introduce a new framework for creating point-wise confidence intervals for the distribution of event times for current status data. Existing methods are based on asymptotics. Our framework is based on binomial properties and motivates confidence intervals that are very simple to apply and are valid, i.e., guarantee nominal coverage. Although these confidence intervals are necessarily conservative for small sample sizes, asymptotically their coverage rate approaches the nominal one. This binomial framework also motivates approximately valid confidence intervals, and simulations show that these approximate intervals generally have coverage rates closer to the nominal level with shorter length than existing intervals, including the likelihood ratio-based confidence interval. Unlike previous asymptotic methods that require different asymptotic distributions for continuous or grid-based assessment, the binomial framework can be applied to either type of assessment distribution.
△ Less
Submitted 16 May, 2018;
originally announced May 2018.
