Trading-off Bias and Variance in Stratified Experiments and in Matching Studies, Under a Boundedness Condition on the Magnitude of the Treatment Effect
Authors:
Clément de Chaisemartin
Abstract:
I consider estimation of the average treatment effect (ATE), in a population composed of $S$ groups or units, when one has unbiased estimators of each group's conditional average treatment effect (CATE). These conditions are met in stratified experiments and in matching studies. I assume that each CATE is bounded in absolute value by $B$ standard deviations of the outcome, for some known $B$. This…
▽ More
I consider estimation of the average treatment effect (ATE), in a population composed of $S$ groups or units, when one has unbiased estimators of each group's conditional average treatment effect (CATE). These conditions are met in stratified experiments and in matching studies. I assume that each CATE is bounded in absolute value by $B$ standard deviations of the outcome, for some known $B$. This restriction may be appealing: outcomes are often standardized in applied work, so researchers can use available literature to determine a plausible value for $B$. I derive, across all linear combinations of the CATEs' estimators, the minimax estimator of the ATE. In two stratified experiments, my estimator has twice lower worst-case mean-squared-error than the commonly-used strata-fixed effects estimator. In a matching study with limited overlap, my estimator achieves 56\% of the precision gains of a commonly-used trimming estimator, and has an 11 times smaller worst-case mean-squared-error.
△ Less
Submitted 25 January, 2024; v1 submitted 18 May, 2021;
originally announced May 2021.
Empirical MSE Minimization to Estimate a Scalar Parameter
Authors:
Clément de Chaisemartin,
Xavier D'Haultfœuille
Abstract:
We consider the estimation of a scalar parameter, when two estimators are available. The first is always consistent. The second is inconsistent in general, but has a smaller asymptotic variance than the first, and may be consistent if an assumption is satisfied. We propose to use the weighted sum of the two estimators with the lowest estimated mean-squared error (MSE). We show that this third esti…
▽ More
We consider the estimation of a scalar parameter, when two estimators are available. The first is always consistent. The second is inconsistent in general, but has a smaller asymptotic variance than the first, and may be consistent if an assumption is satisfied. We propose to use the weighted sum of the two estimators with the lowest estimated mean-squared error (MSE). We show that this third estimator dominates the other two from a minimax-regret perspective: the maximum asymptotic-MSE-gain one may incur by using this estimator rather than one of the other estimators is larger than the maximum asymptotic-MSE-loss.
△ Less
Submitted 25 June, 2020;
originally announced June 2020.
