-
Autoregressive models for panel data causal inference with application to state-level opioid policies
Authors:
Joseph Antonelli,
Max Rubinstein,
Denis Agniel,
Rosanna Smart,
Elizabeth Stuart,
Matthew Cefalu,
Terry Schell,
Joshua Eagan,
Elizabeth Stone,
Max Griswold,
Mark Sorbero,
Beth Ann Griffin
Abstract:
Motivated by the study of state opioid policies, we propose a novel approach that uses autoregressive models for causal effect estimation in settings with panel data and staggered treatment adoption. Specifically, we seek to estimate of the impact of key opioid-related policies by quantifying the effects of must access prescription drug monitoring programs (PDMPs), naloxone access laws (NALs), and…
▽ More
Motivated by the study of state opioid policies, we propose a novel approach that uses autoregressive models for causal effect estimation in settings with panel data and staggered treatment adoption. Specifically, we seek to estimate of the impact of key opioid-related policies by quantifying the effects of must access prescription drug monitoring programs (PDMPs), naloxone access laws (NALs), and medical marijuana laws on opioid prescribing. Existing methods, such as differences-in-differences and synthetic controls, are challenging to apply in these types of dynamic policy landscapes where multiple policies are implemented over time and sample sizes are small. Autoregressive models are an alternative strategy that have been used to estimate policy effects in similar settings, but until this paper have lacked formal justification. We outline a set of assumptions that tie these models to causal effects, and we study biases of estimates based on this approach when key causal assumptions are violated. In a set of simulation studies that mirror the structure of our application, we also show that our proposed estimators frequently outperform existing estimators. In short, we justify the use of autoregressive models to provide robust evidence on the effectiveness of four state policies in combating the opioid crisis.
△ Less
Submitted 16 August, 2024;
originally announced August 2024.
-
Estimating effects within nonlinear autoregressive models: a case study on the impact of child access prevention laws on firearm mortality
Authors:
Matthew Cefalu,
Terry Schell,
Beth Ann Griffin,
Rosanna Smart,
Andrew Morral
Abstract:
Autoregressive models are widely used for the analysis of time-series data, but they remain underutilized when estimating effects of interventions. This is in part due to endogeneity of the lagged outcome with any intervention of interest, which creates difficulty interpreting model coefficients. These problems are only exacerbated in nonlinear or nonadditive models that are common when studying c…
▽ More
Autoregressive models are widely used for the analysis of time-series data, but they remain underutilized when estimating effects of interventions. This is in part due to endogeneity of the lagged outcome with any intervention of interest, which creates difficulty interpreting model coefficients. These problems are only exacerbated in nonlinear or nonadditive models that are common when studying crime, mortality, or disease. In this paper, we explore the use of negative binomial autoregressive models when estimating the effects of interventions on count data. We derive a simple approximation that facilitates direct interpretation of model parameters under any order autoregressive model. We illustrate the approach using an empirical simulation study using 36 years of state-level firearm mortality data from the United States and use the approach to estimate the effect of child access prevention laws on firearm mortality.
△ Less
Submitted 7 September, 2021;
originally announced September 2021.
-
Moving beyond the classic difference-in-differences model: A simulation study comparing statistical methods for estimating effectiveness of state-level policies
Authors:
Beth Ann Griffin,
Megan S. Schuler,
Elizabeth A. Stuart,
Stephen Patrick,
Elizabeth McNeer,
Rosanna Smart,
David Powell,
Bradley D. Stein,
Terry Schell,
Rosalie L. Pacula
Abstract:
State-level policy evaluations commonly employ a difference-in-differences (DID) study design; yet within this framework, statistical model specification varies notably across studies. Motivated by applied state-level opioid policy evaluations, this simulation study compares statistical performance of multiple variations of two-way fixed effect models traditionally used for DID under a range of si…
▽ More
State-level policy evaluations commonly employ a difference-in-differences (DID) study design; yet within this framework, statistical model specification varies notably across studies. Motivated by applied state-level opioid policy evaluations, this simulation study compares statistical performance of multiple variations of two-way fixed effect models traditionally used for DID under a range of simulation conditions. While most linear models resulted in minimal bias, non-linear models and population-weighted versions of classic linear two-way fixed effect and linear GEE models yielded considerable bias (60 to 160%). Further, root mean square error is minimized by linear AR models when examining crude mortality rates and by negative binomial models when examining raw death counts. In the context of frequentist hypothesis testing, many models yielded high Type I error rates and very low rates of correctly rejecting the null hypothesis (< 10%), raising concerns of spurious conclusions about policy effectiveness. When considering performance across models, the linear autoregressive models were optimal in terms of directional bias, root mean squared error, Type I error, and correct rejection rates. These findings highlight notable limitations of traditional statistical models commonly used for DID designs, designs widely used in opioid policy studies and in state policy evaluations more broadly.
△ Less
Submitted 8 June, 2021; v1 submitted 26 March, 2020;
originally announced March 2020.
