Showing 1–17 of 17 results for author: Griffin, A

Choosing an analytic approach: Key study design considerations in state policy evaluation

Authors: Elizabeth M. Stone, Megan S. Schuler, Elizabeth A. Stuart, Max Rubinstein, Max Griswold, Bradley D. Stein, Beth Ann Griffin

Abstract: This paper reviews and details methods for state policy evaluation to guide selection of a research approach based on evaluation setting and available data. We highlight key design considerations for an analysis, including treatment and control group selection, timing of policy adoption, expected effect heterogeneity, and data considerations. We then provide an overview of analytic approaches and… ▽ More This paper reviews and details methods for state policy evaluation to guide selection of a research approach based on evaluation setting and available data. We highlight key design considerations for an analysis, including treatment and control group selection, timing of policy adoption, expected effect heterogeneity, and data considerations. We then provide an overview of analytic approaches and differentiate between methods based on evaluation context, such as settings with no control units, a single treated unit, multiple treated units, or with multiple treatment cohorts. Methods discussed include interrupted time series models, difference-in-differences estimators, autoregressive models, and synthetic control methods, along with method extensions which address issues like staggered policy adoption and heterogenous treatment effects. We end with an illustrative example, applying the developed framework to evaluate the impacts of state-level naloxone standing order policies on overdose rates. Overall, we provide researchers with an approach for deciding on methods for state policy evaluations, which can be used to select study designs and inform methodological choices. △ Less

Submitted 4 April, 2025; originally announced April 2025.

Assessing Bias and Precision in State Policy Evaluations: A Comparative Analysis of Time-Varying Estimators Using Policy Simulations

Authors: Max Griswold, Beth Ann Griffin, Max Rubinstein, Mincen Liu, Megan Schuler, Elizabeth Stone, Pedro Nascimento de Lima, Bradley D. Stein, Elizabeth A. Stuart

Abstract: Using state-level opioid overdose mortality data from 1999-2016, we simulated four time-varying treatment scenarios, which correspond to real-world policy dynamics (ramp up, ramp down, temporary and inconsistent). We then evaluated seven commonly used policy evaluation methods: two-way fixed effects event study, debiased autoregressive model, augmented synthetic control, difference-in-differences… ▽ More Using state-level opioid overdose mortality data from 1999-2016, we simulated four time-varying treatment scenarios, which correspond to real-world policy dynamics (ramp up, ramp down, temporary and inconsistent). We then evaluated seven commonly used policy evaluation methods: two-way fixed effects event study, debiased autoregressive model, augmented synthetic control, difference-in-differences with staggered adoption, event study with heterogeneous treatment, two-stage differences-in-differences and differences-in-differences imputation. Statistical performance was assessed by comparing bias, standard errors, coverage, and root mean squared error over 1,000 simulations. Results Our findings indicate that estimator performance varied across policy scenarios. In settings where policy effectiveness diminished over time, synthetic control methods recovered effects with lower bias and higher variance. Difference-in-difference approaches, while offering reasonable coverage under some scenarios, struggled when effects were non-monotonic. Autoregressive methods, although demonstrating lower variability, underestimated uncertainty. Overall, a clear bias-variance tradeoff emerged, underscoring that no single method uniformly excelled across scenarios. Conclusions This study highlights the importance of tailoring the choice of estimator to the expected trajectory of policy effects. In dynamic time-varying settings, particularly when a policy has an anticipated diminishing impact, methods like augmented synthetic controls may offer advantages despite reduced precision. Researchers should carefully consider these tradeoffs to ensure robust and credible state-policy evaluations. △ Less

Submitted 26 March, 2025; originally announced March 2025.

Autoregressive models for panel data causal inference with application to state-level opioid policies

Authors: Joseph Antonelli, Max Rubinstein, Denis Agniel, Rosanna Smart, Elizabeth Stuart, Matthew Cefalu, Terry Schell, Joshua Eagan, Elizabeth Stone, Max Griswold, Mark Sorbero, Beth Ann Griffin

Abstract: Motivated by the study of state opioid policies, we propose a novel approach that uses autoregressive models for causal effect estimation in settings with panel data and staggered treatment adoption. Specifically, we seek to estimate of the impact of key opioid-related policies by quantifying the effects of must access prescription drug monitoring programs (PDMPs), naloxone access laws (NALs), and… ▽ More Motivated by the study of state opioid policies, we propose a novel approach that uses autoregressive models for causal effect estimation in settings with panel data and staggered treatment adoption. Specifically, we seek to estimate of the impact of key opioid-related policies by quantifying the effects of must access prescription drug monitoring programs (PDMPs), naloxone access laws (NALs), and medical marijuana laws on opioid prescribing. Existing methods, such as differences-in-differences and synthetic controls, are challenging to apply in these types of dynamic policy landscapes where multiple policies are implemented over time and sample sizes are small. Autoregressive models are an alternative strategy that have been used to estimate policy effects in similar settings, but until this paper have lacked formal justification. We outline a set of assumptions that tie these models to causal effects, and we study biases of estimates based on this approach when key causal assumptions are violated. In a set of simulation studies that mirror the structure of our application, we also show that our proposed estimators frequently outperform existing estimators. In short, we justify the use of autoregressive models to provide robust evidence on the effectiveness of four state policies in combating the opioid crisis. △ Less

Submitted 16 August, 2024; originally announced August 2024.

Identifying Optimal Methods for Addressing Confounding Bias When Estimating the Effects of State-Level Policies

Authors: Beth Ann Griffin, Megan S. Schuler, Elizabeth M. Stone, Stephen W. Patrick, Bradley D. Stein, Pedro Nascimento de Lima, Max Griswold, Adam Scherling, Elizabeth A. Stuart

Abstract: Background: Policy evaluation studies that assess how state-level policies affect health-related outcomes are foundational to health and social policy research. The relative ability of newer analytic methods to address confounding, a key source of bias in observational studies, has not been closely examined. Methods: We conducted a simulation study to examine how differing magnitudes of confoundin… ▽ More Background: Policy evaluation studies that assess how state-level policies affect health-related outcomes are foundational to health and social policy research. The relative ability of newer analytic methods to address confounding, a key source of bias in observational studies, has not been closely examined. Methods: We conducted a simulation study to examine how differing magnitudes of confounding affected the performance of four methods used for policy evaluations: (1) the two-way fixed effects (TWFE) difference-in-differences (DID) model; (2) a one-period lagged autoregressive (AR) model; (3) augmented synthetic control method (ASCM); and (4) the doubly robust DID approach with multiple time periods from Callaway-Sant'Anna (CSA). We simulated our data to have staggered policy adoption and multiple confounding scenarios (i.e., varying the magnitude and nature of confounding relationships). Results: Bias increased for each method: (1) as confounding magnitude increases; (2) when confounding is generated with respect to prior outcome trends (rather than levels), and (3) when confounding associations are nonlinear (rather than linear). The AR and ASCM have notably lower root mean squared error than the TWFE model and CSA approach for all scenarios; the exception is nonlinear confounding by prior trends, where CSA excels. Coverage rates are unreasonably high for ASCM (e.g., 100%), reflecting large model-based standard errors and wide confidence intervals in practice. Conclusions: Our simulation study indicated that no single method consistently outperforms the others. But a researcher's toolkit should include all methodological options. Our simulations and associated R package can help researchers choose the most appropriate approach for their data. △ Less

Submitted 3 July, 2023; originally announced July 2023.

Comments: 4 figures, 1 table, supplemental material including code

A tutorial for using propensity score weighting for moderation analysis: an application to smoking disparities among sexual minority adults

Authors: Beth Ann Griffin, Megan S. Schuler, Matt Cefalu, Lynsay Ayer, Mark Godley, Noah Greifer, Donna L. Coffman, Daniel McCaffrey

Abstract: Objective. To provide step-by-step guidance and STATA and R code for using propensity score (PS) weighting to estimate moderation effects. Research Design. Tutorial illustrating the key steps for estimating and testing moderation using observational data. Steps include (1) examining covariate overlap across treatment groups within levels of the moderator, (2) estimating the PS weights, (3) evaluat… ▽ More Objective. To provide step-by-step guidance and STATA and R code for using propensity score (PS) weighting to estimate moderation effects. Research Design. Tutorial illustrating the key steps for estimating and testing moderation using observational data. Steps include (1) examining covariate overlap across treatment groups within levels of the moderator, (2) estimating the PS weights, (3) evaluating whether PS weights improved covariate balance, (4) estimating moderated treatment effects, and (5) assessing sensitivity of findings to unobserved confounding. Our illustrative case study uses data from 41,832 adults from the 2019 National Survey on Drug Use and Health to examine if gender moderates the association between sexual minority status (e.g., lesbian, gay, or bisexual [LGB] identity) and adult smoking prevalence. Results. For our case study, there were no noted concerns about covariate overlap and we were able to successfully estimate the PS weights within each level of the moderator. Moreover, balance criteria indicated that PS weights successfully achieved covariate balance for both moderator groups. PS weighted results indicated there was significant evidence of moderation for the case study and sensitivity analyses demonstrated that results were highly robust for one level of the moderator but not the other. Conclusions. When conducting moderation analyses, covariate imbalances across levels of the moderator can cause biased estimates. As demonstrated in this tutorial, PS weighting within each level of the moderator can improve the estimated moderation effects by minimizing bias from imbalance within the moderator subgroups. △ Less

Submitted 9 May, 2023; v1 submitted 7 April, 2022; originally announced April 2022.

Estimating effects within nonlinear autoregressive models: a case study on the impact of child access prevention laws on firearm mortality

Authors: Matthew Cefalu, Terry Schell, Beth Ann Griffin, Rosanna Smart, Andrew Morral

Abstract: Autoregressive models are widely used for the analysis of time-series data, but they remain underutilized when estimating effects of interventions. This is in part due to endogeneity of the lagged outcome with any intervention of interest, which creates difficulty interpreting model coefficients. These problems are only exacerbated in nonlinear or nonadditive models that are common when studying c… ▽ More Autoregressive models are widely used for the analysis of time-series data, but they remain underutilized when estimating effects of interventions. This is in part due to endogeneity of the lagged outcome with any intervention of interest, which creates difficulty interpreting model coefficients. These problems are only exacerbated in nonlinear or nonadditive models that are common when studying crime, mortality, or disease. In this paper, we explore the use of negative binomial autoregressive models when estimating the effects of interventions on count data. We derive a simple approximation that facilitates direct interpretation of model parameters under any order autoregressive model. We illustrate the approach using an empirical simulation study using 36 years of state-level firearm mortality data from the United States and use the approach to estimate the effect of child access prevention laws on firearm mortality. △ Less

Submitted 7 September, 2021; originally announced September 2021.

How balance and sample size impact bias in the estimation of causal treatment effects: A simulation study

Authors: Andreas Markoulidakis, Peter Holmans, Philip Pallmann, Monica Busse, Beth Ann Griffin

Abstract: Observational studies are often used to understand relationships between exposures and outcomes. They do not, however, allow conclusions about causal relationships to be drawn unless statistical techniques are used to account for the imbalance of confounders across exposure groups. Propensity score and balance weighting (PSBW) are useful techniques that aim to reduce the imbalances between exposur… ▽ More Observational studies are often used to understand relationships between exposures and outcomes. They do not, however, allow conclusions about causal relationships to be drawn unless statistical techniques are used to account for the imbalance of confounders across exposure groups. Propensity score and balance weighting (PSBW) are useful techniques that aim to reduce the imbalances between exposure groups by weighting the groups to look alike on the observed confounders. Despite the plethora of available methods to estimate PSBW, there is little guidance on what one defines as adequate balance, and unbiased and robust estimation of the causal treatment effect is not guaranteed unless several conditions hold. Accurate inference requires that 1. the treatment allocation mechanism is known, 2. the relationship between the baseline covariates and the outcome is known, 3. adequate balance of baseline covariates is achieved post-weighting, 4. a proper set of covariates to control for confounding bias is known, and 5. a large enough sample size is available. In this article, we use simulated data of various sizes to investigate the influence of these five factors on statistical inference. Our findings provide evidence that the maximum Kolmogorov- Smirnov statistic is the proper statistical measure to assess balance on the baseline covariates, in contrast to the mean standardised mean difference used in many applications, and 0.1 is a suitable threshold to consider as acceptable balance. Finally, we recommend that 60-80 observations, per confounder per treatment group, are required to obtain a reliable and unbiased estimation of the causal treatment effect. △ Less

Submitted 19 July, 2021; originally announced July 2021.

Balancing Higher Moments Matters for Causal Estimation: Further Context for the Results of Setodji et al. (2017)

Authors: Melody Y. Huang, Brian G. Vegetabile, Lane F. Burgette, Claude Setodji, Beth Ann Griffin

Abstract: We expand upon the simulation study of Setodji et al. (2017) which compared three promising balancing methods when assessing the average treatment effect on the treated for binary treatments: generalized boosted models (GBM), covariate-balancing propensity scores (CBPS), and entropy balance (EB). The study showed that GBM can outperform CBPS and EB when there are likely to be non-linear associatio… ▽ More We expand upon the simulation study of Setodji et al. (2017) which compared three promising balancing methods when assessing the average treatment effect on the treated for binary treatments: generalized boosted models (GBM), covariate-balancing propensity scores (CBPS), and entropy balance (EB). The study showed that GBM can outperform CBPS and EB when there are likely to be non-linear associations in both the treatment assignment and outcome models and CBPS and EB are fine-tuned to obtain balance only on first order moments. We explore the potential benefit of using higher-order moments in the balancing conditions for CBPS and EB. Our findings showcase that CBPS and EB should, by default, include higher order moments and that focusing only on first moments can result in substantial bias in both CBPS and EB estimated treatment effect estimates that could be avoided by the use of higher moments. △ Less

Submitted 8 July, 2021; originally announced July 2021.

Comments: 9 pages, 1 table

Methodological considerations for estimating policy effects in the context of co-occurring policies

Authors: Beth Ann Griffin, Megan S. Schuler, Joseph Pane, Stephen W. Patrick, Rosanna Smart, Bradley D. Stein, Geoffrey Grimm, Elizabeth A. Stuart

Abstract: Understanding how best to estimate state-level policy effects is important, and several unanswered questions remain, particularly about the ability of statistical models to disentangle the effects of concurrently enacted policies. In practice, many policy evaluation studies do not attempt to control for effects of co-occurring policies, and this issue has not received extensive attention in the me… ▽ More Understanding how best to estimate state-level policy effects is important, and several unanswered questions remain, particularly about the ability of statistical models to disentangle the effects of concurrently enacted policies. In practice, many policy evaluation studies do not attempt to control for effects of co-occurring policies, and this issue has not received extensive attention in the methodological literature to date. In this study, we utilized Monte Carlo simulations to assess the impact of co-occurring policies on the performance of commonly-used statistical models in state policy evaluations. Simulation conditions varied effect sizes of the co-occurring policies and length of time between policy enactment dates, among other factors. Outcome data (annual state-specific opioid mortality rate per 100,000) were obtained from 1999-2016 National Vital Statistics System (NVSS) Multiple Cause of Death mortality files, thus yielding longitudinal annual state-level data over 18 years from 50 states. When co-occurring policies are ignored (i.e., omitted from the analytic model), our results demonstrated that high relative bias (>85%) arises, particularly when policies are enacted in rapid succession. Moreover, as expected, controlling for all co-occurring policies will effectively mitigate the threat of confounding bias; however, effect estimates may be relatively imprecise (i.e., larger variance) when policies are enacted in near succession. Our findings highlight several key methodological issues regarding co-occurring policies in the context of opioid-policy research yet also generalize more broadly to evaluation of other state-level policies, such as policies related to firearms or COVID-19, showcasing the need to think critically about co-occurring policies that are likely to influence the outcome when specifying analytic models. △ Less

Submitted 9 August, 2022; v1 submitted 8 June, 2021; originally announced June 2021.

Comments: Health Serv Outcomes Res Method (2022)

Best Practices in Statistical Computing

Authors: Ricardo Sanchez, Beth Ann Griffin, Joseph Pane, Daniel McCaffrey

Abstract: The world is becoming increasingly complex, both in terms of the rich sources of data we have access to as well as in terms of the statistical and computational methods we can use on those data. These factors create an ever-increasing risk for errors in our code and sensitivity in our findings to data preparation and execution of complex statistical and computing methods. The consequences of codin… ▽ More The world is becoming increasingly complex, both in terms of the rich sources of data we have access to as well as in terms of the statistical and computational methods we can use on those data. These factors create an ever-increasing risk for errors in our code and sensitivity in our findings to data preparation and execution of complex statistical and computing methods. The consequences of coding and data mistakes can be substantial. Openness (e.g., providing others with data code) and transparency (e.g., requiring that data processing and code follow standards) are two key solutions to help alleviate concerns about replicability and errors. In this paper, we describe the key steps for implementing a code quality assurance (QA) process for researchers to follow to improve their coding practices throughout a project to assure the quality of the final data, code, analyses and ultimately the results. These steps include: (i) adherence to principles for code writing and style that follow best practices, (ii) clear written documentation that describes code, workflow and key analytic decisions; (iii) careful version control, (iv) good data management; and (iv) regular testing and review. Following all these steps will greatly improve the ability of a study to assure results are accurate and reproducible. The responsibility for code QA falls not only on individual researchers but institutions, journals, and funding agencies as well. △ Less

Submitted 6 August, 2021; v1 submitted 28 January, 2021; originally announced January 2021.

Comments: 29 pages, 6 figures

A tutorial comparing different covariate balancing methods with an application evaluating the causal effects of substance use treatment programs for adolescents

Authors: Andreas Markoulidakis, Khadijeh Taiyari, Peter Holmans, Philip Pallmann, Monica Busse, Mark D. Godley, Beth Ann Griffin

Abstract: Randomized controlled trials are the gold standard for measuring causal effects. However, they are often not always feasible, and causal treatment effects must be estimated from observational data. Observational studies do not allow robust conclusions about causal relationships unless statistical techniques account for the imbalance of pretreatment confounders across groups while key assumptions h… ▽ More Randomized controlled trials are the gold standard for measuring causal effects. However, they are often not always feasible, and causal treatment effects must be estimated from observational data. Observational studies do not allow robust conclusions about causal relationships unless statistical techniques account for the imbalance of pretreatment confounders across groups while key assumptions hold. Propensity score and balance weighting (PSBW) are useful techniques that aim to reduce the imbalances between treatment groups by weighting the groups to look alike on the observed confounders. There are many methods available to estimate PSBW. However, it is unclear a priori which will achieve the best trade-off between covariate balance and effective sample size. Moreover, it is critical to assess the validity of key assumptions required for robust estimation of the needed treatment effects, including the overlap and no unmeasured confounding assumptions. We present a step-by-step guide to covariate balancing strategies, including how to evaluate overlap, obtain estimates of PSBW, check for covariate balance, and assess sensitivity to unobserved confounding. We compare the performance of several estimation methods using a case study examining the relative effectiveness of substance use treatment programs and provide a user-friendly web application that can implement the proposed steps. △ Less

Submitted 15 May, 2021; v1 submitted 19 October, 2020; originally announced October 2020.

An epidemic model for an evolving pathogen with strain-dependent immunity

Authors: Adam Griffin, Simon E. F. Spencer, Gareth O. Roberts

Abstract: Between pandemics, the influenza virus exhibits periods of incremental evolution via a process known as antigenic drift. This process gives rise to a sequence of strains of the pathogen that are continuously replaced by newer strains, preventing a build up of immunity in the host population. In this paper, a parsimonious epidemic model is defined that attempts to capture the dynamics of evolving s… ▽ More Between pandemics, the influenza virus exhibits periods of incremental evolution via a process known as antigenic drift. This process gives rise to a sequence of strains of the pathogen that are continuously replaced by newer strains, preventing a build up of immunity in the host population. In this paper, a parsimonious epidemic model is defined that attempts to capture the dynamics of evolving strains within a host population. The `evolving strains' epidemic model has many properties that lie in-between the Susceptible-Infected-Susceptible and the Susceptible-Infected-Removed epidemic models, due to the fact that individuals can only be infected by each strain once, but remain susceptible to reinfection by newly emerged strains. Coupling results are used to identify key properties, such as the time to extinction. A range of reproduction numbers are explored to characterize the model, including a novel quasi-stationary reproduction number that can be used to describe the re-emergence of the pathogen into a population with `average' levels of strain immunity, analogous to the beginning of the winter peak in influenza. Finally the quasi-stationary distribution of the evolving strains model is explored via simulation. △ Less

Submitted 17 August, 2020; originally announced August 2020.

Comments: 34 pages, 7 figures, in review

MSC Class: 92D30

Towards Detection of Sheep Onboard a UAV

Authors: Farah Sarwar, Anthony Griffin, Saeed Ur Rehman, Timotius Pasang

Abstract: In this work we consider the task of detecting sheep onboard an unmanned aerial vehicle (UAV) flying at an altitude of 80 m. At this height, the sheep are relatively small, only about 15 pixels across. Although deep learning strategies have gained enormous popularity in the last decade and are now extensively used for object detection in many fields, state-of-the-art detectors perform poorly in th… ▽ More In this work we consider the task of detecting sheep onboard an unmanned aerial vehicle (UAV) flying at an altitude of 80 m. At this height, the sheep are relatively small, only about 15 pixels across. Although deep learning strategies have gained enormous popularity in the last decade and are now extensively used for object detection in many fields, state-of-the-art detectors perform poorly in the case of smaller objects. We develop a novel dataset of UAV imagery of sheep and consider a variety of object detectors to determine which is the most suitable for our task in terms of both accuracy and speed. Our findings indicate that a UNet detector using the weighted Hausdorff distance as a loss function during training is an excellent option for detection of sheep onboard a UAV. △ Less

Submitted 18 March, 2020; originally announced April 2020.

Comments: This was accepted for publication and presentation at the Embedded AI for Real-time Machine Vision 2019 in conjunction with the British Machine Vision Conference (BMVC) 2019. It was presented on 12 September 2019 in Cardiff, Wales. 10 pages, 3 figures, and 1 table, note that this is a web-friendly format as used at BMVC, so the pages are about A5 size (but not exactly!)

Moving beyond the classic difference-in-differences model: A simulation study comparing statistical methods for estimating effectiveness of state-level policies

Authors: Beth Ann Griffin, Megan S. Schuler, Elizabeth A. Stuart, Stephen Patrick, Elizabeth McNeer, Rosanna Smart, David Powell, Bradley D. Stein, Terry Schell, Rosalie L. Pacula

Abstract: State-level policy evaluations commonly employ a difference-in-differences (DID) study design; yet within this framework, statistical model specification varies notably across studies. Motivated by applied state-level opioid policy evaluations, this simulation study compares statistical performance of multiple variations of two-way fixed effect models traditionally used for DID under a range of si… ▽ More State-level policy evaluations commonly employ a difference-in-differences (DID) study design; yet within this framework, statistical model specification varies notably across studies. Motivated by applied state-level opioid policy evaluations, this simulation study compares statistical performance of multiple variations of two-way fixed effect models traditionally used for DID under a range of simulation conditions. While most linear models resulted in minimal bias, non-linear models and population-weighted versions of classic linear two-way fixed effect and linear GEE models yielded considerable bias (60 to 160%). Further, root mean square error is minimized by linear AR models when examining crude mortality rates and by negative binomial models when examining raw death counts. In the context of frequentist hypothesis testing, many models yielded high Type I error rates and very low rates of correctly rejecting the null hypothesis (< 10%), raising concerns of spurious conclusions about policy effectiveness. When considering performance across models, the linear autoregressive models were optimal in terms of directional bias, root mean squared error, Type I error, and correct rejection rates. These findings highlight notable limitations of traditional statistical models commonly used for DID designs, designs widely used in opioid policy studies and in state policy evaluations more broadly. △ Less

Submitted 8 June, 2021; v1 submitted 26 March, 2020; originally announced March 2020.

Nonparametric Estimation of Population Average Dose-Response Curves using Entropy Balancing Weights for Continuous Exposures

Authors: Brian G. Vegetabile, Beth Ann Griffin, Donna L. Coffman, Matthew Cefalu, Daniel F. McCaffrey

Abstract: Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure sett… ▽ More Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure settings, such as those based on entropy balancing, have shown more promise in estimating treatment effects than those methods that focus on the direct estimation of the propensity score using likelihood-based methods. This paper explores recent developments of entropy balancing methods to continuous exposure settings and the estimation of population dose-response curves using nonparametric estimation combined with entropy balancing weights, focusing on factors that would be important to applied researchers in medical or health services research. The methods developed here are applied to data from a study assessing the effect of non-randomized components of an evidence-based substance use treatment program on emotional and substance use clinical outcomes. △ Less

Submitted 5 March, 2020; originally announced March 2020.

Comments: 26 pages, 10 figures

Simulation from quasi-stationary distributions on reducible state spaces

Authors: Adam Griffin, Paul A. Jenkins, Gareth O. Roberts, Simon E. F. Spencer

Abstract: Quasi-stationary distributions (QSDs)arise from stochastic processes that exhibit transient equilibrium behaviour on the way to absorption QSDs are often mathematically intractable and even drawing samples from them is not straightforward. In this paper the framework of Sequential Monte Carlo samplers is utilized to simulate QSDs and several novel resampling techniques are proposed to accommodate… ▽ More Quasi-stationary distributions (QSDs)arise from stochastic processes that exhibit transient equilibrium behaviour on the way to absorption QSDs are often mathematically intractable and even drawing samples from them is not straightforward. In this paper the framework of Sequential Monte Carlo samplers is utilized to simulate QSDs and several novel resampling techniques are proposed to accommodate models with reducible state spaces, with particular focus on preserving particle diversity on discrete spaces. Finally an approach is considered to estimate eigenvalues associated with QSDs, such as the decay parameter. △ Less

Submitted 17 January, 2017; v1 submitted 6 December, 2016; originally announced December 2016.

Comments: 30 pages, 9 Figures

MSC Class: 60J27; 62G09

An application of principal stratification to control for institutionalization at follow-up in studies of substance abuse treatment programs

Authors: Beth Ann Griffin, Daniel F. McCaffrey, Andrew R. Morral

Abstract: Participants in longitudinal studies on the effects of drug treatment and criminal justice system interventions are at high risk for institutionalization (e.g., spending time in an environment where their freedom to use drugs, commit crimes, or engage in risky behavior may be circumscribed). Methods used for estimating treatment effects in the presence of institutionalization during follow-up ca… ▽ More Participants in longitudinal studies on the effects of drug treatment and criminal justice system interventions are at high risk for institutionalization (e.g., spending time in an environment where their freedom to use drugs, commit crimes, or engage in risky behavior may be circumscribed). Methods used for estimating treatment effects in the presence of institutionalization during follow-up can be highly sensitive to assumptions that are unlikely to be met in applications and thus likely to yield misleading inferences. In this paper we consider the use of principal stratification to control for institutionalization at follow-up. Principal stratification has been suggested for similar problems where outcomes are unobservable for samples of study participants because of dropout, death or other forms of censoring. The method identifies principal strata within which causal effects are well defined and potentially estimable. We extend the method of principal stratification to model institutionalization at follow-up and estimate the effect of residential substance abuse treatment versus outpatient services in a large scale study of adolescent substance abuse treatment programs. Additionally, we discuss practical issues in applying the principal stratification model to data. We show via simulation studies that the model can only recover true effects provided the data meet strenuous demands and that there must be caution taken when implementing principal stratification as a technique to control for post-treatment confounders such as institutionalization. △ Less

Submitted 12 November, 2008; originally announced November 2008.

Comments: Published in at http://dx.doi.org/10.1214/08-AOAS179 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOAS-AOAS179

Journal ref: Annals of Applied Statistics 2008, Vol. 2, No. 3, 1034-1055