-
Dealing with multiple intercurrent events using hypothetical and treatment policy strategies simultaneously
Authors:
Camila Olarte Parra,
Rhian M. Daniel,
Jonathan W. Bartlett
Abstract:
To precisely define the treatment effect of interest in a clinical trial, the ICH E9 estimand addendum describes that relevant so-called intercurrent events should be identified and strategies specified to deal with them. Handling intercurrent events with different strategies leads to different estimands. In this paper, we focus on estimands that involve addressing one intercurrent event with the…
▽ More
To precisely define the treatment effect of interest in a clinical trial, the ICH E9 estimand addendum describes that relevant so-called intercurrent events should be identified and strategies specified to deal with them. Handling intercurrent events with different strategies leads to different estimands. In this paper, we focus on estimands that involve addressing one intercurrent event with the treatment policy strategy and another with the hypothetical strategy. We define these estimands using potential outcomes and causal diagrams, considering the possible causal relationships between the two intercurrent events and other variables. We show that there are different causal estimand definitions and assumptions one could adopt, each having different implications for estimation, which is demonstrated in a simulation study. The different considerations are illustrated conceptually using a diabetes trial as an example.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
Estimating hypothetical estimands with causal inference and missing data estimators in a diabetes trial
Authors:
Camila Olarte Parra,
Rhian M. Daniel,
David Wright,
Jonathan W. Bartlett
Abstract:
The recently published ICH E9 addendum on estimands in clinical trials provides a framework for precisely defining the treatment effect that is to be estimated, but says little about estimation methods. Here we report analyses of a clinical trial in type 2 diabetes, targeting the effects of randomised treatment, handling rescue treatment and discontinuation of randomised treatment using the so-cal…
▽ More
The recently published ICH E9 addendum on estimands in clinical trials provides a framework for precisely defining the treatment effect that is to be estimated, but says little about estimation methods. Here we report analyses of a clinical trial in type 2 diabetes, targeting the effects of randomised treatment, handling rescue treatment and discontinuation of randomised treatment using the so-called hypothetical strategy. We show how this can be estimated using mixed models for repeated measures, multiple imputation, inverse probability of treatment weighting, G-formula and G-estimation. We describe their assumptions and practical details of their implementation using packages in R. We report the results of these analyses, broadly finding similar estimates and standard errors across the estimators. We discuss various considerations relevant when choosing an estimation approach, including computational time, how to handle missing data, whether to include post intercurrent event data in the analysis, whether and how to adjust for additional time-varying confounders, and whether and how to model different types of ICE separately.
△ Less
Submitted 22 September, 2023; v1 submitted 24 August, 2023;
originally announced August 2023.
-
G-formula for causal inference via multiple imputation
Authors:
Jonathan W. Bartlett,
Camila Olarte Parra,
Emily Granger,
Ruth H. Keogh,
Erik W. van Zwet,
Rhian M. Daniel
Abstract:
G-formula is a popular approach for estimating treatment or exposure effects from longitudinal data that are subject to time-varying confounding. G-formula estimation is typically performed by Monte-Carlo simulation, with non-parametric bootstrapping used for inference. We show that G-formula can be implemented by exploiting existing methods for multiple imputation (MI) for synthetic data. This in…
▽ More
G-formula is a popular approach for estimating treatment or exposure effects from longitudinal data that are subject to time-varying confounding. G-formula estimation is typically performed by Monte-Carlo simulation, with non-parametric bootstrapping used for inference. We show that G-formula can be implemented by exploiting existing methods for multiple imputation (MI) for synthetic data. This involves using an existing modified version of Rubin's variance estimator. In practice missing data is ubiquitous in longitudinal datasets. We show that such missing data can be readily accommodated as part of the MI procedure when using G-formula, and describe how MI software can be used to implement the approach. We explore its performance using a simulation study and an application from cystic fibrosis.
△ Less
Submitted 11 October, 2023; v1 submitted 27 January, 2023;
originally announced January 2023.
-
Estimands and their Estimators for Clinical Trials Impacted by the COVID-19 Pandemic: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions
Authors:
Kelly Van Lancker,
Sergey Tarima,
Jonathan Bartlett,
Madeline Bauer,
Bharani Bharani-Dharan,
Frank Bretz,
Nancy Flournoy,
Hege Michiels,
Camila Olarte Parra,
James L Rosenberger,
Suzie Cro
Abstract:
The COVID-19 pandemic continues to affect the conduct of clinical trials globally. Complications may arise from pandemic-related operational challenges such as site closures, travel limitations and interruptions to the supply chain for the investigational product, or from health-related challenges such as COVID-19 infections. Some of these complications lead to unforeseen intercurrent events in th…
▽ More
The COVID-19 pandemic continues to affect the conduct of clinical trials globally. Complications may arise from pandemic-related operational challenges such as site closures, travel limitations and interruptions to the supply chain for the investigational product, or from health-related challenges such as COVID-19 infections. Some of these complications lead to unforeseen intercurrent events in the sense that they affect either the interpretation or the existence of the measurements associated with the clinical question of interest. In this article, we demonstrate how the ICH E9(R1) Addendum on estimands and sensitivity analyses provides a rigorous basis to discuss potential pandemic-related trial disruptions and to embed these disruptions in the context of study objectives and design elements. We introduce several hypothetical estimand strategies and review various causal inference and missing data methods, as well as a statistical method that combines unbiased and possibly biased estimators for estimation. To illustrate, we describe the features of a stylized trial, and how it may have been impacted by the pandemic. This stylized trial will then be re-visited by discussing the changes to the estimand and the estimator to account for pandemic disruptions. Finally, we outline considerations for designing future trials in the context of unforeseen disruptions.
△ Less
Submitted 7 February, 2022;
originally announced February 2022.
-
Hypothetical estimands in clinical trials: a unification of causal inference and missing data methods
Authors:
Camila Olarte Parra,
Rhian M. Daniel,
Jonathan W. Bartlett
Abstract:
The ICH E9 addendum introduces the term intercurrent event to refer to events that happen after randomisation and that can either preclude observation of the outcome of interest or affect its interpretation. It proposes five strategies for handling intercurrent events to form an estimand but does not suggest statistical methods for estimation. In this paper we focus on the hypothetical strategy, w…
▽ More
The ICH E9 addendum introduces the term intercurrent event to refer to events that happen after randomisation and that can either preclude observation of the outcome of interest or affect its interpretation. It proposes five strategies for handling intercurrent events to form an estimand but does not suggest statistical methods for estimation. In this paper we focus on the hypothetical strategy, where the treatment effect is defined under the hypothetical scenario in which the intercurrent event is prevented. For its estimation, we consider causal inference and missing data methods. We establish that certain 'causal inference estimators' are identical to certain 'missing data estimators'. These links may help those familiar with one set of methods but not the other. Moreover, using potential outcome notation allows us to state more clearly the assumptions on which missing data methods rely to estimate hypothetical estimands. This helps to indicate whether estimating a hypothetical estimand is reasonable, and what data should be used in the analysis. We show that hypothetical estimands can be estimated by exploiting data after intercurrent event occurrence, which is typically not used. We also present Monte Carlo simulations that illustrate the implementation and performance of the methods in different settings.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Trial emulation and survival analysis for disease incidence registers: a case study on the causal effect of pre-emptive kidney transplantation
Authors:
Camila Olarte Parra,
Ingeborg Waernbaum,
Staffan Schön,
Els Goetghebeur
Abstract:
Numerous tutorials and research papers focus on methods in either survival analysis or causal inference, leaving common complications in medical studies unaddressed. In practice one must handle problems jointly, without the luxury of ignoring essential features of the data structure. In this paper, we follow incident cases of end-stage renal disease and examine the effect on all-cause mortality of…
▽ More
Numerous tutorials and research papers focus on methods in either survival analysis or causal inference, leaving common complications in medical studies unaddressed. In practice one must handle problems jointly, without the luxury of ignoring essential features of the data structure. In this paper, we follow incident cases of end-stage renal disease and examine the effect on all-cause mortality of starting treatment with transplant, so-called pre-emptive kidney transplantation, versus dialysis. The question is relatively simple: which treatment start is expected to bring the best survival for a target population? To address the question, we emulate a target trial drawing on the Swedish Renal Registry to estimate a causal effect on survival curves. Aware of important challenges, we see how previous studies have selected patients into treatment groups based on events occurring post treatment initiation. Our study reveals the dramatic impact of resulting immortal time bias and other typical features of long term incident disease registries, including: missing or mismeasured covariates during (the early) phases of the register, varying risk profile of patients entering treatment groups over calendar time and changes in risk as care improves over the years. With characteristics of cases and versions of treatment evolving over time, informative censoring is introduced in unadjusted Kaplan-Meier curves and also their IPW version is no longer valid. Here we discuss feasible ways of handling these features and answer different research questions relying on the no unmeasured baseline confounders assumption.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
