-
Estimation and Evaluation of the Resource-Constrained Optimal Dynamic Treatment Rule: An Application to HIV Care Retention
Authors:
Lina M. Montoya,
Elvin H. Geng,
Harriet F. Adhiambo,
Maya L. Petersen
Abstract:
The optimal strategy for deploying a treatment in a population may recommend giving all in the population that treatment. Such a strategy may not be feasible, especially in resource-limited settings. One approach for determining how to allocate a treatment in such settings is the resource-constrained optimal dynamic treatment rule (RC ODTR) SuperLearner algorithm, developed by Luedtke and van der…
▽ More
The optimal strategy for deploying a treatment in a population may recommend giving all in the population that treatment. Such a strategy may not be feasible, especially in resource-limited settings. One approach for determining how to allocate a treatment in such settings is the resource-constrained optimal dynamic treatment rule (RC ODTR) SuperLearner algorithm, developed by Luedtke and van der Laan. In this paper, we describe this algorithm, offer various novel approaches for presenting the RC ODTR and its value in terms of benefit and cost, and provide practical guidance on implementing the algorithm (including software). In particular, we apply this method to the Adaptive Strategies for Preventing and Treating Lapses of Retention in HIV care (NCT02338739) trial to determine how to best allocate conditional cash transfers (CCTs) for increasing HIV care adherence given varying constraints on the proportion of people who can receive CCTs in the population, providing one of the few applied illustrations of this method and novel substantive findings. We find that there are clinical and monetary benefits to deploying CCTs to a small percent (e.g., 10\%) of the population compared to administering the care standard for all; however, results suggest that these incremental benefits are only due to the loosening of constraints, rather than a presence of treatment effect heterogeneity strong enough to drive a more efficient and effective constrained allocation approach.
△ Less
Submitted 20 February, 2025;
originally announced February 2025.
-
Cost Effectiveness Analyses for Sequential Multiple Assignment Randomized Trials
Authors:
Lina M. Montoya,
Elvin H. Geng,
Harriet F. Adhiambo,
Eliud Akama,
Starley B. Shade,
Assurah Elly,
Thomas Odeny,
Maya L. Petersen
Abstract:
Sequential multiple assignment randomized trials (SMARTs) have grown in popularity in recent years, and many of their study protocols propose conducting a cost effectiveness analysis of the adaptive strategies embedded within them. The cost effectiveness of these regimes is often proposed to be assessed using incremental cost effectiveness ratios (ICERs). In this paper, we present an estimation an…
▽ More
Sequential multiple assignment randomized trials (SMARTs) have grown in popularity in recent years, and many of their study protocols propose conducting a cost effectiveness analysis of the adaptive strategies embedded within them. The cost effectiveness of these regimes is often proposed to be assessed using incremental cost effectiveness ratios (ICERs). In this paper, we present an estimation and inference procedure for such cost effectiveness measures for the embedded dynamic treatment regimes within a SMART design. In particular, we describe a targeted maximum likelihood estimator for the ICER of a SMART's embedded regimes with influence curve-based inference. We illustrate the performance of these methods using simulations. Throughout, we use as illustration a cost effectiveness analysis for the Adaptive Strategies for Preventing and Treating Lapses of Retention in HIV Care (ADAPT-R; NCT02338739) trial, presenting estimated ICERs (with inference) for embedded regimes aimed at increasing HIV care adherence. This manuscript is one of the first to present cost effectiveness analysis results from a SMART.
△ Less
Submitted 11 February, 2025;
originally announced February 2025.
-
Effects Among the Affected
Authors:
Lina M. Montoya,
Elvin H. Geng,
Michael Valancius,
Michael R. Kosorok,
Maya L. Petersen
Abstract:
Many interventions are both beneficial to initiate and harmful to stop. Traditionally, to determine whether to deploy that intervention in a time-limited way depends on if, on average, the increase in the benefits of starting it outweigh the increase in the harms of stopping it. We propose a novel causal estimand that provides a more nuanced understanding of the effects of such treatments, particu…
▽ More
Many interventions are both beneficial to initiate and harmful to stop. Traditionally, to determine whether to deploy that intervention in a time-limited way depends on if, on average, the increase in the benefits of starting it outweigh the increase in the harms of stopping it. We propose a novel causal estimand that provides a more nuanced understanding of the effects of such treatments, particularly, how response to an earlier treatment (e.g., treatment initiation) modifies the effect of a later treatment (e.g., treatment discontinuation), thus learning if there are effects among the (un)affected. Specifically, we consider a marginal structural working model summarizing how the average effect of a later treatment varies as a function of the (estimated) conditional average effect of an earlier treatment. We allow for estimation of this conditional average treatment effect using machine learning, such that the causal estimand is a data-adaptive parameter. We show how a sequentially randomized design can be used to identify this causal estimand, and we describe a targeted maximum likelihood estimator for the resulting statistical estimand, with influence curve-based inference. Throughout, we use the Adaptive Strategies for Preventing and Treating Lapses of Retention in HIV Care trial (NCT02338739) as an illustrative example, showing that discontinuation of conditional cash transfers for HIV care adherence was most harmful among those who most had an increase in benefits from them initially.
△ Less
Submitted 26 August, 2024;
originally announced August 2024.
-
An Approach to Nonparametric Inference on the Causal Dose Response Function
Authors:
Aaron Hudson,
Elvin H. Geng,
Thomas A. Odeny,
Elizabeth A. Bukusi,
Maya L. Petersen,
Mark J. van der Laan
Abstract:
The causal dose response curve is commonly selected as the statistical parameter of interest in studies where the goal is to understand the effect of a continuous exposure on an outcome.Most of the available methodology for statistical inference on the dose-response function in the continuous exposure setting requires strong parametric assumptions on the probability distribution. Such parametric a…
▽ More
The causal dose response curve is commonly selected as the statistical parameter of interest in studies where the goal is to understand the effect of a continuous exposure on an outcome.Most of the available methodology for statistical inference on the dose-response function in the continuous exposure setting requires strong parametric assumptions on the probability distribution. Such parametric assumptions are typically untenable in practice and lead to invalid inference. It is often preferable to instead use nonparametric methods for inference, which only make mild assumptions about the data-generating mechanism. We propose a nonparametric test of the null hypothesis that the dose-response function is equal to a constant function. We argue that when the null hypothesis holds, the dose-response function has zero variance. Thus, one can test the null hypothesis by assessing whether there is sufficient evidence to claim that the variance is positive. We construct a novel estimator for the variance of the dose-response function, for which we can fully characterize the null limiting distribution and thus perform well-calibrated tests of the null hypothesis. We also present an approach for constructing simultaneous confidence bands for the dose-response function by inverting our proposed hypothesis test. We assess the validity of our proposal in a simulation study. In a data example, we study, in a population of patients who have initiated treatment for HIV, how the distance required to travel to an HIV clinic affects retention in care.
△ Less
Submitted 13 June, 2023;
originally announced June 2023.
-
Efficient and Robust Approaches for Analysis of SMARTs: Illustration using the ADAPT-R Trial
Authors:
Lina M. Montoya,
Michael R. Kosorok,
Elvin H. Geng,
Joshua Schwab,
Thomas A. Odeny,
Maya L. Petersen
Abstract:
Personalized intervention strategies, in particular those that modify treatment based on a participant's own response, are a core component of precision medicine approaches. Sequential Multiple Assignment Randomized Trials (SMARTs) are growing in popularity and are specifically designed to facilitate the evaluation of sequential adaptive strategies, in particular those embedded within the SMART. A…
▽ More
Personalized intervention strategies, in particular those that modify treatment based on a participant's own response, are a core component of precision medicine approaches. Sequential Multiple Assignment Randomized Trials (SMARTs) are growing in popularity and are specifically designed to facilitate the evaluation of sequential adaptive strategies, in particular those embedded within the SMART. Advances in efficient estimation approaches that are able to incorporate machine learning while retaining valid inference can allow for more precise estimates of the effectiveness of these embedded regimes. However, to the best of our knowledge, such approaches have not yet been applied as the primary analysis in SMART trials. In this paper, we present a robust and efficient approach using Targeted Maximum Likelihood Estimation (TMLE) for estimating and contrasting expected outcomes under the dynamic regimes embedded in a SMART, together with generating simultaneous confidence intervals for the resulting estimates. We contrast this method with two alternatives (G-computation and Inverse Probability Weighting estimators). The precision gains and robust inference achievable through the use of TMLE to evaluate the effects of embedded regimes are illustrated using both outcome-blind simulations and a real data analysis from the Adaptive Strategies for Preventing and Treating Lapses of Retention in HIV Care (ADAPT-R) trial (NCT02338739), a SMART with a primary aim of identifying strategies to improve retention in HIV care among people living with HIV in sub-Saharan Africa.
△ Less
Submitted 7 October, 2022;
originally announced October 2022.