-
Large Sample Inference with Dynamic Information Borrowing
Authors:
Sergey Tarima,
Silvia Calderazzo,
Mary Homan
Abstract:
Large sample behavior of dynamic information borrowing (DIB) estimators is investigated. Asymptotic properties of several DIB approaches (adaptive risk minimization, adaptive LASSO, Bayesian procedures with empirical power prior, fully Bayesian procedures, and a Bayes-frequentist compromise) are explored against shrinking to zero alternatives. As shown theoretically and with simulations, local asy…
▽ More
Large sample behavior of dynamic information borrowing (DIB) estimators is investigated. Asymptotic properties of several DIB approaches (adaptive risk minimization, adaptive LASSO, Bayesian procedures with empirical power prior, fully Bayesian procedures, and a Bayes-frequentist compromise) are explored against shrinking to zero alternatives. As shown theoretically and with simulations, local asymptotic distributions of DIB estimators are often non-normal. A simple Gaussian setting with external information borrowing illustrates that none of the considered DIB methods outperforms others in terms of mean squared error (MSE): at different conflict values, the MSEs of DIBs are changing between the MSEs of the maximum likelihood estimators based on the current and pooled data. To uniquely determine an optimality criterion for DIB, a prior distribution on the conflict needs be either implicitly or explicitly determined using data independent considerations. Data independent assumptions on the conflict are also needed for DIB-based hypothesis testing. New families of DIB estimators parameterized by a sensitivity-to-conflict parameter S are suggested and their use is illustrated in an infant mortality example. The choice of S is determined in a data-independent manner by a cost-benefit compromise associated with the use of external data.
△ Less
Submitted 28 February, 2025;
originally announced February 2025.
-
Information borrowing in Bayesian clinical trials: choice of tuning parameters for the robust mixture prior
Authors:
Vivienn Weru,
Annette Kopp-Schneider,
Manuel Wiesenfarth,
Sebastian Weber,
Silvia Calderazzo
Abstract:
Borrowing historical data for use in clinical trials has increased in recent years. This is accomplished in the Bayesian framework by specification of informative prior distributions. One such approach is the robust mixture prior arising as a weighted mixture of an informative prior and a robust prior inducing dynamic borrowing that allows to borrow most when the current and external data are obse…
▽ More
Borrowing historical data for use in clinical trials has increased in recent years. This is accomplished in the Bayesian framework by specification of informative prior distributions. One such approach is the robust mixture prior arising as a weighted mixture of an informative prior and a robust prior inducing dynamic borrowing that allows to borrow most when the current and external data are observed to be similar. The robust mixture prior requires the choice of three additional quantities: the mixture weight, and the mean and dispersion of the robust component. Some general guidance is available, but a case-by-case study of the impact of these quantities on specific operating characteristics seems lacking. We focus on evaluating the impact of parameter choices for the robust component of the mixture prior in one-arm and hybrid-control trials. The results show that all three quantities can strongly impact the operating characteristics. In particular, as already known, variance of the robust component is linked to robustness. Less known, however, is that its location can have a strong impact on Type I error rate and MSE which can even become unbounded. Further, the impact of the weight choice is strongly linked with the robust component's location and variance. Recommendations are provided for the choice of the robust component parameters, prior weight, alternative functional form for this component as well as considerations to keep in mind when evaluating operating characteristics.
△ Less
Submitted 4 December, 2024;
originally announced December 2024.
-
Simulating and reporting frequentist operating characteristics of clinical trials that borrow external information
Authors:
Annette Kopp-Schneider,
Manuel Wiesenfarth,
Leonhard Held,
Silvia Calderazzo
Abstract:
Borrowing of information from historical or external data to inform inference in a current trial is an expanding field in the era of precision medicine, where trials are often performed in small patient cohorts for practical or ethical reasons. Many approaches for borrowing from external data have been proposed. Even though these methods are mainly based on Bayesian approaches by incorporating ext…
▽ More
Borrowing of information from historical or external data to inform inference in a current trial is an expanding field in the era of precision medicine, where trials are often performed in small patient cohorts for practical or ethical reasons. Many approaches for borrowing from external data have been proposed. Even though these methods are mainly based on Bayesian approaches by incorporating external information into the prior for the current analysis, frequentist operating characteristics of the analysis strategy are of interest. In particular, type I error and power at a prespecified point alternative are in the focus. It is well-known that borrowing from external information may lead to the alteration of type I error rate. We propose a procedure to investigate and report the frequentist operating characteristics in this context. The approach evaluates type I error rate of the test with borrowing from external data and calibrates the test without borrowing to this type I error rate. On this basis, a fair comparison of power between the test with and without borrowing is achieved.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
Robust incorporation of historical information with known type I error rate inflation
Authors:
Silvia Calderazzo,
Annette Kopp-Schneider
Abstract:
Bayesian clinical trials can benefit of available historical information through the elicitation of informative prior distributions. Concerns are however often raised about the potential for prior-data conflict and the impact of Bayes test decisions on frequentist operating characteristics, with particular attention being assigned to inflation of type I error rates. This motivates the development…
▽ More
Bayesian clinical trials can benefit of available historical information through the elicitation of informative prior distributions. Concerns are however often raised about the potential for prior-data conflict and the impact of Bayes test decisions on frequentist operating characteristics, with particular attention being assigned to inflation of type I error rates. This motivates the development of principled borrowing mechanisms, that strike a balance between frequentist and Bayesian decisions. Ideally, the trust assigned to historical information defines the degree of robustness to prior-data conflict one is willing to sacrifice. However, such relationship is often not directly available when explicitly considering inflation of type I error rates. We build on available literature relating frequentist and Bayesian test decisions, and investigate a rationale for inflation of type I error rate which explicitly and linearly relates the amount of borrowing and the amount of type I error rate inflation in one-arm studies. A novel dynamic borrowing mechanism tailored to hypothesis testing is additionally proposed. We show that, while dynamic borrowing prevents the possibility to obtain a simple closed form type I error rate computation, an explicit upper bound can still be enforced. Connections with the robust mixture prior approach, particularly in relation to the choice of the mixture weight and robust component, are made. Simulations are performed to show the properties of the approach for normal and binomial outcomes.
△ Less
Submitted 30 November, 2022;
originally announced November 2022.
-
Coping with Information Loss and the Use of Auxiliary Sources of Data: A Report from the NISS Ingram Olkin Forum Series on Unplanned Clinical Trial Disruptions
Authors:
Silvia Calderazzo,
Sergey Tarima,
Carissa Reid,
Nancy Flournoy,
Tim Friede,
Nancy Geller,
James L Rosenberger,
Nigel Stallard,
Moreno Ursino,
Marc Vandemeulebroecke,
Kelly Van Lancker,
Sarah Zohar
Abstract:
Clinical trials disruption has always represented a non negligible part of the ending of interventional studies. While the SARS-CoV-2 (COVID-19) pandemic has led to an impressive and unprecedented initiation of clinical research, it has also led to considerable disruption of clinical trials in other disease areas, with around 80% of non-COVID-19 trials stopped or interrupted during the pandemic. I…
▽ More
Clinical trials disruption has always represented a non negligible part of the ending of interventional studies. While the SARS-CoV-2 (COVID-19) pandemic has led to an impressive and unprecedented initiation of clinical research, it has also led to considerable disruption of clinical trials in other disease areas, with around 80% of non-COVID-19 trials stopped or interrupted during the pandemic. In many cases the disrupted trials will not have the planned statistical power necessary to yield interpretable results. This paper describes methods to compensate for the information loss arising from trial disruptions by incorporating additional information available from auxiliary data sources. The methods described include the use of auxiliary data on baseline and early outcome data available from the trial itself and frequentist and Bayesian approaches for the incorporation of information from external data sources. The methods are illustrated by application to the analysis of artificial data based on the Primary care pediatrics Learning Activity Nutrition (PLAN) study, a clinical trial assessing a diet and exercise intervention for overweight children, that was affected by the COVID-19 pandemic. We show how all of the methods proposed lead to an increase in precision relative to use of complete case data only.
△ Less
Submitted 22 June, 2022;
originally announced June 2022.
