-
Scanning Tactile Sensor with Spiral Coil Structure Amplifying Detection Performance of Micro-concave
Authors:
Takeru Kurokawa,
Toshinobu Takei,
Haruo Noma,
Mitsuhito Ando
Abstract:
Surface inspection is a delicate process aimed at detecting fine defects, irregularities, and foreign substances at the tens of micrometers level, subsequently excluding products that do not meet the quality standards as defective. Currently, this inspection relies on the tactile senses of skilled technicians, leading to variability in the detection accuracy based on the level of proficiency and e…
▽ More
Surface inspection is a delicate process aimed at detecting fine defects, irregularities, and foreign substances at the tens of micrometers level, subsequently excluding products that do not meet the quality standards as defective. Currently, this inspection relies on the tactile senses of skilled technicians, leading to variability in the detection accuracy based on the level of proficiency and experience. Consequently, a standardized method for surface inspection has yet to be established. In response to this issue, we have developed a device capable of amplifying tactile information, allowing for the detection of minute distortions without the need for highly skilled technicians. The experimental results on various small distortions suggest the potential for the quantitative evaluation of these distortions. In the future, the application of this device could contribute to the automation of surface inspection.
△ Less
Submitted 7 November, 2024;
originally announced November 2024.
-
Mouse Embedded Soft Vibration Actuator for Exploring Surface Textures
Authors:
Asahi Kurokawa,
Masaharu Shimizu,
Mitsuhito Ando,
Haruo Noma
Abstract:
We aimed to develop a tactile display that allows users to actively explore the virtual texture of a surface. We developed a tactile display embedded in an optical mouse that provides a wide range of frequency vibrations to the user's fingertip in response to its movement. We conducted an experiment to confirm the degree of fineness based on a stripe pattern identification task using a trial syste…
▽ More
We aimed to develop a tactile display that allows users to actively explore the virtual texture of a surface. We developed a tactile display embedded in an optical mouse that provides a wide range of frequency vibrations to the user's fingertip in response to its movement. We conducted an experiment to confirm the degree of fineness based on a stripe pattern identification task using a trial system. The results showed that the subject could identify a fine spatial resolution up to 0.16 mm width.
△ Less
Submitted 7 November, 2024;
originally announced November 2024.
-
Ridge, lasso, and elastic-net estimations of the modified Poisson and least-squares regressions for binary outcome data
Authors:
Takahiro Kitano,
Hisashi Noma
Abstract:
Logistic regression is a standard method in multivariate analysis for binary outcome data in epidemiological and clinical studies; however, the resultant odds-ratio estimates fail to provide directly interpretable effect measures. The modified Poisson and least-squares regressions are alternative standard methods that can provide risk-ratio and risk difference estimates without computational probl…
▽ More
Logistic regression is a standard method in multivariate analysis for binary outcome data in epidemiological and clinical studies; however, the resultant odds-ratio estimates fail to provide directly interpretable effect measures. The modified Poisson and least-squares regressions are alternative standard methods that can provide risk-ratio and risk difference estimates without computational problems. However, the bias and invalid inference problems of these regression analyses under small or sparse data conditions (i.e.,the "separation" problem) have been insufficiently investigated. We show that the separation problem can adversely affect the inferences of the modified Poisson and least squares regressions, and to address these issues, we apply the ridge, lasso, and elastic-net estimating approaches to the two regression methods. As the methods are not founded on the maximum likelihood principle, we propose regularized quasi-likelihood approaches based on the estimating equations for these generalized linear models. The methods provide stable shrinkage estimates of risk ratios and risk differences even under separation conditions, and the lasso and elastic-net approaches enable simultaneous variable selection. We provide a bootstrap method to calculate the confidence intervals on the basis of the regularized quasi-likelihood estimation. The proposed methods are applied to a hematopoietic stem cell transplantation cohort study and the National Child Development Survey. We also provide an R package, regconfint, to implement these methods with simple commands.
△ Less
Submitted 25 November, 2024; v1 submitted 24 August, 2024;
originally announced August 2024.
-
Influence analyses of "designs" for evaluating inconsistency in network meta-analysis
Authors:
Kotaro Sasaki,
Hisashi Noma
Abstract:
Network meta-analysis is an evidence synthesis method for comparing the effectiveness of multiple available treatments. To justify evidence synthesis, consistency is an important assumption; however, existing methods founded on statistical testing can be substantially limited in statistical power or have several drawbacks when handling multi-arm studies. Moreover, inconsistency can be theoreticall…
▽ More
Network meta-analysis is an evidence synthesis method for comparing the effectiveness of multiple available treatments. To justify evidence synthesis, consistency is an important assumption; however, existing methods founded on statistical testing can be substantially limited in statistical power or have several drawbacks when handling multi-arm studies. Moreover, inconsistency can be theoretically explained as design-by-treatment interactions, and the primary purpose of such analyses is to prioritize the further investigation of specific "designs" to explore sources of bias and other issues that might influence the overall results. In this article, we propose an alternative framework for evaluating inconsistency using influence diagnostics methods, which enable the influence of individual designs on the overall results to be quantitatively evaluated. We provide four new methods, the averaged studentized residual, MDFFITS, Φ_d, and Ξ_d, to quantify the influence of individual designs through a "leave-one-design-out" analysis framework. We also propose a simple summary measure, the O-value, for prioritizing designs and interpreting these influential analyses in a straightforward manner. Furthermore, we propose another testing approach based on the leave-one-design-out analysis framework. By applying the new methods to a network meta-analysis of antihypertensive drugs and performing simulation studies, we demonstrate that the new methods accurately located potential sources of inconsistency. The proposed methods provide new insights into alternatives to existing test-based methods, especially the quantification of the influence of individual designs on the overall network meta-analysis results.
△ Less
Submitted 28 April, 2025; v1 submitted 24 June, 2024;
originally announced June 2024.
-
MVPBT: R package for publication bias tests in meta-analysis of diagnostic accuracy studies
Authors:
Hisashi Noma
Abstract:
Meta-analysis for diagnostic test accuracy (DTA) has been a standard research method for synthesizing evidence from diagnostic studies. In DTA meta-analysis, although publication bias is an important source of bias, no certain methods similar to the Egger test in univariate meta-analysis have been developed to detect such bias. However, several recent studies have discussed these methods in the fr…
▽ More
Meta-analysis for diagnostic test accuracy (DTA) has been a standard research method for synthesizing evidence from diagnostic studies. In DTA meta-analysis, although publication bias is an important source of bias, no certain methods similar to the Egger test in univariate meta-analysis have been developed to detect such bias. However, several recent studies have discussed these methods in the framework of multivariate meta-analysis, and some generalized Egger tests have been developed. The R package MVPBT (https://cran.r-project.org/web/packages/MVPBT/) was developed to implement the generalized Egger tests developed by Noma (2020; Biometrics 76, 1255-1259) for DTA meta-analysis. Noma's publication bias tests effectively incorporate the correlation information between multiple outcomes and are expected to improve the statistical powers. The present paper provides a nontechnical introduction and practical examples of data analyses of the publication bias tests of DTA meta-analysis using the MVPBT package.
△ Less
Submitted 30 May, 2023; v1 submitted 14 September, 2022;
originally announced September 2022.
-
Variance estimation for logistic regression in case-cohort studies
Authors:
Hisashi Noma
Abstract:
The logistic regression analysis proposed by Schouten et al. (Stat Med. 1993;12:1733-1745) has been a standard method in current statistical analysis of case-cohort studies, and it enables effective estimation of risk ratio from selected subsamples. Schouten et al. (1993) also proposed the standard error estimate of the risk ratio estimator can be calculated by the robust variance estimator. In th…
▽ More
The logistic regression analysis proposed by Schouten et al. (Stat Med. 1993;12:1733-1745) has been a standard method in current statistical analysis of case-cohort studies, and it enables effective estimation of risk ratio from selected subsamples. Schouten et al. (1993) also proposed the standard error estimate of the risk ratio estimator can be calculated by the robust variance estimator. In this article, however, we show that the robust variance estimator does not account for the duplications of case and subcohort samples and generally has certain bias, i.e., inaccurate confidence intervals and P-values are possibly obtained. To address the invalid statistical inference problem, we provide an alternative bootstrap-based valid variance estimator. Through simulation studies, the bootstrap method consistently provided more precise confidence intervals compared with those provided by the robust variance method, while retaining adequate coverage probabilities. The conventional robust variance estimator has certain bias, and inadequate conclusions might be deduced. The bootstrap method would be an alternative effective approach in practice to provide accurate evidence.
△ Less
Submitted 18 January, 2023; v1 submitted 6 August, 2022;
originally announced August 2022.
-
pimeta: an R package of prediction intervals for random-effects meta-analysis
Authors:
Kengo Nagashima,
Hisashi Noma,
Toshi A. Furukawa
Abstract:
The prediction interval is gaining prominence in meta-analysis as it enables the assessment of uncertainties in treatment effects and heterogeneity between studies. However, coverage probabilities of the current standard method for constructing prediction intervals cannot retain their nominal levels in general, particularly when the number of synthesized studies is moderate or small, because their…
▽ More
The prediction interval is gaining prominence in meta-analysis as it enables the assessment of uncertainties in treatment effects and heterogeneity between studies. However, coverage probabilities of the current standard method for constructing prediction intervals cannot retain their nominal levels in general, particularly when the number of synthesized studies is moderate or small, because their validities depend on large sample approximations. Recently, several methods have developed been to address this issue. This paper briefly summarizes the recent developments in methods of prediction intervals and provides readable examples using R for multiple types of data with simple code. The pimeta package is an R package that provides these improved methods to calculate accurate prediction intervals and graphical tools to illustrate these results. The pimeta package is listed in ``CRAN Task View: Meta-Analysis.'' The analysis is easily performed in R using a series of R packages.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
Sample size calculations for single-arm survival studies using transformations of the Kaplan-Meier estimator
Authors:
Kengo Nagashima,
Hisashi Noma,
Yasunori Sato,
Masahiko Gosho
Abstract:
In single-arm clinical trials with survival outcomes, the Kaplan-Meier estimator and its confidence interval are widely used to assess survival probability and median survival time. Since the asymptotic normality of the Kaplan-Meier estimator is a common result, the sample size calculation methods have not been studied in depth. An existing sample size calculation method is founded on the asymptot…
▽ More
In single-arm clinical trials with survival outcomes, the Kaplan-Meier estimator and its confidence interval are widely used to assess survival probability and median survival time. Since the asymptotic normality of the Kaplan-Meier estimator is a common result, the sample size calculation methods have not been studied in depth. An existing sample size calculation method is founded on the asymptotic normality of the Kaplan-Meier estimator using the log transformation. However, the small sample properties of the log transformed estimator are quite poor in small sample sizes (which are typical situations in single-arm trials), and the existing method uses an inappropriate standard normal approximation to calculate sample sizes. These issues can seriously influence the accuracy of results. In this paper, we propose alternative methods to determine sample sizes based on a valid standard normal approximation with several transformations that may give an accurate normal approximation even with small sample sizes. In numerical evaluations via simulations, some of the proposed methods provided more accurate results, and the empirical power of the proposed method with the arcsine square-root transformation tended to be closer to a prescribed power than the other transformations. These results were supported when methods were applied to data from three clinical trials.
△ Less
Submitted 29 April, 2021; v1 submitted 6 December, 2020;
originally announced December 2020.
-
Confidence intervals of prediction accuracy measures for multivariable prediction models based on the bootstrap-based optimism correction methods
Authors:
Hisashi Noma,
Tomohiro Shinozaki,
Katsuhiro Iba,
Satoshi Teramukai,
Toshi A. Furukawa
Abstract:
In assessing prediction accuracy of multivariable prediction models, optimism corrections are essential for preventing biased results. However, in most published papers of clinical prediction models, the point estimates of the prediction accuracy measures are corrected by adequate bootstrap-based correction methods, but their confidence intervals are not corrected, e.g., the DeLong's confidence in…
▽ More
In assessing prediction accuracy of multivariable prediction models, optimism corrections are essential for preventing biased results. However, in most published papers of clinical prediction models, the point estimates of the prediction accuracy measures are corrected by adequate bootstrap-based correction methods, but their confidence intervals are not corrected, e.g., the DeLong's confidence interval is usually used for assessing the C-statistic. These naive methods do not adjust for the optimism bias and do not account for statistical variability in the estimation of parameters in the prediction models. Therefore, their coverage probabilities of the true value of the prediction accuracy measure can be seriously below the nominal level (e.g., 95%). In this article, we provide two generic bootstrap methods, namely (1) location-shifted bootstrap confidence intervals and (2) two-stage bootstrap confidence intervals, that can be generally applied to the bootstrap-based optimism correction methods, i.e., the Harrell's bias correction, 0.632, and 0.632+ methods. In addition, they can be widely applied to various methods for prediction model development involving modern shrinkage methods such as the ridge and lasso regressions. Through numerical evaluations by simulations, the proposed confidence intervals showed favourable coverage performances. Besides, the current standard practices based on the optimism-uncorrected methods showed serious undercoverage properties. To avoid erroneous results, the optimism-uncorrected confidence intervals should not be used in practice, and the adjusted methods are recommended instead. We also developed the R package predboot for implementing these methods (https://github.com/nomahi/predboot). The effectiveness of the proposed methods are illustrated via applications to the GUSTO-I clinical trial.
△ Less
Submitted 25 July, 2021; v1 submitted 4 May, 2020;
originally announced May 2020.
-
Confidence interval for the AUC of SROC curve and some related methods using bootstrap for meta-analysis of diagnostic accuracy studies
Authors:
Hisashi Noma,
Yuki Matsushima,
Ryota Ishii
Abstract:
The area under the curve (AUC) of summary receiver operating characteristic (SROC) curve is a primary statistical outcome for meta-analysis of diagnostic test accuracy studies (DTA). However, its confidence interval has not been reported in most of DTA meta-analyses, because no certain methods and statistical packages have been provided. In this article, we provide a bootstrap algorithm for comput…
▽ More
The area under the curve (AUC) of summary receiver operating characteristic (SROC) curve is a primary statistical outcome for meta-analysis of diagnostic test accuracy studies (DTA). However, its confidence interval has not been reported in most of DTA meta-analyses, because no certain methods and statistical packages have been provided. In this article, we provide a bootstrap algorithm for computing the confidence interval of the AUC. Also, using the bootstrap framework, we can conduct a bootstrap test for assessing significance of the difference of AUCs for multiple diagnostic tests. In addition, we provide an influence diagnostic method based on the AUC by leave-one-study-out analyses. We present illustrative examples using two DTA met-analyses for diagnostic tests of cervical cancer and asthma. We also developed an easy-to-handle R package dmetatools for these computations. The various quantitative evidence provided by these methods certainly supports the interpretations and precise evaluations of statistical evidence of DTA meta-analyses.
△ Less
Submitted 16 June, 2020; v1 submitted 8 April, 2020;
originally announced April 2020.
-
Efficient testing and effect size estimation for set-based genetic association inference via semiparametric multilevel mixture modeling: Application to a genome-wide association study of coronary artery disease
Authors:
Shonosuke Sugasawa,
Hisashi Noma
Abstract:
In genetic association studies, rare variants with extremely small allele frequency play a crucial role in complex traits, and the set-based testing methods that jointly assess the effects of groups of single nucleotide polymorphisms (SNPs) were developed to improve powers for the association tests. However, the powers of these tests are still severely limited due to the extremely small allele fre…
▽ More
In genetic association studies, rare variants with extremely small allele frequency play a crucial role in complex traits, and the set-based testing methods that jointly assess the effects of groups of single nucleotide polymorphisms (SNPs) were developed to improve powers for the association tests. However, the powers of these tests are still severely limited due to the extremely small allele frequency, and precise estimations for the effect sizes of individual SNPs are substantially impossible. In this article, we provide an efficient set-based inference framework that addresses the two important issues simultaneously based on a Bayesian semiparametric multilevel mixture model. We propose to use the multilevel hierarchical model that incorporate the variations in set-specific effects and variant-specific effects, and to apply the optimal discovery procedure (ODP) that achieves the largest overall power in multiple significance testing. In addition, we provide Bayesian optimal "set-based" estimator of the empirical distribution of effect sizes. Efficiency of the proposed methods is demonstrated through application to a genome-wide association study of coronary artery disease (CAD), and through simulation studies. These results suggested there could be a lot of rare variants with large effect sizes for CAD, and the number of significant sets detected by the ODP was much greater than those by existing methods.
△ Less
Submitted 12 March, 2020;
originally announced March 2020.
-
Flexible random-effects distribution models for meta-analysis
Authors:
Hisashi Noma,
Kengo Nagashima,
Shogo Kato,
Satoshi Teramukai,
Toshi A. Furukawa
Abstract:
In meta-analysis, the random-effects models are standard tools to address between-study heterogeneity in evidence synthesis analyses. For the random-effects distribution models, the normal distribution model has been adopted in most systematic reviews due to its computational and conceptual simplicity. However, the restrictive model assumption might have serious influences on the overall conclusio…
▽ More
In meta-analysis, the random-effects models are standard tools to address between-study heterogeneity in evidence synthesis analyses. For the random-effects distribution models, the normal distribution model has been adopted in most systematic reviews due to its computational and conceptual simplicity. However, the restrictive model assumption might have serious influences on the overall conclusions in practices. In this article, we first provide two examples of real-world evidence that clearly show that the normal distribution assumption is unsuitable. To address the model restriction problem, we propose alternative flexible random-effects models that can flexibly regulate skewness, kurtosis and tailweight: skew normal distribution, skew t-distribution, asymmetric Subbotin distribution, Jones-Faddy distribution, and sinh-arcsinh distribution. We also developed a R package, flexmeta, that can easily perform these methods. Using the flexible random-effects distribution models, the results of the two meta-analyses were markedly altered, potentially influencing the overall conclusions of these systematic reviews. The flexible methods and computational tools can provide more precise evidence, and these methods would be recommended at least as sensitivity analysis tools to assess the influence of the normal distribution assumption of the random-effects model.
△ Less
Submitted 1 August, 2020; v1 submitted 10 March, 2020;
originally announced March 2020.
-
Re-evaluation of the comparative effectiveness of bootstrap-based optimism correction methods in the development of multivariable clinical prediction models
Authors:
Katsuhiro Iba,
Tomohiro Shinozaki,
Kazushi Maruo,
Hisashi Noma
Abstract:
Multivariable predictive models are important statistical tools for providing synthetic diagnosis and prognostic algorithms based on multiple patients' characteristics. Their apparent discriminant and calibration measures usually have overestimation biases (known as 'optimism') relative to the actual performances for external populations. Existing statistical evidence and guidelines suggest that t…
▽ More
Multivariable predictive models are important statistical tools for providing synthetic diagnosis and prognostic algorithms based on multiple patients' characteristics. Their apparent discriminant and calibration measures usually have overestimation biases (known as 'optimism') relative to the actual performances for external populations. Existing statistical evidence and guidelines suggest that three bootstrap-based bias correction methods are preferable in practice, namely Harrell's bias correction and the .632 and .632+ estimators. Although Harrell's method has been widely adopted in clinical studies, simulation-based evidence indicates that the .632+ estimator may perform better than the other two methods. However, there is limited evidence and these methods' actual comparative effectiveness is still unclear. In this article, we conducted extensive simulations to compare the effectiveness of these methods, particularly using the following modern regression models: conventional logistic regression, stepwise variable selections, Firth's penalized likelihood method, ridge, lasso, and elastic-net. Under relatively large sample settings, the three bootstrap-based methods were comparable and performed well. However, all three methods had biases under small sample settings, and the directions and sizes of the biases were inconsistent. In general, the .632+ estimator is recommended, but we provide several notes concerning the operating characteristics of each method.
△ Less
Submitted 5 March, 2020;
originally announced March 2020.
-
Outlier detection and influence diagnostics in network meta-analysis
Authors:
Hisashi Noma,
Masahiko Gosho,
Ryota Ishii,
Koji Oba,
Toshi A. Furukawa
Abstract:
Network meta-analysis has been gaining prominence as an evidence synthesis method that enables the comprehensive synthesis and simultaneous comparison of multiple treatments. In many network meta-analyses, some of the constituent studies may have markedly different characteristics from the others, and may be influential enough to change the overall results. The inclusion of these "outlying" studie…
▽ More
Network meta-analysis has been gaining prominence as an evidence synthesis method that enables the comprehensive synthesis and simultaneous comparison of multiple treatments. In many network meta-analyses, some of the constituent studies may have markedly different characteristics from the others, and may be influential enough to change the overall results. The inclusion of these "outlying" studies might lead to biases, yielding misleading results. In this article, we propose effective methods for detecting outlying and influential studies in a frequentist framework. In particular, we propose suitable influence measures for network meta-analysis models that involve missing outcomes and adjust the degree of freedoms appropriately. We propose three influential measures by a leave-one-trial-out cross-validation scheme: (1) comparison-specific studentized residual, (2) relative change measure for covariance matrix of the comparative effectiveness parameters, (3) relative change measure for heterogeneity covariance matrix. We also propose (4) a model-based approach using a likelihood ratio statistic by a mean-shifted outlier detection model. We illustrate the effectiveness of the proposed methods via applications to a network meta-analysis of antihypertensive drugs. Using the four proposed methods, we could detect three potential influential trials involving an obvious outlier that was retracted because of data falsifications. We also demonstrate that the overall results of comparative efficacy estimates and the ranking of drugs were altered by omitting these three influential studies.
△ Less
Submitted 29 October, 2019;
originally announced October 2019.
-
Frequentist performances of Bayesian prediction intervals for random-effects meta-analysis
Authors:
Yuta Hamaguchi,
Hisashi Noma,
Kengo Nagashima,
Tomohide Yamada,
Toshi A. Furukawa
Abstract:
The prediction interval has been increasingly used in meta-analyses as a useful measure for assessing the magnitude of treatment effect and between-studies heterogeneity. In calculations of the prediction interval, although the Higgins-Thompson-Spiegelhalter method is used most often in practice, it might not have adequate coverage probability for the true treatment effect of a future study under…
▽ More
The prediction interval has been increasingly used in meta-analyses as a useful measure for assessing the magnitude of treatment effect and between-studies heterogeneity. In calculations of the prediction interval, although the Higgins-Thompson-Spiegelhalter method is used most often in practice, it might not have adequate coverage probability for the true treatment effect of a future study under realistic situations. An effective alternative candidate is the Bayesian prediction interval, which has also been widely used in general prediction problems. However, these prediction intervals are constructed based on the Bayesian philosophy, and their frequentist validities are only justified by large-sample approximations even if non-informative priors are adopted. There has been no certain evidence that evaluated their frequentist performances under realistic situations of meta-analyses. In this study, we conducted extensive simulation studies to assess the frequentist coverage performances of Bayesian prediction intervals with 11 non-informative prior distributions under general meta-analysis settings. Through these simulation studies, we found that frequentist coverage performances strongly depended on what prior distributions were adopted. In addition, when the number of studies was smaller than 10, there were no prior distributions that retained accurate frequentist coverage properties. We also illustrated these methods via applications to eight real meta-analysis datasets. The resultant prediction intervals also differed according to the adopted prior distributions. Inaccurate prediction intervals may provide invalid evidence and misleading conclusions. Thus, if frequentist accuracy is required, Bayesian prediction intervals should be used cautiously in practice.
△ Less
Submitted 30 June, 2019;
originally announced July 2019.
-
Bayesian influence diagnostics and outlier detection for meta-analysis of diagnostic test accuracy
Authors:
Yuki Matsushima,
Hisashi Noma,
Tomohide Yamada,
Toshi A. Furukawa
Abstract:
Meta-analyses of diagnostic test accuracy (DTA) studies have been gaining prominence in research in clinical epidemiology and health technology development. In these DTA meta-analyses, some studies may have markedly different characteristics from the others, and potentially be inappropriate to include. The inclusion of these "outlying" studies might lead to biases, yielding misleading results. In…
▽ More
Meta-analyses of diagnostic test accuracy (DTA) studies have been gaining prominence in research in clinical epidemiology and health technology development. In these DTA meta-analyses, some studies may have markedly different characteristics from the others, and potentially be inappropriate to include. The inclusion of these "outlying" studies might lead to biases, yielding misleading results. In addition, there might be influential studies that have notable impacts on the results. In this article, we propose Bayesian methods for detecting outlying studies and their influence diagnostics in DTA meta-analyses. Synthetic influence measures based on the bivariate hierarchical Bayesian random effects models are developed because the overall influences of individual studies should be simultaneously assessed by the two outcome variables and their correlation information. We propose four synthetic measures for influence analyses: (1) relative distance, (2) standardized residual, (3) Bayesian p-value, and (4) influence statistic on the area under the summary receiver operating characteristic curve. We also show conventional univariate Bayesian influential measures can be applied to the bivariate random effects models, which can be used as marginal influential measures. We illustrate the effectiveness of the proposed methods by applying them to a DTA meta-analysis of ultrasound in screening for vesicoureteral reflux among children with urinary tract infections.
△ Less
Submitted 14 October, 2019; v1 submitted 25 June, 2019;
originally announced June 2019.
-
Efficient screening of predictive biomarkers for individual treatment selection
Authors:
Shonosuke Sugasawa,
Hisashi Noma
Abstract:
The development of molecular diagnostic tools to achieve individualized medicine requires identifying predictive biomarkers associated with subgroups of individuals who might receive beneficial or harmful effects from different available treatments. However, due to the large number of candidate biomarkers in the large-scale genetic and molecular studies, and complex relationships among clinical ou…
▽ More
The development of molecular diagnostic tools to achieve individualized medicine requires identifying predictive biomarkers associated with subgroups of individuals who might receive beneficial or harmful effects from different available treatments. However, due to the large number of candidate biomarkers in the large-scale genetic and molecular studies, and complex relationships among clinical outcome, biomarkers and treatments, the ordinary statistical tests for the interactions between treatments and covariates have difficulties from their limited statistical powers. In this paper, we propose an efficient method for detecting predictive biomarkers. We employ weighted loss functions of Chen et al. (2017) to directly estimate individual treatment scores and propose synthetic posterior inference for effect sizes of biomarkers. We develop an empirical Bayes approach, namely, we estimate unknown hyperparameters in the prior distribution based on data. We then provide efficient screening methods for the candidate biomarkers via optimal discovery procedure with adequate control of false discovery rate. The proposed method is demonstrated in simulation studies and an application to a breast cancer clinical study in which the proposed method was shown to detect the much larger numbers of significant biomarkers than existing standard methods.
△ Less
Submitted 17 January, 2020; v1 submitted 4 May, 2019;
originally announced May 2019.
-
Permutation inference methods for multivariate meta-analysis
Authors:
Hisashi Noma,
Kengo Nagashima,
Toshi A. Furukawa
Abstract:
Multivariate meta-analysis is gaining prominence in evidence synthesis research because it enables simultaneous synthesis of multiple correlated outcome data, and random-effects models have generally been used for addressing between-studies heterogeneities. However, coverage probabilities of confidence regions or intervals for standard inference methods for random-effects models (e.g., restricted…
▽ More
Multivariate meta-analysis is gaining prominence in evidence synthesis research because it enables simultaneous synthesis of multiple correlated outcome data, and random-effects models have generally been used for addressing between-studies heterogeneities. However, coverage probabilities of confidence regions or intervals for standard inference methods for random-effects models (e.g., restricted maximum likelihood estimation) cannot retain their nominal confidence levels in general, especially when the number of synthesized studies is small because their validities depend on large sample approximations. In this article, we provide permutation-based inference methods that enable exact joint inferences for average outcome measures without large sample approximations. We also provide accurate marginal inference methods under general settings of multivariate meta-analyses. We propose effective approaches for permutation inferences using optimal weighting based on the efficient score statistic. The effectiveness of the proposed methods is illustrated via applications to bivariate meta-analyses of diagnostic accuracy studies for airway eosinophilia in asthma and a network meta-analysis for antihypertensive drugs on incident diabetes, as well as through simulation experiments. In numerical evaluations performed via simulations, our methods generally provided accurate confidence regions or intervals under a broad range of settings, whereas the current standard inference methods exhibited serious undercoverage properties.
△ Less
Submitted 30 July, 2019; v1 submitted 11 September, 2018;
originally announced September 2018.
-
An efficient and robust method for analyzing population pharmacokinetic data in genome-wide pharmacogenomic studies: a generalized estimating equation approach
Authors:
Kengo Nagashima,
Yasunori Sato,
Hisashi Noma,
Chikuma Hamada
Abstract:
Powerful array-based single-nucleotide polymorphism--typing platforms have recently heralded a new era in which genome-wide studies are conducted with increasing frequency. A genetic polymorphism associated with population pharmacokinetics (PK) is typically analyzed using nonlinear mixed-effect models (NLMM). Applying NLMM to large-scale data, such as those generated by genome-wide studies, raises…
▽ More
Powerful array-based single-nucleotide polymorphism--typing platforms have recently heralded a new era in which genome-wide studies are conducted with increasing frequency. A genetic polymorphism associated with population pharmacokinetics (PK) is typically analyzed using nonlinear mixed-effect models (NLMM). Applying NLMM to large-scale data, such as those generated by genome-wide studies, raises several issues related to the assumption of random effects, as follows: (i) Computation time: it takes a long time to compute the marginal likelihood. (ii) Convergence of iterative calculation: an adaptive Gauss-Hermite quadrature is generally used to estimate NLMM; however, iterative calculations may not converge in complex models. (iii) Random-effects misspecification leads to slightly inflated type-I error rates. As an alternative effective approach to resolving these issues, in this article we propose a generalized estimating equation (GEE) approach for analyzing population PK data. In general, GEE analysis does not account for inter-individual variability in PK parameters; therefore, the usual GEE estimators cannot be interpreted straightforwardly, and their validities have not been justified. Here, we propose valid inference methods for using GEE even under conditions of inter-individual variability, and provide theoretical justifications of the proposed GEE estimators for population PK data. In numerical evaluations by simulations, the proposed GEE approach exhibited high computational speed and stability relative to the NLMM approach. Furthermore, the NLMM analysis was sensitive to the misspecification of the random-effects distribution, and the proposed GEE inference is valid for any distributional form. An illustration is provided using data from a genome-wide pharmacogenomic study of an anticancer drug.
△ Less
Submitted 14 May, 2018;
originally announced May 2018.
-
Prediction intervals for random-effects meta-analysis: a confidence distribution approach
Authors:
Kengo Nagashima,
Hisashi Noma,
Toshi A. Furukawa
Abstract:
For the inference of random-effects models in meta-analysis, the prediction interval was proposed as a summary measure of the treatment effects that explains the heterogeneity in the target population. While the Higgins-Thompson-Spiegelhalter (HTS) plug-in-type prediction interval has been widely used, in which the heterogeneity parameter is replaced with its point estimate, its validity depends o…
▽ More
For the inference of random-effects models in meta-analysis, the prediction interval was proposed as a summary measure of the treatment effects that explains the heterogeneity in the target population. While the Higgins-Thompson-Spiegelhalter (HTS) plug-in-type prediction interval has been widely used, in which the heterogeneity parameter is replaced with its point estimate, its validity depends on a large sample approximation. Most meta-analyses, however, include less than 20 studies. It has been revealed that the validity of the HTS method is not assured under realistic situations, but no solution to this problem has been proposed in literature. Therefore, in this article, we describe our proposed prediction interval. Instead of using the plug-in scheme, we developed a bootstrap approach using an exact confidence distribution to account for the uncertainty in estimation of the heterogeneity parameter. Compared to the HTS method, the proposed method provides an accurate prediction interval that adequately explains the heterogeneity of treatment effects and the statistical error. Simulation studies demonstrated that the HTS method had poor coverage performance; by contrast, the coverage probabilities for the proposed method satisfactorily retained the nominal level. Applications to three published random-effects meta-analyses are presented.
△ Less
Submitted 12 June, 2019; v1 submitted 3 April, 2018;
originally announced April 2018.
-
A Unified Method for Improved Inference in Random-effects Meta-analysis
Authors:
Shonosuke Sugasawa,
Hisashi Noma
Abstract:
Random-effects meta-analyses have been widely applied in evidence synthesis for various types of medical studies. However, standard inference methods (e.g. restricted maximum likelihood estimation) usually underestimate statistical errors and possibly provide highly overconfident results under realistic situations; for instance, coverage probabilities of confidence intervals can be substantially b…
▽ More
Random-effects meta-analyses have been widely applied in evidence synthesis for various types of medical studies. However, standard inference methods (e.g. restricted maximum likelihood estimation) usually underestimate statistical errors and possibly provide highly overconfident results under realistic situations; for instance, coverage probabilities of confidence intervals can be substantially below the nominal level. The main reason is that these inference methods rely on large sample approximations even though the number of synthesized studies is usually small or moderate in practice. In this article we solve this problem using a unified inference method based on Monte Carlo conditioning for broad application to random-effects meta-analysis. The developed method provides improved confidence intervals with coverage probabilities that are closer to the nominal level than standard methods. As specific applications, we provide new inference procedures for three types of meta-analysis: conventional univariate meta-analysis for pairwise treatment comparisons, meta-analysis of diagnostic test accuracy, and multiple treatment comparisons via network meta-analysis. We also illustrate the practical effectiveness of these methods via real data applications and simulation studies.
△ Less
Submitted 9 May, 2019; v1 submitted 16 November, 2017;
originally announced November 2017.
