-
Enriching meta-analyses through scoping review, bibliometrics, and alternative impact metrics: Visualizing study characteristics, hidden risk of bias, societal influence, and research translation
Authors:
Yefeng Yang,
Malgorzata Lagisz,
Shinichi Nakagawa
Abstract:
We present a framework consisting of three approaches that can enhance meta-analyses: 1) scoping reviews (evidence map), 2) bibliometrics, and 3) alternative impact metrics. These three "enrichment" approaches facilitate the research synthesis of both quantitative and qualitative evidence, along with academic and non-academic influences. While the meta-analysis yields quantitative insights (e.g.,…
▽ More
We present a framework consisting of three approaches that can enhance meta-analyses: 1) scoping reviews (evidence map), 2) bibliometrics, and 3) alternative impact metrics. These three "enrichment" approaches facilitate the research synthesis of both quantitative and qualitative evidence, along with academic and non-academic influences. While the meta-analysis yields quantitative insights (e.g., overall estimates), the enrichment analyses provide user-friendly summaries of qualitative information on the evidence base. Scoping reviews can visualize study characteristics, unravelling knowledge gaps and methodological differences. Bibliometric analysis offers a visual assessment of the non-independent evidence, such as hyper-dominant authors and countries, and funding sources, potentially informing the risk of bias. Impact metric analysis employs alternative metrics to gauge societal influence and research translation (e.g., policy and patent citations) of studies in the meta-analysis. To illustrate the application of this framework, we provide sample visualizations and R code.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Four principles for improved statistical ecology
Authors:
Gordana Popovic,
Tanya J. Mason,
Tiago A. Marques,
Joanne Potts,
Szymon M. Drobniak,
Rocío Joo,
Res Altwegg,
Carolyn C. I. Burns,
Michael A. McCarthy,
Alison Johnston,
Shinichi Nakagawa,
Louise McMillan,
Kadambari Devarajan,
Patrick l. Taggart,
Alison C. Wunderlich,
Magdalena M. Mair,
Juan Andrés Martínez-Lanfranco,
Malgorzata Lagisz,
Patrice P. Pottier
Abstract:
Increasing attention has been drawn to the misuse of statistical methods over recent years, with particular concern about the prevalence of practices such as poor experimental design, cherry-picking and inadequate reporting. These failures are largely unintentional and no more common in ecology than in other scientific disciplines, with many of them easily remedied given the right guidance.
Orig…
▽ More
Increasing attention has been drawn to the misuse of statistical methods over recent years, with particular concern about the prevalence of practices such as poor experimental design, cherry-picking and inadequate reporting. These failures are largely unintentional and no more common in ecology than in other scientific disciplines, with many of them easily remedied given the right guidance.
Originating from a discussion at the 2020 International Statistical Ecology Conference, we show how ecologists can build their research following four guiding principles for impactful statistical research practices: 1. Define a focused research question, then plan sampling and analysis to answer it; 2. Develop a model that accounts for the distribution and dependence of your data; 3. Emphasise effect sizes to replace statistical significance with ecological relevance; 4. Report your methods and findings in sufficient detail so that your research is valid and reproducible.
Listed in approximate order of importance, these principles provide a framework for experimental design and reporting that guards against unsound practices. Starting with a well-defined research question allows researchers to create an efficient study to answer it, and guards against poor research practices that lead to false positives and poor replicability. Correct and appropriate statistical models give sound conclusions, good reporting practices and a focus on ecological relevance make results impactful and replicable.
Illustrated with an example from a recent study into the impact of disturbance on upland swamps, this paper explains the rationale for the selection and use of effective statistical practices and provides practical guidance for ecologists seeking to improve their use of statistical methods.
△ Less
Submitted 2 February, 2023;
originally announced February 2023.
-
Approximation to probability density functions in sampling distributions based on Fourier cosine series
Authors:
Shigekazu Nakagawa,
Hiroki Hashiguchi,
Yoko Ono
Abstract:
We derive a simple and precise approximation to probability density functions in sampling distributions based on the Fourier cosine series. After clarifying the required conditions, we illustrate the approximation on two examples: the distribution of the sum of uniformly distributed random variables, and the distribution of sample skewness drawn from a normal population. The probability density fu…
▽ More
We derive a simple and precise approximation to probability density functions in sampling distributions based on the Fourier cosine series. After clarifying the required conditions, we illustrate the approximation on two examples: the distribution of the sum of uniformly distributed random variables, and the distribution of sample skewness drawn from a normal population. The probability density function of the first example can be explicitly expressed, but that of the second example has no explicit expression.
△ Less
Submitted 26 April, 2021; v1 submitted 22 March, 2021;
originally announced March 2021.
-
A measure of skewness for testing departures from normality
Authors:
Shigekazu Nakagawa,
Hiroki Hashiguchi,
Naoto Niki
Abstract:
We propose a new skewness test statistic for normality based on the Pearson measure of skewness. We obtain asymptotic first four moments of the null distribution for this statistic by using a computer algebra system and its normalizing transformation based on the Johnson $S_{U}$ system. Finally the performance of the proposed statistic is shown by comparing the powers of several skewness test stat…
▽ More
We propose a new skewness test statistic for normality based on the Pearson measure of skewness. We obtain asymptotic first four moments of the null distribution for this statistic by using a computer algebra system and its normalizing transformation based on the Johnson $S_{U}$ system. Finally the performance of the proposed statistic is shown by comparing the powers of several skewness test statistics against some alternative hypotheses.
△ Less
Submitted 23 February, 2012;
originally announced February 2012.
