A Tutorial on Fisher Information
Authors:
Alexander Ly,
Maarten Marsman,
Josine Verhagen,
Raoul Grasman,
Eric-Jan Wagenmakers
Abstract:
In many statistical applications that concern mathematical psychologists, the concept of Fisher information plays an important role. In this tutorial we clarify the concept of Fisher information as it manifests itself across three different statistical paradigms. First, in the frequentist paradigm, Fisher information is used to construct hypothesis tests and confidence intervals using maximum like…
▽ More
In many statistical applications that concern mathematical psychologists, the concept of Fisher information plays an important role. In this tutorial we clarify the concept of Fisher information as it manifests itself across three different statistical paradigms. First, in the frequentist paradigm, Fisher information is used to construct hypothesis tests and confidence intervals using maximum likelihood estimators; second, in the Bayesian paradigm, Fisher information is used to define a default prior; lastly, in the minimum description length paradigm, Fisher information is used to measure model complexity.
△ Less
Submitted 17 October, 2017; v1 submitted 2 May, 2017;
originally announced May 2017.
Unidimensional factor models imply weaker partial correlations than zero-order correlations
Authors:
Riet van Bork,
Raoul P. P. P. Grasman,
Lourens J. Waldorp
Abstract:
In a unidimensional factor model it is assumed that the set of indicators that loads on this factor are conditionally independent given the latent factor. Two indicators are, however, never conditionally independent given (a set of) other indicators that load on this factor, as this would require one of the indicators that is conditioned on to correlate one with the latent factor. Although partial…
▽ More
In a unidimensional factor model it is assumed that the set of indicators that loads on this factor are conditionally independent given the latent factor. Two indicators are, however, never conditionally independent given (a set of) other indicators that load on this factor, as this would require one of the indicators that is conditioned on to correlate one with the latent factor. Although partial correlations between two indicators given the other indicators can thus never equal zero (Holland and Rosenbaum, 1986), we show in this paper that the partial correlations do need to be always weaker than the zero-order correlations. More precisely, we prove that the partial correlation between two observed variables that load on one factor given all other observed variables that load on this factor, is always closer to zero than the zero-order correlation between these two variables.
△ Less
Submitted 12 October, 2016; v1 submitted 11 October, 2016;
originally announced October 2016.