Showing 1–11 of 11 results for author: D'Agostini, G

Fits, and especially linear fits, with errors on both axes, extra variance of the data points and other complications

Authors: G. D'Agostini

Abstract: The aim of this paper, triggered by some discussions in the astrophysics community raised by astro-ph/0508529, is to introduce the issue of `fits' from a probabilistic perspective (also known as Bayesian), with special attention to the construction of model that describes the `network of dependences' (a Bayesian network) that connects experimental observations to model parameters and upon which… ▽ More The aim of this paper, triggered by some discussions in the astrophysics community raised by astro-ph/0508529, is to introduce the issue of `fits' from a probabilistic perspective (also known as Bayesian), with special attention to the construction of model that describes the `network of dependences' (a Bayesian network) that connects experimental observations to model parameters and upon which the probabilistic inference relies. The particular case of linear fit with errors on both axes and extra variance of the data points around the straight line (i.e. not accounted by the experimental errors) is shown in detail. Some questions related to the use of linear fit formulas to log-linearized exponential and power laws are also sketched, as well as the issue of systematic errors. △ Less

Submitted 21 November, 2005; originally announced November 2005.

Comments: 20 pages, 4 figures, hyperlinked bibliography in pdf version

From Observations to Hypotheses: Probabilistic Reasoning Versus Falsificationism and its Statistical Variations

Authors: G. D'Agostini

Abstract: Testing hypotheses is an issue of primary importance in the scientific research, as well as in many other human activities. Much clarification about it can be achieved if the process of learning from data is framed in a stochastic model of causes and effects. Formulated with Poincare's words, the "essential problem of the experimental method" becomes then solving a "problem in the probability of… ▽ More Testing hypotheses is an issue of primary importance in the scientific research, as well as in many other human activities. Much clarification about it can be achieved if the process of learning from data is framed in a stochastic model of causes and effects. Formulated with Poincare's words, the "essential problem of the experimental method" becomes then solving a "problem in the probability of causes", i.e. ranking the several hypotheses, that might be responsible for the observations, in credibility. This probabilistic approach to the problem (nowadays known as the Bayesian approach) differs from the standard (i.e. frequentistic) statistical methods of hypothesis tests. The latter methods might be seen as practical attempts of implementing the ideal of falsificationism, that can itself be viewed as an extension of the proof by contradiction of the classical logic to the experimental method. Some criticisms concerning conceptual as well as practical aspects of na\"ıve falsificationism and conventional, frequentistic hypothesis tests are presented, and the alternative, probabilistic approach is outlined. △ Less

Submitted 19 February, 2005; v1 submitted 22 December, 2004; originally announced December 2004.

Comments: 17 pages, 4 figures (V2 fixes some typos and adds a reference). Invited talk at the 2004 Vulcano Workshop on Frontier Objects in Astrophysics and Particle Physics, Vulcano (Italy) May 24-29, 2004. This paper and related work are also available at http://www.roma1.infn.it/~dagos/prob+stat.html

Inferring the success parameter p of a binomial model from small samples affected by background

Authors: G. D'Agostini

Abstract: The problem of inferring the binomial parameter p from x successes obtained in n trials is reviewed and extended to take into account the presence of background, that can affect the data in two ways: a) fake successes are due to a background modeled as a Poisson process of known intensity; b) fake trials are due to a background modeled as a Poisson process of known intensity, each trial being ch… ▽ More The problem of inferring the binomial parameter p from x successes obtained in n trials is reviewed and extended to take into account the presence of background, that can affect the data in two ways: a) fake successes are due to a background modeled as a Poisson process of known intensity; b) fake trials are due to a background modeled as a Poisson process of known intensity, each trial being characterized by a known success probability p_b. △ Less

Submitted 13 December, 2004; originally announced December 2004.

Comments: 24 pages, 12 figures. This paper and related work are also available at http://www.roma1.infn.it/~dagos/prob+stat.html

Asymmetric Uncertainties: Sources, Treatment and Potential Dangers

Authors: G. D'Agostini

Abstract: The issue of asymmetric uncertainties resulting from fits, nonlinear propagation and systematic effects is reviewed. It is shown that, in all cases, whenever a published result is given with asymmetric uncertainties, the value of the physical quantity of interest is biased with respect to what would be obtained using at best all experimental and theoretical information that contribute to evaluat… ▽ More The issue of asymmetric uncertainties resulting from fits, nonlinear propagation and systematic effects is reviewed. It is shown that, in all cases, whenever a published result is given with asymmetric uncertainties, the value of the physical quantity of interest is biased with respect to what would be obtained using at best all experimental and theoretical information that contribute to evaluate the combined uncertainty. The probabilistic solution to the problem is provided both in exact and in approximated forms. △ Less

Submitted 27 April, 2004; v1 submitted 17 March, 2004; originally announced March 2004.

Comments: 21 pages, 5 figures. improved version with some corrections, additional remarks and references (download of new version is recommended). This paper and related work are also available at http://www.roma1.infn.it/~dagos/prob+stat.html

Bayesian model comparison applied to the Explorer-Nautilus 2001 coincidence data

Authors: Pia Astone, Giulio D'Agostini, Sabrina D'Antonio

Abstract: Bayesian reasoning is applied to the data by the ROG Collaboration, in which gravitational wave (g.w.) signals are searched for in a coincidence experiment between Explorer and Nautilus. The use of Bayesian reasoning allows, under well defined hypotheses, even tiny pieces of evidence in favor of each model to be extracted from the data. The combination of the data of several experiments can ther… ▽ More Bayesian reasoning is applied to the data by the ROG Collaboration, in which gravitational wave (g.w.) signals are searched for in a coincidence experiment between Explorer and Nautilus. The use of Bayesian reasoning allows, under well defined hypotheses, even tiny pieces of evidence in favor of each model to be extracted from the data. The combination of the data of several experiments can therefore be performed in an optimal and efficient way. Some models for Galactic sources are considered and, within each model, the experimental result is summarized with the likelihood rescaled to the insensitivity limit value (``${\cal R}$ function''). The model comparison result is given in in terms of Bayes factors, which quantify how the ratio of beliefs about two alternative models are modified by the experimental observation △ Less

Submitted 16 June, 2003; v1 submitted 24 April, 2003; originally announced April 2003.

Comments: 16 pages, 4 figures. Presented at the GWDAW2002 conference, held in Kyoto on Dec.,2002. This version includes comments by the referees of CQG, which has accepted the paper for pubblication in the special issue of the conference. In particular, note that in Eq. 12 there was a typeset error. As suggested by one of the referees, a uniform prior in Log(alpha) has also been considered

Journal ref: Class.Quant.Grav. 20 (2003) S769-S784

Search for correlation between GRB's detected by BeppoSAX and gravitational wave detectors EXPLORER and NAUTILUS

Authors: P. Astone, M. Bassan, P. Bonifazi, P. Carelli, G. Castellano, E. Coccia, C. Cosmelli, G. D'Agostini, S. D'Antonio, V. Fafone, G. Federici, F. Frontera, C. Guidorzi, A. Marini, Y. Minenkov, I. Modena, G. Modestino, A. Moleti, E. Montanari, G. V. Pallottino, G. Pizzella, L. Quintieri, A. Rocchi, F. Ronga, A. Rocchi , et al. (3 additional authors not shown)

Abstract: Data obtained during five months of 2001 with the gravitational wave (GW) detectors EXPLORER and NAUTILUS were studied in correlation with the gamma ray burst data (GRB) obtained with the BeppoSAX satellite. During this period BeppoSAX was the only GRB satellite in operation, while EXPLORER and NAUTILUS were the only GW detectors in operation. No correlation between the GW data and the GRB bur… ▽ More Data obtained during five months of 2001 with the gravitational wave (GW) detectors EXPLORER and NAUTILUS were studied in correlation with the gamma ray burst data (GRB) obtained with the BeppoSAX satellite. During this period BeppoSAX was the only GRB satellite in operation, while EXPLORER and NAUTILUS were the only GW detectors in operation. No correlation between the GW data and the GRB bursts was found. The analysis, performed over 47 GRB's, excludes the presence of signals of amplitude h >=1.2 * 10^{-18}, with 95 % probability, if we allow a time delay between GW bursts and GRB within +-400 s, and h >= 6.5 * 10^{-19}, if the time delay is within +- 5 s. The result is also provided in form of scaled likelihood for unbiased interpretation and easier use for further analysis. △ Less

Submitted 12 July, 2002; v1 submitted 25 June, 2002; originally announced June 2002.

Comments: 14 pages, 7 figures. Latex file, compiled with cernik.cls (provided in the package)

Journal ref: Phys.Rev. D66 (2002) 102002

Sceptical combination of experimental results: General considerations and application to epsilon-prime/epsilon

Authors: G. D'Agostini

Abstract: This paper is meant as a contribution to the often debated subject of how to combine data which appear to be in mutual disagreement. As a practical example, the epsilon-prime/epsilon determinations have been considered. This paper is meant as a contribution to the often debated subject of how to combine data which appear to be in mutual disagreement. As a practical example, the epsilon-prime/epsilon determinations have been considered. △ Less

Submitted 18 October, 1999; originally announced October 1999.

Comments: 20 pages, 12 figures. This paper and related work are also available at http://www-zeus.roma1.infn.it/~agostini/prob+stat.html

Report number: CERN-EP/99-139

Inferring the intensity of Poisson processes at the limit of the detector sensitivity (with a case study on gravitational wave burst search)

Authors: P. Astone, G. D'Agostini

Abstract: We consider the issue of reporting the result of search experiment in the most unbiased and efficient way, i.e. in a way which allows an easy interpretation and combination of results and which do not depend on whether the experimenters believe or not to having found the searched-for effect. Since this work uses the language of Bayesian theory, to which most physicists are not used, we find that… ▽ More We consider the issue of reporting the result of search experiment in the most unbiased and efficient way, i.e. in a way which allows an easy interpretation and combination of results and which do not depend on whether the experimenters believe or not to having found the searched-for effect. Since this work uses the language of Bayesian theory, to which most physicists are not used, we find that it could be useful to practitioners to have in a single paper a simple presentation of Bayesian inference, together with an example of application of it in search of rare processes. △ Less

Submitted 27 September, 1999; originally announced September 1999.

Comments: 36 pages, 11 figures, Latex files using cernart.cls (included). This paper and related work are also available at http://www-zeus.roma1.infn.it/~agostini/prob+stat.html

Report number: CERN-EP/99-126

Bayesian reasoning versus conventional statistics in High Energy Physics

Authors: G. D'Agostini

Abstract: The intuitive reasoning of physicists in conditions of uncertainty is closer to the Bayesian approach than to the frequentist ideas taught at University and which are considered the reference framework for handling statistical problems. The combination of intuition and conventional statistics allows practitioners to get results which are very close, both in meaning and in numerical value, to tho… ▽ More The intuitive reasoning of physicists in conditions of uncertainty is closer to the Bayesian approach than to the frequentist ideas taught at University and which are considered the reference framework for handling statistical problems. The combination of intuition and conventional statistics allows practitioners to get results which are very close, both in meaning and in numerical value, to those obtainable by Bayesian methods, at least in simple routine applications. There are, however, cases in which ``arbitrary'' probability inversions produce unacceptable or misleading results and in these cases the conscious application of Bayesian reasoning becomes crucial. Starting from these considerations, I will finally comment on the often debated question: ``is there any chance that all physicists will become Bayesian?'' △ Less

Submitted 24 November, 1998; originally announced November 1998.

Comments: 14 pages, LateX, Invited talk at the XVIII International Workshop on "Maximum Entropy and Bayesian Methods" (Maxent98), Garching/Munich, (Germany), July 27-31 1998. This paper and related work are also available at the author's web page http://www-zeus.roma1.infn.it/~agostini/

A Theory of Measurement Uncertainty Based on Conditional Probability

Authors: G. D'Agostini

Abstract: A theory of measurement uncertainty is presented, which, since it is based exclusively on the Bayesian approach and on the subjective concept of conditional probability, is applicable in the most general cases. The recent International Organization for Standardization (ISO) recommendation on measurement uncertainty is reobtained as the limit case in which linearization is meaningful and one is… ▽ More A theory of measurement uncertainty is presented, which, since it is based exclusively on the Bayesian approach and on the subjective concept of conditional probability, is applicable in the most general cases. The recent International Organization for Standardization (ISO) recommendation on measurement uncertainty is reobtained as the limit case in which linearization is meaningful and one is interested only in the best estimates of the quantities and in their variances. △ Less

Submitted 21 November, 1996; originally announced November 1996.

Comments: 9 pages, latex, to appear in the proceedings of the "1996 Joint Statistical Meetings"

Report number: Roma1 N. 1079, November 1996

Probability and Measurement Uncertainty in Physics - a Bayesian Primer

Authors: G. D'Agostini

Abstract: Bayesian statistics is based on the subjective definition of probability as {\it ``degree of belief''} and on Bayes' theorem, the basic tool for assigning probabilities to hypotheses combining {\it a priori} judgements and experimental information. This was the original point of view of Bayes, Bernoulli, Gauss, Laplace, etc. and contrasts with later ``conventional'' (pseudo-)definitions of proba… ▽ More Bayesian statistics is based on the subjective definition of probability as {\it ``degree of belief''} and on Bayes' theorem, the basic tool for assigning probabilities to hypotheses combining {\it a priori} judgements and experimental information. This was the original point of view of Bayes, Bernoulli, Gauss, Laplace, etc. and contrasts with later ``conventional'' (pseudo-)definitions of probabilities, which implicitly presuppose the concept of probability. These notes show that the Bayesian approach is the natural one for data analysis in the most general sense, and for assigning uncertainties to the results of physical measurements - while at the same time resolving philosophical aspects of the problems. The approach, although little known and usually misunderstood among the High Energy Physics community, has become the standard way of reasoning in several fields of research and has recently been adopted by the international metrology organizations in their recommendations for assessing measurement uncertainty. These notes describe a general model for treating uncertainties originating from random and systematic errors in a consistent way and include examples of applications of the model in High Energy Physics, e.g. ``confidence intervals'' in different contexts, upper/lower limits, treatment of ``systematic errors'', hypothesis tests and unfolding. △ Less

Submitted 14 December, 1995; v1 submitted 11 December, 1995; originally announced December 1995.

Comments: 100 pages, 13 figures; 3.4 MB PostScript also available at http://zow00.desy.de:8000/zeus_papers/ZEUS_PAPERS/DESY-95-242.ps

Report number: DESY 95-242, Roma1 N.1070