Showing 1–29 of 29 results for author: Caticha, A

Entropic Density Functional Theory

Authors: Ahmad Yousefi, Ariel Caticha

Abstract: A formulation of the density functional theory is constructed on the foundations of entropic inference. The theory is introduced as an application of maximum entropy for inhomogeneous fluids in thermal equilibrium. It is shown that entropic inference produces the variational principle of DFT when information about the expected density of particles is imposed. This process introduces a family of tr… ▽ More A formulation of the density functional theory is constructed on the foundations of entropic inference. The theory is introduced as an application of maximum entropy for inhomogeneous fluids in thermal equilibrium. It is shown that entropic inference produces the variational principle of DFT when information about the expected density of particles is imposed. This process introduces a family of trial density-parametrized density matrices from which the preferred density matrix is found using the method of quantum maximum entropy. As illustrations some known approximation schemes of the theory are discussed. △ Less

Submitted 28 December, 2023; v1 submitted 21 July, 2022; originally announced July 2022.

Journal ref: Entropy 2024, 26, 10

An Entropic Approach To Classical Density Functional Theory

Authors: Ahmad Yousefi, Ariel Caticha

Abstract: The classical Density Functional Theory (DFT) is introduced as an application of entropic inference for inhomogeneous fluids at thermal equilibrium. It is shown that entropic inference reproduces the variational principle of DFT when information about expected density of particles is imposed. This process introduces an intermediate family of trial density-parametrized probability distributions, an… ▽ More The classical Density Functional Theory (DFT) is introduced as an application of entropic inference for inhomogeneous fluids at thermal equilibrium. It is shown that entropic inference reproduces the variational principle of DFT when information about expected density of particles is imposed. This process introduces an intermediate family of trial density-parametrized probability distributions, and consequently an intermediate entropy, from which the preferred one is found using the method of Maximum Entropy (MaxEnt). As an application, the DFT model for slowly varying density is provided, and its approximation scheme is discussed. △ Less

Submitted 12 September, 2021; v1 submitted 3 August, 2021; originally announced August 2021.

Comments: 8 pages, no figures

Entropic dynamics on Gibbs statistical manifolds

Authors: Pedro Pessoa, Felipe Xavier Costa, Ariel Caticha

Abstract: Entropic dynamics is a framework in which the laws of dynamics are derived as an application of entropic methods of inference. Its successes include the derivation of quantum mechanics and quantum field theory from probabilistic principles. Here we develop the entropic dynamics of a system the state of which is described by a probability distribution. Thus, the dynamics unfolds on a statistical ma… ▽ More Entropic dynamics is a framework in which the laws of dynamics are derived as an application of entropic methods of inference. Its successes include the derivation of quantum mechanics and quantum field theory from probabilistic principles. Here we develop the entropic dynamics of a system the state of which is described by a probability distribution. Thus, the dynamics unfolds on a statistical manifold which is automatically endowed by a metric structure provided by information geometry. The curvature of the manifold has a significant influence. We focus our dynamics on the statistical manifold of Gibbs distributions (also known as canonical distributions or the exponential family). The model includes an "entropic" notion of time that is tailored to the system under study; the system is its own clock. As one might expect, entropic time is intrinsically directional; there is a natural arrow of time which is lead by entropic considerations. As illustrative examples we discuss dynamics on a space of Gaussians and the discrete 3-state system. △ Less

Submitted 15 April, 2021; v1 submitted 11 August, 2020; originally announced August 2020.

Journal ref: Entropy 2021, 23(5), 494

Exact Renormalization Groups as a form of Entropic Dynamics

Authors: Pedro Pessoa, Ariel Caticha

Abstract: The Renormalization Group (RG) is a set of methods that have been instrumental in tackling problems involving an infinite number of degrees of freedom. What all these methods have in common -- which is what explains their success -- is that they allow a systematic search for those degrees of freedom that happen to be relevant to the phenomena in question. In the standard approaches the RG transfor… ▽ More The Renormalization Group (RG) is a set of methods that have been instrumental in tackling problems involving an infinite number of degrees of freedom. What all these methods have in common -- which is what explains their success -- is that they allow a systematic search for those degrees of freedom that happen to be relevant to the phenomena in question. In the standard approaches the RG transformations are implemented by either coarse graining or by changes of variables. When these transformations are infinitesimal the formalism can be described as a continuous dynamical flow in a fictitious time parameter. It is generally the case that these exact RG equations are functional diffusion equations. In this paper we show that the exact RG equations can be derived using entropic methods. The RG flow is then described as a form of entropic dynamics of field configurations. Although equivalent to other versions of the RG, in this approach the RG transformations receive a purely inferential interpretation that establishes a clear link to information theory. △ Less

Submitted 6 December, 2017; originally announced December 2017.

Comments: Presented at MaxEnt 2017, the 37th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (July 9-14, 2017, Jarinu, Brazil)

Journal ref: Entropy 2018, 20(1), 25

Entropic Dynamics: Mechanics without Mechanism

Authors: Ariel Caticha

Abstract: Entropic Dynamics is a framework in which dynamical laws such as those that arise in physics are derived as an application of entropic methods of inference. No underlying action principle is postulated. Instead, the dynamics is driven by entropy subject to constraints reflecting the information that is relevant to the problem at hand. In this work I review the derivation of quantum theory but the… ▽ More Entropic Dynamics is a framework in which dynamical laws such as those that arise in physics are derived as an application of entropic methods of inference. No underlying action principle is postulated. Instead, the dynamics is driven by entropy subject to constraints reflecting the information that is relevant to the problem at hand. In this work I review the derivation of quantum theory but the fact that Entropic Dynamics is based on inference methods that are of universal applicability suggests that it may be possible to adapt these methods to fields other than physics. △ Less

Submitted 21 February, 2018; v1 submitted 9 April, 2017; originally announced April 2017.

Comments: Invited chapter to appear in "Recent Advances in Info-Metrics" edited by M. Chen and A. Golan. Version 2 includes an improved treatment of the prior and added remarks on the differences between Entropic Dynamics and hidden-variable theories. arXiv admin note: text overlap with arXiv:1509.03222

Changes of Variables and the Renormalization Group

Authors: Ariel Caticha

Abstract: A class of exact infinitesimal renormalization group transformations is proposed and studied. These transformations are pure changes of variables (i.e., no integration or elimination of some degrees of freedom is required) such that a saddle point approximation is more accurate, becoming, in some cases asymptotically exact as the transformations are iterated. The formalism provides a simplified an… ▽ More A class of exact infinitesimal renormalization group transformations is proposed and studied. These transformations are pure changes of variables (i.e., no integration or elimination of some degrees of freedom is required) such that a saddle point approximation is more accurate, becoming, in some cases asymptotically exact as the transformations are iterated. The formalism provides a simplified and unified approach to several known renormalization groups. It also suggests some new ways in which renormalization group methods might successfully be applied. In particular, an exact gauge covariant renormalization group transformation is constructed. Solutions for a scalar field theory are obtained both as an expansion in ε=4-d and as an expansion in a single coupling constant. △ Less

Submitted 6 November, 2017; v1 submitted 20 May, 2016; originally announced May 2016.

Comments: In v2 several typos have been corrected

Report number: Caltech preprint CALT-68-1099

Entropic Inference: some pitfalls and paradoxes we can avoid

Authors: Ariel Caticha

Abstract: The method of maximum entropy has been very successful but there are cases where it has either failed or led to paradoxes that have cast doubt on its general legitimacy. My more optimistic assessment is that such failures and paradoxes provide us with valuable learning opportunities to sharpen our skills in the proper way to deploy entropic methods. The central theme of this paper revolves around… ▽ More The method of maximum entropy has been very successful but there are cases where it has either failed or led to paradoxes that have cast doubt on its general legitimacy. My more optimistic assessment is that such failures and paradoxes provide us with valuable learning opportunities to sharpen our skills in the proper way to deploy entropic methods. The central theme of this paper revolves around the different ways in which constraints are used to capture the information that is relevant to a problem. This leads us to focus on four epistemically different types of constraints. I propose that the failure to recognize the distinctions between them is a prime source of errors. I explicitly discuss two examples. One concerns the dangers involved in replacing expected values with sample averages. The other revolves around misunderstanding ignorance. I discuss the Friedman-Shimony paradox as it is manifested in the three-sided die problem and also in its original thermodynamic formulation. △ Less

Submitted 31 December, 2012; originally announced December 2012.

Comments: 14 pages, 1 figure. Invited paper presented at MaxEnt 2012, The 32nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering, (July 15--20, 2012, Garching, Germany)

The Entropic Dynamics of Relativistic Quantum Fields

Authors: Ariel Caticha

Abstract: The formulation of quantum mechanics within the framework of entropic dynamics is extended to the domain of relativistic quantum fields. The result is a non-dissipative relativistic diffusion in the infinite dimensional space of field configurations. On extending the notion of entropic time to the relativistic regime we find that the field fluctuations provide the clock that sets the scale of dura… ▽ More The formulation of quantum mechanics within the framework of entropic dynamics is extended to the domain of relativistic quantum fields. The result is a non-dissipative relativistic diffusion in the infinite dimensional space of field configurations. On extending the notion of entropic time to the relativistic regime we find that the field fluctuations provide the clock that sets the scale of duration. We also find that the usual divergences that affect all quantum field theories do not refer to the real values of physical quantities but rather to epistemic quantities invariably associated to unphysical probability distributions such as variances and other measures of uncertainty. △ Less

Submitted 31 December, 2012; originally announced December 2012.

Comments: 10 pages. Presented at MaxEnt 2012, The 32nd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering, (July 15-20, 2012, Garching, Germany)

Entropic Time

Authors: Ariel Caticha

Abstract: The formulation of quantum mechanics within the framework of entropic dynamics includes several new elements. In this paper we concentrate on one of them: the implications for the theory of time. Entropic time is introduced as a book-keeping device to keep track of the accumulation of changes. One new feature is that, unlike other concepts of time appearing in the so-called fundamental laws of phy… ▽ More The formulation of quantum mechanics within the framework of entropic dynamics includes several new elements. In this paper we concentrate on one of them: the implications for the theory of time. Entropic time is introduced as a book-keeping device to keep track of the accumulation of changes. One new feature is that, unlike other concepts of time appearing in the so-called fundamental laws of physics, entropic time incorporates a natural distinction between past and future. △ Less

Submitted 2 November, 2010; originally announced November 2010.

Comments: Presented at MaxEnt 2010, the 30th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (July 4-9, 2010, Chamonix, France)

Journal ref: AIP Conf.Proc.1305:200-207,2011

Entropic Inference

Authors: Ariel Caticha

Abstract: In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for infer… ▽ More In this tutorial we review the essential arguments behing entropic inference. We focus on the epistemological notion of information and its relation to the Bayesian beliefs of rational agents. The problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), includes as special cases both MaxEnt and Bayes' rule, and therefore unifies the two themes of these workshops -- the Maximum Entropy and the Bayesian methods -- into a single general inference scheme. △ Less

Submitted 2 November, 2010; originally announced November 2010.

Comments: Presented at MaxEnt 2010, the 30th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (July 4-9, 2010, Chamonix, France)

From Entropic Dynamics to Quantum Theory

Authors: Ariel Caticha

Abstract: Non-relativistic quantum theory is derived from information codified into an appropriate statistical model. The basic assumption is that there is an irreducible uncertainty in the location of particles: positions constitute a configuration space and the corresponding probability distributions constitute a statistical manifold. The dynamics follows from a principle of inference, the method of Max… ▽ More Non-relativistic quantum theory is derived from information codified into an appropriate statistical model. The basic assumption is that there is an irreducible uncertainty in the location of particles: positions constitute a configuration space and the corresponding probability distributions constitute a statistical manifold. The dynamics follows from a principle of inference, the method of Maximum Entropy. The concept of time is introduced as a convenient way to keep track of change. A welcome feature is that the entropic dynamics notion of time incorporates a natural distinction between past and future. The statistical manifold is assumed to be a dynamical entity: its curved and evolving geometry determines the evolution of the particles which, in their turn, react back and determine the evolution of the geometry. Imposing that the dynamics conserve energy leads to the Schroedinger equation and to a natural explanation of its linearity, its unitarity, and of the role of complex numbers. The phase of the wave function is explained as a feature of purely statistical origin. There is a quantum analogue to the gravitational equivalence principle. △ Less

Submitted 12 February, 2010; v1 submitted 24 July, 2009; originally announced July 2009.

Comments: Extended and corrected version of a paper presented at MaxEnt 2009, the 29th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (July 5-10, 2009, Oxford, Mississippi, USA). In version v3 I corrected a mistake and considerably simplified the argument. The overall conclusions remain unchanged

Using Relative Entropy to Find Optimal Approximations: an Application to Simple Fluids

Authors: Chih-Yuan Tseng, Ariel Caticha

Abstract: We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a preferred approximation from within a family of trial parameterized distributions, and (b) to obtain the optimal approximation by marginalizing over parameters using… ▽ More We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a preferred approximation from within a family of trial parameterized distributions, and (b) to obtain the optimal approximation by marginalizing over parameters using the method of maximum entropy and information geometry. As an illustration we apply our method to simple fluids. The "exact" canonical distribution is approximated by that of a fluid of hard spheres. The proposed method first determines the preferred value of the hard-sphere diameter, and then obtains an optimal hard-sphere approximation by a suitably weighed average over different hard-sphere diameters. This leads to a considerable improvement in accounting for the soft-core nature of the interatomic potential. As a numerical demonstration, the radial distribution function and the equation of state for a Lennard-Jones fluid (argon) are compared with results from molecular dynamics simulations. △ Less

Submitted 29 August, 2008; originally announced August 2008.

Comments: 5 figures, accepted for publication in Physica A, 2008

Journal ref: Physica A387, 6759 (2008)

From Inference to Physics

Authors: Ariel Caticha

Abstract: Entropic dynamics, a program that aims at deriving the laws of physics from standard probabilistic and entropic rules for processing information, is developed further. We calculate the probability for an arbitrary path followed by a system as it moves from given initial to final states. For an appropriately chosen configuration space the path of maximum probability reproduces Newtonian dynamics. Entropic dynamics, a program that aims at deriving the laws of physics from standard probabilistic and entropic rules for processing information, is developed further. We calculate the probability for an arbitrary path followed by a system as it moves from given initial to final states. For an appropriately chosen configuration space the path of maximum probability reproduces Newtonian dynamics. △ Less

Submitted 8 August, 2008; originally announced August 2008.

Comments: Presented at MaxEnt 2008, the 28th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (July 8-13, 2008, Boraceia Beach, Sao Paulo, Brazil)

Lectures on Probability, Entropy, and Statistical Physics

Authors: Ariel Caticha

Abstract: These lectures deal with the problem of inductive inference, that is, the problem of reasoning under conditions of incomplete information. Is there a general method for handling uncertainty? Or, at least, are there rules that could in principle be followed by an ideally rational mind when discussing scientific matters? What makes one statement more plausible than another? How much more plausible… ▽ More These lectures deal with the problem of inductive inference, that is, the problem of reasoning under conditions of incomplete information. Is there a general method for handling uncertainty? Or, at least, are there rules that could in principle be followed by an ideally rational mind when discussing scientific matters? What makes one statement more plausible than another? How much more plausible? And then, when new information is acquired how do we change our minds? Or, to put it differently, are there rules for learning? Are there rules for processing information that are objective and consistent? Are they unique? And, come to think of it, what, after all, is information? It is clear that data contains or conveys information, but what does this precisely mean? Can information be conveyed in other ways? Is information physical? Can we measure amounts of information? Do we need to? Our goal is to develop the main tools for inductive inference--probability and entropy--from a thoroughly Bayesian point of view and to illustrate their use in physics with examples borrowed from the foundations of classical statistical physics. △ Less

Submitted 31 July, 2008; originally announced August 2008.

Comments: 170 pages. Invited lectures at MaxEnt 2008, the 28th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (July 8-13, 2008, Boraceia Beach, Sao Paulo, Brazil)

Information and Entropy

Authors: Ariel Caticha

Abstract: What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an elimin… ▽ More What is information? Is it physical? We argue that in a Bayesian theory the notion of information must be defined in terms of its effects on the beliefs of rational agents. Information is whatever constrains rational beliefs and therefore it is the force that induces us to change our minds. This problem of updating from a prior to a posterior probability distribution is tackled through an eliminative induction process that singles out the logarithmic relative entropy as the unique tool for inference. The resulting method of Maximum relative Entropy (ME), which is designed for updating from arbitrary priors given information in the form of arbitrary constraints, includes as special cases both MaxEnt (which allows arbitrary constraints) and Bayes' rule (which allows arbitrary priors). Thus, ME unifies the two themes of these workshops -- the Maximum Entropy and the Bayesian methods -- into a single general inference scheme that allows us to handle problems that lie beyond the reach of either of the two methods separately. I conclude with a couple of simple illustrative examples. △ Less

Submitted 4 October, 2007; originally announced October 2007.

Comments: Presented at MaxEnt 2007, the 27th International Workshop on Bayesian Inference and Maximum Entropy Methods (July 8-13, 2007, Saratoga Springs, New York, USA)

Updating Probabilities

Authors: Ariel Caticha, Adom Giffin

Abstract: We show that Skilling's method of induction leads to a unique general theory of inductive inference, the method of Maximum relative Entropy (ME). The main tool for updating probabilities is the logarithmic relative entropy; other entropies such as those of Renyi or Tsallis are ruled out. We also show that Bayes updating is a special case of ME updating and thus, that the two are completely compa… ▽ More We show that Skilling's method of induction leads to a unique general theory of inductive inference, the method of Maximum relative Entropy (ME). The main tool for updating probabilities is the logarithmic relative entropy; other entropies such as those of Renyi or Tsallis are ruled out. We also show that Bayes updating is a special case of ME updating and thus, that the two are completely compatible. △ Less

Submitted 17 August, 2006; originally announced August 2006.

Comments: Presented at MaxEnt 2006, the 26th International Workshop on Bayesian Inference and Maximum Entropy Methods (July 8-13, 2006, Paris, France)

Report number: UAlbany-Physics 001

Maximum Entropy and the Variational Method in Statistical Mechanics: an Application to Simple Fluids

Authors: Chih-Yuan Tseng, Ariel Caticha

Abstract: We develop the method of Maximum Entropy (ME) as a technique to generate approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a "best" approximation from within a family of trial distributions, and (b) to quantify the extent to which non-optimal trial distributions are ruled out. The Bog… ▽ More We develop the method of Maximum Entropy (ME) as a technique to generate approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a "best" approximation from within a family of trial distributions, and (b) to quantify the extent to which non-optimal trial distributions are ruled out. The Bogoliuvob variational method is shown to be included as a special case. As an illustration we apply our method to simple fluids. In a first use of the ME method the "exact" canonical distribution is approximated by that of a fluid of hard spheres and ME is used to select the optimal value of the hard-sphere diameter. A second, more refined application of the ME method approximates the "exact" distribution by a suitably weighed average over different hard-sphere diameters and leads to a considerable improvement in accounting for the soft-core nature of the interatomic potential. As a specific example, the radial distribution function and the equation of state for a Lennard-Jones fluid (Argon) are compared with results from molecular dynamics simulations. △ Less

Submitted 24 July, 2007; v1 submitted 25 November, 2004; originally announced November 2004.

Comments: 5 figures. Additional demonstrations on radial distribution functions and equation of states are added

Questions, relevance and relative entropy

Authors: Ariel Caticha

Abstract: What is a question? According to Cox a question can be identified with the set of assertions that constitute possible answers. In this paper we propose a different approach that combines the notion that questions are requests for information with the notion that probability distributions represent uncertainties resulting from lack of information. This suggests that to each probability distributi… ▽ More What is a question? According to Cox a question can be identified with the set of assertions that constitute possible answers. In this paper we propose a different approach that combines the notion that questions are requests for information with the notion that probability distributions represent uncertainties resulting from lack of information. This suggests that to each probability distribution one can naturally associate that particular question which requests the information that is missing and vice-versa. We propose to represent questions q by probability distributions Next we consider how questions relate to each other: to what extent is finding the answer to one question relevant to answering another? A natural measure of relevance is derived by requiring that it satisfy three desirable features (three axioms). We find that the relevance of a question q to another question Q turns out to be the relative entropy S[q,Q] of the corresponding distributions. An application to statistical physics is briefly considered. △ Less

Submitted 7 September, 2004; originally announced September 2004.

Comments: Presented at MaxEnt 2004, the 24th International Workshop on Bayesian Inference and Maximum Entropy Methods (July 25-30, 2004, Garching bei Munchen, Germany)

Journal ref: p. 429 in "Bayesian Inference and Maximum Entropy Methods in Science and Engineering" ed. by R. Fischer et al. (A.I.P. Vol. 735, 2004)

Maximum entropy approach to the theory of simple fluids

Authors: Chih-Yuan Tseng, Ariel Caticha

Abstract: We explore the use of the method of Maximum Entropy (ME) as a technique to generate approximations. In a first use of the ME method the "exact" canonical probability distribution of a fluid is approximated by that of a fluid of hard spheres; ME is used to select an optimal value of the hard-sphere diameter. These results coincide with the results obtained using the Bogoliuvob variational method.… ▽ More We explore the use of the method of Maximum Entropy (ME) as a technique to generate approximations. In a first use of the ME method the "exact" canonical probability distribution of a fluid is approximated by that of a fluid of hard spheres; ME is used to select an optimal value of the hard-sphere diameter. These results coincide with the results obtained using the Bogoliuvob variational method. A second more complete use of the ME method leads to a better descritption of the soft-core nature of the interatomic potential in terms of a statistical mixture of distributions corresponding to hard spheres of different diameters. As an example, the radial distribution function for a Lennard-Jones fluid (Argon) is compared with results from molecular dynamics simulations. There is a considerable improvement over the results obtained from the Bogoliuvob principle. △ Less

Submitted 30 October, 2003; v1 submitted 30 October, 2003; originally announced October 2003.

Comments: 14 pages and 4 figures. Presented at MaxEnt 2003, the 23rd International Workshop on Bayesian Inference and Maximum Entropy Methods (August 3-8, 2003, Jackson Hole, WY, USA)

Journal ref: p. 17 in "Bayesian Inference and Maximum Entropy Methods in Science and Engineering" ed. by G. Erickson and Y. Zhai (A.I.P. Vol. 707, 2004)

Maximum Entropy approach to a Mean Field Theory for Fluids

Authors: Chih-Yuan Tseng, Ariel Caticha

Abstract: Making statistical predictions requires tackling two problems: one must assign appropriate probability distributions and then one must calculate a variety of expected values. The method of maximum entropy is commonly used to address the first problem. Here we explore its use to tackle the second problem. We show how this use of maximum entropy leads to the Bogoliuvob variational principle which… ▽ More Making statistical predictions requires tackling two problems: one must assign appropriate probability distributions and then one must calculate a variety of expected values. The method of maximum entropy is commonly used to address the first problem. Here we explore its use to tackle the second problem. We show how this use of maximum entropy leads to the Bogoliuvob variational principle which we generalize, apply to density functional theory, and use it to develop a mean field theory for classical fluids. Numerical calculations for Argon gas are compared with experimental data. △ Less

Submitted 13 December, 2002; v1 submitted 9 December, 2002; originally announced December 2002.

Comments: Correctly included 4 figures into the article. Presented at MaxEnt 2002, the 22th International Workshop on Bayesian Inference and Maximum Entropy Methods (August 3-7, 2002, Moscow, Idaho, USA)

Journal ref: p. 73 in "Bayesian Inference and Maximum Entropy Methods in Science and Engineering" ed. by C. J. Williams (A.I.P. Vol. 659, 2003)

Entropic Dynamics

Authors: Ariel Caticha

Abstract: I explore the possibility that the laws of physics might be laws of inference rather than laws of nature. What sort of dynamics can one derive from well-established rules of inference? Specifically, I ask: Given relevant information codified in the initial and the final states, what trajectory is the system expected to follow? The answer follows from a principle of inference, the principle of ma… ▽ More I explore the possibility that the laws of physics might be laws of inference rather than laws of nature. What sort of dynamics can one derive from well-established rules of inference? Specifically, I ask: Given relevant information codified in the initial and the final states, what trajectory is the system expected to follow? The answer follows from a principle of inference, the principle of maximum entropy, and not from a principle of physics. The entropic dynamics derived this way exhibits some remarkable formal similarities with other generally covariant theories such as general relativity. △ Less

Submitted 19 September, 2001; originally announced September 2001.

Comments: Presented at MaxEnt 2001, the 21th International Workshop on Bayesian Inference and Maximum Entropy Methods (August 4-9, 2001, Baltimore, MD, USA)

Journal ref: AIP Conf.Proc. 617 (2002) 302

Yet another resolution of the Gibbs paradox: an information theory approach

Authors: Chih-Yuan Tseng, Ariel Caticha

Abstract: The ``Gibbs Paradox'' refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to count states in systems of identical particles. Several authors have recognized that the paradox is resolved once it is realized that there is no such thing as… ▽ More The ``Gibbs Paradox'' refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to count states in systems of identical particles. Several authors have recognized that the paradox is resolved once it is realized that there is no such thing as the entropy of a system, that there are many entropies, and that the choice between treating particles as being distinguishable or not depends on the resolution of the experiment. The purpose of this note is essentially pedagogical; we add to their analysis by examining the paradox from the point of view of information theory. Our argument is based on that `grouping' property of entropy that Shannon recognized, by including it among his axioms, as an essential requirement on any measure of information. Not only does it provide the right connection between different entropies but, in addition, it draws our attention to the obvious fact that addressing issues of distinguishability and of counting states requires a clear idea about what precisely do we mean by a state. △ Less

Submitted 18 September, 2001; originally announced September 2001.

Comments: Presented at MaxEnt 2001, the 21th International Workshop on Bayesian Inference and Maximum Entropy Methods (August 4-9, 2001, Baltimore, MD, USA)

Journal ref: p. 331 in "Bayesian Inference and Maximum Entropy Methods in Science and Engineering" ed. by R. L. Fry (A.I.P. Vol. 617, 2002)

Change, time and information geometry

Authors: Ariel Caticha

Abstract: Dynamics, the study of change, is normally the subject of mechanics. Whether the chosen mechanics is ``fundamental'' and deterministic or ``phenomenological'' and stochastic, all changes are described relative to an external time. Here we show that once we define what we are talking about, namely, the system, its states and a criterion to distinguish among them, there is a single, unique, and na… ▽ More Dynamics, the study of change, is normally the subject of mechanics. Whether the chosen mechanics is ``fundamental'' and deterministic or ``phenomenological'' and stochastic, all changes are described relative to an external time. Here we show that once we define what we are talking about, namely, the system, its states and a criterion to distinguish among them, there is a single, unique, and natural dynamical law for irreversible processes that is compatible with the principle of maximum entropy. In this alternative dynamics changes are described relative to an internal, ``intrinsic'' time which is a derived, statistical concept defined and measured by change itself. Time is quantified change. △ Less

Submitted 7 August, 2000; originally announced August 2000.

Comments: Presented at MaxEnt 2000, the 20th International Workshop on Bayesian Inference and Maximum Entropy Methods (July 8-13, 2000, Gif-sur-Yvette, France)

MSC Class: 82C00 (primary); 54C70 (secondary); 82C35 (secondary)

Journal ref: p. 72 in "Maximum Entropy and Bayesian Methods in Science and Engineering" ed. by A. Mohammad-Djafari (A.I.P. Vol. 568, 2001)

Maximum entropy, fluctuations and priors

Authors: Ariel Caticha

Abstract: The method of maximum entropy (ME) is extended to address the following problem: Once one accepts that the ME distribution is to be preferred over all others, the question is to what extent are distributions with lower entropy supposed to be ruled out. Two applications are given. The first is to the theory of thermodynamic fluctuations. The formulation is exact, covariant under changes of coordi… ▽ More The method of maximum entropy (ME) is extended to address the following problem: Once one accepts that the ME distribution is to be preferred over all others, the question is to what extent are distributions with lower entropy supposed to be ruled out. Two applications are given. The first is to the theory of thermodynamic fluctuations. The formulation is exact, covariant under changes of coordinates, and allows fluctuations of both the extensive and the conjugate intensive variables. The second application is to the construction of an objective prior for Bayesian inference. The prior obtained by following the ME method to its inevitable conclusion turns out to be a special case of what are currently known under the name of entropic priors. △ Less

Submitted 7 August, 2000; originally announced August 2000.

Comments: presented at MaxEnt 2000, the 20th International Workshop on Bayesian Inference and Maximum Entropy Methods (July 8-13, Gif-sur-Yvette, France))

MSC Class: 82B03 (primary); 54C70 (secondary); 62F15 (secondary)

Journal ref: p. 94 in "Maximum Entropy and Bayesian Methods in Science and Engineering" ed. by A. Mohammad-Djafari (A.I.P. Vol. 568, 2001)

An asymptotic form of the reciprocity theorem with applications in x-ray scattering

Authors: Ariel Caticha

Abstract: The emission of electromagnetic waves from a source within or near a non-trivial medium (with or without boundaries, crystalline or amorphous, with inhomogeneities, absorption and so on) is sometimes studied using the reciprocity principle. This is a variation of the method of Green's functions. If one is only interested in the asymptotic radiation fields the generality of these methods may actu… ▽ More The emission of electromagnetic waves from a source within or near a non-trivial medium (with or without boundaries, crystalline or amorphous, with inhomogeneities, absorption and so on) is sometimes studied using the reciprocity principle. This is a variation of the method of Green's functions. If one is only interested in the asymptotic radiation fields the generality of these methods may actually be a shortcoming: obtaining expressions valid for the uninteresting near fields is not just a wasted effort but may be prohibitively difficult. In this work we obtain a modified form the reciprocity principle which gives the asymptotic radiation field directly. The method may be used to obtain the radiation from a prescribed source, and also to study scattering problems. To illustrate the power of the method we study a few pedagogical examples and then, as a more challenging application we tackle two related problems. We calculate the specular reflection of x rays by a rough surface and by a smoothly graded surface taking polarization effects into account. In conventional treatments of reflection x rays are treated as scalar waves, polarization effects are neglected. This is a good approximation at grazing incidence but becomes increasingly questionable for soft x rays and UV at higher incidence angles. PACs: 61.10.Dp, 61.10.Kw, 03.50.De △ Less

Submitted 3 January, 2000; originally announced January 2000.

Comments: 19 pages, 4 figures

Journal ref: Physical Review B62, 3639 (2000)

Insufficient reason and entropy in quantum theory

Authors: Ariel Caticha

Abstract: The objective of the consistent-amplitude approach to quantum theory has been to justify the mathematical formalism on the basis of three main assumptions: the first defines the subject matter, the second introduces amplitudes as the tools for quantitative reasoning, and the third is an interpretative rule that provides the link to the prediction of experimental outcomes. In this work we introdu… ▽ More The objective of the consistent-amplitude approach to quantum theory has been to justify the mathematical formalism on the basis of three main assumptions: the first defines the subject matter, the second introduces amplitudes as the tools for quantitative reasoning, and the third is an interpretative rule that provides the link to the prediction of experimental outcomes. In this work we introduce a natural and compelling fourth assumption: if there is no reason to prefer one region of the configuration space over another then they should be `weighted' equally. This is the last ingredient necessary to introduce a unique inner product in the linear space of wave functions. Thus, a form of the principle of insufficient reason is implicit in the Hilbert inner product. Armed with the inner product we obtain two results. First, we elaborate on an earlier proof of the Born probability rule. The implicit appeal to insufficient reason shows that quantum probabilities are not more objective than classical probabilities. Previously we had argued that the consistent manipulation of amplitudes leads to a linear time evolution; our second result is that time evolution must also be unitary. The argument is straightforward and hinges on the conservation of entropy. The only subtlety consists of defining the correct entropy; it is the array entropy, not von Neumann's. After unitary evolution has been established we proceed to introduce the useful notion of observables and we explore how von Neumann's entropy can be linked to Shannon's information theory. Finally, we discuss how various connections among the postulates of quantum theory are made explicit within this approach. △ Less

Submitted 26 February, 1999; v1 submitted 24 October, 1998; originally announced October 1998.

Comments: Minor changes that improve the clarity of the argument without affecting its substance have been incorporated

Journal ref: Found.Phys.30:227-251,2000

Probability and Entropy in Quantum Theory

Authors: Ariel Caticha

Abstract: Entropic arguments are shown to play a central role in the foundations of quantum theory. We prove that probabilities are given by the modulus squared of wave functions, and that the time evolution of states is linear and also unitary. Entropic arguments are shown to play a central role in the foundations of quantum theory. We prove that probabilities are given by the modulus squared of wave functions, and that the time evolution of states is linear and also unitary. △ Less

Submitted 25 September, 1998; v1 submitted 14 August, 1998; originally announced August 1998.

Comments: Presented at the 18th International Workshop on Maximum Entropy and Bayesian Methods, MaxEnt '98, (27-31 July 1998, Garching, Germany) In version 2 an error on page 7 is corrected. Results and conclusions remain unchanged

Consistency, Amplitudes and Probabilities in Quantum Theory

Authors: Ariel Caticha

Abstract: Quantum theory is formulated as the only consistent way to manipulate probability amplitudes. The crucial ingredient is a consistency constraint: if there are two different ways to compute an amplitude the two answers must agree. This constraint is expressed in the form of functional equations the solution of which leads to the usual sum and product rules for amplitudes. A consequence is that th… ▽ More Quantum theory is formulated as the only consistent way to manipulate probability amplitudes. The crucial ingredient is a consistency constraint: if there are two different ways to compute an amplitude the two answers must agree. This constraint is expressed in the form of functional equations the solution of which leads to the usual sum and product rules for amplitudes. A consequence is that the Schrodinger equation must be linear: non-linear variants of quantum mechanics are inconsistent. The physical interpretation of the theory is given in terms of a single natural rule. This rule, which does not itself involve probabilities, is used to obtain a proof of Born's statistical postulate. Thus, consistency leads to indeterminism. PACS: 03.65.Bz, 03.65.Ca. △ Less

Submitted 4 April, 1998; v1 submitted 3 April, 1998; originally announced April 1998.

Comments: 23 pages, 3 figures (old version did not include the figures)

Journal ref: Phys.Rev. A57 (1998) 1572

Consistency and Linearity in Quantum Theory

Authors: Ariel Caticha

Abstract: Quantum theory is formulated as the uniquely consistent way to manipulate probability amplitudes. The crucial ingredient is a consistency constraint: if the amplitude of a quantum process can be computed in two different ways, the two answers must agree. The constraint is expressed in the form of functional equations the solution of which leads to the usual sum and product rules for amplitudes.… ▽ More Quantum theory is formulated as the uniquely consistent way to manipulate probability amplitudes. The crucial ingredient is a consistency constraint: if the amplitude of a quantum process can be computed in two different ways, the two answers must agree. The constraint is expressed in the form of functional equations the solution of which leads to the usual sum and product rules for amplitudes. An immediate consequence is that the Schrodinger equation must be linear: non-linear variants of quantum mechanics violate the requirement of consistency. PACS: 03.65.Bz, 03.65.Ca. △ Less

Submitted 31 March, 1998; originally announced March 1998.

Journal ref: Phys.Lett. A244 (1998) 13-17