Skip to main content

Showing 1–23 of 23 results for author: Ionides, E

Searching in archive stat. Search in all archives.
.
  1. arXiv:2506.04508  [pdf, ps, other

    stat.AP q-bio.PE stat.CO

    Mechanistic models for panel data: Analysis of ecological experiments with four interacting species

    Authors: Bo Yang, Jesse Wheeler, Meghan A. Duffy, Aaron A. King, Edward L. Ionides

    Abstract: In an ecological context, panel data arise when time series measurements are made on a collection of ecological processes. Each process may correspond to a spatial location for field data, or to an experimental ecosystem in a designed experiment. Statistical models for ecological panel data should capture the high levels of nonlinearity, stochasticity, and measurement uncertainty inherent in ecolo… ▽ More

    Submitted 8 June, 2025; v1 submitted 4 June, 2025; originally announced June 2025.

    Comments: 73 pages, 31 figures

  2. arXiv:2410.07934  [pdf, other

    stat.ME stat.CO

    panelPomp: Analysis of Panel Data via Partially Observed Markov Processes in R

    Authors: Carles Bretó, Jesse Wheeler, Aaron A. King, Edward L. Ionides

    Abstract: Panel data arise when time series measurements are collected from multiple, dynamically independent but structurally related systems. Each system's time series can be modeled as a partially observed Markov process (POMP), and the ensemble of these models is called a PanelPOMP. If the time series are relatively short, statistical inference for each time series must draw information from across the… ▽ More

    Submitted 19 May, 2025; v1 submitted 10 October, 2024; originally announced October 2024.

  3. arXiv:2409.12173  [pdf, other

    stat.ME

    Poisson approximate likelihood compared to the particle filter

    Authors: Yize Hao, Aaron A. Abkemeier, Edward L. Ionides

    Abstract: Filtering algorithms are fundamental for inference on partially observed stochastic dynamic systems, since they provide access to the likelihood function and hence enable likelihood-based or Bayesian inference. A novel Poisson approximate likelihood (PAL) filter was introduced by Whitehouse et al. (2023). PAL employs a Poisson approximation to conditional densities, offering a fast approximation t… ▽ More

    Submitted 18 September, 2024; originally announced September 2024.

  4. arXiv:2409.03876  [pdf, other

    stat.CO stat.ME

    A tutorial on panel data analysis using partially observed Markov processes via the R package panelPomp

    Authors: Carles Breto, Jesse Wheeler, Aaron A. King, Edward L. Ionides

    Abstract: The R package panelPomp supports analysis of panel data via a general class of partially observed Markov process models (PanelPOMP). This package tutorial describes how the mathematical concept of a PanelPOMP is represented in the software and demonstrates typical use-cases of panelPomp. Monte Carlo methods used for POMP models require adaptation for PanelPOMP models due to the higher dimensionali… ▽ More

    Submitted 5 September, 2024; originally announced September 2024.

  5. arXiv:2407.03085  [pdf, other

    stat.ME stat.CO stat.ML

    Accelerated Inference for Partially Observed Markov Processes using Automatic Differentiation

    Authors: Kevin Tan, Giles Hooker, Edward L. Ionides

    Abstract: Automatic differentiation (AD) has driven recent advances in machine learning, including deep neural networks and Hamiltonian Markov Chain Monte Carlo methods. Partially observed nonlinear stochastic dynamical systems have proved resistant to AD techniques because widely used particle filter algorithms yield an estimated likelihood function that is discontinuous as a function of the model paramete… ▽ More

    Submitted 3 July, 2024; originally announced July 2024.

  6. arXiv:2405.17032  [pdf, other

    q-bio.QM math.PR q-bio.PE stat.AP

    Exact phylodynamic likelihood via structured Markov genealogy processes

    Authors: Aaron A. King, Qianying Lin, Edward L. Ionides

    Abstract: We consider genealogies arising from a Markov population process in which individuals are categorized into a discrete collection of compartments, with the requirement that individuals within the same compartment are statistically exchangeable. When equipped with a sampling process, each such population process induces a time-evolving tree-valued process defined as the genealogy of all sampled indi… ▽ More

    Submitted 16 January, 2025; v1 submitted 27 May, 2024; originally announced May 2024.

  7. arXiv:2311.06702  [pdf, other

    stat.AP physics.soc-ph q-bio.PE

    Inference on spatiotemporal dynamics for networks of biological populations

    Authors: Jifan Li, Edward L. Ionides, Aaron A. King, Mercedes Pascual, Ning Ning

    Abstract: Mathematical models in ecology and epidemiology must be consistent with observed data in order to generate reliable knowledge and evidence-based policy. Metapopulation systems, which consist of a network of connected sub-populations, pose technical challenges in statistical inference due to nonlinear, stochastic interactions. Numerical difficulties encountered in conducting inference can obstruct… ▽ More

    Submitted 6 February, 2024; v1 submitted 11 November, 2023; originally announced November 2023.

  8. arXiv:2310.01198  [pdf, other

    stat.ME stat.CO

    Likelihood Based Inference for ARMA Models

    Authors: Jesse Wheeler, Edward L. Ionides

    Abstract: Autoregressive moving average (ARMA) models are widely used for analyzing time series data. However, standard likelihood-based inference methodology for ARMA models has avoidable limitations. We show that common ARMA likelihood maximization strategies often lead to sub-optimal parameter estimates. While this possibility has been previously identified, no routinely applicable algorithm has been dev… ▽ More

    Submitted 4 December, 2024; v1 submitted 2 October, 2023; originally announced October 2023.

    Comments: The developmental version of the R package used in this paper is available at the following GitHub repository: [email protected]:jeswheel/arima2.git

  9. Informing policy via dynamic models: Cholera in Haiti

    Authors: Jesse Wheeler, AnnaElaine Rosengart, Zhuoxun Jiang, Kevin Tan, Noah Treutle, Edward Ionides

    Abstract: Public health decisions must be made about when and how to implement interventions to control an infectious disease epidemic. These decisions should be informed by data on the epidemic as well as current understanding about the transmission dynamics. Such decisions can be posed as statistical questions about scientifically motivated dynamic models. Thus, we encounter the methodological task of bui… ▽ More

    Submitted 4 March, 2024; v1 submitted 21 January, 2023; originally announced January 2023.

    Comments: To be submitted to Plos Comp Bio

  10. arXiv:2206.03837  [pdf, other

    stat.ME

    An iterated block particle filter for inference on coupled dynamic systems with shared and unit-specific parameters

    Authors: Edward L. Ionides, Ning Ning, Jesse Wheeler

    Abstract: We consider inference for a collection of partially observed, stochastic, interacting, nonlinear dynamic processes. Each process is identified with a label called its unit, and our primary motivation arises in biological metapopulation systems where a unit corresponds to a spatially distinct sub-population. Metapopulation systems are characterized by strong dependence through time within a single… ▽ More

    Submitted 19 December, 2022; v1 submitted 8 June, 2022; originally announced June 2022.

  11. arXiv:2110.10745  [pdf, other

    stat.ML cs.LG math.ST stat.AP stat.CO stat.ME

    Iterated Block Particle Filter for High-dimensional Parameter Learning: Beating the Curse of Dimensionality

    Authors: Ning Ning, Edward L. Ionides

    Abstract: Parameter learning for high-dimensional, partially observed, and nonlinear stochastic processes is a methodological challenge. Spatiotemporal disease transmission systems provide examples of such processes giving rise to open inference problems. We propose the iterated block particle filter (IBPF) algorithm for learning high-dimensional parameters over graphical state space models with general sta… ▽ More

    Submitted 4 April, 2023; v1 submitted 20 October, 2021; originally announced October 2021.

  12. arXiv:2106.10387  [pdf, other

    stat.ME math.PR math.ST stat.AP

    Systemic Infinitesimal Over-dispersion on Graphical Dynamic Models

    Authors: Ning Ning, Edward L. Ionides

    Abstract: Stochastic models for collections of interacting populations have crucial roles in scientific fields such as epidemiology and ecology, yet the standard approach to extending an ordinary differential equation model to a Markov chain does not have sufficient flexibility in the mean-variance relationship to match data. To handle that, over-dispersed Markov chains have previously been constructed usin… ▽ More

    Submitted 3 October, 2022; v1 submitted 18 June, 2021; originally announced June 2021.

    Comments: 33 pages

    MSC Class: 05C20; 60G07; 60J75; 92D30

  13. arXiv:2105.12730  [pdf, other

    math.PR q-bio.PE q-bio.QM stat.AP stat.ME

    Markov Genealogy Processes

    Authors: Aaron A. King, Qianying Lin, Edward L. Ionides

    Abstract: We construct a family of genealogy-valued Markov processes that are induced by a continuous-time Markov population process. We derive exact expressions for the likelihood of a given genealogy conditional on the history of the underlying population process. These lead to a nonlinear filtering equation which can be used to design efficient Monte Carlo inference algorithms. We demonstrate these calcu… ▽ More

    Submitted 24 January, 2022; v1 submitted 26 May, 2021; originally announced May 2021.

    MSC Class: 60J99

    Journal ref: Theoretical Population Biology 143:77-91 (2022)

  14. arXiv:2101.01157  [pdf, other

    stat.ME stat.CO

    A tutorial on spatiotemporal partially observed Markov process models via the R package spatPomp

    Authors: Kidus Asfaw, Joonha Park, Aaron A. King, Edward L. Ionides

    Abstract: We describe a computational framework for modeling and statistical inference on high-dimensional stochastic dynamic systems. Our primary motivation is the investigation of metapopulation dynamics arising from a collection of spatially distributed, interacting biological populations. To make progress on this goal, we embed it in a more general problem: inference for a collection of interacting part… ▽ More

    Submitted 18 April, 2024; v1 submitted 4 January, 2021; originally announced January 2021.

  15. arXiv:2007.00723  [pdf, other

    math.ST math.PR stat.ME

    Scalable Monte Carlo Inference and Rescaled Local Asymptotic Normality

    Authors: Ning Ning, Edward Ionides, Ya'acov Ritov

    Abstract: In this paper, we generalize the property of local asymptotic normality (LAN) to an enlarged neighborhood, under the name of rescaled local asymptotic normality (RLAN). We obtain sufficient conditions for a regular parametric model to satisfy RLAN. We show that RLAN supports the construction of a statistically efficient estimator which maximizes a cubic approximation to the log-likelihood on this… ▽ More

    Submitted 30 November, 2020; v1 submitted 1 July, 2020; originally announced July 2020.

    Comments: 41 pages, 1 figure

  16. arXiv:2002.11184  [pdf, other

    q-bio.PE math.PR stat.AP

    The Sampled Moran Genealogy Process

    Authors: Aaron A. King, Qianying Lin, Edward L. Ionides

    Abstract: We define the Sampled Moran Genealogy Process, a continuous-time Markov process on the space of genealogies with the demography of the classical Moran process, sampled through time. To do so, we begin by defining the Moran Genealogy Process using a novel representation. We then extend this process to include sampling through time. We derive exact conditional and marginal probability distributions… ▽ More

    Submitted 19 October, 2020; v1 submitted 25 February, 2020; originally announced February 2020.

    MSC Class: 60J99

  17. Bagged filters for partially observed interacting systems

    Authors: Edward L. Ionides, Kidus Asfaw, Joonha Park, Aaron A. King

    Abstract: Bagging (i.e., bootstrap aggregating) involves combining an ensemble of bootstrap estimators. We consider bagging for inference from noisy or incomplete measurements on a collection of interacting stochastic dynamic systems. Each system is called a unit, and each unit is associated with a spatial location. A motivating example arises in epidemiology, where each unit is a city: the majority of tran… ▽ More

    Submitted 28 June, 2021; v1 submitted 12 February, 2020; originally announced February 2020.

  18. Panel data analysis via mechanistic models

    Authors: Carles Bretó, Edward L. Ionides, Aaron A. King

    Abstract: Panel data, also known as longitudinal data, consist of a collection of time series. Each time series, which could itself be multivariate, comprises a sequence of measurements taken on a distinct unit. Mechanistic modeling involves writing down scientifically motivated equations describing the collection of dynamic systems giving rise to the observations on each unit. A defining characteristic of… ▽ More

    Submitted 25 March, 2019; v1 submitted 17 January, 2018; originally announced January 2018.

    Comments: Accepted for publication in Journal of the American Statistical Association

  19. arXiv:1708.08543  [pdf, other

    stat.ME

    Inference on high-dimensional implicit dynamic models using a guided intermediate resampling filter

    Authors: Joonha Park, Edward L. Ionides

    Abstract: We propose a method for inference on moderately high-dimensional, nonlinear, non-Gaussian, partially observed Markov process models for which the transition density is not analytically tractable. Markov processes with intractable transition densities arise in models defined implicitly by simulation algorithms. Widely used particle filter methods are applicable to nonlinear, non-Gaussian models but… ▽ More

    Submitted 31 March, 2020; v1 submitted 28 August, 2017; originally announced August 2017.

  20. arXiv:1612.02710  [pdf, other

    stat.ME

    Monte Carlo profile confidence intervals

    Authors: Edward L. Ionides, Carles Breto, Joonha Park, Richard A. Smith, Aaron A. King

    Abstract: Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable. When Monte Carlo error can be made small, by sufficiently exhaustive computation, then the standard theory and practice of likelihood-based inference applies. A… ▽ More

    Submitted 9 February, 2017; v1 submitted 8 December, 2016; originally announced December 2016.

  21. Statistical Inference for Partially Observed Markov Processes via the R Package pomp

    Authors: Aaron A. King, Dao Nguyen, Edward L. Ionides

    Abstract: Partially observed Markov process (POMP) models, also known as hidden Markov models or state space models, are ubiquitous tools for time series analysis. The R package pomp provides a very flexible framework for Monte Carlo statistical investigations using nonlinear, non-Gaussian POMP models. A range of modern statistical methods for POMP models have been implemented in this framework including se… ▽ More

    Submitted 21 October, 2015; v1 submitted 1 September, 2015; originally announced September 2015.

    Comments: In press at the Journal of Statistical Software. A version of this paper is provided at the pomp package website: http://kingaa.github.io/pomp

  22. Discussion of "Feature Matching in Time Series Modeling" by Y. Xia and H. Tong

    Authors: Edward L. Ionides

    Abstract: Discussion of "Feature Matching in Time Series Modeling" by Y. Xia and H. Tong [arXiv:1104.3073]

    Submitted 6 January, 2012; originally announced January 2012.

    Comments: Published in at http://dx.doi.org/10.1214/11-STS345C the Statistical Science (http://www.imstat.org/sts/) by the Institute of Mathematical Statistics (http://www.imstat.org)

    Report number: IMS-STS-STS345C

    Journal ref: Statistical Science 2011, Vol. 26, No. 1, 49-52

  23. Macroeconomic effects on mortality revealed by panel analysis with nonlinear trends

    Authors: Edward L. Ionides, Zhen Wang, José A. Tapia Granados

    Abstract: Many investigations have used panel methods to study the relationships between fluctuations in economic activity and mortality. A broad consensus has emerged on the overall procyclical nature of mortality: perhaps counter-intuitively, mortality typically rises above its trend during expansions. This consensus has been tarnished by inconsistent reports on the specific age groups and mortality cause… ▽ More

    Submitted 28 November, 2013; v1 submitted 24 October, 2011; originally announced October 2011.

    Comments: Published in at http://dx.doi.org/10.1214/12-AOAS624 the Annals of Applied Statistics (http://www.imstat.org/aoas/) by the Institute of Mathematical Statistics (http://www.imstat.org)

    Report number: IMS-AOAS-AOAS624

    Journal ref: Annals of Applied Statistics 2013, Vol. 7, No. 3, 1362-1385