Showing 1–9 of 9 results for author: Duffin, C

Probabilistic Super-Resolution for High-Fidelity Physical System Simulations with Uncertainty Quantification

Authors: Pengyu Zhang, Connor Duffin, Alex Glyn-Davies, Arnaud Vadeboncoeur, Mark Girolami

Abstract: Super-resolution (SR) is a promising tool for generating high-fidelity simulations of physical systems from low-resolution data, enabling fast and accurate predictions in engineering applications. However, existing deep-learning based SR methods, require large labeled datasets and lack reliable uncertainty quantification (UQ), limiting their applicability in real-world scenarios. To overcome these… ▽ More Super-resolution (SR) is a promising tool for generating high-fidelity simulations of physical systems from low-resolution data, enabling fast and accurate predictions in engineering applications. However, existing deep-learning based SR methods, require large labeled datasets and lack reliable uncertainty quantification (UQ), limiting their applicability in real-world scenarios. To overcome these challenges, we propose a probabilistic SR framework that leverages the Statistical Finite Element Method and energy-based generative modeling. Our method enables efficient high-resolution predictions with inherent UQ, while eliminating the need for extensive labeled datasets. The method is validated on a 2D Poisson example and compared with bicubic interpolation upscaling. Results demonstrate a computational speed-up over high-resolution numerical solvers while providing reliable uncertainty estimates. △ Less

Submitted 14 February, 2025; originally announced February 2025.

Statistical Finite Elements via Interacting Particle Langevin Dynamics

Authors: Alex Glyn-Davies, Connor Duffin, Ieva Kazlauskaite, Mark Girolami, Ö. Deniz Akyildiz

Abstract: In this paper, we develop a class of interacting particle Langevin algorithms to solve inverse problems for partial differential equations (PDEs). In particular, we leverage the statistical finite elements (statFEM) formulation to obtain a finite-dimensional latent variable statistical model where the parameter is that of the (discretised) forward map and the latent variable is the statFEM solutio… ▽ More In this paper, we develop a class of interacting particle Langevin algorithms to solve inverse problems for partial differential equations (PDEs). In particular, we leverage the statistical finite elements (statFEM) formulation to obtain a finite-dimensional latent variable statistical model where the parameter is that of the (discretised) forward map and the latent variable is the statFEM solution of the PDE which is assumed to be partially observed. We then adapt a recently proposed expectation-maximisation like scheme, interacting particle Langevin algorithm (IPLA), for this problem and obtain a joint estimation procedure for the parameters and the latent variables. We consider three main examples: (i) estimating the forcing for linear Poisson PDE, (ii) estimating diffusivity for linear Poisson PDE, and (iii) estimating the forcing for nonlinear Poisson PDE. We provide computational complexity estimates for forcing estimation in the linear case. We also provide comprehensive numerical experiments and preconditioning strategies that significantly improve the performance, showing that the proposed class of methods can be the choice for parameter inference in PDE models. △ Less

Submitted 27 May, 2025; v1 submitted 11 September, 2024; originally announced September 2024.

Comments: 26 pages, 6 figures

Stark Many-Body Localisation Under Periodic Driving

Authors: Christian Duffin, Aydin Deger, Achilleas Lazarides

Abstract: We study stability of localisation under periodic driving in many-body Stark systems. We find that localisation is stable except near special resonant frequencies, where resonances cause delocalisation. We provide approximate analytical arguments and numerical evidence in support of these results. This shows that disorder-free broken ergodicity is stable to driving, opening up the way to studying… ▽ More We study stability of localisation under periodic driving in many-body Stark systems. We find that localisation is stable except near special resonant frequencies, where resonances cause delocalisation. We provide approximate analytical arguments and numerical evidence in support of these results. This shows that disorder-free broken ergodicity is stable to driving, opening up the way to studying nonequilibrium driven physics in a novel setting. △ Less

Submitted 24 October, 2024; v1 submitted 17 April, 2024; originally announced April 2024.

Comments: 8 pages, 7 figures

Journal ref: Phys. Rev. B 110, 134205 (2024)

Exploring Model Misspecification in Statistical Finite Elements via Shallow Water Equations

Authors: Connor Duffin, Paul Branson, Matt Rayson, Mark Girolami, Edward Cripps, Thomas Stemler

Abstract: The abundance of observed data in recent years has increased the number of statistical augmentations to complex models across science and engineering. By augmentation we mean coherent statistical methods that incorporate measurements upon arrival and adjust the model accordingly. However, in this research area methodological developments tend to be central, with important assessments of model fide… ▽ More The abundance of observed data in recent years has increased the number of statistical augmentations to complex models across science and engineering. By augmentation we mean coherent statistical methods that incorporate measurements upon arrival and adjust the model accordingly. However, in this research area methodological developments tend to be central, with important assessments of model fidelity often taking second place. Recently, the statistical finite element method (statFEM) has been posited as a potential solution to the problem of model misspecification when the data are believed to be generated from an underlying partial differential equation system. Bayes nonlinear filtering permits data driven finite element discretised solutions that are updated to give a posterior distribution which quantifies the uncertainty over model solutions. The statFEM has shown great promise in systems subject to mild misspecification but its ability to handle scenarios of severe model misspecification has not yet been presented. In this paper we fill this gap, studying statFEM in the context of shallow water equations chosen for their oceanographic relevance. By deliberately misspecifying the governing equations, via linearisation, viscosity, and bathymetry, we systematically analyse misspecification through studying how the resultant approximate posterior distribution is affected, under additional regimes of decreasing spatiotemporal observational frequency. Results show that statFEM performs well with reasonable accuracy, as measured by theoretically sound proper scoring rules. △ Less

Submitted 11 July, 2023; originally announced July 2023.

Comments: 16 pages, 9 figures, 4 tables, submitted version

$Φ$-DVAE: Physics-Informed Dynamical Variational Autoencoders for Unstructured Data Assimilation

Authors: Alex Glyn-Davies, Connor Duffin, Ö. Deniz Akyildiz, Mark Girolami

Abstract: Incorporating unstructured data into physical models is a challenging problem that is emerging in data assimilation. Traditional approaches focus on well-defined observation operators whose functional forms are typically assumed to be known. This prevents these methods from achieving a consistent model-data synthesis in configurations where the mapping from data-space to model-space is unknown. To… ▽ More Incorporating unstructured data into physical models is a challenging problem that is emerging in data assimilation. Traditional approaches focus on well-defined observation operators whose functional forms are typically assumed to be known. This prevents these methods from achieving a consistent model-data synthesis in configurations where the mapping from data-space to model-space is unknown. To address these shortcomings, in this paper we develop a physics-informed dynamical variational autoencoder ($Φ$-DVAE) to embed diverse data streams into time-evolving physical systems described by differential equations. Our approach combines a standard, possibly nonlinear, filter for the latent state-space model and a VAE, to assimilate the unstructured data into the latent dynamical system. Unstructured data, in our example systems, comes in the form of video data and velocity field measurements, however the methodology is suitably generic to allow for arbitrary unknown observation operators. A variational Bayesian framework is used for the joint estimation of the encoding, latent states, and unknown system parameters. To demonstrate the method, we provide case studies with the Lorenz-63 ordinary differential equation, and the advection and Korteweg-de Vries partial differential equations. Our results, with synthetic data, show that $Φ$-DVAE provides a data efficient dynamics encoding methodology which is competitive with standard approaches. Unknown parameters are recovered with uncertainty quantification, and unseen data are accurately predicted. △ Less

Submitted 24 July, 2024; v1 submitted 30 September, 2022; originally announced September 2022.

Comments: 29 pages, 9 figures, updated version

Statistical Finite Elements via Langevin Dynamics

Authors: Ömer Deniz Akyildiz, Connor Duffin, Sotirios Sabanis, Mark Girolami

Abstract: The recent statistical finite element method (statFEM) provides a coherent statistical framework to synthesise finite element models with observed data. Through embedding uncertainty inside of the governing equations, finite element solutions are updated to give a posterior distribution which quantifies all sources of uncertainty associated with the model. However to incorporate all sources of unc… ▽ More The recent statistical finite element method (statFEM) provides a coherent statistical framework to synthesise finite element models with observed data. Through embedding uncertainty inside of the governing equations, finite element solutions are updated to give a posterior distribution which quantifies all sources of uncertainty associated with the model. However to incorporate all sources of uncertainty, one must integrate over the uncertainty associated with the model parameters, the known forward problem of uncertainty quantification. In this paper, we make use of Langevin dynamics to solve the statFEM forward problem, studying the utility of the unadjusted Langevin algorithm (ULA), a Metropolis-free Markov chain Monte Carlo sampler, to build a sample-based characterisation of this otherwise intractable measure. Due to the structure of the statFEM problem, these methods are able to solve the forward problem without explicit full PDE solves, requiring only sparse matrix-vector products. ULA is also gradient-based, and hence provides a scalable approach up to high degrees-of-freedom. Leveraging the theory behind Langevin-based samplers, we provide theoretical guarantees on sampler performance, demonstrating convergence, for both the prior and posterior, in the Kullback-Leibler divergence, and, in Wasserstein-2, with further results on the effect of preconditioning. Numerical experiments are also provided, for both the prior and posterior, to demonstrate the efficacy of the sampler, with a Python package also included. △ Less

Submitted 27 December, 2021; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: New version, experiments updated

Low-rank statistical finite elements for scalable model-data synthesis

Authors: Connor Duffin, Edward Cripps, Thomas Stemler, Mark Girolami

Abstract: Statistical learning additions to physically derived mathematical models are gaining traction in the literature. A recent approach has been to augment the underlying physics of the governing equations with data driven Bayesian statistical methodology. Coined statFEM, the method acknowledges a priori model misspecification, by embedding stochastic forcing within the governing equations. Upon receip… ▽ More Statistical learning additions to physically derived mathematical models are gaining traction in the literature. A recent approach has been to augment the underlying physics of the governing equations with data driven Bayesian statistical methodology. Coined statFEM, the method acknowledges a priori model misspecification, by embedding stochastic forcing within the governing equations. Upon receipt of additional data, the posterior distribution of the discretised finite element solution is updated using classical Bayesian filtering techniques. The resultant posterior jointly quantifies uncertainty associated with the ubiquitous problem of model misspecification and the data intended to represent the true process of interest. Despite this appeal, computational scalability is a challenge to statFEM's application to high-dimensional problems typically experienced in physical and industrial contexts. This article overcomes this hurdle by embedding a low-rank approximation of the underlying dense covariance matrix, obtained from the leading order modes of the full-rank alternative. Demonstrated on a series of reaction-diffusion problems of increasing dimension, using experimental and simulated data, the method reconstructs the sparsely observed data-generating processes with minimal loss of information, in both the posterior mean and variance, paving the way for further integration of physical and probabilistic approaches to complex systems. △ Less

Submitted 21 March, 2022; v1 submitted 10 September, 2021; originally announced September 2021.

Comments: 33 pages, 14 figures, revised version

Controlling a Quantum System via its Boundary Conditions

Authors: Christian Duffin, Arend G. Dijkstra

Abstract: We numerically study a particle in a box with moving walls. In the case where the walls are oscillating sinusoidally with small amplitude, we show that states up to the fourth state can be populated with more than 80 percent population, while higher-lying states can also be selectively excited. This work introduces a way of controlling quantum systems which does not rely on (dipole) selection rule… ▽ More We numerically study a particle in a box with moving walls. In the case where the walls are oscillating sinusoidally with small amplitude, we show that states up to the fourth state can be populated with more than 80 percent population, while higher-lying states can also be selectively excited. This work introduces a way of controlling quantum systems which does not rely on (dipole) selection rules. △ Less

Submitted 1 October, 2018; originally announced October 2018.

Measurement-device-independent quantum key distribution: from idea towards application

Authors: Raju Valivarthi, Itzel Lucio-Martinez, Philip Chan, Allison Rubenok, Caleb John, Daniel Korchinski, Cooper Duffin, Francesco Marsili, Varun Verma, Mathew D. Shaw, Jeffrey A. Stern, Sae Woo Nam, Daniel Oblak, Qiang Zhou, Joshua A. Slater, Wolfgang Tittel

Abstract: We assess the overall performance of our quantum key distribution (QKD) system implementing the measurement-device-independent (MDI) protocol using components with varying capabilities such as different single photon detectors and qubit preparation hardware. We experimentally show that superconducting nanowire single photon detectors allow QKD over a channel featuring 60 dB loss, and QKD with more… ▽ More We assess the overall performance of our quantum key distribution (QKD) system implementing the measurement-device-independent (MDI) protocol using components with varying capabilities such as different single photon detectors and qubit preparation hardware. We experimentally show that superconducting nanowire single photon detectors allow QKD over a channel featuring 60 dB loss, and QKD with more than 600 bits of secret key per second (not considering finite key effects) over a 16 dB loss channel. This corresponds to 300 km and 80 km of standard telecommunication fiber, respectively. We also demonstrate that the integration of our QKD system into FPGA-based hardware (instead of state-of-the-art arbitrary waveform generators) does not impact on its performance. Our investigation allows us to acquire an improved understanding of the trade-offs between complexity, cost and system performance, which is required for future customization of MDI-QKD. Given that our system can be operated outside the laboratory over deployed fiber, we conclude that MDI-QKD is a promising approach to information-theoretic secure key distribution. △ Less

Submitted 28 January, 2015; originally announced January 2015.

Comments: 10 pages, 5 figures

Journal ref: Journal of Modern Optics 62, 1141-1150 (2015)