-
Adaptive multipliers for extrapolation in frequency
Authors:
Diego Castelli Lacunza,
Carlos A. Sing Long
Abstract:
Resolving the details of an object from coarse-scale measurements is a classical problem in applied mathematics. This problem is usually formulated as extrapolating the Fourier transform of the object from a bounded region to the entire space, that is, in terms of performing extrapolation in frequency. This problem is ill-posed unless one assumes that the object has some additional structure. When…
▽ More
Resolving the details of an object from coarse-scale measurements is a classical problem in applied mathematics. This problem is usually formulated as extrapolating the Fourier transform of the object from a bounded region to the entire space, that is, in terms of performing extrapolation in frequency. This problem is ill-posed unless one assumes that the object has some additional structure. When the object is compactly supported, then it is well-known that its Fourier transform can be extended to the entire space. However, it is also well-known that this problem is severely ill-conditioned.
In this work, we assume that the object is known to belong to a collection of compactly supported functions and, instead performing extrapolation in frequency to the entire space, we study the problem of extrapolating to a larger bounded set using dilations in frequency and a single Fourier multiplier. This is reminiscent of the refinement equation in multiresolution analysis. Under suitable conditions, we prove the existence of a worst-case optimal multiplier over the entire collection, and we show that all such multipliers share the same canonical structure. When the collection is finite, we show that any worst-case optimal multiplier can be represented in terms of an Hermitian matrix. This allows us to introduce a fixed-point iteration to find the optimal multiplier. This leads us to introduce a family of multipliers, which we call $Σ$-multipliers, that can be used to perform extrapolation in frequency. We establish connections between $Σ$-multipliers and multiresolution analysis. We conclude with some numerical experiments illustrating the practical consequences of our results.
△ Less
Submitted 28 January, 2025;
originally announced January 2025.
-
InVAErt networks for amortized inference and identifiability analysis of lumped parameter hemodynamic models
Authors:
Guoxiang Grayson Tong,
Carlos A. Sing Long,
Daniele E. Schiavazzi
Abstract:
Estimation of cardiovascular model parameters from electronic health records (EHR) poses a significant challenge primarily due to lack of identifiability. Structural non-identifiability arises when a manifold in the space of parameters is mapped to a common output, while practical non-identifiability can result due to limited data, model misspecification, or noise corruption. To address the result…
▽ More
Estimation of cardiovascular model parameters from electronic health records (EHR) poses a significant challenge primarily due to lack of identifiability. Structural non-identifiability arises when a manifold in the space of parameters is mapped to a common output, while practical non-identifiability can result due to limited data, model misspecification, or noise corruption. To address the resulting ill-posed inverse problem, optimization-based or Bayesian inference approaches typically use regularization, thereby limiting the possibility of discovering multiple solutions. In this study, we use inVAErt networks, a neural network-based, data-driven framework for enhanced digital twin analysis of stiff dynamical systems. We demonstrate the flexibility and effectiveness of inVAErt networks in the context of physiological inversion of a six-compartment lumped parameter hemodynamic model from synthetic data to real data with missing components.
△ Less
Submitted 15 August, 2024;
originally announced August 2024.
-
InVAErt networks: a data-driven framework for model synthesis and identifiability analysis
Authors:
Guoxiang Grayson Tong,
Carlos A. Sing Long,
Daniele E. Schiavazzi
Abstract:
Use of generative models and deep learning for physics-based systems is currently dominated by the task of emulation. However, the remarkable flexibility offered by data-driven architectures would suggest to extend this representation to other aspects of system synthesis including model inversion and identifiability. We introduce inVAErt (pronounced "invert") networks, a comprehensive framework fo…
▽ More
Use of generative models and deep learning for physics-based systems is currently dominated by the task of emulation. However, the remarkable flexibility offered by data-driven architectures would suggest to extend this representation to other aspects of system synthesis including model inversion and identifiability. We introduce inVAErt (pronounced "invert") networks, a comprehensive framework for data-driven analysis and synthesis of parametric physical systems which uses a deterministic encoder and decoder to represent the forward and inverse solution maps, a normalizing flow to capture the probabilistic distribution of system outputs, and a variational encoder designed to learn a compact latent representation for the lack of bijectivity between inputs and outputs. We formally investigate the selection of penalty coefficients in the loss function and strategies for latent space sampling, since we find that these significantly affect both training and testing performance. We validate our framework through extensive numerical examples, including simple linear, nonlinear, and periodic maps, dynamical systems, and spatio-temporal PDEs.
△ Less
Submitted 11 September, 2023; v1 submitted 24 July, 2023;
originally announced July 2023.
-
On Dependent Dirichlet Processes for General Polish Spaces
Authors:
Andres Iturriaga,
Carlos A. Sing Long,
Alejandro Jara
Abstract:
We study Dirichlet process-based models for sets of predictor-dependent probability distributions, where the domain and predictor space are general Polish spaces. We generalize the definition of dependent Dirichlet processes, originally constructed on Euclidean spaces, to more general Polish spaces. We provide sufficient conditions under which dependent Dirichlet processes have appealing propertie…
▽ More
We study Dirichlet process-based models for sets of predictor-dependent probability distributions, where the domain and predictor space are general Polish spaces. We generalize the definition of dependent Dirichlet processes, originally constructed on Euclidean spaces, to more general Polish spaces. We provide sufficient conditions under which dependent Dirichlet processes have appealing properties regarding continuity (weak and strong), association structure, and support (under different topologies). We also provide sufficient conditions under which mixture models induced by dependent Dirichlet processes have appealing properties regarding strong continuity, association structure, support, and weak consistency under i.i.d. sampling of both responses and predictors. The results can be easily extended to more general dependent stick-breaking processes.
△ Less
Submitted 11 May, 2022;
originally announced May 2022.
