Showing 1–4 of 4 results for author: Scarnati, T

Covariance-Generalized Matching Component Analysis for Data Fusion and Transfer Learning

Authors: Nick Lorenzo, Sean O'Rourke, Theresa Scarnati

Abstract: In order to encode additional statistical information in data fusion and transfer learning applications, we introduce a generalized covariance constraint for the matching component analysis (MCA) transfer learning technique. We provide a closed-form solution to the resulting covariance-generalized optimization problem and an algorithm for its computation. We call the resulting technique -- applica… ▽ More In order to encode additional statistical information in data fusion and transfer learning applications, we introduce a generalized covariance constraint for the matching component analysis (MCA) transfer learning technique. We provide a closed-form solution to the resulting covariance-generalized optimization problem and an algorithm for its computation. We call the resulting technique -- applicable to both data fusion and transfer learning -- covariance-generalized MCA (CGMCA). We also demonstrate via numerical experiments that CGMCA is capable of meaningfully encoding into its maps more information than MCA. △ Less

Submitted 14 December, 2022; v1 submitted 25 October, 2021; originally announced October 2021.

Comments: v3: Made major organizational changes; added numerical results; eliminated statement and proof of lemma in favor of offering a solution achieving a cited bound

MSC Class: Primary 90C90; Secondary 65F99; 68Q32; ; 68T99

Empirical Bayesian Inference using Joint Sparsity

Authors: Jiahui Zhang, Anne Gelb, Theresa Scarnati

Abstract: This paper develops a new empirical Bayesian inference algorithm for solving a linear inverse problem given multiple measurement vectors (MMV) of under-sampled and noisy observable data. Specifically, by exploiting the joint sparsity across the multiple measurements in the sparse domain of the underlying signal or image, we construct a new support informed sparsity promoting prior. Several applica… ▽ More This paper develops a new empirical Bayesian inference algorithm for solving a linear inverse problem given multiple measurement vectors (MMV) of under-sampled and noisy observable data. Specifically, by exploiting the joint sparsity across the multiple measurements in the sparse domain of the underlying signal or image, we construct a new support informed sparsity promoting prior. Several applications can be modeled using this framework, and as a prototypical example we consider reconstructing an image from synthetic aperture radar (SAR) observations using nearby azimuth angles. Our numerical experiments demonstrate that using this new prior not only improves accuracy of the recovery, but also reduces the uncertainty in the posterior when compared to standard sparsity producing priors. △ Less

Submitted 29 March, 2021; originally announced March 2021.

Comments: Submitted for publication to SIAM Journal on Uncertainty Quantification 26 March 2021

MSC Class: 62C12; 65C40; 68U10

Accelerated Variance Based Joint Sparsity Recovery of Images from Fourier Data

Authors: Theresa Scarnati, Anne Gelb

Abstract: Several problems in imaging acquire multiple measurement vectors (MMVs) of Fourier samples for the same underlying scene. Image recovery techniques from MMVs aim to exploit the joint sparsity across the measurements in the sparse domain. This is typically accomplished by extending the use of $\ell_1$ regularization of the sparse domain in the single measurement vector (SMV) case to using… ▽ More Several problems in imaging acquire multiple measurement vectors (MMVs) of Fourier samples for the same underlying scene. Image recovery techniques from MMVs aim to exploit the joint sparsity across the measurements in the sparse domain. This is typically accomplished by extending the use of $\ell_1$ regularization of the sparse domain in the single measurement vector (SMV) case to using $\ell_{2,1}$ regularization so that the "jointness" can be accounted for. Although effective, the approach is inherently coupled and therefore computationally inefficient. The method also does not consider current approaches in the SMV case that use spatially varying weighted $\ell_1$ regularization term. The recently introduced variance based joint sparsity (VBJS) recovery method uses the variance across the measurements in the sparse domain to produce a weighted MMV method that is more accurate and more efficient than the standard $\ell_{2,1}$ approach. The efficiency is due to the decoupling of the measurement vectors, with the increased accuracy resulting from the spatially varying weight. This paper introduces the accelerated VBJS which reduces computational cost even further by eliminating the requirement to first approximate the underlying image in order to construct the weights. Eliminating this preprocessing step moreover reduces the amount of information lost from the data, so that our method is more accurate. Numerical examples provided in the paper verify these benefits. △ Less

Submitted 18 October, 2019; originally announced October 2019.

Comments: 30 pages. Submitted to Journal of Computational Mathematics

MSC Class: 49N45; 68U10; 65T99

Matching Component Analysis for Transfer Learning

Authors: Charles Clum, Dustin G. Mixon, Theresa Scarnati

Abstract: We introduce a new Procrustes-type method called matching component analysis to isolate components in data for transfer learning. Our theoretical results describe the sample complexity of this method, and we demonstrate through numerical experiments that our approach is indeed well suited for transfer learning. We introduce a new Procrustes-type method called matching component analysis to isolate components in data for transfer learning. Our theoretical results describe the sample complexity of this method, and we demonstrate through numerical experiments that our approach is indeed well suited for transfer learning. △ Less

Submitted 4 September, 2019; originally announced September 2019.

Comments: Submitted to SIAM Journal on Mathematics of Data Science (SIMODS)

MSC Class: 65F10; 68T99; 68Q32; 68T05; 90C90