-
Integrating Generative and Physics-Based Models for Ptychographic Imaging with Uncertainty Quantification
Authors:
Canberk Ekmekci,
Tekin Bicer,
Zichao Wendy Di,
Junjing Deng,
Mujdat Cetin
Abstract:
Ptychography is a scanning coherent diffractive imaging technique that enables imaging nanometer-scale features in extended samples. One main challenge is that widely used iterative image reconstruction methods often require significant amount of overlap between adjacent scan locations, leading to large data volumes and prolonged acquisition times. To address this key limitation, this paper propos…
▽ More
Ptychography is a scanning coherent diffractive imaging technique that enables imaging nanometer-scale features in extended samples. One main challenge is that widely used iterative image reconstruction methods often require significant amount of overlap between adjacent scan locations, leading to large data volumes and prolonged acquisition times. To address this key limitation, this paper proposes a Bayesian inversion method for ptychography that performs effectively even with less overlap between neighboring scan locations. Furthermore, the proposed method can quantify the inherent uncertainty on the ptychographic object, which is created by the ill-posed nature of the ptychographic inverse problem. At a high level, the proposed method first utilizes a deep generative model to learn the prior distribution of the object and then generates samples from the posterior distribution of the object by using a Markov Chain Monte Carlo algorithm. Our results from simulated ptychography experiments show that the proposed framework can consistently outperform a widely used iterative reconstruction algorithm in cases of reduced overlap. Moreover, the proposed framework can provide uncertainty estimates that closely correlate with the true error, which is not available in practice. The project website is available here.
△ Less
Submitted 14 December, 2024;
originally announced December 2024.
-
Uncertainty quantification for ptychography using normalizing flows
Authors:
Agnimitra Dasgupta,
Zichao Wendy Di
Abstract:
Ptychography, as an essential tool for high-resolution and nondestructive material characterization, presents a challenging large-scale nonlinear and non-convex inverse problem; however, its intrinsic photon statistics create clear opportunities for statistical-based deep learning approaches to tackle these challenges, which has been underexplored. In this work, we explore normalizing flows to obt…
▽ More
Ptychography, as an essential tool for high-resolution and nondestructive material characterization, presents a challenging large-scale nonlinear and non-convex inverse problem; however, its intrinsic photon statistics create clear opportunities for statistical-based deep learning approaches to tackle these challenges, which has been underexplored. In this work, we explore normalizing flows to obtain a surrogate for the high-dimensional posterior, which also enables the characterization of the uncertainty associated with the reconstruction: an extremely desirable capability when judging the reconstruction quality in the absence of ground truth, spotting spurious artifacts and guiding future experiments using the returned uncertainty patterns. We demonstrate the performance of the proposed method on a synthetic sample with added noise and in various physical experimental settings.
△ Less
Submitted 1 November, 2021;
originally announced November 2021.
-
Simultaneous Reconstruction and Uncertainty Quantification for Tomography
Authors:
Agnimitra Dasgupta,
Carlo Graziani,
Zichao Wendy Di
Abstract:
Tomographic reconstruction, despite its revolutionary impact on a wide range of applications, suffers from its ill-posed nature in that there is no unique solution because of limited and noisy measurements. Therefore, in the absence of ground truth, quantifying the solution quality is highly desirable but under-explored. In this work, we address this challenge through Gaussian process modeling to…
▽ More
Tomographic reconstruction, despite its revolutionary impact on a wide range of applications, suffers from its ill-posed nature in that there is no unique solution because of limited and noisy measurements. Therefore, in the absence of ground truth, quantifying the solution quality is highly desirable but under-explored. In this work, we address this challenge through Gaussian process modeling to flexibly and explicitly incorporate prior knowledge of sample features and experimental noises through the choices of the kernels and noise models. Our proposed method yields not only comparable reconstruction to existing practical reconstruction methods (e.g., regularized iterative solver for inverse problem) but also an efficient way of quantifying solution uncertainties. We demonstrate the capabilities of the proposed approach on various images and show its unique capability of uncertainty quantification in the presence of various noises.
△ Less
Submitted 7 April, 2023; v1 submitted 29 March, 2021;
originally announced March 2021.
-
Low-Rank Tensor Regression for X-Ray Tomography
Authors:
Sanket R. Jantre,
Zichao Wendy Di
Abstract:
Tomographic imaging is useful for revealing the internal structure of a 3D sample. Classical reconstruction methods treat the object of interest as a vector to estimate its value. Such an approach, however, can be inefficient in analyzing high-dimensional data because of the underexploration of the underlying structure. In this work, we propose to apply a tensor-based regression model to perform t…
▽ More
Tomographic imaging is useful for revealing the internal structure of a 3D sample. Classical reconstruction methods treat the object of interest as a vector to estimate its value. Such an approach, however, can be inefficient in analyzing high-dimensional data because of the underexploration of the underlying structure. In this work, we propose to apply a tensor-based regression model to perform tomographic reconstruction. Furthermore, we explore the low-rank structure embedded in the corresponding tensor form. As a result, our proposed method efficiently reduces the dimensionality of the unknown parameters, which is particularly beneficial for ill-posed inverse problem suffering from insufficient data. We demonstrate the robustness of our proposed approach on synthetic noise-free data as well as on Gaussian noise-added data.
△ Less
Submitted 8 March, 2021;
originally announced March 2021.
-
Increasing trend of scientists to switch between topics
Authors:
An Zeng,
Zhesi Shen,
Jianlin Zhou,
Ying Fan,
Zengru Di,
Yougui Wang,
H. Eugene Stanley,
Shlomo Havlin
Abstract:
We analyze the publication records of individual scientists, aiming to quantify the topic switching dynamics of scientists and its influence. For each scientist, the relations among her publications are characterized via shared references. We find that the co-citing network of the papers of a scientist exhibits a clear community structure where each major community represents a research topic. Our…
▽ More
We analyze the publication records of individual scientists, aiming to quantify the topic switching dynamics of scientists and its influence. For each scientist, the relations among her publications are characterized via shared references. We find that the co-citing network of the papers of a scientist exhibits a clear community structure where each major community represents a research topic. Our analysis suggests that scientists tend to have a narrow distribution of the number of topics. However, researchers nowadays switch more frequently between topics than those in the early days. We also find that high switching probability in early career (<12y) is associated with low overall productivity, while it is correlated with high overall productivity in latter career. Interestingly, the average citation per paper, however, is in all career stages negatively correlated with the switching probability. We propose a model with exploitation and exploration mechanisms that can explain the main observed features.
△ Less
Submitted 10 December, 2018;
originally announced December 2018.
-
Detecting the optimal number of communities in complex networks
Authors:
Zhifang Li,
Yanqing Hu,
Beishan Xu,
Zengru Di,
Ying Fan
Abstract:
To obtain the optimal number of communities is an important problem in detecting community structure. In this paper, we extend the measurement of community detecting algorithms to find the optimal community number. Based on the normalized mutual information index, which has been used as a measure for similarity of communities, a statistic $Ω(c)$ is proposed to detect the optimal number of communit…
▽ More
To obtain the optimal number of communities is an important problem in detecting community structure. In this paper, we extend the measurement of community detecting algorithms to find the optimal community number. Based on the normalized mutual information index, which has been used as a measure for similarity of communities, a statistic $Ω(c)$ is proposed to detect the optimal number of communities. In general, when $Ω(c)$ reaches its local maximum, especially the first one, the corresponding number of communities \emph{c} is likely to be optimal in community detection. Moreover, the statistic $Ω(c)$ can also measure the significance of community structures in complex networks, which has been paid more attention recently. Numerical and empirical results show that the index $Ω(c)$ is effective in both artificial and real world networks.
△ Less
Submitted 30 March, 2011;
originally announced March 2011.
