-
X-Ray2EM: Uncertainty-Aware Cross-Modality Image Reconstruction from X-Ray to Electron Microscopy in Connectomics
Authors:
Yicong Li,
Yaron Meirovitch,
Aaron T. Kuan,
Jasper S. Phelps,
Alexandra Pacureanu,
Wei-Chung Allen Lee,
Nir Shavit,
Lu Mi
Abstract:
Comprehensive, synapse-resolution imaging of the brain will be crucial for understanding neuronal computations and function. In connectomics, this has been the sole purview of volume electron microscopy (EM), which entails an excruciatingly difficult process because it requires cutting tissue into many thin, fragile slices that then need to be imaged, aligned, and reconstructed. Unlike EM, hard X-…
▽ More
Comprehensive, synapse-resolution imaging of the brain will be crucial for understanding neuronal computations and function. In connectomics, this has been the sole purview of volume electron microscopy (EM), which entails an excruciatingly difficult process because it requires cutting tissue into many thin, fragile slices that then need to be imaged, aligned, and reconstructed. Unlike EM, hard X-ray imaging is compatible with thick tissues, eliminating the need for thin sectioning, and delivering fast acquisition, intrinsic alignment, and isotropic resolution. Unfortunately, current state-of-the-art X-ray microscopy provides much lower resolution, to the extent that segmenting membranes is very challenging. We propose an uncertainty-aware 3D reconstruction model that translates X-ray images to EM-like images with enhanced membrane segmentation quality, showing its potential for developing simpler, faster, and more accurate X-ray based connectomics pipelines.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
The XPRESS Challenge: Xray Projectomic Reconstruction -- Extracting Segmentation with Skeletons
Authors:
Tri Nguyen,
Mukul Narwani,
Mark Larson,
Yicong Li,
Shuhan Xie,
Hanspeter Pfister,
Donglai Wei,
Nir Shavit,
Lu Mi,
Alexandra Pacureanu,
Wei-Chung Lee,
Aaron T. Kuan
Abstract:
The wiring and connectivity of neurons form a structural basis for the function of the nervous system. Advances in volume electron microscopy (EM) and image segmentation have enabled mapping of circuit diagrams (connectomics) within local regions of the mouse brain. However, applying volume EM over the whole brain is not currently feasible due to technological challenges. As a result, comprehensiv…
▽ More
The wiring and connectivity of neurons form a structural basis for the function of the nervous system. Advances in volume electron microscopy (EM) and image segmentation have enabled mapping of circuit diagrams (connectomics) within local regions of the mouse brain. However, applying volume EM over the whole brain is not currently feasible due to technological challenges. As a result, comprehensive maps of long-range connections between brain regions are lacking. Recently, we demonstrated that X-ray holographic nanotomography (XNH) can provide high-resolution images of brain tissue at a much larger scale than EM. In particular, XNH is wellsuited to resolve large, myelinated axon tracts (white matter) that make up the bulk of long-range connections (projections) and are critical for inter-region communication. Thus, XNH provides an imaging solution for brain-wide projectomics. However, because XNH data is typically collected at lower resolutions and larger fields-of-view than EM, accurate segmentation of XNH images remains an important challenge that we present here. In this task, we provide volumetric XNH images of cortical white matter axons from the mouse brain along with ground truth annotations for axon trajectories. Manual voxel-wise annotation of ground truth is a time-consuming bottleneck for training segmentation networks. On the other hand, skeleton-based ground truth is much faster to annotate, and sufficient to determine connectivity. Therefore, we encourage participants to develop methods to leverage skeleton-based training. To this end, we provide two types of ground-truth annotations: a small volume of voxel-wise annotations and a larger volume with skeleton-based annotations. Entries will be evaluated on how accurately the submitted segmentations agree with the ground-truth skeleton annotations.
△ Less
Submitted 24 February, 2023; v1 submitted 7 February, 2023;
originally announced February 2023.
-
X-ray imaging non-destructively identifies functional 3D photonic nanostructures
Authors:
D. A. Grishina,
C. A. M. Harteveld,
A. Pacureanu,
D. Devashish,
A. Lagendijk,
P. Cloetens,
W. L. Vos
Abstract:
To investigate the performance of three-dimensional (3D) nanostructures, it is vital to study in situ their internal structure non-destructively. Hence, we perform synchrotron X-ray holographic tomography on exemplary 3D silicon photonic band gap crystals without irreversible preparation steps. Here, we obtain real space 3D density distributions of whole crystals buried on 2 mm^2 beams with 20 nan…
▽ More
To investigate the performance of three-dimensional (3D) nanostructures, it is vital to study in situ their internal structure non-destructively. Hence, we perform synchrotron X-ray holographic tomography on exemplary 3D silicon photonic band gap crystals without irreversible preparation steps. Here, we obtain real space 3D density distributions of whole crystals buried on 2 mm^2 beams with 20 nanometer resolution. Our X-ray results identify why structures that look similar in scanning electron microscopy have vastly different nanophotonic functionality: One crystal with a broad photonic gap reveals 3D periodicity as designed ("Good"), a second structure without gap reveals a buried void ("Bad"), a third one without gap is shallow due to fabrication errors ("Ugly"). We conclude that X-ray tomography is a crucial tool to critically assess 3D functional nanostructures.
△ Less
Submitted 3 August, 2018;
originally announced August 2018.
