-
Revealing the Evolution of Order in Materials Microstructures Using Multi-Modal Computer Vision
Authors:
Arman Ter-Petrosyan,
Michael Holden,
Jenna A. Bilbrey,
Sarah Akers,
Christina Doty,
Kayla H. Yano,
Le Wang,
Rajendra Paudel,
Eric Lang,
Khalid Hattar,
Ryan B. Comes,
Yingge Du,
Bethany E. Matthews,
Steven R. Spurgeon
Abstract:
The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal laten…
▽ More
The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La$_{1-x}$Sr$_x$FeO$_3$. We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.
△ Less
Submitted 14 November, 2024;
originally announced November 2024.
-
Final Report for CHESS: Cloud, High-Performance Computing, and Edge for Science and Security
Authors:
Nathan Tallent,
Jan Strube,
Luanzheng Guo,
Hyungro Lee,
Jesun Firoz,
Sayan Ghosh,
Bo Fang,
Oceane Bel,
Steven Spurgeon,
Sarah Akers,
Christina Doty,
Erol Cromwell
Abstract:
Automating the theory-experiment cycle requires effective distributed workflows that utilize a computing continuum spanning lab instruments, edge sensors, computing resources at multiple facilities, data sets distributed across multiple information sources, and potentially cloud. Unfortunately, the obvious methods for constructing continuum platforms, orchestrating workflow tasks, and curating dat…
▽ More
Automating the theory-experiment cycle requires effective distributed workflows that utilize a computing continuum spanning lab instruments, edge sensors, computing resources at multiple facilities, data sets distributed across multiple information sources, and potentially cloud. Unfortunately, the obvious methods for constructing continuum platforms, orchestrating workflow tasks, and curating datasets over time fail to achieve scientific requirements for performance, energy, security, and reliability. Furthermore, achieving the best use of continuum resources depends upon the efficient composition and execution of workflow tasks, i.e., combinations of numerical solvers, data analytics, and machine learning. Pacific Northwest National Laboratory's LDRD "Cloud, High-Performance Computing (HPC), and Edge for Science and Security" (CHESS) has developed a set of interrelated capabilities for enabling distributed scientific workflows and curating datasets. This report describes the results and successes of CHESS from the perspective of open science.
△ Less
Submitted 21 October, 2024;
originally announced October 2024.
-
In-Flight Performance of Spider's 280 GHz Receivers
Authors:
Elle C. Shaw,
P. A. R. Ade,
S. Akers,
M. Amiri,
J. Austermann,
J. Beall,
D. T. Becker,
S. J. Benton,
A. S. Bergman,
J. J. Bock,
J. R. Bond,
S. A. Bryan,
H. C. Chiang,
C. R. Contaldi,
R. S. Domagalski,
O. Doré,
S. M. Duff,
A. J. Duivenvoorden,
H. K. Eriksen,
M. Farhang,
J. P. Filippini,
L. M. Fissel,
A. A. Fraisse,
K. Freese,
M. Galloway
, et al. (62 additional authors not shown)
Abstract:
SPIDER is a balloon-borne instrument designed to map the cosmic microwave background at degree-angular scales in the presence of Galactic foregrounds. SPIDER has mapped a large sky area in the Southern Hemisphere using more than 2000 transition-edge sensors (TESs) during two NASA Long Duration Balloon flights above the Antarctic continent. During its first flight in January 2015, SPIDER observed i…
▽ More
SPIDER is a balloon-borne instrument designed to map the cosmic microwave background at degree-angular scales in the presence of Galactic foregrounds. SPIDER has mapped a large sky area in the Southern Hemisphere using more than 2000 transition-edge sensors (TESs) during two NASA Long Duration Balloon flights above the Antarctic continent. During its first flight in January 2015, SPIDER observed in the 95 GHz and 150 GHz frequency bands, setting constraints on the B-mode signature of primordial gravitational waves. Its second flight in the 2022-23 season added new receivers at 280 GHz, each using an array of TESs coupled to the sky through feedhorns formed from stacks of silicon wafers. These receivers are optimized to produce deep maps of polarized Galactic dust emission over a large sky area, providing a unique data set with lasting value to the field. In this work, we describe the instrument's performance during SPIDER's second flight.
△ Less
Submitted 19 August, 2024;
originally announced August 2024.
-
Deep Learning for Automated Experimentation in Scanning Transmission Electron Microscopy
Authors:
Sergei V. Kalinin,
Debangshu Mukherjee,
Kevin M. Roccapriore,
Ben Blaiszik,
Ayana Ghosh,
Maxim A. Ziatdinov,
A. Al-Najjar,
Christina Doty,
Sarah Akers,
Nageswara S. Rao,
Joshua C. Agar,
Steven R. Spurgeon
Abstract:
Machine learning (ML) has become critical for post-acquisition data analysis in (scanning) transmission electron microscopy, (S)TEM, imaging and spectroscopy. An emerging trend is the transition to real-time analysis and closed-loop microscope operation. The effective use of ML in electron microscopy now requires the development of strategies for microscopy-centered experiment workflow design and…
▽ More
Machine learning (ML) has become critical for post-acquisition data analysis in (scanning) transmission electron microscopy, (S)TEM, imaging and spectroscopy. An emerging trend is the transition to real-time analysis and closed-loop microscope operation. The effective use of ML in electron microscopy now requires the development of strategies for microscopy-centered experiment workflow design and optimization. Here, we discuss the associated challenges with the transition to active ML, including sequential data analysis and out-of-distribution drift effects, the requirements for the edge operation, local and cloud data storage, and theory in the loop operations. Specifically, we discuss the relative contributions of human scientists and ML agents in the ideation, orchestration, and execution of experimental workflows and the need to develop universal hyper languages that can apply across multiple platforms. These considerations will collectively inform the operationalization of ML in next-generation experimentation.
△ Less
Submitted 4 April, 2023;
originally announced April 2023.
-
Evaluating Stage Motion for Automated Electron Microscopy
Authors:
Kevin R. Fiedler,
Matthew Olszta,
Kayla Yano,
Christina Doty,
Derek Hopkins,
Sarah Akers,
Steven R. Spurgeon
Abstract:
Precise control is an essential and elusive quality of emerging self-driving microscopes. It is widely understood these instruments must be capable of performing rapid, high-volume, and arbitrary movements for practical self-driving operation. However, stage movements are difficult to automate at scale, owing to mechanical instability, hysteresis, and thermal drift. Such difficulties pose major ba…
▽ More
Precise control is an essential and elusive quality of emerging self-driving microscopes. It is widely understood these instruments must be capable of performing rapid, high-volume, and arbitrary movements for practical self-driving operation. However, stage movements are difficult to automate at scale, owing to mechanical instability, hysteresis, and thermal drift. Such difficulties pose major barriers to intelligent microscope designs that require repeatable, precise movements. To guide design of emerging instruments, it is necessary to understand the behavior of existing designs to identify rate limiting steps for full autonomy. Here we describe a general framework to evaluate stage motion in any electron microscope. We define metrics to evaluate stage degrees of freedom, propose solutions to improve performance, and comment on fundamental limits to automated experimentation using present hardware.
△ Less
Submitted 16 December, 2022;
originally announced December 2022.
-
An Automated Scanning Transmission Electron Microscope Guided by Sparse Data Analytics
Authors:
Matthew Olszta,
Derek Hopkins,
Kevin R. Fiedler,
Marjolein Oostrom,
Sarah Akers,
Steven R. Spurgeon
Abstract:
Artificial intelligence (AI) promises to reshape scientific inquiry and enable breakthrough discoveries in areas such as energy storage, quantum computing, and biomedicine. Scanning transmission electron microscopy (STEM), a cornerstone of the study of chemical and materials systems, stands to benefit greatly from AI-driven automation. However, present barriers to low-level instrument control, as…
▽ More
Artificial intelligence (AI) promises to reshape scientific inquiry and enable breakthrough discoveries in areas such as energy storage, quantum computing, and biomedicine. Scanning transmission electron microscopy (STEM), a cornerstone of the study of chemical and materials systems, stands to benefit greatly from AI-driven automation. However, present barriers to low-level instrument control, as well as generalizable and interpretable feature detection, make truly automated microscopy impractical. Here, we discuss the design of a closed-loop instrument control platform guided by emerging sparse data analytics. We demonstrate how a centralized controller, informed by machine learning combining limited $a$ $priori$ knowledge and task-based discrimination, can drive on-the-fly experimental decision-making. This platform unlocks practical, automated analysis of a variety of material features, enabling new high-throughput and statistical studies.
△ Less
Submitted 29 September, 2021;
originally announced September 2021.
-
Design of a Graphical User Interface for Few-Shot Machine Learning Classification of Electron Microscopy Data
Authors:
Christina Doty,
Shaun Gallagher,
Wenqi Cui,
Wenya Chen,
Shweta Bhushan,
Marjolein Oostrom,
Sarah Akers,
Steven R. Spurgeon
Abstract:
The recent growth in data volumes produced by modern electron microscopes requires rapid, scalable, and flexible approaches to image segmentation and analysis. Few-shot machine learning, which can richly classify images from a handful of user-provided examples, is a promising route to high-throughput analysis. However, current command-line implementations of such approaches can be slow and unintui…
▽ More
The recent growth in data volumes produced by modern electron microscopes requires rapid, scalable, and flexible approaches to image segmentation and analysis. Few-shot machine learning, which can richly classify images from a handful of user-provided examples, is a promising route to high-throughput analysis. However, current command-line implementations of such approaches can be slow and unintuitive to use, lacking the real-time feedback necessary to perform effective classification. Here we report on the development of a Python-based graphical user interface that enables end users to easily conduct and visualize the output of few-shot learning models. This interface is lightweight and can be hosted locally or on the web, providing the opportunity to reproducibly conduct, share, and crowd-source few-shot analyses.
△ Less
Submitted 21 July, 2021;
originally announced July 2021.
-
A Topological-Framework to Improve Analysis of Machine Learning Model Performance
Authors:
Henry Kvinge,
Colby Wight,
Sarah Akers,
Scott Howland,
Woongjo Choi,
Xiaolong Ma,
Luke Gosink,
Elizabeth Jurrus,
Keerti Kappagantula,
Tegan H. Emerson
Abstract:
As both machine learning models and the datasets on which they are evaluated have grown in size and complexity, the practice of using a few summary statistics to understand model performance has become increasingly problematic. This is particularly true in real-world scenarios where understanding model failure on certain subpopulations of the data is of critical importance. In this paper we propos…
▽ More
As both machine learning models and the datasets on which they are evaluated have grown in size and complexity, the practice of using a few summary statistics to understand model performance has become increasingly problematic. This is particularly true in real-world scenarios where understanding model failure on certain subpopulations of the data is of critical importance. In this paper we propose a topological framework for evaluating machine learning models in which a dataset is treated as a "space" on which a model operates. This provides us with a principled way to organize information about model performance at both the global level (over the entire test set) and also the local level (on specific subpopulations). Finally, we describe a topological data structure, presheaves, which offer a convenient way to store and analyze model performance between different subpopulations.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Design and pre-flight performance of SPIDER 280 GHz receivers
Authors:
E. C. Shaw,
P. A. R. Ade,
S. Akers,
M. Amiri,
J. Austermann,
J. Beall,
D. T. Becker,
S. J. Benton,
A. S. Bergman,
J. J. Bock,
J. R. Bond,
S. A. Bryan,
H. C. Chiang,
C. R. Contaldi,
R. S. Domagalski,
O. Doré,
S. M. Duff,
A. J. Duivenvoorden,
H. K. Eriksen,
M. Farhang,
J. P. Filippini,
L. M. Fissel,
A. A. Fraisse,
K. Freese,
M. Galloway
, et al. (57 additional authors not shown)
Abstract:
In this work we describe upgrades to the Spider balloon-borne telescope in preparation for its second flight, currently planned for December 2021. The Spider instrument is optimized to search for a primordial B-mode polarization signature in the cosmic microwave background at degree angular scales. During its first flight in 2015, Spider mapped ~10% of the sky at 95 and 150 GHz. The payload for th…
▽ More
In this work we describe upgrades to the Spider balloon-borne telescope in preparation for its second flight, currently planned for December 2021. The Spider instrument is optimized to search for a primordial B-mode polarization signature in the cosmic microwave background at degree angular scales. During its first flight in 2015, Spider mapped ~10% of the sky at 95 and 150 GHz. The payload for the second Antarctic flight will incorporate three new 280 GHz receivers alongside three refurbished 95- and 150 GHz receivers from Spider's first flight. In this work we discuss the design and characterization of these new receivers, which employ over 1500 feedhorn-coupled transition-edge sensors. We describe pre-flight laboratory measurements of detector properties, and the optical performance of completed receivers. These receivers will map a wide area of the sky at 280 GHz, providing new information on polarized Galactic dust emission that will help to separate it from the cosmological signal.
△ Less
Submitted 22 December, 2020;
originally announced December 2020.
-
280 GHz Focal Plane Unit Design and Characterization for the SPIDER-2 Suborbital Polarimeter
Authors:
A. S. Bergman,
P. A. R. Ade,
S. Akers,
M. Amiri,
J. A. Austermann,
J. A. Beall,
D. T. Becker,
S. J. Benton,
J. J. Bock,
J. R. Bond,
S. A. Bryan,
H. C. Chiang,
C. R. Contaldi,
R. S Domagalski,
O. Doré,
S. M. Duff,
A. J. Duivenvoorden,
H. K. Eriksen,
M. Farhang,
J. P. Filippini,
L. M. Fissel,
A. A. Fraisse,
K. Freese,
M. Galloway,
A. E. Gambrel
, et al. (54 additional authors not shown)
Abstract:
We describe the construction and characterization of the 280 GHz bolometric focal plane units (FPUs) to be deployed on the second flight of the balloon-borne SPIDER instrument. These FPUs are vital to SPIDER's primary science goal of detecting or placing an upper limit on the amplitude of the primordial gravitational wave signature in the cosmic microwave background (CMB) by constraining the B-mod…
▽ More
We describe the construction and characterization of the 280 GHz bolometric focal plane units (FPUs) to be deployed on the second flight of the balloon-borne SPIDER instrument. These FPUs are vital to SPIDER's primary science goal of detecting or placing an upper limit on the amplitude of the primordial gravitational wave signature in the cosmic microwave background (CMB) by constraining the B-mode contamination in the CMB from Galactic dust emission. Each 280 GHz focal plane contains a 16 x 16 grid of corrugated silicon feedhorns coupled to an array of aluminum-manganese transition-edge sensor (TES) bolometers fabricated on 150 mm diameter substrates. In total, the three 280 GHz FPUs contain 1,530 polarization sensitive bolometers (765 spatial pixels) optimized for the low loading environment in flight and read out by time-division SQUID multiplexing. In this paper we describe the mechanical, thermal, and magnetic shielding architecture of the focal planes and present cryogenic measurements which characterize yield and the uniformity of several bolometer parameters. The assembled FPUs have high yields, with one array as high as 95% including defects from wiring and readout. We demonstrate high uniformity in device parameters, finding the median saturation power for each TES array to be ~3 pW at 300 mK with a less than 6% variation across each array at one standard deviation. These focal planes will be deployed alongside the 95 and 150 GHz telescopes in the SPIDER-2 instrument, slated to fly from McMurdo Station in Antarctica in December 2018.
△ Less
Submitted 22 November, 2017; v1 submitted 11 November, 2017;
originally announced November 2017.
