Mic-hackathon 2024: Hackathon on Machine Learning for Electron and Scanning Probe Microscopy
Authors:
Utkarsh Pratiush,
Austin Houston,
Kamyar Barakati,
Aditya Raghavan,
Dasol Yoon,
Harikrishnan KP,
Zhaslan Baraissov,
Desheng Ma,
Samuel S. Welborn,
Mikolaj Jakowski,
Shawn-Patrick Barhorst,
Alexander J. Pattison,
Panayotis Manganaris,
Sita Sirisha Madugula,
Sai Venkata Gayathri Ayyagari,
Vishal Kennedy,
Ralph Bulanadi,
Michelle Wang,
Kieran J. Pang,
Ian Addison-Smith,
Willy Menacho,
Horacio V. Guzman,
Alexander Kiefer,
Nicholas Furth,
Nikola L. Kolev
, et al. (48 additional authors not shown)
Abstract:
Microscopy is a primary source of information on materials structure and functionality at nanometer and atomic scales. The data generated is often well-structured, enriched with metadata and sample histories, though not always consistent in detail or format. The adoption of Data Management Plans (DMPs) by major funding agencies promotes preservation and access. However, deriving insights remains d…
▽ More
Microscopy is a primary source of information on materials structure and functionality at nanometer and atomic scales. The data generated is often well-structured, enriched with metadata and sample histories, though not always consistent in detail or format. The adoption of Data Management Plans (DMPs) by major funding agencies promotes preservation and access. However, deriving insights remains difficult due to the lack of standardized code ecosystems, benchmarks, and integration strategies. As a result, data usage is inefficient and analysis time is extensive. In addition to post-acquisition analysis, new APIs from major microscope manufacturers enable real-time, ML-based analytics for automated decision-making and ML-agent-controlled microscope operation. Yet, a gap remains between the ML and microscopy communities, limiting the impact of these methods on physics, materials discovery, and optimization. Hackathons help bridge this divide by fostering collaboration between ML researchers and microscopy experts. They encourage the development of novel solutions that apply ML to microscopy, while preparing a future workforce for instrumentation, materials science, and applied ML. This hackathon produced benchmark datasets and digital twins of microscopes to support community growth and standardized workflows. All related code is available at GitHub: https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1
△ Less
Submitted 9 June, 2025;
originally announced June 2025.
Streaming Large-Scale Electron Microscopy Data to a Supercomputing Facility
Authors:
Samuel S. Welborn,
Chris Harris,
Stephanie M. Ribet,
Georgios Varnavides,
Colin Ophus,
Bjoern Enders,
Peter Ercius
Abstract:
Data management is a critical component of modern experimental workflows. As data generation rates increase, transferring data from acquisition servers to processing servers via conventional file-based methods is becoming increasingly impractical. The 4D Camera at the National Center for Electron Microscopy (NCEM) generates data at a nominal rate of 480 Gbit/s (87,000 frames/s) producing a 700 GB…
▽ More
Data management is a critical component of modern experimental workflows. As data generation rates increase, transferring data from acquisition servers to processing servers via conventional file-based methods is becoming increasingly impractical. The 4D Camera at the National Center for Electron Microscopy (NCEM) generates data at a nominal rate of 480 Gbit/s (87,000 frames/s) producing a 700 GB dataset in fifteen seconds. To address the challenges associated with storing and processing such quantities of data, we developed a streaming workflow that utilizes a high-speed network to connect the 4D Camera's data acquisition (DAQ) system to supercomputing nodes at the National Energy Research Scientific Computing Center (NERSC), bypassing intermediate file storage entirely. In this work, we demonstrate the effectiveness of our streaming pipeline in a production setting through an hour-long experiment that generated over 10 TB of raw data, yielding high-quality datasets suitable for advanced analyses. Additionally, we compare the efficacy of this streaming workflow against the conventional file-transfer workflow by conducting a post-mortem analysis on historical data from experiments performed by real users. Our findings show that the streaming workflow significantly improves data turnaround time, enables real-time decision-making, and minimizes the potential for human error by eliminating manual user interactions.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
