-
Mic-hackathon 2024: Hackathon on Machine Learning for Electron and Scanning Probe Microscopy
Authors:
Utkarsh Pratiush,
Austin Houston,
Kamyar Barakati,
Aditya Raghavan,
Dasol Yoon,
Harikrishnan KP,
Zhaslan Baraissov,
Desheng Ma,
Samuel S. Welborn,
Mikolaj Jakowski,
Shawn-Patrick Barhorst,
Alexander J. Pattison,
Panayotis Manganaris,
Sita Sirisha Madugula,
Sai Venkata Gayathri Ayyagari,
Vishal Kennedy,
Ralph Bulanadi,
Michelle Wang,
Kieran J. Pang,
Ian Addison-Smith,
Willy Menacho,
Horacio V. Guzman,
Alexander Kiefer,
Nicholas Furth,
Nikola L. Kolev
, et al. (48 additional authors not shown)
Abstract:
Microscopy is a primary source of information on materials structure and functionality at nanometer and atomic scales. The data generated is often well-structured, enriched with metadata and sample histories, though not always consistent in detail or format. The adoption of Data Management Plans (DMPs) by major funding agencies promotes preservation and access. However, deriving insights remains d…
▽ More
Microscopy is a primary source of information on materials structure and functionality at nanometer and atomic scales. The data generated is often well-structured, enriched with metadata and sample histories, though not always consistent in detail or format. The adoption of Data Management Plans (DMPs) by major funding agencies promotes preservation and access. However, deriving insights remains difficult due to the lack of standardized code ecosystems, benchmarks, and integration strategies. As a result, data usage is inefficient and analysis time is extensive. In addition to post-acquisition analysis, new APIs from major microscope manufacturers enable real-time, ML-based analytics for automated decision-making and ML-agent-controlled microscope operation. Yet, a gap remains between the ML and microscopy communities, limiting the impact of these methods on physics, materials discovery, and optimization. Hackathons help bridge this divide by fostering collaboration between ML researchers and microscopy experts. They encourage the development of novel solutions that apply ML to microscopy, while preparing a future workforce for instrumentation, materials science, and applied ML. This hackathon produced benchmark datasets and digital twins of microscopes to support community growth and standardized workflows. All related code is available at GitHub: https://github.com/KalininGroup/Mic-hackathon-2024-codes-publication/tree/1.0.0.1
△ Less
Submitted 9 June, 2025;
originally announced June 2025.
-
Exploring Domain Wall Pinning in Ferroelectrics via Automated High Throughput AFM
Authors:
Kamyar Barakati,
Yu Liu,
Hiroshi Funakubo,
Sergei V. Kalinin
Abstract:
Domain-wall dynamics in ferroelectric materials are strongly position-dependent since each polar interface is locked into a unique local microstructure. This necessitates spatially resolved studies of the wall-pinning using scanning-probe microscopy techniques. The pinning centers and preexisting domain walls are usually sparse within image plane, precluding the use of dense hyperspectral imaging…
▽ More
Domain-wall dynamics in ferroelectric materials are strongly position-dependent since each polar interface is locked into a unique local microstructure. This necessitates spatially resolved studies of the wall-pinning using scanning-probe microscopy techniques. The pinning centers and preexisting domain walls are usually sparse within image plane, precluding the use of dense hyperspectral imaging modes and requiring time-consuming human experimentation. Here, a large area epitaxial PbTiO$_3$ film on cubic KTaO$_3$ were investigated to quantify the electric field driven dynamics of the polar-strain domain structures using ML-controlled automated Piezoresponse Force Microscopy. Analysis of 1500 switching events reveals that domain wall displacement depends not only on field parameters but also on the local ferroelectric-ferroelastic configuration. For example, twin boundaries in polydomains regions like a$_1^-$/$c^+$ $\parallel$ a$_2^-$/$c^-$ stay pinned up to a certain level of bias magnitude and change only marginally as the bias increases from 20V to 30V, whereas single variant boundaries like a$_2^+$/$c^+$ $\parallel$ a$_2^-$/$c^-$ stack are already activated at 20V. These statistics on the possible ferroelectric and ferroelastic wall orientations, together with the automated, high-throughput AFM workflow, can be distilled into a predictive map that links domain configurations to pulse parameters. This microstructure-specific rule set forms the foundation for designing ferroelectric memories.
△ Less
Submitted 29 May, 2025;
originally announced May 2025.
-
Rewards-based image analysis in microscopy
Authors:
Kamyar Barakati,
Yu Liu,
Utkarsh Pratiush,
Boris N. Slautin,
Sergei V. Kalinin
Abstract:
Analyzing imaging and hyperspectral data is crucial across scientific fields, including biology, medicine, chemistry, and physics. The primary goal is to transform high-resolution or high-dimensional data into an interpretable format to generate actionable insights, aiding decision-making and advancing knowledge. Currently, this task relies on complex, human-designed workflows comprising iterative…
▽ More
Analyzing imaging and hyperspectral data is crucial across scientific fields, including biology, medicine, chemistry, and physics. The primary goal is to transform high-resolution or high-dimensional data into an interpretable format to generate actionable insights, aiding decision-making and advancing knowledge. Currently, this task relies on complex, human-designed workflows comprising iterative steps such as denoising, spatial sampling, keypoint detection, feature generation, clustering, dimensionality reduction, and physics-based deconvolutions. The introduction of machine learning over the past decade has accelerated tasks like image segmentation and object detection via supervised learning, and dimensionality reduction via unsupervised methods. However, both classical and NN-based approaches still require human input, whether for hyperparameter tuning, data labeling, or both. The growing use of automated imaging tools, from atomically resolved imaging to biological applications, demands unsupervised methods that optimize data representation for human decision-making or autonomous experimentation. Here, we discuss advances in reward-based workflows, which adopt expert decision-making principles and demonstrate strong transfer learning across diverse tasks. We represent image analysis as a decision-making process over possible operations and identify desiderata and their mappings to classical decision-making frameworks. Reward-driven workflows enable a shift from supervised, black-box models sensitive to distribution shifts to explainable, unsupervised, and robust optimization in image analysis. They can function as wrappers over classical and DCNN-based methods, making them applicable to both unsupervised and supervised workflows (e.g., classification, regression for structure-property mapping) across imaging and hyperspectral data.
△ Less
Submitted 23 February, 2025;
originally announced February 2025.
-
Materials Discovery in Combinatorial and High-throughput Synthesis and Processing: A New Frontier for SPM
Authors:
Boris N. Slautin,
Yongtao Liu,
Kamyar Barakati,
Yu Liu,
Reece Emery,
Seungbum Hong,
Astita Dubey,
Vladimir V. Shvartsman,
Doru C. Lupascu,
Sheryl L. Sanchez,
Mahshid Ahmadi,
Yunseok Kim,
Evgheni Strelcov,
Keith A. Brown,
Philip D. Rack,
Sergei V. Kalinin
Abstract:
For over three decades, scanning probe microscopy (SPM) has been a key method for exploring material structures and functionalities at nanometer and often atomic scales in ambient, liquid, and vacuum environments. Historically, SPM applications have predominantly been downstream, with images and spectra serving as a qualitative source of data on the microstructure and properties of materials, and…
▽ More
For over three decades, scanning probe microscopy (SPM) has been a key method for exploring material structures and functionalities at nanometer and often atomic scales in ambient, liquid, and vacuum environments. Historically, SPM applications have predominantly been downstream, with images and spectra serving as a qualitative source of data on the microstructure and properties of materials, and in rare cases of fundamental physical knowledge. However, the fast-growing developments in accelerated material synthesis via self-driving labs and established applications such as combinatorial spread libraries are poised to change this paradigm. Rapid synthesis demands matching capabilities to probe structure and functionalities of materials on small scales and with high throughput. SPM inherently meets these criteria, offering a rich and diverse array of data from a single measurement. Here, we overview SPM methods applicable to these emerging applications and emphasize their quantitativeness, focusing on piezoresponse force microscopy, electrochemical strain microscopy, conductive, and surface photovoltage measurements. We discuss the challenges and opportunities ahead, asserting that SPM will play a crucial role in closing the loop from material prediction and synthesis to characterization.
△ Less
Submitted 11 April, 2025; v1 submitted 5 January, 2025;
originally announced January 2025.
