-
EAP4EMSIG -- Enhancing Event-Driven Microscopy for Microfluidic Single-Cell Analysis
Authors:
Nils Friederich,
Angelo Jovin Yamachui Sitcheu,
Annika Nassal,
Erenus Yildiz,
Matthias Pesch,
Maximilian Beichter,
Lukas Scholtes,
Bahar Akbaba,
Thomas Lautenschlager,
Oliver Neumann,
Dietrich Kohlheyer,
Hanno Scharr,
Johannes Seiffarth,
Katharina Nöh,
Ralf Mikut
Abstract:
Microfluidic Live-Cell Imaging (MLCI) yields data on microbial cell factories. However, continuous acquisition is challenging as high-throughput experiments often lack real-time insights, delaying responses to stochastic events. We introduce three components in the Experiment Automation Pipeline for Event-Driven Microscopy to Smart Microfluidic Single-Cell Analysis (EAP4EMSIG): a fast, accurate Mu…
▽ More
Microfluidic Live-Cell Imaging (MLCI) yields data on microbial cell factories. However, continuous acquisition is challenging as high-throughput experiments often lack real-time insights, delaying responses to stochastic events. We introduce three components in the Experiment Automation Pipeline for Event-Driven Microscopy to Smart Microfluidic Single-Cell Analysis (EAP4EMSIG): a fast, accurate Multi-Layer Perceptron (MLP)-based autofocusing method predicting the focus offset, an evaluation of real-time segmentation methods and a real-time data analysis dashboard. Our MLP-based autofocusing achieves a Mean Absolute Error (MAE) of 0.105 $μ$m with inference times from 87 ms. Among eleven evaluated Deep Learning (DL) segmentation methods, Cellpose reached a Panoptic Quality (PQ) of 93.36 %, while a distance-based method was fastest (121 ms, Panoptic Quality 93.02 %).
△ Less
Submitted 7 July, 2025; v1 submitted 30 March, 2025;
originally announced April 2025.
-
How To Make Your Cell Tracker Say "I dunno!"
Authors:
Richard D. Paul,
Johannes Seiffarth,
David Rügamer,
Hanno Scharr,
Katharina Nöh
Abstract:
Cell tracking is a key computational task in live-cell microscopy, but fully automated analysis of high-throughput imaging requires reliable and, thus, uncertainty-aware data analysis tools, as the amount of data recorded within a single experiment exceeds what humans are able to overlook. We here propose and benchmark various methods to reason about and quantify uncertainty in linear assignment-b…
▽ More
Cell tracking is a key computational task in live-cell microscopy, but fully automated analysis of high-throughput imaging requires reliable and, thus, uncertainty-aware data analysis tools, as the amount of data recorded within a single experiment exceeds what humans are able to overlook. We here propose and benchmark various methods to reason about and quantify uncertainty in linear assignment-based cell tracking algorithms. Our methods take inspiration from statistics and machine learning, leveraging two perspectives on the cell tracking problem explored throughout this work: Considering it as a Bayesian inference problem and as a classification problem. Our methods admit a framework-like character in that they equip any frame-to-frame tracking method with uncertainty quantification. We demonstrate this by applying it to various existing tracking algorithms including the recently presented Transformer-based trackers. We demonstrate empirically that our methods yield useful and well-calibrated tracking uncertainties.
△ Less
Submitted 12 March, 2025;
originally announced March 2025.
-
EAP4EMSIG -- Experiment Automation Pipeline for Event-Driven Microscopy to Smart Microfluidic Single-Cells Analysis
Authors:
Nils Friederich,
Angelo Jovin Yamachui Sitcheu,
Annika Nassal,
Matthias Pesch,
Erenus Yildiz,
Maximilian Beichter,
Lukas Scholtes,
Bahar Akbaba,
Thomas Lautenschlager,
Oliver Neumann,
Dietrich Kohlheyer,
Hanno Scharr,
Johannes Seiffarth,
Katharina Nöh,
Ralf Mikut
Abstract:
Microfluidic Live-Cell Imaging (MLCI) generates high-quality data that allows biotechnologists to study cellular growth dynamics in detail. However, obtaining these continuous data over extended periods is challenging, particularly in achieving accurate and consistent real-time event classification at the intersection of imaging and stochastic biology. To address this issue, we introduce the Exper…
▽ More
Microfluidic Live-Cell Imaging (MLCI) generates high-quality data that allows biotechnologists to study cellular growth dynamics in detail. However, obtaining these continuous data over extended periods is challenging, particularly in achieving accurate and consistent real-time event classification at the intersection of imaging and stochastic biology. To address this issue, we introduce the Experiment Automation Pipeline for Event-Driven Microscopy to Smart Microfluidic Single-Cells Analysis (EAP4EMSIG). In particular, we present initial zero-shot results from the real-time segmentation module of our approach. Our findings indicate that among four State-Of-The- Art (SOTA) segmentation methods evaluated, Omnipose delivers the highest Panoptic Quality (PQ) score of 0.9336, while Contour Proposal Network (CPN) achieves the fastest inference time of 185 ms with the second-highest PQ score of 0.8575. Furthermore, we observed that the vision foundation model Segment Anything is unsuitable for this particular use case.
△ Less
Submitted 6 November, 2024;
originally announced November 2024.
-
Robust Approximate Characterization of Single-Cell Heterogeneity in Microbial Growth
Authors:
Richard D. Paul,
Johannes Seiffarth,
Hanno Scharr,
Katharina Nöh
Abstract:
Live-cell microscopy allows to go beyond measuring average features of cellular populations to observe, quantify and explain biological heterogeneity. Deep Learning-based instance segmentation and cell tracking form the gold standard analysis tools to process the microscopy data collected, but tracking in particular suffers severely from low temporal resolution. In this work, we show that approxim…
▽ More
Live-cell microscopy allows to go beyond measuring average features of cellular populations to observe, quantify and explain biological heterogeneity. Deep Learning-based instance segmentation and cell tracking form the gold standard analysis tools to process the microscopy data collected, but tracking in particular suffers severely from low temporal resolution. In this work, we show that approximating cell cycle time distributions in microbial colonies of C. glutamicum is possible without performing tracking, even at low temporal resolution. To this end, we infer the parameters of a stochastic multi-stage birth process model using the Bayesian Synthetic Likelihood method at varying temporal resolutions by subsampling microscopy sequences, for which ground truth tracking is available. Our results indicate, that the proposed approach yields high quality approximations even at very low temporal resolution, where tracking fails to yield reasonable results.
△ Less
Submitted 8 August, 2024;
originally announced August 2024.
