-
Optical Label-Free Microscopy Characterization of Dielectric Nanoparticles
Authors:
Berenice Garcia Rodriguez,
Erik Olsén,
Fredrik Skärberg,
Giovanni Volpe,
Fredrik Höök,
Daniel Sundås Midtvedt
Abstract:
In order to relate nanoparticle properties to function, fast and detailed particle characterization, is needed. The ability to characterize nanoparticle samples using optical microscopy techniques has drastically improved over the past few decades; consequently, there are now numerous microscopy methods available for detailed characterization of particles with nanometric size. However, there is cu…
▽ More
In order to relate nanoparticle properties to function, fast and detailed particle characterization, is needed. The ability to characterize nanoparticle samples using optical microscopy techniques has drastically improved over the past few decades; consequently, there are now numerous microscopy methods available for detailed characterization of particles with nanometric size. However, there is currently no ``one size fits all'' solution to the problem of nanoparticle characterization. Instead, since the available techniques have different detection limits and deliver related but different quantitative information, the measurement and analysis approaches need to be selected and adapted for the sample at hand. In this tutorial, we review the optical theory of single particle scattering and how it relates to the differences and similarities in the quantitative particle information obtained from commonly used microscopy techniques, with an emphasis on nanometric (submicron) sized dielectric particles. Particular emphasis is placed on how the optical signal relates to mass, size, structure, and material properties of the detected particles and to its combination with diffusivity-based particle sizing. We also discuss emerging opportunities in the wake of new technology development, with the ambition to guide the choice of measurement strategy based on various challenges related to different types of nanoparticle samples and associated analytical demands.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Deep-learning-powered data analysis in plankton ecology
Authors:
Harshith Bachimanchi,
Matthew I. M. Pinder,
Chloé Robert,
Pierre De Wit,
Jonathan Havenhand,
Alexandra Kinnby,
Daniel Midtvedt,
Erik Selander,
Giovanni Volpe
Abstract:
The implementation of deep learning algorithms has brought new perspectives to plankton ecology. Emerging as an alternative approach to established methods, deep learning offers objective schemes to investigate plankton organisms in diverse environments. We provide an overview of deep-learning-based methods including detection and classification of phyto- and zooplankton images, foraging and swimm…
▽ More
The implementation of deep learning algorithms has brought new perspectives to plankton ecology. Emerging as an alternative approach to established methods, deep learning offers objective schemes to investigate plankton organisms in diverse environments. We provide an overview of deep-learning-based methods including detection and classification of phyto- and zooplankton images, foraging and swimming behaviour analysis, and finally ecological modelling. Deep learning has the potential to speed up the analysis and reduce the human experimental bias, thus enabling data acquisition at relevant temporal and spatial scales with improved reproducibility. We also discuss shortcomings and show how deep learning architectures have evolved to mitigate imprecise readouts. Finally, we suggest opportunities where deep learning is particularly likely to catalyze plankton research. The examples are accompanied by detailed tutorials and code samples that allow readers to apply the methods described in this review to their own data.
△ Less
Submitted 15 September, 2023;
originally announced September 2023.
-
Single-shot self-supervised particle tracking
Authors:
Benjamin Midtvedt,
Jesús Pineda,
Fredrik Skärberg,
Erik Olsén,
Harshith Bachimanchi,
Emelie Wesén,
Elin K. Esbjörner,
Erik Selander,
Fredrik Höök,
Daniel Midtvedt,
Giovanni Volpe
Abstract:
Particle tracking is a fundamental task in digital microscopy. Recently, machine-learning approaches have made great strides in overcoming the limitations of more classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on either vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, the data pr…
▽ More
Particle tracking is a fundamental task in digital microscopy. Recently, machine-learning approaches have made great strides in overcoming the limitations of more classical approaches. The training of state-of-the-art machine-learning methods almost universally relies on either vast amounts of labeled experimental data or the ability to numerically simulate realistic datasets. However, the data produced by experiments are often challenging to label and cannot be easily reproduced numerically. Here, we propose a novel deep-learning method, named LodeSTAR (Low-shot deep Symmetric Tracking And Regression), that learns to tracks objects with sub-pixel accuracy from a single unlabeled experimental image. This is made possible by exploiting the inherent roto-translational symmetries of the data. We demonstrate that LodeSTAR outperforms traditional methods in terms of accuracy. Furthermore, we analyze challenging experimental data containing densely packed cells or noisy backgrounds. We also exploit additional symmetries to extend the measurable particle properties to the particle's vertical position by propagating the signal in Fourier space and its polarizability by scaling the signal strength. Thanks to the ability to train deep-learning models with a single unlabeled image, LodeSTAR can accelerate the development of high-quality microscopic analysis pipelines for engineering, biology, and medicine.
△ Less
Submitted 28 February, 2022;
originally announced February 2022.
-
Microplankton life histories revealed by holographic microscopy and deep learning
Authors:
Harshith Bachimanchi,
Benjamin Midtvedt,
Daniel Midtvedt,
Erik Selander,
Giovanni Volpe
Abstract:
The marine microbial food web plays a central role in the global carbon cycle. Our mechanistic understanding of the ocean, however, is biased towards its larger constituents, while rates and biomass fluxes in the microbial food web are mainly inferred from indirect measurements and ensemble averages. Yet, resolution at the level of the individual microplankton is required to advance our understand…
▽ More
The marine microbial food web plays a central role in the global carbon cycle. Our mechanistic understanding of the ocean, however, is biased towards its larger constituents, while rates and biomass fluxes in the microbial food web are mainly inferred from indirect measurements and ensemble averages. Yet, resolution at the level of the individual microplankton is required to advance our understanding of the oceanic food web. Here, we demonstrate that, by combining holographic microscopy with deep learning, we can follow microplanktons throughout their lifespan, continuously measuring their three dimensional position and dry mass. The deep learning algorithms circumvent the computationally intensive processing of holographic data and allow rapid measurements over extended time periods. This permits us to reliably estimate growth rates, both in terms of dry mass increase and cell divisions, as well as to measure trophic interactions between species such as predation events. The individual resolution provides information about selectivity, individual feeding rates and handling times for individual microplanktons. This method is particularly useful to explore the flux of carbon through micro-zooplankton, the most important and least known group of primary consumers in the global oceans. We exemplify this by detailed descriptions of micro-zooplankton feeding events, cell divisions, and long term monitoring of single cells from division to division.
△ Less
Submitted 18 February, 2022;
originally announced February 2022.
-
Quantitative Digital Microscopy with Deep Learning
Authors:
Benjamin Midtvedt,
Saga Helgadottir,
Aykut Argun,
Jesús Pineda,
Daniel Midtvedt,
Giovanni Volpe
Abstract:
Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches usi…
▽ More
Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on algorithmic approaches, which are often difficult to implement, time consuming, and computationally expensive. Recently, alternative data-driven approaches using deep learning have greatly improved quantitative digital microscopy, potentially offering automatized, accurate, and fast image analysis. However, the combination of deep learning and video microscopy remains underutilized primarily due to the steep learning curve involved in developing custom deep-learning solutions. To overcome this issue, we introduce a software, DeepTrack 2.0, to design, train and validate deep-learning solutions for digital microscopy. We use it to exemplify how deep learning can be employed for a broad range of applications, from particle localization, tracking and characterization to cell counting and classification. Thanks to its user-friendly graphical interface, DeepTrack 2.0 can be easily customized for user-specific applications, and, thanks to its open-source object-oriented programming, it can be easily expanded to add features and functionalities, potentially introducing deep-learning-enhanced video microscopy to a far wider audience.
△ Less
Submitted 16 October, 2020;
originally announced October 2020.
-
Holographic characterisation of subwavelength particles enhanced by deep learning
Authors:
Benjamin Midtvedt,
Erik Olsén,
Fredrik Eklund,
Fredrik Höök,
Caroline Beck Adiels,
Giovanni Volpe,
Daniel Midtvedt
Abstract:
The characterisation of the physical properties of nanoparticles in their native environment plays a central role in a wide range of fields, from nanoparticle-enhanced drug delivery to environmental nanopollution assessment. Standard optical approaches require long trajectories of nanoparticles dispersed in a medium with known viscosity to characterise their diffusion constant and, thus, their siz…
▽ More
The characterisation of the physical properties of nanoparticles in their native environment plays a central role in a wide range of fields, from nanoparticle-enhanced drug delivery to environmental nanopollution assessment. Standard optical approaches require long trajectories of nanoparticles dispersed in a medium with known viscosity to characterise their diffusion constant and, thus, their size. However, often only short trajectories are available, while the medium viscosity is unknown, e.g., in most biomedical applications. In this work, we demonstrate a label-free method to quantify size and refractive index of individual subwavelength particles using two orders of magnitude shorter trajectories than required by standard methods, and without assumptions about the physicochemical properties of the medium. We achieve this by developing a weighted average convolutional neural network to analyse the holographic images of the particles. As a proof of principle, we distinguish and quantify size and refractive index of silica and polystyrene particles without prior knowledge of solute viscosity or refractive index. As an example of an application beyond the state of the art, we demonstrate how this technique can monitor the aggregation of polystyrene nanoparticles, revealing the time-resolved dynamics of the monomer number and fractal dimension of individual subwavelength aggregates. This technique opens new possibilities for nanoparticle characterisation with a broad range of applications from biomedicine to environmental monitoring.
△ Less
Submitted 19 June, 2020;
originally announced June 2020.
-
Multi-scale approach for strain-engineering of phosphorene
Authors:
Daniel Midtvedt,
Caio H. Lewenkopf,
Alexander Croy
Abstract:
A multi-scale approach for the theoretical description of deformed phosphorene is presented. This approach combines a valence-force model to relate macroscopic strain to microscopic displacements of atoms and a tight-binding model with distance-dependent hopping parameters to obtain electronic properties. The resulting self-consistent electromechanical model is suitable for large-scale modeling of…
▽ More
A multi-scale approach for the theoretical description of deformed phosphorene is presented. This approach combines a valence-force model to relate macroscopic strain to microscopic displacements of atoms and a tight-binding model with distance-dependent hopping parameters to obtain electronic properties. The resulting self-consistent electromechanical model is suitable for large-scale modeling of phosphorene devices. We demonstrate this for the case of an inhomogeneously deformed phosphorene drum, which may be used as an exciton funnel.
△ Less
Submitted 23 January, 2017;
originally announced January 2017.
-
Valence force model and nanomechanics of single-layer phosphorene
Authors:
Daniel Midtvedt,
Alexander Croy
Abstract:
In order to understand the relation of strain and material properties, both a microscopic model connecting a given strain to the displacement of atoms, and a macroscopic model relating applied stress to induced strain, are required. Starting from a valence-force model for black phosphorous (phosphorene) [Kaneta et al., Solid State Communications, 1982, 44, 613] we use recent experimental and compu…
▽ More
In order to understand the relation of strain and material properties, both a microscopic model connecting a given strain to the displacement of atoms, and a macroscopic model relating applied stress to induced strain, are required. Starting from a valence-force model for black phosphorous (phosphorene) [Kaneta et al., Solid State Communications, 1982, 44, 613] we use recent experimental and computational results to obtain an improved set of valence-force parameters. From the model we calculate the phonon dispersion and the elastic properties of single-layer phosphorene. Finally, we use these results to derive a complete continuum model, including the bending rigidities, valid for long-wavelength deformations of phosphorene. This continuum model is then used to study the properties of pressurized suspended phosphorene sheets.
△ Less
Submitted 21 June, 2016;
originally announced June 2016.
-
Strain-displacement relations and strain engineering in 2d materials
Authors:
Daniel Midtvedt,
Caio H. Lewenkopf,
Alexander Croy
Abstract:
We investigate the electromechanical coupling in 2d materials. For non-Bravais lattices, we find important corrections to the standard macroscopic strain - microscopic atomic-displacement theory. We put forward a general and systematic approach to calculate strain-displacement relations for several classes of 2d materials. We apply our findings to graphene as a study case, by combining a tight bin…
▽ More
We investigate the electromechanical coupling in 2d materials. For non-Bravais lattices, we find important corrections to the standard macroscopic strain - microscopic atomic-displacement theory. We put forward a general and systematic approach to calculate strain-displacement relations for several classes of 2d materials. We apply our findings to graphene as a study case, by combining a tight binding and a valence force-field model to calculate electronic and mechanical properties of graphene nanoribbons under strain. The results show good agreement with the predictions of the Dirac equation coupled to continuum mechanics. For this long wave-limit effective theory, we find that the strain-displacement relations lead to a renormalization correction to the strain-induced pseudo-magnetic fields. Implications for nanomechanical properties and electromechanical coupling in 2d materials are discussed.
△ Less
Submitted 8 September, 2015;
originally announced September 2015.
-
Strain-tuning of vacancy-induced magnetism in graphene nanoribbons
Authors:
Daniel Midtvedt,
Alexander Croy
Abstract:
Vacancies in graphene lead to the appearance of localized electronic states with non-vanishing spin moments. Using a mean-field Hubbard model and an effective double-quantum dot description we investigate the influence of strain on localization and magnetic properties of the vacancy-induced states in semiconducting armchair nanoribbons. We find that the exchange splitting of a single vacancy and t…
▽ More
Vacancies in graphene lead to the appearance of localized electronic states with non-vanishing spin moments. Using a mean-field Hubbard model and an effective double-quantum dot description we investigate the influence of strain on localization and magnetic properties of the vacancy-induced states in semiconducting armchair nanoribbons. We find that the exchange splitting of a single vacancy and the singlet-triplet splitting for two vacancies can be widely tuned by applying uniaxial strain, which is crucial for spintronic applications.
△ Less
Submitted 9 January, 2016; v1 submitted 27 April, 2015;
originally announced April 2015.
-
Nonlinear phononics using atomically thin membranes
Authors:
Daniel Midtvedt,
Andreas Isacsson,
Alexander Croy
Abstract:
Phononic crystals and acoustic meta-materials are used to tailor phonon and sound propagation properties by facilitating artificial, periodic structures. Analogous to photonic crystals, phononic band gaps can be created, which influence wave propagation and, more generally, allow engineering of the acoustic properties of a system. Beyond that, nonlinear phenomena in periodic structures have been e…
▽ More
Phononic crystals and acoustic meta-materials are used to tailor phonon and sound propagation properties by facilitating artificial, periodic structures. Analogous to photonic crystals, phononic band gaps can be created, which influence wave propagation and, more generally, allow engineering of the acoustic properties of a system. Beyond that, nonlinear phenomena in periodic structures have been extensively studied in photonic crystals and atomic Bose-Einstein Condensates in optical lattices. However, creating nonlinear phononic crystals or nonlinear acoustic meta-materials remains challenging and only few examples have been demonstrated. Here we show that atomically thin and periodically pinned membranes support coupled localized modes with nonlinear dynamics. The proposed system provides a platform for investigating nonlinear phononics.
△ Less
Submitted 6 August, 2014; v1 submitted 30 April, 2014;
originally announced April 2014.
-
FPU physics with nanomechanical graphene resonators: intrinsic relaxation and thermalization from flexural mode coupling
Authors:
Daniel Midtvedt,
Zenan Qi,
Alexander Croy,
Harold S. Park,
Andreas Isacsson
Abstract:
Thermalization in nonlinear systems is a central concept in statistical mechanics and has been extensively studied theoretically since the seminal work of Fermi, Pasta and Ulam (FPU). Using molecular dynamics and continuum modeling of a ring-down setup, we show that thermalization due to nonlinear mode coupling intrinsically limits the quality factor of nanomechanical graphene drums and turns them…
▽ More
Thermalization in nonlinear systems is a central concept in statistical mechanics and has been extensively studied theoretically since the seminal work of Fermi, Pasta and Ulam (FPU). Using molecular dynamics and continuum modeling of a ring-down setup, we show that thermalization due to nonlinear mode coupling intrinsically limits the quality factor of nanomechanical graphene drums and turns them into potential test beds for FPU physics. We find the thermalization rate $Γ$ to be independent of radius and scaling as $Γ\sim T^*/ε_{\rm pre}^2$, where $T^*$ and $ε_{\rm pre}$ are effective resonator temperature and prestrain.
△ Less
Submitted 7 April, 2014; v1 submitted 6 September, 2013;
originally announced September 2013.
-
Frequency tuning, nonlinearities and mode coupling in circular graphene resonators
Authors:
A. M. Eriksson,
D. Midtvedt,
A. Croy,
A. Isacsson
Abstract:
We study circular nanomechanical graphene resonators by means of continuum elasticity theory, treating them as membranes. We derive dynamic equations for the flexural mode amplitudes. Due to geometrical nonlinearity these can be modeled by coupled Duffing equations. By solving the Airy stress problem we obtain analytic expressions for eigenfrequencies and nonlinear coefficients as functions of rad…
▽ More
We study circular nanomechanical graphene resonators by means of continuum elasticity theory, treating them as membranes. We derive dynamic equations for the flexural mode amplitudes. Due to geometrical nonlinearity these can be modeled by coupled Duffing equations. By solving the Airy stress problem we obtain analytic expressions for eigenfrequencies and nonlinear coefficients as functions of radius, suspension height, initial tension, back-gate voltage and elastic constants, which we compare with finite element simulations. Using perturbation theory, we show that it is necessary to include the effects of the non-uniform stress distribution for finite deflections. This correctly reproduces the spectrum and frequency tuning of the resonator, including frequency crossings.
△ Less
Submitted 17 May, 2013; v1 submitted 16 May, 2013;
originally announced May 2013.
-
Nonlinear Damping in Graphene Resonators
Authors:
Alexander Croy,
Daniel Midtvedt,
Andreas Isacsson,
Jari M. Kinaret
Abstract:
Based on a continuum mechanical model for single-layer graphene we propose and analyze a microscopic mechanism for dissipation in nanoelectromechanical graphene resonators. We find that coupling between flexural modes and in-plane phonons leads to linear and nonlinear damping of out-of-plane vibrations. By tuning external parameters such as bias and ac voltages, one can cross over from a linear to…
▽ More
Based on a continuum mechanical model for single-layer graphene we propose and analyze a microscopic mechanism for dissipation in nanoelectromechanical graphene resonators. We find that coupling between flexural modes and in-plane phonons leads to linear and nonlinear damping of out-of-plane vibrations. By tuning external parameters such as bias and ac voltages, one can cross over from a linear to a nonlinear-damping dominated regime. We discuss the behavior of the effective quality factor in this context.
△ Less
Submitted 14 December, 2012; v1 submitted 4 April, 2012;
originally announced April 2012.
-
Determination of the Bending Rigidity of Graphene via Electrostatic Actuation of Buckled Membranes
Authors:
Niklas Lindahl,
Daniel Midtvedt,
Johannes Svensson,
Oleg A. Nerushev,
Niclas Lindvall,
Andreas Isacsson,
Eleanor E. B. Campbell
Abstract:
The small mass and atomic-scale thickness of graphene membranes make them highly suitable for nanoelectromechanical devices such as e.g. mass sensors, high frequency resonators or memory elements. Although only atomically thick, many of the mechanical properties of graphene membranes can be described by classical continuum mechanics. An important parameter for predicting the performance and linear…
▽ More
The small mass and atomic-scale thickness of graphene membranes make them highly suitable for nanoelectromechanical devices such as e.g. mass sensors, high frequency resonators or memory elements. Although only atomically thick, many of the mechanical properties of graphene membranes can be described by classical continuum mechanics. An important parameter for predicting the performance and linearity of graphene nanoelectromechanical devices as well as for describing ripple formation and other properties such as electron scattering mechanisms, is the bending rigidity, κ. In spite of the importance of this parameter it has so far only been estimated indirectly for monolayer graphene from the phonon spectrum of graphite, estimated from AFM measurements or predicted from ab initio calculations or bond-order potential models. Here, we employ a new approach to the experimental determination of κ by exploiting the snap-through instability in pre-buckled graphene membranes. We demonstrate the reproducible fabrication of convex buckled graphene membranes by controlling the thermal stress during the fabrication procedure and show the abrupt switching from convex to concave geometry that occurs when electrostatic pressure is applied via an underlying gate electrode. The bending rigidity of bilayer graphene membranes under ambient conditions was determined to be $35.5^{+20}_{-15}$ eV. Monolayers have significantly lower κ than bilayers.
△ Less
Submitted 20 March, 2012;
originally announced March 2012.