-
Rendering Large Volume Datasets in Unreal Engine 5: A Survey
Authors:
Markus Schlüter,
Tom Kwasnitschka,
Armin Bernstetter,
Jens Karstens
Abstract:
In this technical report, we discuss several approaches to in-core rendering of large volumetric datasets in Unreal Engine 5 (UE5). We explore the following methods: the TBRayMarcher Plugin, the Niagara Fluids Plugin , and various approaches using Sparse Volume Textures (SVT), with a particular focus on Heterogeneous Volumes (HV). We found the HV approach to be the most promising. The biggest chal…
▽ More
In this technical report, we discuss several approaches to in-core rendering of large volumetric datasets in Unreal Engine 5 (UE5). We explore the following methods: the TBRayMarcher Plugin, the Niagara Fluids Plugin , and various approaches using Sparse Volume Textures (SVT), with a particular focus on Heterogeneous Volumes (HV). We found the HV approach to be the most promising. The biggest challenge we encountered with other approaches was the need to chunk datasets so that each fits into volume textures smaller than one gigavoxel. While this enables display of the entire dataset at reasonable frame rates, it introduces noticeable artifacts at chunk borders due to incorrect lighting, as each chunk lacks information about its neighbors. After addressing some (signed) int32 overflows in the Engine's SVT-related source code by converting them to to (unsigned) uint32 or int64, the SVT-based HV system allows us to render sparse datasets up to 32k x 32k x 16k voxels, provided the compressed tile data (including MIP data and padding for correct interpolation) does not exceed 4 gigavoxels. In the future, we intend to extend the existing SVT streaming functionality to support out-of-core rendering, in order to eventually overcome VRAM limitations, graphics API constraints, and the performance issues associated with 64-bit arithmetic in GPU shaders.
△ Less
Submitted 10 April, 2025;
originally announced April 2025.
-
Reproducibility of Large Eddy Simulations for mixing in stirred tank reactors
Authors:
Cees Haringa,
Ryan Rautenbach,
Héctor Maldonado de Léon,
Pieter Brorens,
Michael Schlüter
Abstract:
CFD simulations are widely used to quantify mixing performance of stirred tanks, for various applications in chemical engineering and biotechnology. Due to advances in GPU computing, more and more often these simulations make use of Large Eddy Simulations (LES), which explicitly simulate the dynamics of large-scale turbulence. Although these simulations are fully deterministic and hence theoretica…
▽ More
CFD simulations are widely used to quantify mixing performance of stirred tanks, for various applications in chemical engineering and biotechnology. Due to advances in GPU computing, more and more often these simulations make use of Large Eddy Simulations (LES), which explicitly simulate the dynamics of large-scale turbulence. Although these simulations are fully deterministic and hence theoretically reproducible, small numerical variations induced by round-off errors combined with differences in distribution and order of operations in parallel computing lead to separation of trajectories, i.e. different flowfield evolutions and different mixing times between repeat simulations, even on the same architecture. We investigate the impact of repeat simulations on the mixing time distribution observed in a $30 \liter$ stirred vessel with two commercial CFD packages, and compare to experimental variability. While the distribution between simulations and experiments is in very good agreement, we do conclude confidence intervals should be reported for CFD simulations of mixing.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
-
MVIP -- A Dataset and Methods for Application Oriented Multi-View and Multi-Modal Industrial Part Recognition
Authors:
Paul Koch,
Marian Schlüter,
Jörg Krüger
Abstract:
We present MVIP, a novel dataset for multi-modal and multi-view application-oriented industrial part recognition. Here we are the first to combine a calibrated RGBD multi-view dataset with additional object context such as physical properties, natural language, and super-classes. The current portfolio of available datasets offers a wide range of representations to design and benchmark related meth…
▽ More
We present MVIP, a novel dataset for multi-modal and multi-view application-oriented industrial part recognition. Here we are the first to combine a calibrated RGBD multi-view dataset with additional object context such as physical properties, natural language, and super-classes. The current portfolio of available datasets offers a wide range of representations to design and benchmark related methods. In contrast to existing classification challenges, industrial recognition applications offer controlled multi-modal environments but at the same time have different problems than traditional 2D/3D classification challenges. Frequently, industrial applications must deal with a small amount or increased number of training data, visually similar parts, and varying object sizes, while requiring a robust near 100% top 5 accuracy under cost and time constraints. Current methods tackle such challenges individually, but direct adoption of these methods within industrial applications is complex and requires further research. Our main goal with MVIP is to study and push transferability of various state-of-the-art methods within related downstream tasks towards an efficient deployment of industrial classifiers. Additionally, we intend to push with MVIP research regarding several modality fusion topics, (automated) synthetic data generation, and complex data sampling -- combined in a single application-oriented benchmark.
△ Less
Submitted 21 February, 2025;
originally announced February 2025.
-
Wireless and passive pressure detection using magneto-mechanical resonances in process engineering
Authors:
Timo Merbach,
Felix Kexel,
Jonas Faltinath,
Martin Möddel,
Michael Schlüter,
Tobias Knopp,
Fabian Mohn
Abstract:
A custom-developed magneto-mechanical resonator (MMR) for wireless pressure measurement is investigated for potential applications in process engineering. The MMR sensor utilises changes in the resonance frequency caused by pressure on a flexible 3D printed membrane. The thickness of the printed membrane plays a crucial role in determining the performance and sensitivity of MMRs, and can be tailor…
▽ More
A custom-developed magneto-mechanical resonator (MMR) for wireless pressure measurement is investigated for potential applications in process engineering. The MMR sensor utilises changes in the resonance frequency caused by pressure on a flexible 3D printed membrane. The thickness of the printed membrane plays a crucial role in determining the performance and sensitivity of MMRs, and can be tailored to meet the requirements of specific applications. The study includes static and dynamic measurements to determine the pressure sensitivity and temporal resolution of the sensor. The results show a minimum sensitivity of $0.06~\text{Hz mbar}^{-1}$ and are in agreement with theoretical calculations and measurements. The maximum sensor readout frequency is $2~\text{Hz}$ in this study. Additionally, the temperature dependence of the sensor is investigated, revealing a significant dependence of the resonance frequency on temperature. The developed MMR offers a promising and versatile method for precise pressure measurements in process engineering environments.
△ Less
Submitted 13 February, 2025;
originally announced February 2025.
-
Virtual Fieldwork in Immersive Environments using Game Engines
Authors:
Armin Bernstetter,
Tom Kwasnitschka,
Jens Karstens,
Markus Schlüter,
Isabella Peters
Abstract:
Fieldwork still is the first and foremost source of insight in many disciplines of the geosciences. Virtual fieldwork is an approach meant to enable scientists trained in fieldwork to apply these skills to a virtual representation of outcrops that are inaccessible to humans e.g. due to being located on the seafloor. For this purpose we develop a virtual fieldwork software in the game engine and 3D…
▽ More
Fieldwork still is the first and foremost source of insight in many disciplines of the geosciences. Virtual fieldwork is an approach meant to enable scientists trained in fieldwork to apply these skills to a virtual representation of outcrops that are inaccessible to humans e.g. due to being located on the seafloor. For this purpose we develop a virtual fieldwork software in the game engine and 3D creation tool Unreal Engine. This software is developed specifically for a large, spatially immersive environment as well as virtual reality using head-mounted displays. It contains multiple options for quantitative measurements of visualized 3D model data. We visualize three distinct real-world datasets gathered by different photogrammetric and bathymetric methods as use cases and gather initial feedback from domain experts.
△ Less
Submitted 17 December, 2024; v1 submitted 29 August, 2024;
originally announced August 2024.
-
Navigating simplicity and complexity of social-ecological systems through a dialog between dynamical systems and agent-based models
Authors:
Sonja Radosavljevic,
Udita Sanga,
Maja Schlüter
Abstract:
Social-ecological systems research aims to understand the nature of social-ecological phenomena, to find ways to foster or manage conditions under which desired phenomena occur or to reduce the negative consequences of undesirable phenomena. Such challenges are often addressed using dynamical systems models (DSM) or agent-based models (ABM). Here we develop an iterative procedure for combining DSM…
▽ More
Social-ecological systems research aims to understand the nature of social-ecological phenomena, to find ways to foster or manage conditions under which desired phenomena occur or to reduce the negative consequences of undesirable phenomena. Such challenges are often addressed using dynamical systems models (DSM) or agent-based models (ABM). Here we develop an iterative procedure for combining DSM and ABM to leverage their strengths and gain insights that surpass insights obtained by each approach separately. The procedure uses results of an ABM as inputs for a DSM development. In the following steps, results of the DSM analyses guide future analysis of the ABM and vice versa. This dialogue, more than having a tight connection between the models, enables pushing the research frontier, expanding the set of research questions and insights. We illustrate our method with the example of poverty traps and innovation in agricultural systems, but our conclusions are general and can be applied to other DSM-ABM combinations.
△ Less
Submitted 24 June, 2024; v1 submitted 19 February, 2024;
originally announced February 2024.
-
Revisiting the Performance-Explainability Trade-Off in Explainable Artificial Intelligence (XAI)
Authors:
Barnaby Crook,
Maximilian Schlüter,
Timo Speith
Abstract:
Within the field of Requirements Engineering (RE), the increasing significance of Explainable Artificial Intelligence (XAI) in aligning AI-supported systems with user needs, societal expectations, and regulatory standards has garnered recognition. In general, explainability has emerged as an important non-functional requirement that impacts system quality. However, the supposed trade-off between e…
▽ More
Within the field of Requirements Engineering (RE), the increasing significance of Explainable Artificial Intelligence (XAI) in aligning AI-supported systems with user needs, societal expectations, and regulatory standards has garnered recognition. In general, explainability has emerged as an important non-functional requirement that impacts system quality. However, the supposed trade-off between explainability and performance challenges the presumed positive influence of explainability. If meeting the requirement of explainability entails a reduction in system performance, then careful consideration must be given to which of these quality aspects takes precedence and how to compromise between them. In this paper, we critically examine the alleged trade-off. We argue that it is best approached in a nuanced way that incorporates resource availability, domain characteristics, and considerations of risk. By providing a foundation for future research and best practices, this work aims to advance the field of RE for AI.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
The Power of Typed Affine Decision Structures: A Case Study
Authors:
Gerrit Nolte,
Maximilian Schlüter,
Alnis Murtovi,
Bernhard Steffen
Abstract:
TADS are a novel, concise white-box representation of neural networks. In this paper, we apply TADS to the problem of neural network verification, using them to generate either proofs or concise error characterizations for desirable neural network properties. In a case study, we consider the robustness of neural networks to adversarial attacks, i.e., small changes to an input that drastically chan…
▽ More
TADS are a novel, concise white-box representation of neural networks. In this paper, we apply TADS to the problem of neural network verification, using them to generate either proofs or concise error characterizations for desirable neural network properties. In a case study, we consider the robustness of neural networks to adversarial attacks, i.e., small changes to an input that drastically change a neural networks perception, and show that TADS can be used to provide precise diagnostics on how and where robustness errors a occur. We achieve these results by introducing Precondition Projection, a technique that yields a TADS describing network behavior precisely on a given subset of its input space, and combining it with PCA, a traditional, well-understood dimensionality reduction technique. We show that PCA is easily compatible with TADS. All analyses can be implemented in a straightforward fashion using the rich algebraic properties of TADS, demonstrating the utility of the TADS framework for neural network explainability and verification. While TADS do not yet scale as efficiently as state-of-the-art neural network verifiers, we show that, using PCA-based simplifications, they can still scale to mediumsized problems and yield concise explanations for potential errors that can be used for other purposes such as debugging a network or generating new training samples.
△ Less
Submitted 28 April, 2023;
originally announced April 2023.
-
Towards Rigorous Understanding of Neural Networks via Semantics-preserving Transformations
Authors:
Maximilian Schlüter,
Gerrit Nolte,
Alnis Murtovi,
Bernhard Steffen
Abstract:
In this paper we present an algebraic approach to the precise and global verification and explanation of Rectifier Neural Networks, a subclass of Piece-wise Linear Neural Networks (PLNNs), i.e., networks that semantically represent piece-wise affine functions. Key to our approach is the symbolic execution of these networks that allows the construction of semantically equivalent Typed Affine Decisi…
▽ More
In this paper we present an algebraic approach to the precise and global verification and explanation of Rectifier Neural Networks, a subclass of Piece-wise Linear Neural Networks (PLNNs), i.e., networks that semantically represent piece-wise affine functions. Key to our approach is the symbolic execution of these networks that allows the construction of semantically equivalent Typed Affine Decision Structures (TADS). Due to their deterministic and sequential nature, TADS can, similarly to decision trees, be considered as white-box models and therefore as precise solutions to the model and outcome explanation problem. TADS are linear algebras which allows one to elegantly compare Rectifier Networks for equivalence or similarity, both with precise diagnostic information in case of failure, and to characterize their classification potential by precisely characterizing the set of inputs that are specifically classified or the set of inputs where two network-based classifiers differ. All phenomena are illustrated along a detailed discussion of a minimal, illustrative example: the continuous XOR function.
△ Less
Submitted 28 April, 2023; v1 submitted 19 January, 2023;
originally announced January 2023.
-
Natural Synthetic Anomalies for Self-Supervised Anomaly Detection and Localization
Authors:
Hannah M. Schlüter,
Jeremy Tan,
Benjamin Hou,
Bernhard Kainz
Abstract:
We introduce a simple and intuitive self-supervision task, Natural Synthetic Anomalies (NSA), for training an end-to-end model for anomaly detection and localization using only normal training data. NSA integrates Poisson image editing to seamlessly blend scaled patches of various sizes from separate images. This creates a wide range of synthetic anomalies which are more similar to natural sub-ima…
▽ More
We introduce a simple and intuitive self-supervision task, Natural Synthetic Anomalies (NSA), for training an end-to-end model for anomaly detection and localization using only normal training data. NSA integrates Poisson image editing to seamlessly blend scaled patches of various sizes from separate images. This creates a wide range of synthetic anomalies which are more similar to natural sub-image irregularities than previous data-augmentation strategies for self-supervised anomaly detection. We evaluate the proposed method using natural and medical images. Our experiments with the MVTec AD dataset show that a model trained to localize NSA anomalies generalizes well to detecting real-world a priori unknown types of manufacturing defects. Our method achieves an overall detection AUROC of 97.2 outperforming all previous methods that learn without the use of additional datasets. Code available at https://github.com/hmsch/natural-synthetic-anomalies.
△ Less
Submitted 24 July, 2022; v1 submitted 30 September, 2021;
originally announced September 2021.
-
Simultaneous 2D and 3D turbulent flows in Faraday Waves
Authors:
Raffaele Colombi,
Niclas Rohde,
Michael Schlüter,
Alexandra von Kameke
Abstract:
In nature turbulent flows exist that are neither simply 2D nor 3D but boundary conditions, such as varying stratification, force them towards the one or the other. Here, we report the first evidence of the co-existence of 2D and 3D turbulence in an experimental flow driven by Faraday waves in water. We find that an inverse energy cascade at the fluid surface and a direct energy cascade in the 3D b…
▽ More
In nature turbulent flows exist that are neither simply 2D nor 3D but boundary conditions, such as varying stratification, force them towards the one or the other. Here, we report the first evidence of the co-existence of 2D and 3D turbulence in an experimental flow driven by Faraday waves in water. We find that an inverse energy cascade at the fluid surface and a direct energy cascade in the 3D bulk flow underneath exist simultaneously. We base our analysis on temporally and spatially well-resolved velocity fields measured at horizontal and vertical planes. The findings suggest that the strongly turbulent 2D surface flow drives the 3D bulk flow through sporadic vertical jets as a source of momentum.
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
BackREST: A Model-Based Feedback-Driven Greybox Fuzzer for Web Applications
Authors:
François Gauthier,
Behnaz Hassanshahi,
Benjamin Selwyn-Smith,
Trong Nhan Mai,
Max Schlüter,
Micah Williams
Abstract:
Following the advent of the American Fuzzy Lop (AFL), fuzzing had a surge in popularity, and modern day fuzzers range from simple blackbox random input generators to complex whitebox concolic frameworks that are capable of deep program introspection. Web application fuzzers, however, did not benefit from the tremendous advancements in fuzzing for binary programs and remain largely blackbox in natu…
▽ More
Following the advent of the American Fuzzy Lop (AFL), fuzzing had a surge in popularity, and modern day fuzzers range from simple blackbox random input generators to complex whitebox concolic frameworks that are capable of deep program introspection. Web application fuzzers, however, did not benefit from the tremendous advancements in fuzzing for binary programs and remain largely blackbox in nature. This paper introduces BackREST, a fully automated, model-based, coverage- and taint-driven fuzzer that uses its feedback loops to find more critical vulnerabilities, faster (speedups between 7.4x and 25.9x). To model the server-side of web applications, BackREST automatically infers REST specifications through directed state-aware crawling. Comparing BackREST against three other web fuzzers on five large (>500 KLOC) Node.js applications shows how it consistently achieves comparable coverage while reporting more vulnerabilities than state-of-the-art. Finally, using BackREST, we uncovered nine 0-days, out of which six were not reported by any other fuzzer. All the 0-days have been disclosed and most are now public, including two in the highly popular Sequelize and Mongodb libraries.
△ Less
Submitted 18 August, 2021;
originally announced August 2021.
-
Generating Annotated Training Data for 6D Object Pose Estimation in Operational Environments with Minimal User Interaction
Authors:
Paul Koch,
Marian Schlüter,
Serge Thill
Abstract:
Recently developed deep neural networks achieved state-of-the-art results in the subject of 6D object pose estimation for robot manipulation. However, those supervised deep learning methods require expensive annotated training data. Current methods for reducing those costs frequently use synthetic data from simulations, but rely on expert knowledge and suffer from the "domain gap" when shifting to…
▽ More
Recently developed deep neural networks achieved state-of-the-art results in the subject of 6D object pose estimation for robot manipulation. However, those supervised deep learning methods require expensive annotated training data. Current methods for reducing those costs frequently use synthetic data from simulations, but rely on expert knowledge and suffer from the "domain gap" when shifting to the real world. Here, we present a proof of concept for a novel approach of autonomously generating annotated training data for 6D object pose estimation. This approach is designed for learning new objects in operational environments while requiring little interaction and no expertise on the part of the user. We evaluate our autonomous data generation approach in two grasping experiments, where we archive a similar grasping success rate as related work on a non autonomously generated data set.
△ Less
Submitted 11 May, 2022; v1 submitted 17 March, 2021;
originally announced March 2021.
-
GTOPX Space Mission Benchmarks
Authors:
Martin Schlueter,
Mehdi Neshat,
Mohamed Wahib,
Masaharu Munetomo,
Markus Wagner
Abstract:
This contribution introduces the GTOPX space mission benchmark collection, which is an extension of GTOP database published by the European Space Agency (ESA). GTOPX consists of ten individual benchmark instances representing real-world interplanetary space trajectory design problems. In regard to the original GTOP collection, GTOPX includes three new problem instances featuring mixed-integer and…
▽ More
This contribution introduces the GTOPX space mission benchmark collection, which is an extension of GTOP database published by the European Space Agency (ESA). GTOPX consists of ten individual benchmark instances representing real-world interplanetary space trajectory design problems. In regard to the original GTOP collection, GTOPX includes three new problem instances featuring mixed-integer and multi-objective properties. GTOPX enables a simplified user handling, unified benchmark function call and some minor bug corrections to the original GTOP implementation. Furthermore, GTOPX is linked from it's original C++ source code to Python and Matlab based on dynamic link libraries, assuring computationally fast and accurate reproduction of the benchmark results in all three programming languages. Space mission trajectory design problems as those represented in GTOPX are known to be highly non-linear and difficult to solve. The GTOPX collection, therefore, aims particularly at researchers wishing to put advanced (meta)heuristic and hybrid optimization algorithms to the test. The goal of this paper is to provide researchers with a manual and reference to the newly available GTOPX benchmark software.
△ Less
Submitted 17 February, 2021; v1 submitted 15 October, 2020;
originally announced October 2020.
-
Deep learning with 4D spatio-temporal data representations for OCT-based force estimation
Authors:
Nils Gessert,
Marcel Bengs,
Matthias Schlüter,
Alexander Schlaefer
Abstract:
Estimating the forces acting between instruments and tissue is a challenging problem for robot-assisted minimally-invasive surgery. Recently, numerous vision-based methods have been proposed to replace electro-mechanical approaches. Moreover, optical coherence tomography (OCT) and deep learning have been used for estimating forces based on deformation observed in volumetric image data. The method…
▽ More
Estimating the forces acting between instruments and tissue is a challenging problem for robot-assisted minimally-invasive surgery. Recently, numerous vision-based methods have been proposed to replace electro-mechanical approaches. Moreover, optical coherence tomography (OCT) and deep learning have been used for estimating forces based on deformation observed in volumetric image data. The method demonstrated the advantage of deep learning with 3D volumetric data over 2D depth images for force estimation. In this work, we extend the problem of deep learning-based force estimation to 4D spatio-temporal data with streams of 3D OCT volumes. For this purpose, we design and evaluate several methods extending spatio-temporal deep learning to 4D which is largely unexplored so far. Furthermore, we provide an in-depth analysis of multi-dimensional image data representations for force estimation, comparing our 4D approach to previous, lower-dimensional methods. Also, we analyze the effect of temporal information and we study the prediction of short-term future force values, which could facilitate safety features. For our 4D force estimation architectures, we find that efficient decoupling of spatial and temporal processing is advantageous. We show that using 4D spatio-temporal data outperforms all previously used data representations with a mean absolute error of 10.7mN. We find that temporal information is valuable for force estimation and we demonstrate the feasibility of force prediction.
△ Less
Submitted 20 May, 2020;
originally announced May 2020.
-
Deep Learning for High Speed Optical Coherence Elastography
Authors:
Maximilian Neidhardt,
Marcel Bengs,
Sarah Latus,
Matthias Schlüter,
Thore Saathoff,
Alexander Schlaefer
Abstract:
Mechanical properties of tissue provide valuable information for identifying lesions. One approach to obtain quantitative estimates of elastic properties is shear wave elastography with optical coherence elastography (OCE). However, given the shear wave velocity, it is still difficult to estimate elastic properties. Hence, we propose deep learning to directly predict elastic tissue properties from…
▽ More
Mechanical properties of tissue provide valuable information for identifying lesions. One approach to obtain quantitative estimates of elastic properties is shear wave elastography with optical coherence elastography (OCE). However, given the shear wave velocity, it is still difficult to estimate elastic properties. Hence, we propose deep learning to directly predict elastic tissue properties from OCE data. We acquire 2D images with a frame rate of 30 kHz and use convolutional neural networks to predict gelatin concentration, which we use as a surrogate for tissue elasticity. We compare our deep learning approach to predictions from conventional regression models, using the shear wave velocity as a feature. Mean absolut prediction errors for the conventional approaches range from 1.32$\pm$0.98 p.p. to 1.57$\pm$1.30 p.p. whereas we report an error of 0.90$\pm$0.84 p.p for the convolutional neural network with 3D spatio-temporal input. Our results indicate that deep learning on spatio-temporal data outperforms elastography based on explicit shear wave velocity estimation.
△ Less
Submitted 29 April, 2020;
originally announced April 2020.
-
Spatio-Temporal Deep Learning Methods for Motion Estimation Using 4D OCT Image Data
Authors:
Marcel Bengs,
Nils Gessert,
Matthias Schlüter,
Alexander Schlaefer
Abstract:
Purpose. Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution that has been used for intraoperative imaging and also for motion estimation, for example, in the context of ophthalmic surgery or cochleostomy. Re…
▽ More
Purpose. Localizing structures and estimating the motion of a specific target region are common problems for navigation during surgical interventions. Optical coherence tomography (OCT) is an imaging modality with a high spatial and temporal resolution that has been used for intraoperative imaging and also for motion estimation, for example, in the context of ophthalmic surgery or cochleostomy. Recently, motion estimation between a template and a moving OCT image has been studied with deep learning methods to overcome the shortcomings of conventional, feature-based methods.
Methods. We investigate whether using a temporal stream of OCT image volumes can improve deep learning-based motion estimation performance. For this purpose, we design and evaluate several 3D and 4D deep learning methods and we propose a new deep learning approach. Also, we propose a temporal regularization strategy at the model output.
Results. Using a tissue dataset without additional markers, our deep learning methods using 4D data outperform previous approaches. The best performing 4D architecture achieves an correlation coefficient (aCC) of 98.58% compared to 85.0% of a previous 3D deep learning method. Also, our temporal regularization strategy at the output further improves 4D model performance to an aCC of 99.06%. In particular, our 4D method works well for larger motion and is robust towards image rotations and motion distortions.
Conclusions. We propose 4D spatio-temporal deep learning for OCT-based motion estimation. On a tissue dataset, we find that using 4D information for the model input improves performance while maintaining reasonable inference times. Our regularization strategy demonstrates that additional temporal information is also beneficial at the model output.
△ Less
Submitted 21 April, 2020;
originally announced April 2020.
-
Effective alleviation of rural poverty depends on the interplay between productivity, nutrients, water and soil quality
Authors:
Sonja Radosavljevic,
L. Jamila Haider,
Steven J. Lade,
Maja Schluter
Abstract:
Most of the world poorest people come from rural areas and depend on their local ecosystems for food production. Recent research has highlighted the importance of self-reinforcing dynamics between low soil quality and persistent poverty but little is known on how they affect poverty alleviation. We investigate how the intertwined dynamics of household assets, nutrients (especially phosphorus), wat…
▽ More
Most of the world poorest people come from rural areas and depend on their local ecosystems for food production. Recent research has highlighted the importance of self-reinforcing dynamics between low soil quality and persistent poverty but little is known on how they affect poverty alleviation. We investigate how the intertwined dynamics of household assets, nutrients (especially phosphorus), water and soil quality influence food production and determine the conditions for escape from poverty for the rural poor. We have developed a suite of dynamic, multidimensional poverty trap models of households that combine economic aspects of growth with ecological dynamics of soil quality, water and nutrient flows to analyze the effectiveness of common poverty alleviation strategies such as intensification through agrochemical inputs, diversification of energy sources and conservation tillage. Our results show that (i) agrochemical inputs can reinforce poverty by degrading soil quality, (ii) diversification of household energy sources can create possibilities for effective application of other strategies, and (iii) sequencing of interventions can improve effectiveness of conservation tillage. Our model-based approach demonstrates the interdependence of economic and ecological dynamics which preclude blanket solution for poverty alleviation. Stylized models as developed here can be used for testing effectiveness of different strategies given biophysical and economic settings in the target region.
△ Less
Submitted 8 April, 2020;
originally announced April 2020.
-
High-Speed Markerless Tissue Motion Tracking Using Volumetric Optical Coherence Tomography Images
Authors:
Matthias Schlüter,
Lukas Glandorf,
Johanna Sprenger,
Martin Gromniak,
Maximilian Neidhardt,
Thore Saathoff,
Alexander Schlaefer
Abstract:
Modern optical coherence tomography (OCT) devices provide volumetric images with micrometer-scale spatial resolution and a temporal resolution beyond video rate. In this work, we analyze an OCT-based prototypical tracking system which processes 831 volumes per second, estimates translational motion, and automatically adjusts the field-of-view, which has a size of few millimeters, to follow a sampl…
▽ More
Modern optical coherence tomography (OCT) devices provide volumetric images with micrometer-scale spatial resolution and a temporal resolution beyond video rate. In this work, we analyze an OCT-based prototypical tracking system which processes 831 volumes per second, estimates translational motion, and automatically adjusts the field-of-view, which has a size of few millimeters, to follow a sample even along larger distances. The adjustment is realized by two galvo mirrors and a motorized reference arm, such that no mechanical movement of the scanning setup is necessary. Without requiring a marker or any other knowledge about the sample, we demonstrate that reliable tracking of velocities up to 25 mm/s is possible with mean tracking errors in the order of 0.25 mm. Further, we report successful tracking of lateral velocities up to 70 mm/s with errors below 0.3 mm.
△ Less
Submitted 20 January, 2020;
originally announced January 2020.
-
Zero Crossing Modulation for Communication with Temporally Oversampled 1-Bit Quantization
Authors:
Gerhard Fettweis,
Meik Dörpinghaus,
Sandra Bender,
Lukas Landau,
Peter Neuhaus,
Martin Schlüter
Abstract:
Today's communication systems typically use high resolution analog-to-digital converters (ADCs). However, considering future communication systems with data rates in the order of 100Gbit/s the ADC power consumption becomes a major factor due to the high sampling rates. A promising alternative are receivers based on 1-bit quantization and oversampling w.r.t. the signal bandwidth. Such an approach r…
▽ More
Today's communication systems typically use high resolution analog-to-digital converters (ADCs). However, considering future communication systems with data rates in the order of 100Gbit/s the ADC power consumption becomes a major factor due to the high sampling rates. A promising alternative are receivers based on 1-bit quantization and oversampling w.r.t. the signal bandwidth. Such an approach requires a redesign of modulation, receiver synchronization, and demapping. A zero crossing modulation is a natural choice as the information needs to be carried in the zero crossing time instants. The present paper provides an overview on zero crossing modulation, achievable rates, sequence mapping and demapping, 1-bit based channel parameter estimation, and continuous phase modulation as an alternative zero crossing modulation scheme.
△ Less
Submitted 2 December, 2019;
originally announced December 2019.
-
In-Vitro MPI-Guided IVOCT Catheter Tracking in Real Time for Motion Artifact Compensation
Authors:
Florian Griese,
Sarah Latus,
Matthias Schlüter,
Matthias Graeser,
Matthias Lutz,
Alexander Schlaefer,
Tobias Knopp
Abstract:
Purpose: Using 4D magnetic particle imaging (MPI), intravascular optical coherence tomography (IVOCT) catheters are tracked in real time in order to compensate for image artifacts related to relative motion. Our approach demonstrates the feasibility for bimodal IVOCT and MPI in-vitro experiments. Material and Methods: During IVOCT imaging of a stenosis phantom the catheter is tracked using MPI. A…
▽ More
Purpose: Using 4D magnetic particle imaging (MPI), intravascular optical coherence tomography (IVOCT) catheters are tracked in real time in order to compensate for image artifacts related to relative motion. Our approach demonstrates the feasibility for bimodal IVOCT and MPI in-vitro experiments. Material and Methods: During IVOCT imaging of a stenosis phantom the catheter is tracked using MPI. A 4D trajectory of the catheter tip is determined from the MPI data using center of mass sub-voxel strategies. A custom built IVOCT imaging adapter is used to perform different catheter motion profiles: no motion artifacts, motion artifacts due to catheter bending, and heart beat motion artifacts. Two IVOCT volume reconstruction methods are compared qualitatively and quantitatively using the DICE metric and the known stenosis length. Results: The MPI-tracked trajectory of the IVOCT catheter is validated in multiple repeated measurements calculating the absolute mean error and standard deviation. Both volume reconstruction methods are compared and analyzed whether they are capable of compensating the motion artifacts. The novel approach of MPI-guided catheter tracking corrects motion artifacts leading to a DICE coefficient with a minimum of 86% in comparison to 58% for a standard reconstruction approach. Conclusions: IVOCT catheter tracking with MPI in real time is an auspicious method for radiation free MPI-guided IVOCT interventions. The combination of MPI and IVOCT can help to reduce motion artifacts due to catheter bending and heart beat for optimized IVOCT volume reconstructions.
△ Less
Submitted 27 November, 2019;
originally announced November 2019.
-
Measurements of Sub-Surface Velocity Fields in Quasi-2D Faraday Flow
Authors:
Raffaele Colombi,
Michael Schlüter,
Alexandra von Kameke
Abstract:
Faraday waves are capillary ripples that form on the surface of a fluid being subject to vertical shaking. Although it is well known that the form and shape of the waves pattern depend on driving amplitude and frequency, only recent studies discovered the existence of a horizontal velocity field at the surface, called Faraday flow, which exhibits attributes of two-dimensional turbulence. However,…
▽ More
Faraday waves are capillary ripples that form on the surface of a fluid being subject to vertical shaking. Although it is well known that the form and shape of the waves pattern depend on driving amplitude and frequency, only recent studies discovered the existence of a horizontal velocity field at the surface, called Faraday flow, which exhibits attributes of two-dimensional turbulence. However, despite the increasing attention towards the inverse energy flux in the Faraday flow and other not strictly two-dimensional systems, very little is known about the velocity fields developing beneath the fluid surface. In this study planar velocity fields are measured by means of particle image velocimetry (PIV) with high spatial and temporal resolution on the water surface and below it. A sudden drop in velocity is observed immediately below the water surface, such that at 5 mm below the water surface the mean absolute velocities are already about 6.5 times smaller than the surface velocity. Additionally, the flow structures below the surface are found to comprise much larger spatial scales than those on the surface. These large structures are also found to be slow and temporarily persistent, as proven by analysing the autocorrelation of the velocity fields in time.
△ Less
Submitted 18 August, 2020; v1 submitted 25 November, 2019;
originally announced November 2019.
-
Bimodal intravascular volumetric imaging combining OCT and MPI
Authors:
Sarah Latus,
Florian Griese,
Matthias Schlüter,
Christoph Otte,
Martin Möddel,
Matthias Graeser,
Thore Saathoff,
Tobias Knopp,
Alexander Schlaefer
Abstract:
Intravascular optical coherence tomography (IVOCT) is a catheter based image modality allowing for high resolution imaging of vessels. It is based on a fast sequential acquisition of A-scans with an axial spatial resolution in the range of 5 to 10 μm, i.e., one order of magnitude higher than in conventional methods like intravascular ultrasound or computed tomography angiography. However, position…
▽ More
Intravascular optical coherence tomography (IVOCT) is a catheter based image modality allowing for high resolution imaging of vessels. It is based on a fast sequential acquisition of A-scans with an axial spatial resolution in the range of 5 to 10 μm, i.e., one order of magnitude higher than in conventional methods like intravascular ultrasound or computed tomography angiography. However, position and orientation of the catheter in patient coordinates cannot be obtained from the IVOCT measurements alone. Hence, the pose of the catheter needs to be established to correctly reconstruct the three-dimensional vessel shape. Magnetic particle imaging (MPI) is a three-dimensional tomographic, tracer-based and radiation-free image modality providing high temporal resolution with unlimited penetration depth. Volumetric MPI images are angiographic and hence suitable to complement IVOCT as a co-modality. We study simultaneous bimodal IVOCT MPI imaging with the goal of estimating the IVOCT pullback path based on the 3D MPI data. We present a setup to study and evaluate simultaneous IVOCT and MPI image acquisition of differently shaped vessel phantoms. First, the infuence of the MPI tracer concentration on the optical properties required for IVOCT is analyzed. Second, using a concentration allowing for simultaneous imaging, IVOCT and MPI image data is acquired sequentially and simultaneously. Third, the luminal centerline is established from the MPI image volumes and used to estimate the catheter pullback trajectory for IVOCT image reconstruction. The image volumes are compared to the known shape of the phantoms. We were able to identify a suitable MPI tracer concentration of 2.5 mmol/L with negligible influence on the IVOCT signal. The pullback trajectory estimated from MPI agrees well with the centerline of the phantoms. (...)
△ Less
Submitted 21 November, 2019;
originally announced November 2019.
-
Cross-scale cooperation enables sustainable use of a common-pool resource
Authors:
Andrew K. Ringsmuth,
Steven J. Lade,
Maja Schlüter
Abstract:
In social-ecological systems (SESs), social and biophysical dynamics interact within and between structural levels separated by spatial and temporal scales. Cross-scale interactions (CSIs) are interdependences between processes at different scales, generating behaviour unpredictable at single scales. Understanding CSIs is important for improving SES governance but they remain understudied. Theoret…
▽ More
In social-ecological systems (SESs), social and biophysical dynamics interact within and between structural levels separated by spatial and temporal scales. Cross-scale interactions (CSIs) are interdependences between processes at different scales, generating behaviour unpredictable at single scales. Understanding CSIs is important for improving SES governance but they remain understudied. Theoretical models are needed, which capture essential features while being simple enough to yield insights into mechanisms. In a stylised model, we study CSIs in a two-level system of weakly interacting communities harvesting a common-pool resource. Community members adaptively conform to, or defect from, a norm of socially optimal harvesting, enforced through social sanctioning both within and between communities. Each subsystem's dynamics depend sensitively on the other despite interactions being much weaker between subsystems than within them. When interaction is purely biophysical, stably high cooperation in one community can cause cooperation in the other to collapse. However, even weak social interaction can prevent collapse of cooperation and instead cause collapse of defection. We identify conditions under which subsystem-level cooperation produces desirable system-level outcomes. Our findings expand evidence that collaboration is important for sustainably managing shared resources, showing its importance even when resource sharing and social relationships are weak.
△ Less
Submitted 26 March, 2019;
originally announced May 2019.
-
Towards Automatic Lesion Classification in the Upper Aerodigestive Tract Using OCT and Deep Transfer Learning Methods
Authors:
Nils Gessert,
Matthias Schlüter,
Sarah Latus,
Veronika Volgger,
Christian Betz,
Alexander Schlaefer
Abstract:
Early detection of cancer is crucial for treatment and overall patient survival. In the upper aerodigestive tract (UADT) the gold standard for identification of malignant tissue is an invasive biopsy. Recently, non-invasive imaging techniques such as confocal laser microscopy and optical coherence tomography (OCT) have been used for tissue assessment. In particular, in a recent study experts class…
▽ More
Early detection of cancer is crucial for treatment and overall patient survival. In the upper aerodigestive tract (UADT) the gold standard for identification of malignant tissue is an invasive biopsy. Recently, non-invasive imaging techniques such as confocal laser microscopy and optical coherence tomography (OCT) have been used for tissue assessment. In particular, in a recent study experts classified lesions in the UADT with respect to their invasiveness using OCT images only. As the results were promising, automatic classification of lesions might be feasible which could assist experts in their decision making. Therefore, we address the problem of automatic lesion classification from OCT images. This task is very challenging as the available dataset is extremely small and the data quality is limited. However, as similar issues are typical in many clinical scenarios we study to what extent deep learning approaches can still be trained and used for decision support.
△ Less
Submitted 10 February, 2019;
originally announced February 2019.
-
How coherent structures dominate the residence time in a bubble wake: an experimental example
Authors:
Alexandra von Kameke,
Sven Kastens,
Sophie Rüttinger,
Sonja Herres-Pawlis,
Michael Schlüter
Abstract:
Mixing timescales and residence times in reactive multiphase flows can be essential for product selectivity. For instance when a gas species is consumed e.g. by a competitive consecutive reaction with moderate reaction kinetics where reaction timescales are comparable to relevant mixing timescales. To point out the importance of the details of the fluid flow, we analyze experimental velocity data…
▽ More
Mixing timescales and residence times in reactive multiphase flows can be essential for product selectivity. For instance when a gas species is consumed e.g. by a competitive consecutive reaction with moderate reaction kinetics where reaction timescales are comparable to relevant mixing timescales. To point out the importance of the details of the fluid flow, we analyze experimental velocity data from a Taylor bubble wake by means of Lagrangian methods. By adjusting the channel diameter in which the Taylor bubble rises, and thus the rise velocity, we obtain three different wake regimes. Remarkably the normalized residence times of passive particles advected in the wake velocity field show a peak for intermediate rise velocities. This fact seems unintuitive at first glance because one expects a faster removal of passive tracers for a faster overall flow rate. However, the details of the flow topology analyzed using Finite Time Lyapunov Exponent (FTLE) fields and Lagrangian Coherent Structures (LCS) reveal the existence of a very coherent vortical pattern in the bubble wake which explains the long residence times. The increased residence times within the vortical structure and the close bubble interface acting as a constant gas species source could enhance side product generation of a hypothetical competitive consecutive reaction, where the first reaction with the gas species forms the desired product and the second the side product.
△ Less
Submitted 21 January, 2019;
originally announced January 2019.
-
Experimental and numerical investigation of reactive species transport around a small rising bubble
Authors:
Andre Weiner,
Jens Timmermann,
Chiara Pesci,
Jana Grewe,
Marko Hoffmann,
Michael Schlüter,
Dieter Bothe
Abstract:
In this article, we present experimental and numerical techniques to investigate the transfer, transport, and reaction of a chemical species in the vicinity of rising bubbles. In the experiment, single oxygen bubbles of diameter d b = 0.55 . . . 0.85 mm are released into a measurement cell filled with tap water. The oxygen dissolves and reacts with sulfite to sulfate. Laser-induced fluorescence is…
▽ More
In this article, we present experimental and numerical techniques to investigate the transfer, transport, and reaction of a chemical species in the vicinity of rising bubbles. In the experiment, single oxygen bubbles of diameter d b = 0.55 . . . 0.85 mm are released into a measurement cell filled with tap water. The oxygen dissolves and reacts with sulfite to sulfate. Laser-induced fluorescence is used to visualize the oxygen concentration in the bubble wake from which the global mass transfer coefficient can be calculated. The ruthenium-based fluorescent dye seems to be surface active, such that the rise velocity is reduced by up to 50 % compared to the experiment without fluorescent dye and a recirculation zone forms in the bubble wake. To access the local mass transfer at the interface, we perform complementary numerical simulations. Since the fluorescence tracer is essential for the experimental method, the effect of surface contamination is also considered in the simulation. We employ several improvements in the experimental and numerical procedures which allow for a quantitative comparison (locally and globally). Rise velocity and mass transfer coefficient agree within a few percents between experiment, simulation and literature results. Because the fluorescence tracer is frequently used in mass transfer experiments, we discuss its potential surface activity.
△ Less
Submitted 9 November, 2018;
originally announced November 2018.
-
Feasibility of a markerless tracking system based on optical coherence tomography
Authors:
Matthias Schlüter,
Christoph Otte,
Thore Saathoff,
Nils Gessert,
Alexander Schlaefer
Abstract:
Clinical tracking systems are popular but typically require specific tracking markers. During the last years, scanning speed of optical coherence tomography (OCT) has increased to A-scan rates above 1 MHz allowing to acquire volume scans of moving objects. Thorefore, we propose a markerless tracking system based on OCT to obtain small volumetric images including information of sub-surface structur…
▽ More
Clinical tracking systems are popular but typically require specific tracking markers. During the last years, scanning speed of optical coherence tomography (OCT) has increased to A-scan rates above 1 MHz allowing to acquire volume scans of moving objects. Thorefore, we propose a markerless tracking system based on OCT to obtain small volumetric images including information of sub-surface structures at high spatio-temporal resolution. In contrast to conventional vision based approaches, this allows identifying natural landmarks even for smooth and homogeneous surfaces. We describe the optomechanical setup and process flow to evaluate OCT volumes for translations and accordingly adjust the position of the field-of-view to follow moving samples. While our current setup is still preliminary, we demonstrate tracking of motion transversal to the OCT beam of up to 20 mm/s with errors around 0.2 mm and even better for some scenarios. Tracking is evaluated on a clearly structured and on a homogeneous phantom as well as on actual tissue samples. The results show that OCT is promising for fast and precise tracking of smooth, monochromatic objects in medical scenarios.
△ Less
Submitted 14 January, 2019; v1 submitted 29 October, 2018;
originally announced October 2018.
-
Two-path 3D CNNs for calibration of system parameters for OCT-based motion compensation
Authors:
Nils Gessert,
Martin Gromniak,
Matthias Schlüter,
Alexander Schlaefer
Abstract:
Automatic motion compensation and adjustment of an intraoperative imaging modality's field of view is a common problem during interventions. Optical coherence tomography (OCT) is an imaging modality which is used in interventions due to its high spatial resolution of few micrometers and its temporal resolution of potentially several hundred volumes per second. However, performing motion compensati…
▽ More
Automatic motion compensation and adjustment of an intraoperative imaging modality's field of view is a common problem during interventions. Optical coherence tomography (OCT) is an imaging modality which is used in interventions due to its high spatial resolution of few micrometers and its temporal resolution of potentially several hundred volumes per second. However, performing motion compensation with OCT is problematic due to its small field of view which might lead to tracked objects being lost quickly. We propose a novel deep learning-based approach that directly learns input parameters of motors that move the scan area for motion compensation from optical coherence tomography volumes. We design a two-path 3D convolutional neural network (CNN) architecture that takes two volumes with an object to be tracked as its input and predicts the necessary motor input parameters to compensate the object's movement. In this way, we learn the calibration between object movement and system parameters for motion compensation with arbitrary objects. Thus, we avoid error-prone hand-eye calibration and handcrafted feature tracking from classical approaches. We achieve an average correlation coefficient of 0.998 between predicted and ground-truth motor parameters which leads to sub-voxel accuracy. Furthermore, we show that our deep learning model is real-time capable for use with the system's high volume acquisition frequency.
△ Less
Submitted 22 October, 2018;
originally announced October 2018.
-
A Deep Learning Approach for Pose Estimation from Volumetric OCT Data
Authors:
Nils Gessert,
Matthias Schlüter,
Alexander Schlaefer
Abstract:
Tracking the pose of instruments is a central problem in image-guided surgery. For microscopic scenarios, optical coherence tomography (OCT) is increasingly used as an imaging modality. OCT is suitable for accurate pose estimation due to its micrometer range resolution and volumetric field of view. However, OCT image processing is challenging due to speckle noise and reflection artifacts in additi…
▽ More
Tracking the pose of instruments is a central problem in image-guided surgery. For microscopic scenarios, optical coherence tomography (OCT) is increasingly used as an imaging modality. OCT is suitable for accurate pose estimation due to its micrometer range resolution and volumetric field of view. However, OCT image processing is challenging due to speckle noise and reflection artifacts in addition to the images' 3D nature. We address pose estimation from OCT volume data with a new deep learning-based tracking framework. For this purpose, we design a new 3D convolutional neural network (CNN) architecture to directly predict the 6D pose of a small marker geometry from OCT volumes. We use a hexapod robot to automatically acquire labeled data points which we use to train 3D CNN architectures for multi-output regression. We use this setup to provide an in-depth analysis on deep learning-based pose estimation from volumes. Specifically, we demonstrate that exploiting volume information for pose estimation yields higher accuracy than relying on 2D representations with depth information. Supporting this observation, we provide quantitative and qualitative results that 3D CNNs effectively exploit the depth structure of marker objects. Regarding the deep learning aspect, we present efficient design principles for 3D CNNs, making use of insights from the 2D deep learning community. In particular, we present Inception3D as a new architecture which performs best for our application. We show that our deep learning approach reaches errors at our ground-truth label's resolution. We achieve a mean average error of $\SI{14.89 \pm 9.3}{\micro\metre}$ and $\SI{0.096 \pm 0.072}{\degree}$ for position and orientation learning, respectively.
△ Less
Submitted 10 March, 2018;
originally announced March 2018.
-
Modelling social-ecological transformations: an adaptive network proposal
Authors:
Steven J. Lade,
Örjan Bodin,
Jonathan F. Donges,
Elin Enfors Kautsky,
Diego Galafassi,
Per Olsson,
Maja Schlüter
Abstract:
Transformations to create more sustainable social-ecological systems are urgently needed. Structural change is a feature of transformations of social-ecological systems that is of critical importance but is little understood. Here, we propose a framework for conceptualising and modelling sustainability transformations based on adaptive networks. Adaptive networks focus attention on the interplay b…
▽ More
Transformations to create more sustainable social-ecological systems are urgently needed. Structural change is a feature of transformations of social-ecological systems that is of critical importance but is little understood. Here, we propose a framework for conceptualising and modelling sustainability transformations based on adaptive networks. Adaptive networks focus attention on the interplay between the structure of a social-ecological system and the dynamics of individual entities. Adaptive networks could progress transformations research by: 1) focusing research on changes in structure; 2) providing a conceptual framework that clarifies the temporal dynamics of social-ecological transformations compared to the most commonly used heuristic in resilience studies, the ball-and-cup diagram; 3) providing quantitative modelling tools in an area of study dominated by qualitative methods. We illustrate the potential application of adaptive networks to social-ecological transformations using a case study of illegal fishing in the Southern Ocean and a theoretical model of socially networked resource users.
△ Less
Submitted 18 April, 2017;
originally announced April 2017.
-
Continuous Dynamic Photostimulation - inducing in-vivo-like fluctuating conductances with Channelrhodopsins
Authors:
Andreas Neef,
Ahmed El Hady,
Jatin Nagpal,
Kai Bröking,
Ghazaleh Afshar,
Oliver M Schlüter,
Theo Geisel,
Ernst Bamberg,
Ragnar Fleischmann,
Walter Stühmer,
Fred Wolf
Abstract:
Central neurons operate in a regime of constantly fluctuating conductances, induced by thousands of presynaptic cells. Channelrhodopsins have been almost exclusively used to imprint a fixed spike pattern by sequences of brief depolarizations. Here we introduce continuous dynamic photostimulation (CoDyPs), a novel approach to mimic in-vivo like input fluctuations noninvasively in cells transfected…
▽ More
Central neurons operate in a regime of constantly fluctuating conductances, induced by thousands of presynaptic cells. Channelrhodopsins have been almost exclusively used to imprint a fixed spike pattern by sequences of brief depolarizations. Here we introduce continuous dynamic photostimulation (CoDyPs), a novel approach to mimic in-vivo like input fluctuations noninvasively in cells transfected with the weakly inactivating channelrhodopsin variant ChIEF. Even during long-term experiments, cultured neurons subjected to CoDyPs generate seemingly random, but reproducible spike patterns. In voltage clamped cells CoDyPs induced highly reproducible current waveforms that could be precisely predicted from the light-conductance transfer function of ChIEF. CoDyPs can replace the conventional, flash-evoked imprinting of spike patterns in in-vivo and in-vitro studies, preserving natural activity. When combined with non-invasive spike-detection, CoDyPs allows the acquisition of order of magnitudes larger data sets than previously possible, for studies of dynamical response properties of many individual neurons.
△ Less
Submitted 31 May, 2013; v1 submitted 30 May, 2013;
originally announced May 2013.
