-
The Reachability Problem for Neural-Network Control Systems
Authors:
Christian Schilling,
Martin Zimmermann
Abstract:
A control system consists of a plant component and a controller which periodically computes a control input for the plant. We consider systems where the controller is implemented by a feedforward neural network with ReLU activations. The reachability problem asks, given a set of initial states, whether a set of target states can be reached. We show that this problem is undecidable even for trivial…
▽ More
A control system consists of a plant component and a controller which periodically computes a control input for the plant. We consider systems where the controller is implemented by a feedforward neural network with ReLU activations. The reachability problem asks, given a set of initial states, whether a set of target states can be reached. We show that this problem is undecidable even for trivial plants and fixed-depth neural networks with three inputs and outputs. We also show that the problem becomes semi-decidable when the plant as well as the input and target sets are given by automata over infinite words.
△ Less
Submitted 15 October, 2024; v1 submitted 6 July, 2024;
originally announced July 2024.
-
Weak-signal extraction enabled by deep-neural-network denoising of diffraction data
Authors:
Jens Oppliger,
M. Michael Denner,
Julia Küspert,
Ruggero Frison,
Qisi Wang,
Alexander Morawietz,
Oleh Ivashko,
Ann-Christin Dippel,
Martin von Zimmermann,
Izabela Biało,
Leonardo Martinelli,
Benoît Fauqué,
Jaewon Choi,
Mirian Garcia-Fernandez,
Ke-Jin Zhou,
Niels B. Christensen,
Tohru Kurosawa,
Naoki Momono,
Migaku Oda,
Fabian D. Natterer,
Mark H. Fischer,
Titus Neupert,
Johan Chang
Abstract:
Removal or cancellation of noise has wide-spread applications for imaging and acoustics. In every-day-life applications, denoising may even include generative aspects, which are unfaithful to the ground truth. For scientific use, however, denoising must reproduce the ground truth accurately. Here, we show how data can be denoised via a deep convolutional neural network such that weak signals appea…
▽ More
Removal or cancellation of noise has wide-spread applications for imaging and acoustics. In every-day-life applications, denoising may even include generative aspects, which are unfaithful to the ground truth. For scientific use, however, denoising must reproduce the ground truth accurately. Here, we show how data can be denoised via a deep convolutional neural network such that weak signals appear with quantitative accuracy. In particular, we study X-ray diffraction on crystalline materials. We demonstrate that weak signals stemming from charge ordering, insignificant in the noisy data, become visible and accurate in the denoised data. This success is enabled by supervised training of a deep neural network with pairs of measured low- and high-noise data. We demonstrate that using artificial noise does not yield such quantitatively accurate results. Our approach thus illustrates a practical strategy for noise filtering that can be applied to challenging acquisition problems.
△ Less
Submitted 11 December, 2023; v1 submitted 19 September, 2022;
originally announced September 2022.
-
Image prediction of disease progression by style-based manifold extrapolation
Authors:
Tianyu Han,
Jakob Nikolas Kather,
Federico Pedersoli,
Markus Zimmermann,
Sebastian Keil,
Maximilian Schulze-Hagen,
Marc Terwoelbeck,
Peter Isfort,
Christoph Haarburger,
Fabian Kiessling,
Volkmar Schulz,
Christiane Kuhl,
Sven Nebelung,
Daniel Truhn
Abstract:
Disease-modifying management aims to prevent deterioration and progression of the disease, not just relieve symptoms. Unfortunately, the development of necessary therapies is often hampered by the failure to recognize the presymptomatic disease and limited understanding of disease development. We present a generic solution for this problem by a methodology that allows the prediction of progression…
▽ More
Disease-modifying management aims to prevent deterioration and progression of the disease, not just relieve symptoms. Unfortunately, the development of necessary therapies is often hampered by the failure to recognize the presymptomatic disease and limited understanding of disease development. We present a generic solution for this problem by a methodology that allows the prediction of progression risk and morphology in individuals using a latent extrapolation optimization approach. To this end, we combined a regularized generative adversarial network (GAN) and a latent nearest neighbor algorithm for joint optimization to generate plausible images of future time points. We evaluated our method on osteoarthritis (OA) data from a multi-center longitudinal study (the Osteoarthritis Initiative, OAI). With presymptomatic baseline data, our model is generative and significantly outperforms the end-to-end learning model in discriminating the progressive cohort. Two experiments were performed with seven experienced radiologists. When no synthetic follow-up radiographs were provided, our model performed better than all seven radiologists. In cases where the synthetic follow-ups generated by our model were available, the specificity and sensitivity of all readers in discriminating progressors increased from $72.3\%$ to $88.6\%$ and from $42.1\%$ to $51.6\%$, respectively. Our results open up a new possibility of using model-based morphology and risk prediction to make predictions about future disease occurrence, as demonstrated in the example of OA.
△ Less
Submitted 8 April, 2022; v1 submitted 22 November, 2021;
originally announced November 2021.
-
Deep learning-based bias transfer for overcoming laboratory differences of microscopic images
Authors:
Ann-Katrin Thebille,
Esther Dietrich,
Martin Klaus,
Lukas Gernhold,
Maximilian Lennartz,
Christoph Kuppe,
Rafael Kramann,
Tobias B. Huber,
Guido Sauter,
Victor G. Puelles,
Marina Zimmermann,
Stefan Bonn
Abstract:
The automated analysis of medical images is currently limited by technical and biological noise and bias. The same source tissue can be represented by vastly different images if the image acquisition or processing protocols vary. For an image analysis pipeline, it is crucial to compensate such biases to avoid misinterpretations. Here, we evaluate, compare, and improve existing generative model arc…
▽ More
The automated analysis of medical images is currently limited by technical and biological noise and bias. The same source tissue can be represented by vastly different images if the image acquisition or processing protocols vary. For an image analysis pipeline, it is crucial to compensate such biases to avoid misinterpretations. Here, we evaluate, compare, and improve existing generative model architectures to overcome domain shifts for immunofluorescence (IF) and Hematoxylin and Eosin (H&E) stained microscopy images. To determine the performance of the generative models, the original and transformed images were segmented or classified by deep neural networks that were trained only on images of the target bias. In the scope of our analysis, U-Net cycleGANs trained with an additional identity and an MS-SSIM-based loss and Fixed-Point GANs trained with an additional structure loss led to the best results for the IF and H&E stained samples, respectively. Adapting the bias of the samples significantly improved the pixel-level segmentation for human kidney glomeruli and podocytes and improved the classification accuracy for human prostate biopsies by up to 14%.
△ Less
Submitted 25 May, 2021;
originally announced May 2021.
-
Open community platform for hearing aid algorithm research: open Master Hearing Aid (openMHA)
Authors:
Hendrik Kayser,
Tobias Herzke,
Paul Maanen,
Max Zimmermann,
Giso Grimm,
Volker Hohmann
Abstract:
open Master Hearing Aid (openMHA) was developed and provided to the hearing aid research community as an open-source software platform with the aim to support sustainable and reproducible research towards improvement and new types of assistive hearing systems not limited by proprietary software. The software offers a flexible framework that allows the users to conduct hearing aid research using to…
▽ More
open Master Hearing Aid (openMHA) was developed and provided to the hearing aid research community as an open-source software platform with the aim to support sustainable and reproducible research towards improvement and new types of assistive hearing systems not limited by proprietary software. The software offers a flexible framework that allows the users to conduct hearing aid research using tools and a number of signal processing plugins provided with the software as well as the implementation of own methods. The openMHA software is independent of a specific hardware and supports Linux, macOS and Windows operating systems as well as 32-bit and 64-bit ARM-based architectures such as used in small portable integrated systems. www.openmha.org
△ Less
Submitted 24 January, 2022; v1 submitted 3 March, 2021;
originally announced March 2021.
-
Advancing diagnostic performance and clinical usability of neural networks via adversarial training and dual batch normalization
Authors:
Tianyu Han,
Sven Nebelung,
Federico Pedersoli,
Markus Zimmermann,
Maximilian Schulze-Hagen,
Michael Ho,
Christoph Haarburger,
Fabian Kiessling,
Christiane Kuhl,
Volkmar Schulz,
Daniel Truhn
Abstract:
Unmasking the decision-making process of machine learning models is essential for implementing diagnostic support systems in clinical practice. Here, we demonstrate that adversarially trained models can significantly enhance the usability of pathology detection as compared to their standard counterparts. We let six experienced radiologists rate the interpretability of saliency maps in datasets of…
▽ More
Unmasking the decision-making process of machine learning models is essential for implementing diagnostic support systems in clinical practice. Here, we demonstrate that adversarially trained models can significantly enhance the usability of pathology detection as compared to their standard counterparts. We let six experienced radiologists rate the interpretability of saliency maps in datasets of X-rays, computed tomography, and magnetic resonance imaging scans. Significant improvements were found for our adversarial models, which could be further improved by the application of dual batch normalization. Contrary to previous research on adversarially trained models, we found that the accuracy of such models was equal to standard models when sufficiently large datasets and dual batch norm training were used. To ensure transferability, we additionally validated our results on an external test set of 22,433 X-rays. These findings elucidate that different paths for adversarial and real images are needed during training to achieve state of the art results with superior clinical interpretability.
△ Less
Submitted 25 November, 2020;
originally announced November 2020.
-
On the Potential of Extending Aircraft Service Time Using a Fatigue Damage Index
Authors:
Simon Pfingstl,
Dominik Steinweg,
Markus Zimmermann,
Mirko Hornung
Abstract:
Aircraft structures experience various kinds of loads over their entire lifetime, typically leading to fatigue and ultimately structural failure. In order to avoid structural failure during operation, the maximum number of flight cycles and flight hours is regulated by laws ensuring continued airworthiness. However, since every flight impacts the aircraft differently, not all airframes are equally…
▽ More
Aircraft structures experience various kinds of loads over their entire lifetime, typically leading to fatigue and ultimately structural failure. In order to avoid structural failure during operation, the maximum number of flight cycles and flight hours is regulated by laws ensuring continued airworthiness. However, since every flight impacts the aircraft differently, not all airframes are equally stressed at the time of decommissioning. This paper proposes a new retirement criterion based on the so-called fatigue damage index (FDI). The criterion takes into account that aircraft are differently operated and thus enables an individual decommissioning of aircraft without compromising its safety. Based on aircraft sample data covering 95% of the Airbus A320 fleet over two years, the enhanced decommissioning criterion is estimated to significantly extend the average aircraft service life. The impact varies within the fleet, depending on the experienced seat load factors, cruise altitudes, and taxi times considered for the individual aircraft during operation. While seat load factors and flight altitudes significantly affect the defined FDI, the influence of taxi times is only minor. Based on the estimated increase in aircraft service life, the paper argues that for service life extensions, the FDI shall be considered as the limit of validity in the regulatory framework governing the decommissioning of aircraft.
△ Less
Submitted 11 August, 2021; v1 submitted 7 August, 2020;
originally announced August 2020.
-
Predicting Crack Growth and Fatigue Life with Surrogate Models
Authors:
Simon Pfingstl,
Jose Ignacio Rios,
Horst Baier,
Markus Zimmermann
Abstract:
Fatigue-induced damage is still one of the most uncertain failures in structural systems. Prognostic health monitoring together with surrogate models can help to predict the fatigue life of a structure. This paper demonstrates how to combine data from previously observed crack evolutions with data from the currently observed structure in order to predict crack growth and the total fatigue life. We…
▽ More
Fatigue-induced damage is still one of the most uncertain failures in structural systems. Prognostic health monitoring together with surrogate models can help to predict the fatigue life of a structure. This paper demonstrates how to combine data from previously observed crack evolutions with data from the currently observed structure in order to predict crack growth and the total fatigue life. We show the application of one physics-based model, which is based on Paris' law, and four mathematical surrogate models: recurrent neural networks, Gaussian process regression, k-nearest neighbors, and support vector regression. For a coupon test, we predict the time to failure and the crack growth with confidence intervals. Moreover, we compare the performance of all proposed models by the mean absolute error, coefficient of determination, mean of log-likelihood, and their confidence intervals. The results show that the best mathematical surrogate models are Gaussian process regression and recurrent neural networks. Furthermore, this paper shows that the mathematical surrogate models tend to have conservative confidence intervals, whereas the physics-based model exhibits overly optimistic (too small) confidence intervals.
△ Less
Submitted 26 October, 2020; v1 submitted 5 August, 2020;
originally announced August 2020.
-
Two Decades of SCADA Exploitation: A Brief History
Authors:
Simon Duque Anton,
Daniel Fraunholz,
Christoph Lipps,
Frederic Pohl,
Marc Zimmermann,
Hans D. Schotten
Abstract:
Since the early 1960, industrial process control has been applied by electric systems. In the mid 1970's, the term SCADA emerged, describing the automated control and data acquisition. Since most industrial and automation networks were physically isolated, security was not an issue. This changed, when in the early 2000's industrial networks were opened to the public internet. The reasons were mani…
▽ More
Since the early 1960, industrial process control has been applied by electric systems. In the mid 1970's, the term SCADA emerged, describing the automated control and data acquisition. Since most industrial and automation networks were physically isolated, security was not an issue. This changed, when in the early 2000's industrial networks were opened to the public internet. The reasons were manifold. Increased interconnectivity led to more productivity, simplicity and ease of use. It decreased the configuration overhead and downtimes for system adjustments. However, it also led to an abundance of new attack vectors. In recent time, there has been a remarkable amount of attacks on industrial companies and infrastructures. In this paper, known attacks on industrial systems are analysed. This is done by investigating the exploits that are available on public sources. The different types of attacks and their points of entry are reviewed in this paper. Trends in exploitation as well as targeted attack campaigns against industrial enterprises are introduced.
△ Less
Submitted 21 May, 2019;
originally announced May 2019.
