-
Efficient and Accurate Hyperspectral Image Demosaicing with Neural Network Architectures
Authors:
Eric L. Wisotzky,
Lara Wallburg,
Anna Hilsmann,
Peter Eisert,
Thomas Wittenberg,
Stephan Göb
Abstract:
Neural network architectures for image demosaicing have been become more and more complex. This results in long training periods of such deep networks and the size of the networks is huge. These two factors prevent practical implementation and usage of the networks in real-time platforms, which generally only have limited resources. This study investigates the effectiveness of neural network archi…
▽ More
Neural network architectures for image demosaicing have been become more and more complex. This results in long training periods of such deep networks and the size of the networks is huge. These two factors prevent practical implementation and usage of the networks in real-time platforms, which generally only have limited resources. This study investigates the effectiveness of neural network architectures in hyperspectral image demosaicing. We introduce a range of network models and modifications, and compare them with classical interpolation methods and existing reference network approaches. The aim is to identify robust and efficient performing network architectures. Our evaluation is conducted on two datasets, "SimpleData" and "SimRealData," representing different degrees of realism in multispectral filter array (MSFA) data. The results indicate that our networks outperform or match reference models in both datasets demonstrating exceptional performance. Notably, our approach focuses on achieving correct spectral reconstruction rather than just visual appeal, and this emphasis is supported by quantitative and qualitative assessments. Furthermore, our findings suggest that efficient demosaicing solutions, which require fewer parameters, are essential for practical applications. This research contributes valuable insights into hyperspectral imaging and its potential applications in various fields, including medical imaging.
△ Less
Submitted 21 December, 2023;
originally announced March 2024.
-
Mitosis domain generalization in histopathology images -- The MIDOG challenge
Authors:
Marc Aubreville,
Nikolas Stathonikos,
Christof A. Bertram,
Robert Klopleisch,
Natalie ter Hoeve,
Francesco Ciompi,
Frauke Wilm,
Christian Marzahl,
Taryn A. Donovan,
Andreas Maier,
Jack Breen,
Nishant Ravikumar,
Youjin Chung,
Jinah Park,
Ramin Nateghi,
Fattaneh Pourakpour,
Rutger H. J. Fick,
Saima Ben Hadj,
Mostafa Jahanifar,
Nasir Rajpoot,
Jakob Dexl,
Thomas Wittenberg,
Satoshi Kondo,
Maxime W. Lafarge,
Viktor H. Koelzer
, et al. (10 additional authors not shown)
Abstract:
The density of mitotic figures within tumor tissue is known to be highly correlated with tumor proliferation and thus is an important marker in tumor grading. Recognition of mitotic figures by pathologists is known to be subject to a strong inter-rater bias, which limits the prognostic value. State-of-the-art deep learning methods can support the expert in this assessment but are known to strongly…
▽ More
The density of mitotic figures within tumor tissue is known to be highly correlated with tumor proliferation and thus is an important marker in tumor grading. Recognition of mitotic figures by pathologists is known to be subject to a strong inter-rater bias, which limits the prognostic value. State-of-the-art deep learning methods can support the expert in this assessment but are known to strongly deteriorate when applied in a different clinical environment than was used for training. One decisive component in the underlying domain shift has been identified as the variability caused by using different whole slide scanners. The goal of the MICCAI MIDOG 2021 challenge has been to propose and evaluate methods that counter this domain shift and derive scanner-agnostic mitosis detection algorithms. The challenge used a training set of 200 cases, split across four scanning systems. As a test set, an additional 100 cases split across four scanning systems, including two previously unseen scanners, were given. The best approaches performed on an expert level, with the winning algorithm yielding an F_1 score of 0.748 (CI95: 0.704-0.781). In this paper, we evaluate and compare the approaches that were submitted to the challenge and identify methodological factors contributing to better performance.
△ Less
Submitted 6 April, 2022;
originally announced April 2022.
-
MitoDet: Simple and robust mitosis detection
Authors:
Jakob Dexl,
Michaela Benz,
Volker Bruns,
Petr Kuritcyn,
Thomas Wittenberg
Abstract:
Mitotic figure detection is a challenging task in digital pathology that has a direct impact on therapeutic decisions. While automated methods often achieve acceptable results under laboratory conditions, they frequently fail in the clinical deployment phase. This problem can be mainly attributed to a phenomenon called domain shift. An important source of a domain shift is introduced by different…
▽ More
Mitotic figure detection is a challenging task in digital pathology that has a direct impact on therapeutic decisions. While automated methods often achieve acceptable results under laboratory conditions, they frequently fail in the clinical deployment phase. This problem can be mainly attributed to a phenomenon called domain shift. An important source of a domain shift is introduced by different microscopes and their camera systems, which noticeably change the color representation of digitized images. In this method description we present our submitted algorithm for the Mitosis Domain Generalization Challenge, which employs a RetinaNet trained with strong data augmentation and achieves an F1 score of 0.7138 on the preliminary test set.
△ Less
Submitted 20 January, 2022; v1 submitted 2 September, 2021;
originally announced September 2021.
-
Fast whole-slide cartography in colon cancer histology using superpixels and CNN classification
Authors:
Frauke Wilm,
Michaela Benz,
Volker Bruns,
Serop Baghdadlian,
Jakob Dexl,
David Hartmann,
Petr Kuritcyn,
Martin Weidenfeller,
Thomas Wittenberg,
Susanne Merkel,
Arndt Hartmann,
Markus Eckstein,
Carol I. Geppert
Abstract:
Automatic outlining of different tissue types in digitized histological specimen provides a basis for follow-up analyses and can potentially guide subsequent medical decisions. The immense size of whole-slide-images (WSI), however, poses a challenge in terms of computation time. In this regard, the analysis of non-overlapping patches outperforms pixelwise segmentation approaches, but still leaves…
▽ More
Automatic outlining of different tissue types in digitized histological specimen provides a basis for follow-up analyses and can potentially guide subsequent medical decisions. The immense size of whole-slide-images (WSI), however, poses a challenge in terms of computation time. In this regard, the analysis of non-overlapping patches outperforms pixelwise segmentation approaches, but still leaves room for optimization. Furthermore, the division into patches, regardless of the biological structures they contain, is a drawback due to the loss of local dependencies. We propose to subdivide the WSI into coherent regions prior to classification by grouping visually similar adjacent pixels into superpixels. Afterwards, only a random subset of patches per superpixel is classified and patch labels are combined into a superpixel label. We propose a metric for identifying superpixels with an uncertain classification and evaluate two medical applications, namely tumor area and invasive margin estimation and tumor composition analysis. The algorithm has been developed on 159 hand-annotated WSIs of colon resections and its performance is compared to an analysis without prior segmentation. The algorithm shows an average speed-up of 41% and an increase in accuracy from 93.8% to 95.7%. By assigning a rejection label to uncertain superpixels, we further increase the accuracy by 0.4%. Whilst tumor area estimation shows high concordance to the annotated area, the analysis of tumor composition highlights limitations of our approach. By combining superpixel segmentation and patch classification, we designed a fast and accurate framework for whole-slide cartography that is AI-model agnostic and provides the basis for various medical endpoints.
△ Less
Submitted 15 March, 2022; v1 submitted 30 June, 2021;
originally announced June 2021.
