-
Histopathological Image Classification based on Self-Supervised Vision Transformer and Weak Labels
Authors:
Ahmet Gokberk Gul,
Oezdemir Cetin,
Christoph Reich,
Tim Prangemeier,
Nadine Flinner,
Heinz Koeppl
Abstract:
Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs commonly exhibit resolutions of 100Kx100K pixels. Annotating cancerous areas in WSIs on the pixel level is prohibitively labor-intensive and requires a high le…
▽ More
Whole Slide Image (WSI) analysis is a powerful method to facilitate the diagnosis of cancer in tissue samples. Automating this diagnosis poses various issues, most notably caused by the immense image resolution and limited annotations. WSIs commonly exhibit resolutions of 100Kx100K pixels. Annotating cancerous areas in WSIs on the pixel level is prohibitively labor-intensive and requires a high level of expert knowledge. Multiple instance learning (MIL) alleviates the need for expensive pixel-level annotations. In MIL, learning is performed on slide-level labels, in which a pathologist provides information about whether a slide includes cancerous tissue. Here, we propose Self-ViT-MIL, a novel approach for classifying and localizing cancerous areas based on slide-level annotations, eliminating the need for pixel-wise annotated training data. Self-ViT- MIL is pre-trained in a self-supervised setting to learn rich feature representation without relying on any labels. The recent Vision Transformer (ViT) architecture builds the feature extractor of Self-ViT-MIL. For localizing cancerous regions, a MIL aggregator with global attention is utilized. To the best of our knowledge, Self-ViT- MIL is the first approach to introduce self-supervised ViTs in MIL-based WSI analysis tasks. We showcase the effectiveness of our approach on the common Camelyon16 dataset. Self-ViT-MIL surpasses existing state-of-the-art MIL-based approaches in terms of accuracy and area under the curve (AUC).
△ Less
Submitted 17 April, 2023; v1 submitted 17 October, 2022;
originally announced October 2022.
-
Asymptotically Minimax Robust Hypothesis Testing
Authors:
Gökhan Gül
Abstract:
The design of asymptotically minimax robust hypothesis testing is formalized for the Bayesian and Neyman-Pearson tests of Type-I and Type-II. The uncertainty classes based on the KL-divergence, $α$-divergence, symmetrized $α$-divergence, total variation distance, as well as the band model, moment classes and p-point classes are considered. Implications between single-sample-, all-sample- and asymp…
▽ More
The design of asymptotically minimax robust hypothesis testing is formalized for the Bayesian and Neyman-Pearson tests of Type-I and Type-II. The uncertainty classes based on the KL-divergence, $α$-divergence, symmetrized $α$-divergence, total variation distance, as well as the band model, moment classes and p-point classes are considered. Implications between single-sample-, all-sample- and asymptotic minimax robustness are derived. Existence and uniqueness of asymptotically minimax robust tests are proven using Sion's minimax theorem and the Karush-Kuhn-Tucker multipliers. The least favorable distributions and the corresponding robust likelihood ratio functions are derived in parametric forms, which can then be determined by solving a system of equations. The proposed theory proves that Dabak's design does not produce any asymptotically minimax robust test. Furthermore, it also generalizes the earlier works by Huber and Kassam by allowing analytical derivations, hence, providing answers to the questions 'how?', which were left unanswered. Simulations are provided to exemplify and evaluate the theoretical derivations.
△ Less
Submitted 6 February, 2021; v1 submitted 21 November, 2017;
originally announced November 2017.
-
Minimax Robust Decentralized Detection in Parallel Sensor Networks
Authors:
Gökhan Gül
Abstract:
Minimax robust decentralized detection is studied for parallel sensor networks. Random variables corresponding to sensor observations are assumed to follow a distribution function, which belongs to an uncertainty class. It has been proven that, for some uncertainty classes, if all probability distributions are absolutely continuous with respect to a common measure, the joint stochastic boundedness…
▽ More
Minimax robust decentralized detection is studied for parallel sensor networks. Random variables corresponding to sensor observations are assumed to follow a distribution function, which belongs to an uncertainty class. It has been proven that, for some uncertainty classes, if all probability distributions are absolutely continuous with respect to a common measure, the joint stochastic boundedness property, which is the fundamental rule for the derivations in Veerevalli's work, does not hold. This raises a natural question whether minimax robust decentralized detection is possible if the uncertainty classes do not own this property. The answer to this question has been shown to be positive, which leads to a generalization of the work of Veerevalli. Moreover, due to a direct consequence of Tsitsiklis's work, quantization functions at the sensors are not required to be monotone. For the proposed model, some specific examples have been provided and possible generalizations have been discussed.
△ Less
Submitted 22 March, 2017;
originally announced March 2017.
-
Minimax Robust Hypothesis Testing
Authors:
Gökhan Gül,
Abdelhak M. Zoubir
Abstract:
The minimax robust hypothesis testing problem for the case where the nominal probability distributions are subject to both modeling errors and outliers is studied in twofold. First, a robust hypothesis testing scheme based on a relative entropy distance is designed. This approach provides robustness with respect to modeling errors and is a generalization of a previous work proposed by Levy. Then,…
▽ More
The minimax robust hypothesis testing problem for the case where the nominal probability distributions are subject to both modeling errors and outliers is studied in twofold. First, a robust hypothesis testing scheme based on a relative entropy distance is designed. This approach provides robustness with respect to modeling errors and is a generalization of a previous work proposed by Levy. Then, it is shown that this scheme can be combined with Huber's robust test through a composite uncertainty class, for which the existence of a saddle value condition is also proven. The composite version of the robust hypothesis testing scheme as well as the individual robust tests are extended to fixed sample size and sequential probability ratio tests. The composite model is shown to extend to robust estimation problems as well. Simulation results are provided to validate the proposed assertions.
△ Less
Submitted 2 February, 2015;
originally announced February 2015.
-
Theoretical Bounds in Minimax Decentralized Hypothesis Testing
Authors:
Gökhan Gül,
Abdelhak M. Zoubir
Abstract:
Minimax decentralized detection is studied under two scenarios: with and without a fusion center when the source of uncertainty is the Bayesian prior. When there is no fusion center, the constraints in the network design are determined. Both for a single decision maker and multiple decision makers, the maximum loss in detection performance due to minimax decision making is obtained. In the presenc…
▽ More
Minimax decentralized detection is studied under two scenarios: with and without a fusion center when the source of uncertainty is the Bayesian prior. When there is no fusion center, the constraints in the network design are determined. Both for a single decision maker and multiple decision makers, the maximum loss in detection performance due to minimax decision making is obtained. In the presence of a fusion center, the maximum loss of detection performance between with- and without fusion center networks is derived assuming that both networks are minimax robust. The results are finally generalized.
△ Less
Submitted 23 April, 2016; v1 submitted 15 June, 2013;
originally announced June 2013.
