-
AutoPET III Challenge: PET/CT Semantic Segmentation
Authors:
Reza Safdari,
Mohammad Koohi-Moghaddam,
Kyongtae Tyler Bae
Abstract:
In this study, we implemented a two-stage deep learning-based approach to segment lesions in PET/CT images for the AutoPET III challenge. The first stage utilized a DynUNet model for coarse segmentation, identifying broad regions of interest. The second stage refined this segmentation using an ensemble of SwinUNETR, SegResNet, and UNet models. Preprocessing involved resampling images to a common r…
▽ More
In this study, we implemented a two-stage deep learning-based approach to segment lesions in PET/CT images for the AutoPET III challenge. The first stage utilized a DynUNet model for coarse segmentation, identifying broad regions of interest. The second stage refined this segmentation using an ensemble of SwinUNETR, SegResNet, and UNet models. Preprocessing involved resampling images to a common resolution and normalization, while data augmentation techniques such as affine transformations and intensity adjustments were applied to enhance model generalization. The dataset was split into 80% training and 20% validation, excluding healthy cases. This method leverages multi-stage segmentation and model ensembling to achieve precise lesion segmentation, aiming to improve robustness and overall performance.
△ Less
Submitted 19 September, 2024;
originally announced September 2024.
-
CyPhERS: A Cyber-Physical Event Reasoning System providing real-time situational awareness for attack and fault response
Authors:
Nils Müller,
Kaibin Bao,
Jörg Matthes,
Kai Heussen
Abstract:
Cyber-physical systems (CPSs) constitute the backbone of critical infrastructures such as power grids or water distribution networks. Operating failures in these systems can cause serious risks for society. To avoid or minimize downtime, operators require real-time awareness about critical incidents. However, online event identification in CPSs is challenged by the complex interdependency of numer…
▽ More
Cyber-physical systems (CPSs) constitute the backbone of critical infrastructures such as power grids or water distribution networks. Operating failures in these systems can cause serious risks for society. To avoid or minimize downtime, operators require real-time awareness about critical incidents. However, online event identification in CPSs is challenged by the complex interdependency of numerous physical and digital components, requiring to take cyber attacks and physical failures equally into account. The online event identification problem is further complicated through the lack of historical observations of critical but rare events, and the continuous evolution of cyber attack strategies. This work introduces and demonstrates CyPhERS, a Cyber-Physical Event Reasoning System. CyPhERS provides real-time information pertaining the occurrence, location, physical impact, and root cause of potentially critical events in CPSs, without the need for historical event observations. Key novelty of CyPhERS is the capability to generate informative and interpretable event signatures of known and unknown types of both cyber attacks and physical failures. The concept is evaluated and benchmarked on a demonstration case that comprises a multitude of attack and fault events targeting various components of a CPS. The results demonstrate that the event signatures provide relevant and inferable information on both known and unknown event types.
△ Less
Submitted 26 May, 2023;
originally announced May 2023.
-
Hawkeye: Hectometer-range Subcentimeter Localization for Large-scale mmWave Backscatter
Authors:
Kang Min Bae,
Hankyeol Moon,
Sung-Min Sohn,
Song Min Kim
Abstract:
Accurate localization of a large number of objects over a wide area is one of the keys to the pervasive interaction with the Internet of Things. This paper presents Hawkeye, a new mmWave backscatter that, for the first time, offers over (i) hundred-scale simultaneous 3D localization at (ii) subcentimeter accuracy for over an (iii) hectometer distance. Hawkeye generally applies to indoors and outdo…
▽ More
Accurate localization of a large number of objects over a wide area is one of the keys to the pervasive interaction with the Internet of Things. This paper presents Hawkeye, a new mmWave backscatter that, for the first time, offers over (i) hundred-scale simultaneous 3D localization at (ii) subcentimeter accuracy for over an (iii) hectometer distance. Hawkeye generally applies to indoors and outdoors as well as under mobility. Hawkeye tag's Van Atta Array design with retro-reflectivity in both elevation and azimuth planes offers 3D localization and effectively suppresses the multipath. Hawkeye localization algorithm is a lightweight signal processing compatible with the commodity FMCW radar. It uniquely leverages the interplay between the tag signal and clutter, and leverages the spetral leakage for fine-grained positioning. Prototype evaluations in corridor, lecture room, and soccer field reveal 6.7 mm median accuracy at 160 m range, and simultaneously localizes 100 tags in only 33.2 ms. Hawkeye is reliable under temperature change with significant oscillator frequency offset.
△ Less
Submitted 6 January, 2023;
originally announced January 2023.
-
Significantly improving zero-shot X-ray pathology classification via fine-tuning pre-trained image-text encoders
Authors:
Jongseong Jang,
Daeun Kyung,
Seung Hwan Kim,
Honglak Lee,
Kyunghoon Bae,
Edward Choi
Abstract:
Deep neural networks are increasingly used in medical imaging for tasks such as pathological classification, but they face challenges due to the scarcity of high-quality, expert-labeled training data. Recent efforts have utilized pre-trained contrastive image-text models like CLIP, adapting them for medical use by fine-tuning the model with chest X-ray images and corresponding reports for zero-sho…
▽ More
Deep neural networks are increasingly used in medical imaging for tasks such as pathological classification, but they face challenges due to the scarcity of high-quality, expert-labeled training data. Recent efforts have utilized pre-trained contrastive image-text models like CLIP, adapting them for medical use by fine-tuning the model with chest X-ray images and corresponding reports for zero-shot pathology classification, thus eliminating the need for pathology-specific annotations. However, most studies continue to use the same contrastive learning objectives as in the general domain, overlooking the multi-labeled nature of medical image-report pairs. In this paper, we propose a new fine-tuning strategy that includes positive-pair loss relaxation and random sentence sampling. We aim to improve the performance of zero-shot pathology classification without relying on external knowledge. Our method can be applied to any pre-trained contrastive image-text encoder and easily transferred to out-of-domain datasets without further training, as it does not use external data. Our approach consistently improves overall zero-shot pathology classification across four chest X-ray datasets and three pre-trained models, with an average macro AUROC increase of 4.3%. Additionally, our method outperforms the state-of-the-art and marginally surpasses board-certified radiologists in zero-shot classification for the five competition pathologies in the CheXpert dataset.
△ Less
Submitted 11 October, 2024; v1 submitted 14 December, 2022;
originally announced December 2022.
-
Internal Calibration Process Using Chirp Pulses with Application of the Adam Learning Algorithm
Authors:
Junho Kweon,
Chan-Yong Jung,
Kyung-Bin Bae,
Seong-Ook Park
Abstract:
We propose a new internal calibration process using chirp pulses. Our method is utilized to mitigate thermal drift, which is unwanted changes and usually occurs in active elements such as a high power amplifier and low noise amplifier. The proposed method has advantages from two distinct aspects: calibration signal and algorithm. In respect to the calibration signal, our method does not contain an…
▽ More
We propose a new internal calibration process using chirp pulses. Our method is utilized to mitigate thermal drift, which is unwanted changes and usually occurs in active elements such as a high power amplifier and low noise amplifier. The proposed method has advantages from two distinct aspects: calibration signal and algorithm. In respect to the calibration signal, our method does not contain an additional signal source because chirp pulses, which are normally used for remote sensing, are used as calibration signals. Moreover, our methods solve the ambiguity problem of analyzing a phase shift which occurs when sinusoidal signals are used as calibration signals. In regards to the algorithm, the Adam learning algorithm avoids learning in the wrong direction, unlike the conventional gradient descent.
Using our method, mathematical forms of received signals are acquired successfully. Our method shows better effectivity compared to the conventional gradient descent algorithm. After compensation, the maximum differences of gain and phase become 0.06 dB and 2.42 degrees, respectively.
△ Less
Submitted 3 December, 2020;
originally announced December 2020.
-
Explaining Convolutional Neural Networks through Attribution-Based Input Sampling and Block-Wise Feature Aggregation
Authors:
Sam Sattarzadeh,
Mahesh Sudhakar,
Anthony Lem,
Shervin Mehryar,
K. N. Plataniotis,
Jongseong Jang,
Hyunwoo Kim,
Yeonjeong Jeong,
Sangmin Lee,
Kyunghoon Bae
Abstract:
As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on class activation mapping and randomized input sampling have gained great popularity. However, the attribution methods based on these techniques provide lower reso…
▽ More
As an emerging field in Machine Learning, Explainable AI (XAI) has been offering remarkable performance in interpreting the decisions made by Convolutional Neural Networks (CNNs). To achieve visual explanations for CNNs, methods based on class activation mapping and randomized input sampling have gained great popularity. However, the attribution methods based on these techniques provide lower resolution and blurry explanation maps that limit their explanation power. To circumvent this issue, visualization based on various layers is sought. In this work, we collect visualization maps from multiple layers of the model based on an attribution-based input sampling technique and aggregate them to reach a fine-grained and complete explanation. We also propose a layer selection strategy that applies to the whole family of CNN-based models, based on which our extraction framework is applied to visualize the last layers of each convolutional block of the model. Moreover, we perform an empirical analysis of the efficacy of derived lower-level information to enhance the represented attributions. Comprehensive experiments conducted on shallow and deep models trained on natural and industrial datasets, using both ground-truth and model-truth based evaluation metrics validate our proposed algorithm by meeting or outperforming the state-of-the-art methods in terms of explanation ability and visual quality, demonstrating that our method shows stability regardless of the size of objects or instances to be explained.
△ Less
Submitted 24 December, 2020; v1 submitted 1 October, 2020;
originally announced October 2020.
-
Advanced Stationary Point Concentration Technique for Leakage Mitigation and Small Drone Detection with FMCW Radar
Authors:
Junhyeong Park,
Jun-Sung Park,
Kyung-Bin Bae,
Seong-Ook Park
Abstract:
As the threats of small drones have grown, developing radars to detect the small drones has become an important issue. In earlier studies, we proposed the stationary point concentration (SPC) technique for the small drone detection with frequency-modulated continuous-wave (FMCW) radar. The SPC technique is a new approach to mitigate the leakage that is an inherent problem in the FMCW radar. The SP…
▽ More
As the threats of small drones have grown, developing radars to detect the small drones has become an important issue. In earlier studies, we proposed the stationary point concentration (SPC) technique for the small drone detection with frequency-modulated continuous-wave (FMCW) radar. The SPC technique is a new approach to mitigate the leakage that is an inherent problem in the FMCW radar. The SPC technique improves the signal-to-noise ratio of the small drones by reducing the noise floor and provides accurate distance and velocity information of the small drones. However, the SPC technique has shortcomings in realizing it. In this paper, we present the drawbacks of the SPC technique clearly and propose an advanced SPC (A-SPC) technique. The A-SPC technique can overcome the drawbacks of the SPC technique while taking all the good effects of the SPC technique. The experimental results verify the proposed A-SPC technique and show its robustness and usefulness.
△ Less
Submitted 14 July, 2020;
originally announced July 2020.
