-
Self-Supervised Learning Featuring Small-Scale Image Dataset for Treatable Retinal Diseases Classification
Authors:
Luffina C. Huang,
Darren J. Chiu,
Manish Mehta
Abstract:
Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised Learning (SSL) is an good alternative to Transfer Learning (TL) and is suitable for imbalanced image datasets. In this study, we assess four pretrained SSL models…
▽ More
Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised Learning (SSL) is an good alternative to Transfer Learning (TL) and is suitable for imbalanced image datasets. In this study, we assess four pretrained SSL models and two TL models in treatable retinal diseases classification using small-scale Optical Coherence Tomography (OCT) images ranging from 125 to 4000 with balanced or imbalanced distribution for training. The proposed SSL model achieves the state-of-art accuracy of 98.84% using only 4,000 training images. Our results suggest the SSL models provide superior performance under both the balanced and imbalanced training scenarios. The SSL model with MoCo-v2 scheme has consistent good performance under the imbalanced scenario and, especially, surpasses the other models when the training set is less than 500 images.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Greedy-optimized Approach for Interbeat Interval and Heart Rate Variability Daily Monitoring using Wearable PPG
Authors:
Luffina C. Huang
Abstract:
Continuous monitoring of heart rate variability (HRV) provides insights in cardiovascular health. Wearable Photoplethysmography (PPG) assures convenient measurement of HRV. PPG, however, is susceptible to motion artifacts, considerably deteriorating the accuracy in estimation. In this study, a greedy-optimized approach is proposed for attaining high accuracy of interbeat intervals (IBIs) estimatio…
▽ More
Continuous monitoring of heart rate variability (HRV) provides insights in cardiovascular health. Wearable Photoplethysmography (PPG) assures convenient measurement of HRV. PPG, however, is susceptible to motion artifacts, considerably deteriorating the accuracy in estimation. In this study, a greedy-optimized approach is proposed for attaining high accuracy of interbeat intervals (IBIs) estimation from PPG signals collected during intensive daily activities. Utilizing the fact of continuity in heartbeats, the IBI estimation is converted into the shortest path problem in a directed acyclic graph, where candidate heartbeats from motion-contaminated PPG are regarded as vertices. The approach exploits a convex penalty function to optimize weight assignment in the shortest path calculation and a greedy fusion method to strengthen the selection process of optimal IBIs. Results achieve correlation of 0.96 for IBI estimation with the improvement of 58.4% in percentage error on the single-channel PPG signal from 2015 IEEE Signal Processing Cup. It also achieves correlation of 0.98 with percentage error of 2.2% in the two-channel PPG signal. Estimated and true HRV parameters are highly correlated. The approach is further validated on the PPG-DaLiA dataset with high correlation and low percentage error for IBI and HRV estimation in two daily activities, indicating the robustness of the proposed technique.
△ Less
Submitted 15 April, 2024; v1 submitted 7 January, 2023;
originally announced January 2023.
-
Faster On-Device Training Using New Federated Momentum Algorithm
Authors:
Zhouyuan Huo,
Qian Yang,
Bin Gu,
Lawrence Carin. Heng Huang
Abstract:
Mobile crowdsensing has gained significant attention in recent years and has become a critical paradigm for emerging Internet of Things applications. The sensing devices continuously generate a significant quantity of data, which provide tremendous opportunities to develop innovative intelligent applications. To utilize these data to train machine learning models while not compromising user privac…
▽ More
Mobile crowdsensing has gained significant attention in recent years and has become a critical paradigm for emerging Internet of Things applications. The sensing devices continuously generate a significant quantity of data, which provide tremendous opportunities to develop innovative intelligent applications. To utilize these data to train machine learning models while not compromising user privacy, federated learning has become a promising solution. However, there is little understanding of whether federated learning algorithms are guaranteed to converge. We reconsider model averaging in federated learning and formulate it as a gradient-based method with biased gradients. This novel perspective assists analysis of its convergence rate and provides a new direction for more acceleration. We prove for the first time that the federated averaging algorithm is guaranteed to converge for non-convex problems, without imposing additional assumptions. We further propose a novel accelerated federated learning algorithm and provide a convergence guarantee. Simulated federated learning experiments are conducted to train deep neural networks on benchmark datasets, and experimental results show that our proposed method converges faster than previous approaches.
△ Less
Submitted 5 February, 2020;
originally announced February 2020.