-
Developing RPC-Net: Leveraging High-Density Electromyography and Machine Learning for Improved Hand Position Estimation
Authors:
Giovanni Rolandino,
Marco Gagliardi,
Taian Martins,
Giacinto Luigi Cerone,
Brian Andrews,
James J. FitzGerald
Abstract:
Objective: The purpose of this study was to develop and evaluate the performance of RPC-Net (Recursive Prosthetic Control Network), a novel method using simple neural network architectures to translate electromyographic activity into hand position with high accuracy and computational efficiency. Methods: RPC-Net uses a regression-based approach to convert forearm electromyographic signals into han…
▽ More
Objective: The purpose of this study was to develop and evaluate the performance of RPC-Net (Recursive Prosthetic Control Network), a novel method using simple neural network architectures to translate electromyographic activity into hand position with high accuracy and computational efficiency. Methods: RPC-Net uses a regression-based approach to convert forearm electromyographic signals into hand kinematics. We tested the adaptability of the algorithm to different conditions and compared its performance with that of solutions from the academic literature. Results: RPC-Net demonstrated a high degree of accuracy in predicting hand position from electromyographic activity, outperforming other solutions with the same computational cost. Including previous position data consistently improved results across subjects and conditions. RPC-Net showed robustness against a reduction in the number of electromyography electrodes used and shorter input signals, indicating potential for further reduction in computational cost. Conclusion: The results demonstrate that RPC-Net is capable of accurately translating forearm electromyographic activity into hand position, offering a practical and adaptable tool that may be accessible in clinical settings. Significance: The development of RPC-Net represents a significant advancement. In clinical settings, its application could enable prosthetic devices to be controlled in a way that feels more natural, improving the quality of life for individuals with limb loss.
△ Less
Submitted 20 May, 2025;
originally announced May 2025.
-
HDE-Array: Development and Validation of a New Dry Electrode Array Design to Acquire HD-sEMG for Hand Position Estimation
Authors:
Giovanni Rolandino,
Chiara Zangrandi,
Taian Vieira,
Giacinto Luigi Cerone,
Brian Andrews,
James J. FitzGerald
Abstract:
This paper aims to introduce HDE-Array (High-Density Electrode Array), a novel dry electrode array for acquiring High-Density surface electromyography (HD-sEMG) for hand position estimation through RPC-Net (Recursive Prosthetic Control Network), a neural network defined in a previous study. We aim to demonstrate the hypothesis that the position estimates returned by RPC-Net using HD-sEMG signals a…
▽ More
This paper aims to introduce HDE-Array (High-Density Electrode Array), a novel dry electrode array for acquiring High-Density surface electromyography (HD-sEMG) for hand position estimation through RPC-Net (Recursive Prosthetic Control Network), a neural network defined in a previous study. We aim to demonstrate the hypothesis that the position estimates returned by RPC-Net using HD-sEMG signals acquired with HDE-Array are as accurate as those obtained from signals acquired with gel electrodes. We compared the results, in terms of precision of hand position estimation by RPC-Net, using signals acquired by traditional gel electrodes and by HDE-Array. As additional validation, we performed a variance analysis to confirm that the presence of only two rows of electrodes does not result in an excessive loss of information, and we characterized the electrode-skin impedance to assess the effects of the voltage divider effect and power line interference. Performance tests indicated that RPC-Net, used with HDE-Array, achieved comparable or superior results to those observed when used with the gel electrode setup. The dry electrodes demonstrated effective performance even with a simplified setup, highlighting potential cost and usability benefits. These results suggest improvements in the accessibility and user-friendliness of upper-limb rehabilitation devices and underscore the potential of HDE-Array and RPC-Net to revolutionize control for medical and non-medical applications.
△ Less
Submitted 20 May, 2025;
originally announced May 2025.
-
2D and 3D Deep Learning Models for MRI-based Parkinson's Disease Classification: A Comparative Analysis of Convolutional Kolmogorov-Arnold Networks, Convolutional Neural Networks, and Graph Convolutional Networks
Authors:
Salil B Patel,
Vicky Goh,
James F FitzGerald,
Chrystalina A Antoniades
Abstract:
Parkinson's Disease (PD) diagnosis remains challenging. This study applies Convolutional Kolmogorov-Arnold Networks (ConvKANs), integrating learnable spline-based activation functions into convolutional layers, for PD classification using structural MRI. The first 3D implementation of ConvKANs for medical imaging is presented, comparing their performance to Convolutional Neural Networks (CNNs) and…
▽ More
Parkinson's Disease (PD) diagnosis remains challenging. This study applies Convolutional Kolmogorov-Arnold Networks (ConvKANs), integrating learnable spline-based activation functions into convolutional layers, for PD classification using structural MRI. The first 3D implementation of ConvKANs for medical imaging is presented, comparing their performance to Convolutional Neural Networks (CNNs) and Graph Convolutional Networks (GCNs) across three open-source datasets. Isolated analyses assessed performance within individual datasets, using cross-validation techniques. Holdout analyses evaluated cross-dataset generalizability by training models on two datasets and testing on the third, mirroring real-world clinical scenarios. In isolated analyses, 2D ConvKANs achieved the highest AUC of 0.99 (95% CI: 0.98-0.99) on the PPMI dataset, outperforming 2D CNNs (AUC: 0.97, p = 0.0092). 3D models showed promise, with 3D CNN and 3D ConvKAN reaching an AUC of 0.85 on PPMI. In holdout analyses, 3D ConvKAN demonstrated superior generalization, achieving an AUC of 0.85 on early-stage PD data. GCNs underperformed in 2D but improved in 3D implementations. These findings highlight ConvKANs' potential for PD detection, emphasize the importance of 3D analysis in capturing subtle brain changes, and underscore cross-dataset generalization challenges. This study advances AI-assisted PD diagnosis using structural MRI and emphasizes the need for larger-scale validation.
△ Less
Submitted 26 September, 2024; v1 submitted 24 July, 2024;
originally announced July 2024.
-
Magnetic resonance delta radiomics to track radiation response in lung tumors receiving stereotactic MRI-guided radiotherapy
Authors:
Yining Zha,
Benjamin H. Kann,
Zezhong Ye,
Anna Zapaishchykova,
John He,
Shu-Hui Hsu,
Jonathan E. Leeman,
Kelly J. Fitzgerald,
David E. Kozono,
Raymond H. Mak,
Hugo J. W. L. Aerts
Abstract:
Introduction: Lung cancer is a leading cause of cancer-related mortality, and stereotactic body radiotherapy (SBRT) has become a standard treatment for early-stage lung cancer. However, the heterogeneous response to radiation at the tumor level poses challenges. Currently, standardized dosage regimens lack adaptation based on individual patient or tumor characteristics. Thus, we explore the potent…
▽ More
Introduction: Lung cancer is a leading cause of cancer-related mortality, and stereotactic body radiotherapy (SBRT) has become a standard treatment for early-stage lung cancer. However, the heterogeneous response to radiation at the tumor level poses challenges. Currently, standardized dosage regimens lack adaptation based on individual patient or tumor characteristics. Thus, we explore the potential of delta radiomics from on-treatment magnetic resonance (MR) imaging to track radiation dose response, inform personalized radiotherapy dosing, and predict outcomes. Methods: A retrospective study of 47 MR-guided lung SBRT treatments for 39 patients was conducted. Radiomic features were extracted using Pyradiomics, and stability was evaluated temporally and spatially. Delta radiomics were correlated with radiation dose delivery and assessed for associations with tumor control and survival with Cox regressions. Results: Among 107 features, 49 demonstrated temporal stability, and 57 showed spatial stability. Fifteen stable and non-collinear features were analyzed. Median Skewness and surface to volume ratio decreased with radiation dose fraction delivery, while coarseness and 90th percentile values increased. Skewness had the largest relative median absolute changes (22%-45%) per fraction from baseline and was associated with locoregional failure (p=0.012) by analysis of covariance. Skewness, Elongation, and Flatness were significantly associated with local recurrence-free survival, while tumor diameter and volume were not. Conclusions: Our study establishes the feasibility and stability of delta radiomics analysis for MR-guided lung SBRT. Findings suggest that MR delta radiomics can capture short-term radiographic manifestations of intra-tumoral radiation effect.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Deep learning-based holographic polarization microscopy
Authors:
Tairan Liu,
Kevin de Haan,
Bijie Bai,
Yair Rivenson,
Yi Luo,
Hongda Wang,
David Karalli,
Hongxiang Fu,
Yibo Zhang,
John FitzGerald,
Aydogan Ozcan
Abstract:
Polarized light microscopy provides high contrast to birefringent specimen and is widely used as a diagnostic tool in pathology. However, polarization microscopy systems typically operate by analyzing images collected from two or more light paths in different states of polarization, which lead to relatively complex optical designs, high system costs or experienced technicians being required. Here,…
▽ More
Polarized light microscopy provides high contrast to birefringent specimen and is widely used as a diagnostic tool in pathology. However, polarization microscopy systems typically operate by analyzing images collected from two or more light paths in different states of polarization, which lead to relatively complex optical designs, high system costs or experienced technicians being required. Here, we present a deep learning-based holographic polarization microscope that is capable of obtaining quantitative birefringence retardance and orientation information of specimen from a phase recovered hologram, while only requiring the addition of one polarizer/analyzer pair to an existing holographic imaging system. Using a deep neural network, the reconstructed holographic images from a single state of polarization can be transformed into images equivalent to those captured using a single-shot computational polarized light microscope (SCPLM). Our analysis shows that a trained deep neural network can extract the birefringence information using both the sample specific morphological features as well as the holographic amplitude and phase distribution. To demonstrate the efficacy of this method, we tested it by imaging various birefringent samples including e.g., monosodium urate (MSU) and triamcinolone acetonide (TCA) crystals. Our method achieves similar results to SCPLM both qualitatively and quantitatively, and due to its simpler optical design and significantly larger field-of-view, this method has the potential to expand the access to polarization microscopy and its use for medical diagnosis in resource limited settings.
△ Less
Submitted 1 July, 2020;
originally announced July 2020.
-
A Cloud-Based Collaboration Platform for Model-Based Design of Cyber-Physical Systems
Authors:
Peter Gorm Larsen,
Hugo Daniel Macedo,
John Fitzgerald,
Holger Pfeifer,
Martin Benedikt,
Stefano Tonetta,
Angelo Marguglio,
Sergio Gusmeroli,
George Suciu Jr
Abstract:
Businesses, particularly small and medium-sized enterprises, aiming to start up in Model-Based Design (MBD) face difficult choices from a wide range of methods, notations and tools before making the significant investments in planning, procurement and training necessary to deploy new approaches successfully. In the development of Cyber-Physical Systems (CPSs) this is exacerbated by the diversity o…
▽ More
Businesses, particularly small and medium-sized enterprises, aiming to start up in Model-Based Design (MBD) face difficult choices from a wide range of methods, notations and tools before making the significant investments in planning, procurement and training necessary to deploy new approaches successfully. In the development of Cyber-Physical Systems (CPSs) this is exacerbated by the diversity of formalisms covering computation, physical and human processes. In this paper, we propose the use of a cloud-enabled and open collaboration platform that allows businesses to offer models, tools and other assets, and permits others to access these on a pay-per-use basis as a means of lowering barriers to the adoption of MBD technology, and to promote experimentation in a sandbox environment.
△ Less
Submitted 5 May, 2020;
originally announced May 2020.