-
Histopathology image embedding based on foundation models features aggregation for patient treatment response prediction
Authors:
Bilel Guetarni,
Feryal Windal,
Halim Benhabiles,
Mahfoud Chaibi,
Romain Dubois,
Emmanuelle Leteurtre,
Dominique Collard
Abstract:
Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the considered treatment. Recent works on foundation models pre-trained with self-supervised learning on large-scale unlabeled histopathology datasets have opened a new dire…
▽ More
Predicting the response of a patient to a cancer treatment is of high interest. Nonetheless, this task is still challenging from a medical point of view due to the complexity of the interaction between the patient organism and the considered treatment. Recent works on foundation models pre-trained with self-supervised learning on large-scale unlabeled histopathology datasets have opened a new direction towards the development of new methods for cancer diagnosis related tasks. In this article, we propose a novel methodology for predicting Diffuse Large B-Cell Lymphoma patients treatment response from Whole Slide Images. Our method exploits several foundation models as feature extractors to obtain a local representation of the image corresponding to a small region of the tissue, then, a global representation of the image is obtained by aggregating these local representations using attention-based Multiple Instance Learning. Our experimental study conducted on a dataset of 152 patients, shows the promising results of our methodology, notably by highlighting the advantage of using foundation models compared to conventional ImageNet pre-training. Moreover, the obtained results clearly demonstrates the potential of foundation models for characterizing histopathology images and generating more suited semantic representation for this task.
△ Less
Submitted 23 July, 2024;
originally announced August 2024.
-
Ensembling and Test Augmentation for Covid-19 Detection and Covid-19 Domain Adaptation from 3D CT-Scans
Authors:
Fares Bougourzi,
Feryal Windal Moula,
Halim Benhabiles,
Fadi Dornaika,
Abdelmalik Taleb-Ahmed
Abstract:
Since the emergence of Covid-19 in late 2019, medical image analysis using artificial intelligence (AI) has emerged as a crucial research area, particularly with the utility of CT-scan imaging for disease diagnosis. This paper contributes to the 4th COV19D competition, focusing on Covid-19 Detection and Covid-19 Domain Adaptation Challenges. Our approach centers on lung segmentation and Covid-19 i…
▽ More
Since the emergence of Covid-19 in late 2019, medical image analysis using artificial intelligence (AI) has emerged as a crucial research area, particularly with the utility of CT-scan imaging for disease diagnosis. This paper contributes to the 4th COV19D competition, focusing on Covid-19 Detection and Covid-19 Domain Adaptation Challenges. Our approach centers on lung segmentation and Covid-19 infection segmentation employing the recent CNN-based segmentation architecture PDAtt-Unet, which simultaneously segments lung regions and infections. Departing from traditional methods, we concatenate the input slice (grayscale) with segmented lung and infection, generating three input channels akin to color channels. Additionally, we employ three 3D CNN backbones Customized Hybrid-DeCoVNet, along with pretrained 3D-Resnet-18 and 3D-Resnet-50 models to train Covid-19 recognition for both challenges. Furthermore, we explore ensemble approaches and testing augmentation to enhance performance. Comparison with baseline results underscores the substantial efficiency of our approach, with a significant margin in terms of F1-score (14 %). This study advances the field by presenting a comprehensive methodology for accurate Covid-19 detection and adaptation, leveraging cutting-edge AI techniques in medical image analysis.
△ Less
Submitted 17 March, 2024;
originally announced March 2024.
-
A vision transformer-based framework for knowledge transfer from multi-modal to mono-modal lymphoma subtyping models
Authors:
Bilel Guetarni,
Feryal Windal,
Halim Benhabiles,
Marianne Petit,
Romain Dubois,
Emmanuelle Leteurtre,
Dominique Collard
Abstract:
Determining lymphoma subtypes is a crucial step for better patient treatment targeting to potentially increase their survival chances. In this context, the existing gold standard diagnosis method, which relies on gene expression technology, is highly expensive and time-consuming, making it less accessibility. Although alternative diagnosis methods based on IHC (immunohistochemistry) technologies e…
▽ More
Determining lymphoma subtypes is a crucial step for better patient treatment targeting to potentially increase their survival chances. In this context, the existing gold standard diagnosis method, which relies on gene expression technology, is highly expensive and time-consuming, making it less accessibility. Although alternative diagnosis methods based on IHC (immunohistochemistry) technologies exist (recommended by the WHO), they still suffer from similar limitations and are less accurate. Whole Slide Image (WSI) analysis using deep learning models has shown promising potential for cancer diagnosis, that could offer cost-effective and faster alternatives to existing methods. In this work, we propose a vision transformer-based framework for distinguishing DLBCL (Diffuse Large B-Cell Lymphoma) cancer subtypes from high-resolution WSIs. To this end, we introduce a multi-modal architecture to train a classifier model from various WSI modalities. We then leverage this model through a knowledge distillation process to efficiently guide the learning of a mono-modal classifier. Our experimental study conducted on a lymphoma dataset of 157 patients shows the promising performance of our mono-modal classification model, outperforming six recent state-of-the-art methods. In addition, the power-law curve, estimated on our experimental data, suggests that with more training data from a reasonable number of additional patients, our model could achieve competitive diagnosis accuracy with IHC technologies. Furthermore, the efficiency of our framework is confirmed through an additional experimental study on an external breast cancer dataset (BCI dataset).
△ Less
Submitted 29 May, 2024; v1 submitted 2 August, 2023;
originally announced August 2023.
-
SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix Data Augmentation
Authors:
Karim Hammoudi,
Adnane Cabani,
Bouthaina Slika,
Halim Benhabiles,
Fadi Dornaika,
Mahmoud Melkemi
Abstract:
A novel approach of data augmentation based on irregular superpixel decomposition is proposed. This approach called SuperpixelGridMasks permits to extend original image datasets that are required by training stages of machine learning-related analysis architectures towards increasing their performances. Three variants named SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix are presented.…
▽ More
A novel approach of data augmentation based on irregular superpixel decomposition is proposed. This approach called SuperpixelGridMasks permits to extend original image datasets that are required by training stages of machine learning-related analysis architectures towards increasing their performances. Three variants named SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix are presented. These grid-based methods produce a new style of image transformations using the dropping and fusing of information. Extensive experiments using various image classification models and datasets show that baseline performances can be significantly outperformed using our methods. The comparative study also shows that our methods can overpass the performances of other data augmentations. Experimental results obtained over image recognition datasets of varied natures show the efficiency of these new methods. SuperpixelGridCut, SuperpixelGridMean and SuperpixelGridMix codes are publicly available at https://github.com/hammoudiproject/SuperpixelGridMasks
△ Less
Submitted 11 April, 2022;
originally announced April 2022.
-
MaskedFace-Net -- A Dataset of Correctly/Incorrectly Masked Face Images in the Context of COVID-19
Authors:
Adnane Cabani,
Karim Hammoudi,
Halim Benhabiles,
Mahmoud Melkemi
Abstract:
The wearing of the face masks appears as a solution for limiting the spread of COVID-19. In this context, efficient recognition systems are expected for checking that people faces are masked in regulated areas. To perform this task, a large dataset of masked faces is necessary for training deep learning models towards detecting people wearing masks and those not wearing masks. Some large datasets…
▽ More
The wearing of the face masks appears as a solution for limiting the spread of COVID-19. In this context, efficient recognition systems are expected for checking that people faces are masked in regulated areas. To perform this task, a large dataset of masked faces is necessary for training deep learning models towards detecting people wearing masks and those not wearing masks. Some large datasets of masked faces are available in the literature. However, at the moment, there are no available large dataset of masked face images that permits to check if detected masked faces are correctly worn or not. Indeed, many people are not correctly wearing their masks due to bad practices, bad behaviors or vulnerability of individuals (e.g., children, old people). For these reasons, several mask wearing campaigns intend to sensitize people about this problem and good practices. In this sense, this work proposes three types of masked face detection dataset; namely, the Correctly Masked Face Dataset (CMFD), the Incorrectly Masked Face Dataset (IMFD) and their combination for the global masked face detection (MaskedFace-Net). Realistic masked face datasets are proposed with a twofold objective: i) to detect people having their faces masked or not masked, ii) to detect faces having their masks correctly worn or incorrectly worn (e.g.; at airport portals or in crowds). To the best of our knowledge, no large dataset of masked faces provides such a granularity of classification towards permitting mask wearing analysis. Moreover, this work globally presents the applied mask-to-face deformable model for permitting the generation of other masked face images, notably with specific masks. Our datasets of masked face images (137,016 images) are available at https://github.com/cabani/MaskedFace-Net.
△ Less
Submitted 18 August, 2020;
originally announced August 2020.
-
Deep Learning on Chest X-ray Images to Detect and Evaluate Pneumonia Cases at the Era of COVID-19
Authors:
Karim Hammoudi,
Halim Benhabiles,
Mahmoud Melkemi,
Fadi Dornaika,
Ignacio Arganda-Carreras,
Dominique Collard,
Arnaud Scherpereel
Abstract:
Coronavirus disease 2019 (COVID-19) is an infectious disease with first symptoms similar to the flu. COVID-19 appeared first in China and very quickly spreads to the rest of the world, causing then the 2019-20 coronavirus pandemic. In many cases, this disease causes pneumonia. Since pulmonary infections can be observed through radiography images, this paper investigates deep learning methods for a…
▽ More
Coronavirus disease 2019 (COVID-19) is an infectious disease with first symptoms similar to the flu. COVID-19 appeared first in China and very quickly spreads to the rest of the world, causing then the 2019-20 coronavirus pandemic. In many cases, this disease causes pneumonia. Since pulmonary infections can be observed through radiography images, this paper investigates deep learning methods for automatically analyzing query chest X-ray images with the hope to bring precision tools to health professionals towards screening the COVID-19 and diagnosing confirmed patients. In this context, training datasets, deep learning architectures and analysis strategies have been experimented from publicly open sets of chest X-ray images. Tailored deep learning models are proposed to detect pneumonia infection cases, notably viral cases. It is assumed that viral pneumonia cases detected during an epidemic COVID-19 context have a high probability to presume COVID-19 infections. Moreover, easy-to-apply health indicators are proposed for estimating infection status and predicting patient status from the detected pneumonia cases. Experimental results show possibilities of training deep learning models over publicly open sets of chest X-ray images towards screening viral pneumonia. Chest X-ray test images of COVID-19 infected patients are successfully diagnosed through detection models retained for their performances. The efficiency of proposed health indicators is highlighted through simulated scenarios of patients presenting infections and health problems by combining real and synthetic health data.
△ Less
Submitted 5 April, 2020;
originally announced April 2020.
-
Measurement and analysis of nuclear $γ$-ray production cross sections in proton interactions with Mg, Si and Fe nuclei abundant in astrophysical sites over the incident energy range $E=30-66$ MeV
Authors:
W. Yahia-Cherif,
S. Ouichaoui,
J. Kiener,
E. A. Lawrie,
J. J. Lawrie,
V. Tatischeff,
A. Belhout,
D. Moussa,
P. Papka,
H. Benhabiles,
T. D. Bucher,
A. Chafa,
J. L. Conradie,
S. Damache,
M. Debabi,
I. Deloncle,
J. L. Easton,
C. Hamadache,
F. Hammache,
P. Jones,
B. V. Kheswa,
N. A. Khumalo,
T. Lamula,
S. N. T. Majola,
J. Ndayishimye
, et al. (7 additional authors not shown)
Abstract:
Gamma-ray production cross section excitation functions have been measured for $30$, $42$, $54$ and $66$ MeV proton beams accelerated onto targets of astrophysical interest, $^{nat}$C, C + O (Mylar), $^{nat}$Mg, $^{nat}$Si and $^{56}$Fe, at the Sector Separated Cyclotron (SSC) of iThemba LABS (near Cape Town, South Africa). The AFRODITE array equipped with 8 Compton suppressed HPGe clover detector…
▽ More
Gamma-ray production cross section excitation functions have been measured for $30$, $42$, $54$ and $66$ MeV proton beams accelerated onto targets of astrophysical interest, $^{nat}$C, C + O (Mylar), $^{nat}$Mg, $^{nat}$Si and $^{56}$Fe, at the Sector Separated Cyclotron (SSC) of iThemba LABS (near Cape Town, South Africa). The AFRODITE array equipped with 8 Compton suppressed HPGe clover detectors was used to record $γ$-ray data. For known, intense $γ$-ray lines the previously reported experimental data measured up to $E_{p}\simeq$ $25$ MeV at the Washington and Orsay tandem accelerators were extended to higher proton energies. Our experimental data for the last 3 targets are reported here and discussed with respect to previous data and the Murphy \textit{et al.} compilation [ApJS 183, 142 (2009)], as well as to predictions of the nuclear reaction code TALYS. The overall agreement between theory and experiment obtained in first-approach calculations using default input parameters of TALYS has been appreciably improved by using modified optical model potential (OMP), deformation, and level density parameters. The OMP parameters have been extracted from theoretical fits to available experimental elastic/inelastic nucleon scattering angular distribution data by means of the coupled-channels reaction code OPTMAN. Experimental data for several new $γ$-ray lines are also reported and discussed. The astrophysical implications of our results are emphasised.
△ Less
Submitted 20 January, 2020;
originally announced January 2020.
-
Gamma-ray emission in alpha-particle reactions with C, Mg, Si, Fe
Authors:
J. Kiener,
J. Bundesmann,
I. Deloncle,
A. Denker,
V. Tatischeff,
A. Gostojic,
C. Hamadache,
J. Röhrich,
H. Benhabiles,
I. Bougaoub,
A. Coc,
F. Hammache,
J. Peyré
Abstract:
Cross sections for the strongest gamma-ray emission lines produced in alpha-particle reactions with C, Mg, Si, Fe have been measured in the range E_alpha = 50 - 90 MeV at the center for proton therapy at the Helmholtz-Zentrum Berlin. Data for more than 60 different gamma-ray lines were determined, with particular efforts for lines that are in cross section compilations/evaluations with astrophysic…
▽ More
Cross sections for the strongest gamma-ray emission lines produced in alpha-particle reactions with C, Mg, Si, Fe have been measured in the range E_alpha = 50 - 90 MeV at the center for proton therapy at the Helmholtz-Zentrum Berlin. Data for more than 60 different gamma-ray lines were determined, with particular efforts for lines that are in cross section compilations/evaluations with astrophysical purpose, and where data exist at lower projectile energies. The data are compared with predictions of a modern nuclear reaction code and cross-section curves of the latest evaluation for gamma-ray line emission in accelerated-particle interactions in solar flares.
△ Less
Submitted 10 January, 2020;
originally announced January 2020.
-
Gamma ray production cross sections in proton induced reactions on natural Mg, Si and Fe targets over the proton energy range 30 up to 66 MeV
Authors:
W. Yahia-Chérif,
S. Ouichaoui,
J. Kiener,
V. Tatischeff,
E. Lawrie,
J. J. Lawrie,
A. Belhout,
H. Benhabiles,
T. D. Bucher,
A. Chafa,
S. Damache,
M. Debabi,
I. Deloncle,
J. L. Easton,
C. Hamadache,
F. Hammache,
P. Jones,
B. V. Kheswa,
N. Khumalo,
T. Lamula,
S. T. H. Majola,
D. Negi,
J. Ndayishimye,
S. P. Noncolela,
D. Moussa
, et al. (7 additional authors not shown)
Abstract:
Gamma-ray excitation functions have been measured for 30, 42, 54 and 66 MeV proton beams accelerated onto C + O (Mylar), Mg, Si, and Fe targets of astrophysical interest at the separate-sector cyclotron of iThemba LABS in Somerset West (Cape Town, South Africa). A large solid angle, high energy resolution detection system of the Eurogam type was used to record Gamma-ray energy spectra. Derived pre…
▽ More
Gamma-ray excitation functions have been measured for 30, 42, 54 and 66 MeV proton beams accelerated onto C + O (Mylar), Mg, Si, and Fe targets of astrophysical interest at the separate-sector cyclotron of iThemba LABS in Somerset West (Cape Town, South Africa). A large solid angle, high energy resolution detection system of the Eurogam type was used to record Gamma-ray energy spectra. Derived preliminary results of Gamma-ray line production cross sections for the Mg, Si and Fe target nuclei are reported and discussed. The current cross section data for known, intense Gamma-ray lines from these nuclei consistently extend to higher proton energies previous experimental data measured up to Ep ~ 25 MeV at the Orsay and Washington tandem accelerators. Data for new Gamma-ray lines observed for the first time in this work are also reported.
△ Less
Submitted 9 July, 2015;
originally announced July 2015.