Skip to main content

Showing 1–19 of 19 results for author: Pluim, J P W

Searching in archive eess. Search in all archives.
.
  1. arXiv:2505.22685  [pdf, ps, other

    eess.IV cs.AI cs.CV

    DeepMultiConnectome: Deep Multi-Task Prediction of Structural Connectomes Directly from Diffusion MRI Tractography

    Authors: Marcus J. Vroemen, Yuqian Chen, Yui Lo, Tengfei Xue, Weidong Cai, Fan Zhang, Josien P. W. Pluim, Lauren J. O'Donnell

    Abstract: Diffusion MRI (dMRI) tractography enables in vivo mapping of brain structural connections, but traditional connectome generation is time-consuming and requires gray matter parcellation, posing challenges for large-scale studies. We introduce DeepMultiConnectome, a deep-learning model that predicts structural connectomes directly from tractography, bypassing the need for gray matter parcellation wh… ▽ More

    Submitted 11 June, 2025; v1 submitted 27 May, 2025; originally announced May 2025.

    Comments: 15 pages, 5 figures

  2. arXiv:2504.17379  [pdf, other

    eess.IV cs.CV

    A Spatially-Aware Multiple Instance Learning Framework for Digital Pathology

    Authors: Hassan Keshvarikhojasteh, Mihail Tifrea, Sibylle Hess, Josien P. W. Pluim, Mitko Veta

    Abstract: Multiple instance learning (MIL) is a promising approach for weakly supervised classification in pathology using whole slide images (WSIs). However, conventional MIL methods such as Attention-Based Deep Multiple Instance Learning (ABMIL) typically disregard spatial interactions among patches that are crucial to pathological diagnosis. Recent advancements, such as Transformer based MIL (TransMIL),… ▽ More

    Submitted 25 April, 2025; v1 submitted 24 April, 2025; originally announced April 2025.

  3. arXiv:2503.04643  [pdf, other

    eess.IV cs.CV

    Adaptive Prototype Learning for Multimodal Cancer Survival Analysis

    Authors: Hong Liu, Haosen Yang, Federica Eduati, Josien P. W. Pluim, Mitko Veta

    Abstract: Leveraging multimodal data, particularly the integration of whole-slide histology images (WSIs) and transcriptomic profiles, holds great promise for improving cancer survival prediction. However, excessive redundancy in multimodal data can degrade model performance. In this paper, we propose Adaptive Prototype Learning (APL), a novel and effective approach for multimodal cancer survival analysis.… ▽ More

    Submitted 6 March, 2025; originally announced March 2025.

    Comments: 10 pages, 3 figures

  4. arXiv:2412.17586  [pdf, other

    eess.IV cs.CV cs.LG

    Enhancing Reconstruction-Based Out-of-Distribution Detection in Brain MRI with Model and Metric Ensembles

    Authors: Evi M. C. Huijben, Sina Amirrajab, Josien P. W. Pluim

    Abstract: Out-of-distribution (OOD) detection is crucial for safely deploying automated medical image analysis systems, as abnormal patterns in images could hamper their performance. However, OOD detection in medical imaging remains an open challenge, and we address three gaps: the underexplored potential of a simple OOD detection model, the lack of optimization of deep learning strategies specifically for… ▽ More

    Submitted 23 December, 2024; originally announced December 2024.

    MSC Class: 68T07

  5. arXiv:2304.13476  [pdf, other

    cs.CV cs.LG eess.IV

    Effect of latent space distribution on the segmentation of images with multiple annotations

    Authors: Ishaan Bhat, Josien P. W. Pluim, Max A. Viergever, Hugo J. Kuijf

    Abstract: We propose the Generalized Probabilistic U-Net, which extends the Probabilistic U-Net by allowing more general forms of the Gaussian distribution as the latent space distribution that can better approximate the uncertainty in the reference segmentations. We study the effect the choice of latent space distribution has on capturing the variation in the reference segmentations for lung tumors and whi… ▽ More

    Submitted 26 April, 2023; originally announced April 2023.

    Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://melba-journal.org/2023:005. arXiv admin note: text overlap with arXiv:2207.12872

    Journal ref: Machine.Learning.for.Biomedical.Imaging. 2 (2023)

  6. arXiv:2301.06304  [pdf

    eess.IV cs.CV

    LYSTO: The Lymphocyte Assessment Hackathon and Benchmark Dataset

    Authors: Yiping Jiao, Jeroen van der Laak, Shadi Albarqouni, Zhang Li, Tao Tan, Abhir Bhalerao, Jiabo Ma, Jiamei Sun, Johnathan Pocock, Josien P. W. Pluim, Navid Alemi Koohbanani, Raja Muhammad Saad Bashir, Shan E Ahmed Raza, Sibo Liu, Simon Graham, Suzanne Wetstein, Syed Ali Khurram, Thomas Watson, Nasir Rajpoot, Mitko Veta, Francesco Ciompi

    Abstract: We introduce LYSTO, the Lymphocyte Assessment Hackathon, which was held in conjunction with the MICCAI 2019 Conference in Shenzen (China). The competition required participants to automatically assess the number of lymphocytes, in particular T-cells, in histopathological images of colon, breast, and prostate cancer stained with CD3 and CD8 immunohistochemistry. Differently from other challenges se… ▽ More

    Submitted 13 April, 2023; v1 submitted 16 January, 2023; originally announced January 2023.

    Comments: will be sumitted to IEEE-JBHI

    MSC Class: 68T07 ACM Class: I.4.9; I.5.4; I.2.1

  7. arXiv:2206.10911  [pdf, other

    eess.IV cs.CV cs.LG

    Influence of uncertainty estimation techniques on false-positive reduction in liver lesion detection

    Authors: Ishaan Bhat, Josien P. W. Pluim, Max A. Viergever, Hugo J. Kuijf

    Abstract: Deep learning techniques show success in detecting objects in medical images, but still suffer from false-positive predictions that may hinder accurate diagnosis. The estimated uncertainty of the neural network output has been used to flag incorrect predictions. We study the role played by features computed from neural network uncertainty estimates and shape-based features computed from binary pre… ▽ More

    Submitted 15 December, 2022; v1 submitted 22 June, 2022; originally announced June 2022.

    Comments: Accepted for publication in the Journal of Machine Learning for Biomedical Imaging (MELBA)

    Journal ref: https://www.melba-journal.org/papers/2022:030.html

  8. arXiv:2101.04386  [pdf, other

    eess.IV cs.CV cs.LG

    Using uncertainty estimation to reduce false positives in liver lesion detection

    Authors: Ishaan Bhat, Hugo J. Kuijf, Veronika Cheplygina, Josien P. W. Pluim

    Abstract: Despite the successes of deep learning techniques at detecting objects in medical images, false positive detections occur which may hinder an accurate diagnosis. We propose a technique to reduce false positive detections made by a neural network using an SVM classifier trained with features derived from the uncertainty map of the neural network prediction. We demonstrate the effectiveness of this… ▽ More

    Submitted 26 January, 2021; v1 submitted 12 January, 2021; originally announced January 2021.

    Comments: Accepted at IEEE ISBI 2021

  9. Deep Learning-Based Grading of Ductal Carcinoma In Situ in Breast Histopathology Images

    Authors: Suzanne C. Wetstein, Nikolas Stathonikos, Josien P. W. Pluim, Yujing J. Heng, Natalie D. ter Hoeve, Celien P. H. Vreuls, Paul J. van Diest, Mitko Veta

    Abstract: Ductal carcinoma in situ (DCIS) is a non-invasive breast cancer that can progress into invasive ductal carcinoma (IDC). Studies suggest DCIS is often overtreated since a considerable part of DCIS lesions may never progress into IDC. Lower grade lesions have a lower progression speed and risk, possibly allowing treatment de-escalation. However, studies show significant inter-observer variation in D… ▽ More

    Submitted 7 October, 2020; originally announced October 2020.

    Journal ref: Laboratory Investigation. Published February 19th, 2021

  10. arXiv:2008.11673  [pdf, other

    eess.IV cs.CV

    Orientation-Disentangled Unsupervised Representation Learning for Computational Pathology

    Authors: Maxime W. Lafarge, Josien P. W. Pluim, Mitko Veta

    Abstract: Unsupervised learning enables modeling complex images without the need for annotations. The representation learned by such models can facilitate any subsequent analysis of large image datasets. However, some generative factors that cause irrelevant variations in images can potentially get entangled in such a learned representation causing the risk of negatively affecting any subsequent use. The… ▽ More

    Submitted 26 August, 2020; originally announced August 2020.

  11. arXiv:2006.16633  [pdf, other

    cs.CV cs.LG eess.IV

    Primary Tumor Origin Classification of Lung Nodules in Spectral CT using Transfer Learning

    Authors: Linde S. Hesse, Pim A. de Jong, Josien P. W. Pluim, Veronika Cheplygina

    Abstract: Early detection of lung cancer has been proven to decrease mortality significantly. A recent development in computed tomography (CT), spectral CT, can potentially improve diagnostic accuracy, as it yields more information per scan than regular CT. However, the shear workload involved with analyzing a large number of scans drives the need for automated diagnosis methods. Therefore, we propose a det… ▽ More

    Submitted 30 June, 2020; originally announced June 2020.

    Comments: MSc thesis Linde Hesse

  12. arXiv:2006.06356  [pdf, other

    cs.CR cs.CV eess.IV

    Adversarial Attack Vulnerability of Medical Image Analysis Systems: Unexplored Factors

    Authors: Gerda Bortsova, Cristina González-Gonzalo, Suzanne C. Wetstein, Florian Dubost, Ioannis Katramados, Laurens Hogeweg, Bart Liefers, Bram van Ginneken, Josien P. W. Pluim, Mitko Veta, Clara I. Sánchez, Marleen de Bruijne

    Abstract: Adversarial attacks are considered a potentially serious security threat for machine learning systems. Medical image analysis (MedIA) systems have recently been argued to be vulnerable to adversarial attacks due to strong financial incentives and the associated technological infrastructure. In this paper, we study previously unexplored factors affecting adversarial attack vulnerability of deep l… ▽ More

    Submitted 17 June, 2021; v1 submitted 11 June, 2020; originally announced June 2020.

    Comments: First three authors contributed equally

    Journal ref: Medical Image Analysis. Available online 18 Jun 2021

  13. arXiv:2004.12807  [pdf

    eess.IV cs.CV

    Quantifying Graft Detachment after Descemet's Membrane Endothelial Keratoplasty with Deep Convolutional Neural Networks

    Authors: Friso G. Heslinga, Mark Alberti, Josien P. W. Pluim, Javier Cabrerizo, Mitko Veta

    Abstract: Purpose: We developed a method to automatically locate and quantify graft detachment after Descemet's Membrane Endothelial Keratoplasty (DMEK) in Anterior Segment Optical Coherence Tomography (AS-OCT) scans. Methods: 1280 AS-OCT B-scans were annotated by a DMEK expert. Using the annotations, a deep learning pipeline was developed to localize scleral spur, center the AS-OCT B-scans and segment the… ▽ More

    Submitted 24 April, 2020; originally announced April 2020.

    Comments: To be published in Translational Vision Science & Technology

  14. clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentation

    Authors: Suprosanna Shit, Johannes C. Paetzold, Anjany Sekuboyina, Ivan Ezhov, Alexander Unger, Andrey Zhylka, Josien P. W. Pluim, Ulrich Bauer, Bjoern H. Menze

    Abstract: Accurate segmentation of tubular, network-like structures, such as vessels, neurons, or roads, is relevant to many fields of research. For such structures, the topology is their most important characteristic; particularly preserving connectedness: in the case of vascular networks, missing a connected vessel entirely alters the blood-flow dynamics. We introduce a novel similarity measure termed cen… ▽ More

    Submitted 15 July, 2022; v1 submitted 16 March, 2020; originally announced March 2020.

    Comments: * The authors Suprosanna Shit and Johannes C. Paetzold contributed equally to the work

    Report number: CVPR 2021

  15. arXiv:1911.10022  [pdf, other

    eess.IV cs.CV cs.LG stat.ML

    Direct Classification of Type 2 Diabetes From Retinal Fundus Images in a Population-based Sample From The Maastricht Study

    Authors: Friso G. Heslinga, Josien P. W. Pluim, A. J. H. M. Houben, Miranda T. Schram, Ronald M. A. Henry, Coen D. A. Stehouwer, Marleen J. van Greevenbroek, Tos T. J. M. Berendschot, Mitko Veta

    Abstract: Type 2 Diabetes (T2D) is a chronic metabolic disorder that can lead to blindness and cardiovascular disease. Information about early stage T2D might be present in retinal fundus images, but to what extent these images can be used for a screening setting is still unknown. In this study, deep neural networks were employed to differentiate between fundus images from individuals with and without T2D.… ▽ More

    Submitted 22 November, 2019; originally announced November 2019.

    Comments: to be published in the proceeding of SPIE - Medical Imaging 2020, 6 pages, 1 figure

  16. arXiv:1910.12753  [pdf, other

    eess.IV q-bio.QM

    Patient-specific fine-tuning of CNNs for follow-up lesion quantification

    Authors: Mariëlle J. A. Jansen, Hugo J. Kuijf, Ashis K. Dhara, Nick A. Weaver, Geert Jan Biessels, Robin Strand, Josien P. W. Pluim

    Abstract: Convolutional neural network (CNN) methods have been proposed to quantify lesions in medical imaging. Commonly more than one imaging examination is available for a patient, but the serial information in these images often remains unused. CNN-based methods have the potential to extract valuable information from previously acquired imaging to better quantify current imaging of the same patient. A pr… ▽ More

    Submitted 28 October, 2019; originally announced October 2019.

  17. arXiv:1910.06635  [pdf, other

    eess.IV cs.CV q-bio.QM

    Liver segmentation and metastases detection in MR images using convolutional neural networks

    Authors: Mariëlle J. A. Jansen, Hugo J. Kuijf, Maarten Niekel, Wouter B. Veldhuis, Frank J. Wessels, Max A. Viergever, Josien P. W. Pluim

    Abstract: Primary tumors have a high likelihood of developing metastases in the liver and early detection of these metastases is crucial for patient outcome. We propose a method based on convolutional neural networks (CNN) to detect liver metastases. First, the liver was automatically segmented using the six phases of abdominal dynamic contrast enhanced (DCE) MR images. Next, DCE-MR and diffusion weighted (… ▽ More

    Submitted 15 October, 2019; originally announced October 2019.

    Journal ref: J. Med. Imag. 6(4), 044003 (2019)

  18. arXiv:1908.08254  [pdf, other

    eess.IV cs.CV

    Motion correction of dynamic contrast enhanced MRI of the liver

    Authors: Mariëlle J. A. Jansen, Wouter B. Veldhuis, Maarten S. van Leeuwen, Josien P. W. Pluim

    Abstract: Motion correction of dynamic contrast enhanced magnetic resonance images (DCE-MRI) is a challenging task, due to changes in image appearance. In this study a groupwise registration, using a principle component analysis (PCA) based metric,1 is evaluated for clinical DCE MRI of the liver. The groupwise registration transforms the images to a common space, rather than to a reference volume as convent… ▽ More

    Submitted 22 August, 2019; originally announced August 2019.

  19. arXiv:1908.08251  [pdf, other

    eess.IV cs.CV

    Optimal input configuration of dynamic contrast enhanced MRI in convolutional neural networks for liver segmentation

    Authors: Mariëlle J. A. Jansen, Hugo J. Kuijf, Josien P. W. Pluim

    Abstract: Most MRI liver segmentation methods use a structural 3D scan as input, such as a T1 or T2 weighted scan. Segmentation performance may be improved by utilizing both structural and functional information, as contained in dynamic contrast enhanced (DCE) MR series. Dynamic information can be incorporated in a segmentation method based on convolutional neural networks in a number of ways. In this study… ▽ More

    Submitted 22 August, 2019; originally announced August 2019.

    Comments: Submitted to SPIE Medical Imaging 2019