Showing 1–43 of 43 results for author: Nürnberger, A

SMILE-UHURA Challenge -- Small Vessel Segmentation at Mesoscopic Scale from Ultra-High Resolution 7T Magnetic Resonance Angiograms

Authors: Soumick Chatterjee, Hendrik Mattern, Marc Dörner, Alessandro Sciarra, Florian Dubost, Hannes Schnurre, Rupali Khatun, Chun-Chih Yu, Tsung-Lin Hsieh, Yi-Shan Tsai, Yi-Zeng Fang, Yung-Ching Yang, Juinn-Dar Huang, Marshall Xu, Siyu Liu, Fernanda L. Ribeiro, Saskia Bollmann, Karthikesh Varma Chintalapati, Chethan Mysuru Radhakrishna, Sri Chandana Hudukula Ram Kumara, Raviteja Sutrave, Abdul Qayyum, Moona Mazher, Imran Razzak, Cristobal Rodero , et al. (23 additional authors not shown)

Abstract: The human brain receives nutrients and oxygen through an intricate network of blood vessels. Pathology affecting small vessels, at the mesoscopic scale, represents a critical vulnerability within the cerebral blood supply and can lead to severe conditions, such as Cerebral Small Vessel Diseases. The advent of 7 Tesla MRI systems has enabled the acquisition of higher spatial resolution images, maki… ▽ More The human brain receives nutrients and oxygen through an intricate network of blood vessels. Pathology affecting small vessels, at the mesoscopic scale, represents a critical vulnerability within the cerebral blood supply and can lead to severe conditions, such as Cerebral Small Vessel Diseases. The advent of 7 Tesla MRI systems has enabled the acquisition of higher spatial resolution images, making it possible to visualise such vessels in the brain. However, the lack of publicly available annotated datasets has impeded the development of robust, machine learning-driven segmentation algorithms. To address this, the SMILE-UHURA challenge was organised. This challenge, held in conjunction with the ISBI 2023, in Cartagena de Indias, Colombia, aimed to provide a platform for researchers working on related topics. The SMILE-UHURA challenge addresses the gap in publicly available annotated datasets by providing an annotated dataset of Time-of-Flight angiography acquired with 7T MRI. This dataset was created through a combination of automated pre-segmentation and extensive manual refinement. In this manuscript, sixteen submitted methods and two baseline methods are compared both quantitatively and qualitatively on two different datasets: held-out test MRAs from the same dataset as the training data (with labels kept secret) and a separate 7T ToF MRA dataset where both input volumes and labels are kept secret. The results demonstrate that most of the submitted deep learning methods, trained on the provided training dataset, achieved reliable segmentation performance. Dice scores reached up to 0.838 $\pm$ 0.066 and 0.716 $\pm$ 0.125 on the respective datasets, with an average performance of up to 0.804 $\pm$ 0.15. △ Less

Submitted 14 November, 2024; originally announced November 2024.

CEAR: Automatic construction of a knowledge graph of chemical entities and roles from scientific literature

Authors: Stefan Langer, Fabian Neuhaus, Andreas Nürnberger

Abstract: Ontologies are formal representations of knowledge in specific domains that provide a structured framework for organizing and understanding complex information. Creating ontologies, however, is a complex and time-consuming endeavor. ChEBI is a well-known ontology in the field of chemistry, which provides a comprehensive resource for defining chemical entities and their properties. However, it cove… ▽ More Ontologies are formal representations of knowledge in specific domains that provide a structured framework for organizing and understanding complex information. Creating ontologies, however, is a complex and time-consuming endeavor. ChEBI is a well-known ontology in the field of chemistry, which provides a comprehensive resource for defining chemical entities and their properties. However, it covers only a small fraction of the rapidly growing knowledge in chemistry and does not provide references to the scientific literature. To address this, we propose a methodology that involves augmenting existing annotated text corpora with knowledge from Chebi and fine-tuning a large language model (LLM) to recognize chemical entities and their roles in scientific text. Our experiments demonstrate the effectiveness of our approach. By combining ontological knowledge and the language understanding capabilities of LLMs, we achieve high precision and recall rates in identifying both the chemical entities and roles in scientific literature. Furthermore, we extract them from a set of 8,000 ChemRxiv articles, and apply a second LLM to create a knowledge graph (KG) of chemical entities and roles (CEAR), which provides complementary information to ChEBI, and can help to extend it. △ Less

Submitted 31 July, 2024; originally announced July 2024.

SPOCKMIP: Segmentation of Vessels in MRAs with Enhanced Continuity using Maximum Intensity Projection as Loss

Authors: Chethan Radhakrishna, Karthikesh Varma Chintalapati, Sri Chandana Hudukula Ram Kumar, Raviteja Sutrave, Hendrik Mattern, Oliver Speck, Andreas Nürnberger, Soumick Chatterjee

Abstract: Identification of vessel structures of different sizes in biomedical images is crucial in the diagnosis of many neurodegenerative diseases. However, the sparsity of good-quality annotations of such images makes the task of vessel segmentation challenging. Deep learning offers an efficient way to segment vessels of different sizes by learning their high-level feature representations and the spatial… ▽ More Identification of vessel structures of different sizes in biomedical images is crucial in the diagnosis of many neurodegenerative diseases. However, the sparsity of good-quality annotations of such images makes the task of vessel segmentation challenging. Deep learning offers an efficient way to segment vessels of different sizes by learning their high-level feature representations and the spatial continuity of such features across dimensions. Semi-supervised patch-based approaches have been effective in identifying small vessels of one to two voxels in diameter. This study focuses on improving the segmentation quality by considering the spatial correlation of the features using the Maximum Intensity Projection~(MIP) as an additional loss criterion. Two methods are proposed with the incorporation of MIPs of label segmentation on the single~(z-axis) and multiple perceivable axes of the 3D volume. The proposed MIP-based methods produce segmentations with improved vessel continuity, which is evident in visual examinations of ROIs. Patch-based training is improved by introducing an additional loss term, MIP loss, to penalise the predicted discontinuity of vessels. A training set of 14 volumes is selected from the StudyForrest dataset comprising of 18 7-Tesla 3D Time-of-Flight~(ToF) Magnetic Resonance Angiography (MRA) images. The generalisation performance of the method is evaluated using the other unseen volumes in the dataset. It is observed that the proposed method with multi-axes MIP loss produces better quality segmentations with a median Dice of $80.245 \pm 0.129$. Also, the method with single-axis MIP loss produces segmentations with a median Dice of $79.749 \pm 0.109$. Furthermore, a visual comparison of the ROIs in the predicted segmentation reveals a significant improvement in the continuity of the vessels when MIP loss is incorporated into training. △ Less

Submitted 11 July, 2024; originally announced July 2024.

PULASki: Learning inter-rater variability using statistical distances to improve probabilistic segmentation

Authors: Soumick Chatterjee, Franziska Gaidzik, Alessandro Sciarra, Hendrik Mattern, Gábor Janiga, Oliver Speck, Andreas Nürnberger, Sahani Pathiraja

Abstract: In the domain of medical imaging, many supervised learning based methods for segmentation face several challenges such as high variability in annotations from multiple experts, paucity of labelled data and class imbalanced datasets. These issues may result in segmentations that lack the requisite precision for clinical analysis and can be misleadingly overconfident without associated uncertainty q… ▽ More In the domain of medical imaging, many supervised learning based methods for segmentation face several challenges such as high variability in annotations from multiple experts, paucity of labelled data and class imbalanced datasets. These issues may result in segmentations that lack the requisite precision for clinical analysis and can be misleadingly overconfident without associated uncertainty quantification. This work proposes the PULASki method as a computationally efficient generative tool for biomedical image segmentation that accurately captures variability in expert annotations, even in small datasets. This approach makes use of an improved loss function based on statistical distances in a conditional variational autoencoder structure (Probabilistic UNet), which improves learning of the conditional decoder compared to the standard cross-entropy particularly in class imbalanced problems. The proposed method was analysed for two structurally different segmentation tasks (intracranial vessel and multiple sclerosis (MS) lesion) and compare our results to four well-established baselines in terms of quantitative metrics and qualitative output. These experiments involve class-imbalanced datasets characterised by challenging features, including suboptimal signal-to-noise ratios and high ambiguity. Empirical results demonstrate the PULASKi method outperforms all baselines at the 5\% significance level. Our experiments are also of the first to present a comparative study of the computationally feasible segmentation of complex geometries using 3D patches and the traditional use of 2D slices. The generated segmentations are shown to be much more anatomically plausible than in the 2D case, particularly for the vessel task. △ Less

Submitted 18 March, 2025; v1 submitted 25 December, 2023; originally announced December 2023.

Journal ref: Medical Image Analysis (2025): 103623

Complex-valued neural networks to speed-up MR Thermometry during Hyperthermia using Fourier PD and PDUNet

Authors: Rupali Khatun, Soumick Chatterjee, Christoph Bert, Martin Wadepohl, Oliver J. Ott, Rainer Fietkau, Andreas Nürnberger, Udo S. Gaipl, Benjamin Frey

Abstract: Hyperthermia (HT) in combination with radio- and/or chemotherapy has become an accepted cancer treatment for distinct solid tumour entities. In HT, tumour tissue is exogenously heated to temperatures between 39 and 43 $^\circ$C for 60 minutes. Temperature monitoring can be performed non-invasively using dynamic magnetic resonance imaging (MRI). However, the slow nature of MRI leads to motion artef… ▽ More Hyperthermia (HT) in combination with radio- and/or chemotherapy has become an accepted cancer treatment for distinct solid tumour entities. In HT, tumour tissue is exogenously heated to temperatures between 39 and 43 $^\circ$C for 60 minutes. Temperature monitoring can be performed non-invasively using dynamic magnetic resonance imaging (MRI). However, the slow nature of MRI leads to motion artefacts in the images due to the movements of patients during image acquisition. By discarding parts of the data, the speed of the acquisition can be increased - known as undersampling. However, due to the invalidation of the Nyquist criterion, the acquired images might be blurry and can also produce aliasing artefacts. The aim of this work was, therefore, to reconstruct highly undersampled MR thermometry acquisitions with better resolution and with fewer artefacts compared to conventional methods. The use of deep learning in the medical field has emerged in recent times, and various studies have shown that deep learning has the potential to solve inverse problems such as MR image reconstruction. However, most of the published work only focuses on the magnitude images, while the phase images are ignored, which are fundamental requirements for MR thermometry. This work, for the first time, presents deep learning-based solutions for reconstructing undersampled MR thermometry data. Two different deep learning models have been employed here, the Fourier Primal-Dual network and the Fourier Primal-Dual UNet, to reconstruct highly undersampled complex images of MR thermometry. The method reduced the temperature difference between the undersampled MRIs and the fully sampled MRIs from 1.3 $^\circ$C to 0.6 $^\circ$C in full volume and 0.49 $^\circ$C to 0.06 $^\circ$C in the tumour region for an acceleration factor of 10. △ Less

Submitted 22 July, 2024; v1 submitted 2 October, 2023; originally announced October 2023.

MedShapeNet -- A Large-Scale Dataset of 3D Medical Shapes for Computer Vision

Authors: Jianning Li, Zongwei Zhou, Jiancheng Yang, Antonio Pepe, Christina Gsaxner, Gijs Luijten, Chongyu Qu, Tiezheng Zhang, Xiaoxi Chen, Wenxuan Li, Marek Wodzinski, Paul Friedrich, Kangxian Xie, Yuan Jin, Narmada Ambigapathy, Enrico Nasca, Naida Solak, Gian Marco Melito, Viet Duc Vu, Afaque R. Memon, Christopher Schlachta, Sandrine De Ribaupierre, Rajnikant Patel, Roy Eagleson, Xiaojun Chen , et al. (132 additional authors not shown)

Abstract: Prior to the deep learning era, shape was commonly used to describe the objects. Nowadays, state-of-the-art (SOTA) algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from numerous shape-related publications in premier vision conferences as well as the growing popularity of Shape… ▽ More Prior to the deep learning era, shape was commonly used to describe the objects. Nowadays, state-of-the-art (SOTA) algorithms in medical imaging are predominantly diverging from computer vision, where voxel grids, meshes, point clouds, and implicit surface models are used. This is seen from numerous shape-related publications in premier vision conferences as well as the growing popularity of ShapeNet (about 51,300 models) and Princeton ModelNet (127,915 models). For the medical domain, we present a large collection of anatomical shapes (e.g., bones, organs, vessels) and 3D models of surgical instrument, called MedShapeNet, created to facilitate the translation of data-driven vision algorithms to medical applications and to adapt SOTA vision algorithms to medical problems. As a unique feature, we directly model the majority of shapes on the imaging data of real patients. As of today, MedShapeNet includes 23 dataset with more than 100,000 shapes that are paired with annotations (ground truth). Our data is freely accessible via a web interface and a Python application programming interface (API) and can be used for discriminative, reconstructive, and variational benchmarks as well as various applications in virtual, augmented, or mixed reality, and 3D printing. Exemplary, we present use cases in the fields of classification of brain tumors, facial and skull reconstructions, multi-class anatomy completion, education, and 3D printing. In future, we will extend the data and improve the interfaces. The project pages are: https://medshapenet.ikim.nrw/ and https://github.com/Jianningli/medshapenet-feedback △ Less

Submitted 12 December, 2023; v1 submitted 30 August, 2023; originally announced August 2023.

Comments: 16 pages

MSC Class: 68T01

Liver Segmentation in Time-resolved C-arm CT Volumes Reconstructed from Dynamic Perfusion Scans using Time Separation Technique

Authors: Soumick Chatterjee, Hana Haseljić, Robert Frysch, Vojtěch Kulvait, Vladimir Semshchikov, Bennet Hensen, Frank Wacker, Inga Brüschx, Thomas Werncke, Oliver Speck, Andreas Nürnberger, Georg Rose

Abstract: Perfusion imaging is a valuable tool for diagnosing and treatment planning for liver tumours. The time separation technique (TST) has been successfully used for modelling C-arm cone-beam computed tomography (CBCT) perfusion data. The reconstruction can be accompanied by the segmentation of the liver - for better visualisation and for generating comprehensive perfusion maps. Recently introduced Tur… ▽ More Perfusion imaging is a valuable tool for diagnosing and treatment planning for liver tumours. The time separation technique (TST) has been successfully used for modelling C-arm cone-beam computed tomography (CBCT) perfusion data. The reconstruction can be accompanied by the segmentation of the liver - for better visualisation and for generating comprehensive perfusion maps. Recently introduced Turbolift learning has been seen to perform well while working with TST reconstructions, but has not been explored for the time-resolved volumes (TRV) estimated out of TST reconstructions. The segmentation of the TRVs can be useful for tracking the movement of the liver over time. This research explores this possibility by training the multi-scale attention UNet of Turbolift learning at its third stage on the TRVs and shows the robustness of Turbolift learning since it can even work efficiently with the TRVs, resulting in a Dice score of 0.864$\pm$0.004. △ Less

Submitted 9 February, 2023; originally announced February 2023.

Journal ref: 2022 IEEE 5th International Conference on Image Processing Applications and Systems (IPAS)

Complex Network for Complex Problems: A comparative study of CNN and Complex-valued CNN

Authors: Soumick Chatterjee, Pavan Tummala, Oliver Speck, Andreas Nürnberger

Abstract: Neural networks, especially convolutional neural networks (CNN), are one of the most common tools these days used in computer vision. Most of these networks work with real-valued data using real-valued features. Complex-valued convolutional neural networks (CV-CNN) can preserve the algebraic structure of complex-valued input data and have the potential to learn more complex relationships between t… ▽ More Neural networks, especially convolutional neural networks (CNN), are one of the most common tools these days used in computer vision. Most of these networks work with real-valued data using real-valued features. Complex-valued convolutional neural networks (CV-CNN) can preserve the algebraic structure of complex-valued input data and have the potential to learn more complex relationships between the input and the ground-truth. Although some comparisons of CNNs and CV-CNNs for different tasks have been performed in the past, a large-scale investigation comparing different models operating on different tasks has not been conducted. Furthermore, because complex features contain both real and imaginary components, CV-CNNs have double the number of trainable parameters as real-valued CNNs in terms of the actual number of trainable parameters. Whether or not the improvements in performance with CV-CNN observed in the past have been because of the complex features or just because of having double the number of trainable parameters has not yet been explored. This paper presents a comparative study of CNN, CNNx2 (CNN with double the number of trainable parameters as the CNN), and CV-CNN. The experiments were performed using seven models for two different tasks - brain tumour classification and segmentation in brain MRIs. The results have revealed that the CV-CNN models outperformed the CNN and CNNx2 models. △ Less

Submitted 9 February, 2023; originally announced February 2023.

Journal ref: 2022 IEEE 5th International Conference on Image Processing Applications and Systems (IPAS)

Liver Segmentation using Turbolift Learning for CT and Cone-beam C-arm Perfusion Imaging

Authors: Hana Haseljić, Soumick Chatterjee, Robert Frysch, Vojtěch Kulvait, Vladimir Semshchikov, Bennet Hensen, Frank Wacker, Inga Brüsch, Thomas Werncke, Oliver Speck, Andreas Nürnberger, Georg Rose

Abstract: Model-based reconstruction employing the time separation technique (TST) was found to improve dynamic perfusion imaging of the liver using C-arm cone-beam computed tomography (CBCT). To apply TST using prior knowledge extracted from CT perfusion data, the liver should be accurately segmented from the CT scans. Reconstructions of primary and model-based CBCT data need to be segmented for proper vis… ▽ More Model-based reconstruction employing the time separation technique (TST) was found to improve dynamic perfusion imaging of the liver using C-arm cone-beam computed tomography (CBCT). To apply TST using prior knowledge extracted from CT perfusion data, the liver should be accurately segmented from the CT scans. Reconstructions of primary and model-based CBCT data need to be segmented for proper visualisation and interpretation of perfusion maps. This research proposes Turbolift learning, which trains a modified version of the multi-scale Attention UNet on different liver segmentation tasks serially, following the order of the trainings CT, CBCT, CBCT TST - making the previous trainings act as pre-training stages for the subsequent ones - addressing the problem of limited number of datasets for training. For the final task of liver segmentation from CBCT TST, the proposed method achieved an overall Dice scores of 0.874$\pm$0.031 and 0.905$\pm$0.007 in 6-fold and 4-fold cross-validation experiments, respectively - securing statistically significant improvements over the model, which was trained only for that task. Experiments revealed that Turbolift not only improves the overall performance of the model but also makes it robust against artefacts originating from the embolisation materials and truncation artefacts. Additionally, in-depth analyses confirmed the order of the segmentation tasks. This paper shows the potential of segmenting the liver from CT, CBCT, and CBCT TST, learning from the available limited training data, which can possibly be used in the future for the visualisation and evaluation of the perfusion maps for the treatment evaluation of liver diseases. △ Less

Submitted 9 February, 2023; v1 submitted 20 July, 2022; originally announced July 2022.

Journal ref: Computers in Biology and Medicine (2023) 106539

Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images

Authors: Alessandro Sciarra, Soumick Chatterjee, Max Dünnwald, Giuseppe Placidi, Andreas Nürnberger, Oliver Speck, Steffen Oeltze-Jafra

Abstract: Motion artefacts in magnetic resonance brain images can have a strong impact on diagnostic confidence. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. Motion artefacts can alter the delineation of structures such as the brain, lesions or tumours and may require a repeat scan. Otherwise, an inaccurate (e.g. correct pathology but wrong severity) or in… ▽ More Motion artefacts in magnetic resonance brain images can have a strong impact on diagnostic confidence. The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis. Motion artefacts can alter the delineation of structures such as the brain, lesions or tumours and may require a repeat scan. Otherwise, an inaccurate (e.g. correct pathology but wrong severity) or incorrect diagnosis (e.g. wrong pathology) may occur. "\textit{Image quality assessment}" as a fast, automated step right after scanning can assist in deciding if the acquired images are diagnostically sufficient. An automated image quality assessment based on the structural similarity index (SSIM) regression through a residual neural network is proposed in this work. Additionally, a classification into different groups - by subdividing with SSIM ranges - is evaluated. Importantly, this method predicts SSIM values of an input image in the absence of a reference ground truth image. The networks were able to detect motion artefacts, and the best performance for the regression and classification task has always been achieved with ResNet-18 with contrast augmentation. The mean and standard deviation of residuals' distribution were $μ=-0.0009$ and $σ=0.0139$, respectively. Whilst for the classification task in 3, 5 and 10 classes, the best accuracies were 97, 95 and 89\%, respectively. The results show that the proposed method could be a tool for supporting neuro-radiologists and radiographers in evaluating image quality quickly. △ Less

Submitted 1 March, 2023; v1 submitted 14 June, 2022; originally announced June 2022.

Weakly-supervised segmentation using inherently-explainable classification models and their application to brain tumour classification

Authors: Soumick Chatterjee, Hadya Yassin, Florian Dubost, Andreas Nürnberger, Oliver Speck

Abstract: Deep learning models have shown their potential for several applications. However, most of the models are opaque and difficult to trust due to their complex reasoning - commonly known as the black-box problem. Some fields, such as medicine, require a high degree of transparency to accept and adopt such technologies. Consequently, creating explainable/interpretable models or applying post-hoc metho… ▽ More Deep learning models have shown their potential for several applications. However, most of the models are opaque and difficult to trust due to their complex reasoning - commonly known as the black-box problem. Some fields, such as medicine, require a high degree of transparency to accept and adopt such technologies. Consequently, creating explainable/interpretable models or applying post-hoc methods on classifiers to build trust in deep learning models are required. Moreover, deep learning methods can be used for segmentation tasks, which typically require hard-to-obtain, time-consuming manually-annotated segmentation labels for training. This paper introduces three inherently-explainable classifiers to tackle both of these problems as one. The localisation heatmaps provided by the networks -- representing the models' focus areas and being used in classification decision-making -- can be directly interpreted, without requiring any post-hoc methods to derive information for model explanation. The models are trained by using the input image and only the classification labels as ground-truth in a supervised fashion - without using any information about the location of the region of interest (i.e. the segmentation labels), making the segmentation training of the models weakly-supervised through classification labels. The final segmentation is obtained by thresholding these heatmaps. The models were employed for the task of multi-class brain tumour classification using two different datasets, resulting in the best F1-score of 0.93 for the supervised classification task while securing a median Dice score of 0.67$\pm$0.08 for the weakly-supervised segmentation task. Furthermore, the obtained accuracy on a subset of tumour-only images outperformed the state-of-the-art glioma tumour grading binary classifiers with the best model achieving 98.7\% accuracy. △ Less

Submitted 26 December, 2023; v1 submitted 10 June, 2022; originally announced June 2022.

Dual Branch Prior-SegNet: CNN for Interventional CBCT using Planning Scan and Auxiliary Segmentation Loss

Authors: Philipp Ernst, Suhita Ghosh, Georg Rose, Andreas Nürnberger

Abstract: This paper proposes an extension to the Dual Branch Prior-Net for sparse view interventional CBCT reconstruction incorporating a high quality planning scan. An additional head learns to segment interventional instruments and thus guides the reconstruction task. The prior scans are misaligned by up to +-5deg in-plane during training. Experiments show that the proposed model, Dual Branch Prior-SegNe… ▽ More This paper proposes an extension to the Dual Branch Prior-Net for sparse view interventional CBCT reconstruction incorporating a high quality planning scan. An additional head learns to segment interventional instruments and thus guides the reconstruction task. The prior scans are misaligned by up to +-5deg in-plane during training. Experiments show that the proposed model, Dual Branch Prior-SegNet, significantly outperforms any other evaluated model by >2.8dB PSNR. It also stays robust wrt. rotations of up to +-5.5deg. △ Less

Submitted 11 May, 2022; originally announced May 2022.

Comments: 3 pages, 1 figure, accepted short paper submission at MIDL 2022

Primal-Dual UNet for Sparse View Cone Beam Computed Tomography Volume Reconstruction

Authors: Philipp Ernst, Soumick Chatterjee, Georg Rose, Andreas Nürnberger

Abstract: In this paper, the Primal-Dual UNet for sparse view CT reconstruction is modified to be applicable to cone beam projections and perform reconstructions of entire volumes instead of slices. Experiments show that the PSNR of the proposed method is increased by 10dB compared to the direct FDK reconstruction and almost 3dB compared to the modified original Primal-Dual Network when using only 23 projec… ▽ More In this paper, the Primal-Dual UNet for sparse view CT reconstruction is modified to be applicable to cone beam projections and perform reconstructions of entire volumes instead of slices. Experiments show that the PSNR of the proposed method is increased by 10dB compared to the direct FDK reconstruction and almost 3dB compared to the modified original Primal-Dual Network when using only 23 projections. The presented network is not optimized wrt. memory consumption or hyperparameters but merely serves as a proof of concept and is limited to low resolution projections and volumes. △ Less

Submitted 11 May, 2022; originally announced May 2022.

Comments: 3 pages, 1 figure, accepted short paper submission at MIDL 2022

DDoS-UNet: Incorporating temporal information using Dynamic Dual-channel UNet for enhancing super-resolution of dynamic MRI

Authors: Soumick Chatterjee, Chompunuch Sarasaen, Georg Rose, Andreas Nürnberger, Oliver Speck

Abstract: Magnetic resonance imaging (MRI) provides high spatial resolution and excellent soft-tissue contrast without using harmful ionising radiation. Dynamic MRI is an essential tool for interventions to visualise movements or changes of the target organ. However, such MRI acquisition with high temporal resolution suffers from limited spatial resolution - also known as the spatio-temporal trade-off of dy… ▽ More Magnetic resonance imaging (MRI) provides high spatial resolution and excellent soft-tissue contrast without using harmful ionising radiation. Dynamic MRI is an essential tool for interventions to visualise movements or changes of the target organ. However, such MRI acquisition with high temporal resolution suffers from limited spatial resolution - also known as the spatio-temporal trade-off of dynamic MRI. Several approaches, including deep learning based super-resolution approaches, have been proposed to mitigate this trade-off. Nevertheless, such an approach typically aims to super-resolve each time-point separately, treating them as individual volumes. This research addresses the problem by creating a deep learning model which attempts to learn both spatial and temporal relationships. A modified 3D UNet model, DDoS-UNet, is proposed - which takes the low-resolution volume of the current time-point along with a prior image volume. Initially, the network is supplied with a static high-resolution planning scan as the prior image along with the low-resolution input to super-resolve the first time-point. Then it continues step-wise by using the super-resolved time-points as the prior image while super-resolving the subsequent time-points. The model performance was tested with 3D dynamic data that was undersampled to different in-plane levels. The proposed network achieved an average SSIM value of 0.951$\pm$0.017 while reconstructing the lowest resolution data (i.e. only 4\% of the k-space acquired) - which could result in a theoretical acceleration factor of 25. The proposed approach can be used to reduce the required scan-time while achieving high spatial resolution. △ Less

Submitted 10 February, 2022; originally announced February 2022.

StRegA: Unsupervised Anomaly Detection in Brain MRIs using a Compact Context-encoding Variational Autoencoder

Authors: Soumick Chatterjee, Alessandro Sciarra, Max Dünnwald, Pavan Tummala, Shubham Kumar Agrawal, Aishwarya Jauhari, Aman Kalra, Steffen Oeltze-Jafra, Oliver Speck, Andreas Nürnberger

Abstract: Expert interpretation of anatomical images of the human brain is the central part of neuro-radiology. Several machine learning-based techniques have been proposed to assist in the analysis process. However, the ML models typically need to be trained to perform a specific task, e.g., brain tumour segmentation or classification. Not only do the corresponding training data require laborious manual an… ▽ More Expert interpretation of anatomical images of the human brain is the central part of neuro-radiology. Several machine learning-based techniques have been proposed to assist in the analysis process. However, the ML models typically need to be trained to perform a specific task, e.g., brain tumour segmentation or classification. Not only do the corresponding training data require laborious manual annotations, but a wide variety of abnormalities can be present in a human brain MRI - even more than one simultaneously, which renders representation of all possible anomalies very challenging. Hence, a possible solution is an unsupervised anomaly detection (UAD) system that can learn a data distribution from an unlabelled dataset of healthy subjects and then be applied to detect out of distribution samples. Such a technique can then be used to detect anomalies - lesions or abnormalities, for example, brain tumours, without explicitly training the model for that specific pathology. Several Variational Autoencoder (VAE) based techniques have been proposed in the past for this task. Even though they perform very well on controlled artificially simulated anomalies, many of them perform poorly while detecting anomalies in clinical data. This research proposes a compact version of the "context-encoding" VAE (ceVAE) model, combined with pre and post-processing steps, creating a UAD pipeline (StRegA), which is more robust on clinical data, and shows its applicability in detecting anomalies such as tumours in brain MRIs. The proposed pipeline achieved a Dice score of 0.642$\pm$0.101 while detecting tumours in T2w images of the BraTS dataset and 0.859$\pm$0.112 while detecting artificially induced anomalies, while the best performing baseline achieved 0.522$\pm$0.135 and 0.783$\pm$0.111, respectively. △ Less

Submitted 4 September, 2022; v1 submitted 31 January, 2022; originally announced January 2022.

Journal ref: Computers in Biology and Medicine, 106093 (2022)

Sinogram upsampling using Primal-Dual UNet for undersampled CT and radial MRI reconstruction

Authors: Philipp Ernst, Soumick Chatterjee, Georg Rose, Oliver Speck, Andreas Nürnberger

Abstract: Computed tomography and magnetic resonance imaging are two widely used clinical imaging modalities for non-invasive diagnosis. However, both of these modalities come with certain problems. CT uses harmful ionising radiation, and MRI suffers from slow acquisition speed. Both problems can be tackled by undersampling, such as sparse sampling. However, such undersampled data leads to lower resolution… ▽ More Computed tomography and magnetic resonance imaging are two widely used clinical imaging modalities for non-invasive diagnosis. However, both of these modalities come with certain problems. CT uses harmful ionising radiation, and MRI suffers from slow acquisition speed. Both problems can be tackled by undersampling, such as sparse sampling. However, such undersampled data leads to lower resolution and introduces artefacts. Several techniques, including deep learning based methods, have been proposed to reconstruct such data. However, the undersampled reconstruction problem for these two modalities was always considered as two different problems and tackled separately by different research works. This paper proposes a unified solution for both sparse CT and undersampled radial MRI reconstruction, achieved by applying Fourier transform-based pre-processing on the radial MRI and then finally reconstructing both modalities using sinogram upsampling combined with filtered back-projection. The Primal-Dual network is a deep learning based method for reconstructing sparsely-sampled CT data. This paper introduces Primal-Dual UNet, which improves the Primal-Dual network in terms of accuracy and reconstruction speed. The proposed method resulted in an average SSIM of 0.932\textpm0.021 while performing sparse CT reconstruction for fan-beam geometry with a sparsity level of 16, achieving a statistically significant improvement over the previous model, which resulted in 0.919\textpm0.016. Furthermore, the proposed model resulted in 0.903\textpm0.019 and 0.957\textpm0.023 average SSIM while reconstructing undersampled brain and abdominal MRI data with an acceleration factor of 16, respectively - statistically significant improvements over the original model, which resulted in 0.867\textpm0.025 and 0.949\textpm0.025. △ Less

Submitted 1 March, 2023; v1 submitted 26 December, 2021; originally announced December 2021.

Dual Skip Connections Minimize the False Positive Rate of Lung Nodule Detection in CT images

Authors: Jiahua Xu, Philipp Ernst, Tung Lung Liu, Andreas Nürnberger

Abstract: Pulmonary cancer is one of the most commonly diagnosed and fatal cancers and is often diagnosed by incidental findings on computed tomography. Automated pulmonary nodule detection is an essential part of computer-aided diagnosis, which is still facing great challenges and difficulties to quickly and accurately locate the exact nodules' positions. This paper proposes a dual skip connection upsampli… ▽ More Pulmonary cancer is one of the most commonly diagnosed and fatal cancers and is often diagnosed by incidental findings on computed tomography. Automated pulmonary nodule detection is an essential part of computer-aided diagnosis, which is still facing great challenges and difficulties to quickly and accurately locate the exact nodules' positions. This paper proposes a dual skip connection upsampling strategy based on Dual Path network in a U-Net structure generating multiscale feature maps, which aims to minimize the ratio of false positives and maximize the sensitivity for lesion detection of nodules. The results show that our new upsampling strategy improves the performance by having 85.3% sensitivity at 4 FROC per image compared to 84.2% for the regular upsampling strategy or 81.2% for VGG16-based Faster-R-CNN. △ Less

Submitted 25 October, 2021; originally announced October 2021.

Comments: to be published at IEEE EMBC 2021, in IEEE Xplore

TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Models

Authors: Soumick Chatterjee, Arnab Das, Chirag Mandal, Budhaditya Mukhopadhyay, Manish Vipinraj, Aniruddh Shukla, Rajatha Nagaraja Rao, Chompunuch Sarasaen, Oliver Speck, Andreas Nürnberger

Abstract: Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of missing insights of the automatically derived decisions. In order to increase trust in these methods, this paper presents approaches that help to interpret and… ▽ More Clinicians are often very sceptical about applying automatic image processing approaches, especially deep learning based methods, in practice. One main reason for this is the black-box nature of these approaches and the inherent problem of missing insights of the automatically derived decisions. In order to increase trust in these methods, this paper presents approaches that help to interpret and explain the results of deep learning algorithms by depicting the anatomical areas which influence the decision of the algorithm most. Moreover, this research presents a unified framework, TorchEsegeta, for applying various interpretability and explainability techniques for deep learning models and generate visual interpretations and explanations for clinicians to corroborate their clinical findings. In addition, this will aid in gaining confidence in such methods. The framework builds on existing interpretability and explainability techniques that are currently focusing on classification models, extending them to segmentation tasks. In addition, these methods have been adapted to 3D models for volumetric analysis. The proposed framework provides methods to quantitatively compare visual explanations using infidelity and sensitivity metrics. This framework can be used by data scientists to perform post-hoc interpretations and explanations of their models, develop more explainable tools and present the findings to clinicians to increase their faith in such models. The proposed framework was evaluated based on a use case scenario of vessel segmentation models trained on Time-of-fight (TOF) Magnetic Resonance Angiogram (MRA) images of the human brain. Quantitative and qualitative results of a comparative study of different models and interpretability methods are presented. Furthermore, this paper provides an extensive overview of several existing interpretability and explainability methods. △ Less

Submitted 7 February, 2022; v1 submitted 15 October, 2021; originally announced October 2021.

Manually Annotated Spelling Error Corpus for Amharic

Authors: Andargachew Mekonnen Gezmu, Tirufat Tesifaye Lema, Binyam Ephrem Seyoum, Andreas Nürnberger

Abstract: This paper presents a manually annotated spelling error corpus for Amharic, lingua franca in Ethiopia. The corpus is designed to be used for the evaluation of spelling error detection and correction. The misspellings are tagged as non-word and real-word errors. In addition, the contextual information available in the corpus makes it useful in dealing with both types of spelling errors. This paper presents a manually annotated spelling error corpus for Amharic, lingua franca in Ethiopia. The corpus is designed to be used for the evaluation of spelling error detection and correction. The misspellings are tagged as non-word and real-word errors. In addition, the contextual information available in the corpus makes it useful in dealing with both types of spelling errors. △ Less

Submitted 25 June, 2021; originally announced June 2021.

Comments: Accepted to 2nd AfricaNLP Workshop at EACL 2021

Contemporary Amharic Corpus: Automatically Morpho-Syntactically Tagged Amharic Corpus

Authors: Andargachew Mekonnen Gezmu, Binyam Ephrem Seyoum, Michael Gasser, Andreas Nürnberger

Abstract: We introduced the contemporary Amharic corpus, which is automatically tagged for morpho-syntactic information. Texts are collected from 25,199 documents from different domains and about 24 million orthographic words are tokenized. Since it is partly a web corpus, we made some automatic spelling error correction. We have also modified the existing morphological analyzer, HornMorpho, to use it for t… ▽ More We introduced the contemporary Amharic corpus, which is automatically tagged for morpho-syntactic information. Texts are collected from 25,199 documents from different domains and about 24 million orthographic words are tokenized. Since it is partly a web corpus, we made some automatic spelling error correction. We have also modified the existing morphological analyzer, HornMorpho, to use it for the automatic tagging. △ Less

Submitted 14 June, 2021; originally announced June 2021.

Comments: Published in Proceedings of the First Workshop on Linguistic Resources for Natural Language Processing at COLING 2018

Journal ref: Proceedings of the First Workshop on Linguistic Resources for Natural Language Processing, pp. 65-70. 2018

Classification of Brain Tumours in MR Images using Deep Spatiospatial Models

Authors: Soumick Chatterjee, Faraz Ahmed Nizamani, Andreas Nürnberger, Oliver Speck

Abstract: A brain tumour is a mass or cluster of abnormal cells in the brain, which has the possibility of becoming life-threatening because of its ability to invade neighbouring tissues and also form metastases. An accurate diagnosis is essential for successful treatment planning and magnetic resonance imaging is the principal imaging modality for diagnostic of brain tumours and their extent. Deep Learning… ▽ More A brain tumour is a mass or cluster of abnormal cells in the brain, which has the possibility of becoming life-threatening because of its ability to invade neighbouring tissues and also form metastases. An accurate diagnosis is essential for successful treatment planning and magnetic resonance imaging is the principal imaging modality for diagnostic of brain tumours and their extent. Deep Learning methods in computer vision applications have shown significant improvement in recent years, most of which can be credited to the fact that a sizeable amount of data is available to train models on, and the improvements in the model architectures yielding better approximations in a supervised setting. Classifying tumours using such deep learning methods has made significant progress with the availability of open datasets with reliable annotations. Typically those methods are either 3D models, which use 3D volumetric MRIs or even 2D models considering each slice separately. However, by treating the slice spatial dimension separately, spatiotemporal models can be employed as spatiospatial models for this task. These models have the capabilities of learning specific spatial and temporal relationship, while reducing computational costs. This paper uses two spatiotemporal models, ResNet (2+1)D and ResNet Mixed Convolution, to classify different types of brain tumours. It was observed that both these models performed superior to the pure 3D convolutional model, ResNet18. Furthermore, it was also observed that pre-training the models on a different, even unrelated dataset before training them for the task of tumour classification improves the performance. Finally, Pre-trained ResNet Mixed Convolution was observed to be the best model in these experiments, achieving a macro F1-score of 0.93 and a test accuracy of 96.98\%, while at the same time being the model with the least computational cost. △ Less

Submitted 14 January, 2022; v1 submitted 28 May, 2021; originally announced May 2021.

Journal ref: Sci Rep 12, 1505 (2022)

Extended Parallel Corpus for Amharic-English Machine Translation

Authors: Andargachew Mekonnen Gezmu, Andreas Nürnberger, Tesfaye Bayu Bati

Abstract: This paper describes the acquisition, preprocessing, segmentation, and alignment of an Amharic-English parallel corpus. It will be helpful for machine translation of a low-resource language, Amharic. We freely released the corpus for research purposes. Furthermore, we developed baseline statistical and neural machine translation systems; we trained statistical and neural machine translation models… ▽ More This paper describes the acquisition, preprocessing, segmentation, and alignment of an Amharic-English parallel corpus. It will be helpful for machine translation of a low-resource language, Amharic. We freely released the corpus for research purposes. Furthermore, we developed baseline statistical and neural machine translation systems; we trained statistical and neural machine translation models using the corpus. In the experiments, we also used a large monolingual corpus for the language model of statistical machine translation and back-translation of neural machine translation. In the automatic evaluation, neural machine translation models outperform statistical machine translation models by approximately six to seven Bilingual Evaluation Understudy (BLEU) points. Besides, among the neural machine translation models, the subword models outperform the word-based models by three to four BLEU points. Moreover, two other relevant automatic evaluation metrics, Translation Edit Rate on Character Level and Better Evaluation as Ranking, reflect corresponding differences among the trained models. △ Less

Submitted 3 May, 2022; v1 submitted 8 April, 2021; originally announced April 2021.

Comments: Accepted to LREC 2022

ReconResNet: Regularised Residual Learning for MR Image Reconstruction of Undersampled Cartesian and Radial Data

Authors: Soumick Chatterjee, Mario Breitkopf, Chompunuch Sarasaen, Hadya Yassin, Georg Rose, Andreas Nürnberger, Oliver Speck

Abstract: MRI is an inherently slow process, which leads to long scan time for high-resolution imaging. The speed of acquisition can be increased by ignoring parts of the data (undersampling). Consequently, this leads to the degradation of image quality, such as loss of resolution or introduction of image artefacts. This work aims to reconstruct highly undersampled Cartesian or radial MR acquisitions, with… ▽ More MRI is an inherently slow process, which leads to long scan time for high-resolution imaging. The speed of acquisition can be increased by ignoring parts of the data (undersampling). Consequently, this leads to the degradation of image quality, such as loss of resolution or introduction of image artefacts. This work aims to reconstruct highly undersampled Cartesian or radial MR acquisitions, with better resolution and with less to no artefact compared to conventional techniques like compressed sensing. In recent times, deep learning has emerged as a very important area of research and has shown immense potential in solving inverse problems, e.g. MR image reconstruction. In this paper, a deep learning based MR image reconstruction framework is proposed, which includes a modified regularised version of ResNet as the network backbone to remove artefacts from the undersampled image, followed by data consistency steps that fusions the network output with the data already available from undersampled k-space in order to further improve reconstruction quality. The performance of this framework for various undersampling patterns has also been tested, and it has been observed that the framework is robust to deal with various sampling patterns, even when mixed together while training, and results in very high quality reconstruction, in terms of high SSIM (highest being 0.990$\pm$0.006 for acceleration factor of 3.5), while being compared with the fully sampled reconstruction. It has been shown that the proposed framework can successfully reconstruct even for an acceleration factor of 20 for Cartesian (0.968$\pm$0.005) and 17 for radially (0.962$\pm$0.012) sampled data. Furthermore, it has been shown that the framework preserves brain pathology during reconstruction while being trained on healthy subjects. △ Less

Submitted 19 February, 2022; v1 submitted 16 March, 2021; originally announced March 2021.

Journal ref: Computers in Biology and Medicine (2022) 105321

ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep learning

Authors: Soumick Chatterjee, Alessandro Sciarra, Max Dünnwald, Raghava Vinaykanth Mushunuri, Ranadheer Podishetti, Rajatha Nagaraja Rao, Geetha Doddapaneni Gopinath, Steffen Oeltze-Jafra, Oliver Speck, Andreas Nürnberger

Abstract: Diffusion-weighted magnetic resonance imaging (DW-MRI) can be used to characterise the microstructure of the nervous tissue, e.g. to delineate brain white matter connections in a non-invasive manner via fibre tracking. Magnetic Resonance Imaging (MRI) in high spatial resolution would play an important role in visualising such fibre tracts in a superior manner. However, obtaining an image of such r… ▽ More Diffusion-weighted magnetic resonance imaging (DW-MRI) can be used to characterise the microstructure of the nervous tissue, e.g. to delineate brain white matter connections in a non-invasive manner via fibre tracking. Magnetic Resonance Imaging (MRI) in high spatial resolution would play an important role in visualising such fibre tracts in a superior manner. However, obtaining an image of such resolution comes at the expense of longer scan time. Longer scan time can be associated with the increase of motion artefacts, due to the patient's psychological and physical conditions. Single Image Super-Resolution (SISR), a technique aimed to obtain high-resolution (HR) details from one single low-resolution (LR) input image, achieved with Deep Learning, is the focus of this study. Compared to interpolation techniques or sparse-coding algorithms, deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts. In this research, a deep learning based super-resolution technique is proposed and has been applied for DW-MRI. Images from the IXI dataset have been used as the ground-truth and were artificially downsampled to simulate the low-resolution images. The proposed method has shown statistically significant improvement over the baselines and achieved an SSIM of $0.913\pm0.045$. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Fine-tuning deep learning model parameters for improved super-resolution of dynamic MRI with prior-knowledge

Authors: Chompunuch Sarasaen, Soumick Chatterjee, Mario Breitkopf, Georg Rose, Andreas Nürnberger, Oliver Speck

Abstract: Dynamic imaging is a beneficial tool for interventions to assess physiological changes. Nonetheless during dynamic MRI, while achieving a high temporal resolution, the spatial resolution is compromised. To overcome this spatio-temporal trade-off, this research presents a super-resolution (SR) MRI reconstruction with prior knowledge based fine-tuning to maximise spatial information while reducing t… ▽ More Dynamic imaging is a beneficial tool for interventions to assess physiological changes. Nonetheless during dynamic MRI, while achieving a high temporal resolution, the spatial resolution is compromised. To overcome this spatio-temporal trade-off, this research presents a super-resolution (SR) MRI reconstruction with prior knowledge based fine-tuning to maximise spatial information while reducing the required scan-time for dynamic MRIs. An U-Net based network with perceptual loss is trained on a benchmark dataset and fine-tuned using one subject-specific static high resolution MRI as prior knowledge to obtain high resolution dynamic images during the inference stage. 3D dynamic data for three subjects were acquired with different parameters to test the generalisation capabilities of the network. The method was tested for different levels of in-plane undersampling for dynamic MRI. The reconstructed dynamic SR results after fine-tuning showed higher similarity with the high resolution ground-truth, while quantitatively achieving statistically significant improvement. The average SSIM of the lowest resolution experimented during this research (6.25~\% of the k-space) before and after fine-tuning were 0.939 $\pm$ 0.008 and 0.957 $\pm$ 0.006 respectively. This could theoretically result in an acceleration factor of 16, which can potentially be acquired in less than half a second. The proposed approach shows that the super-resolution MRI reconstruction with prior-information can alleviate the spatio-temporal trade-off in dynamic MRI, even for high acceleration factors. △ Less

Submitted 23 October, 2021; v1 submitted 4 February, 2021; originally announced February 2021.

Journal ref: Artificial Intelligence in Medicine (2021) 102196

Retrospective Motion Correction of MR Images using Prior-Assisted Deep Learning

Authors: Soumick Chatterjee, Alessandro Sciarra, Max Dünnwald, Steffen Oeltze-Jafra, Andreas Nürnberger, Oliver Speck

Abstract: In MRI, motion artefacts are among the most common types of artefacts. They can degrade images and render them unusable for accurate diagnosis. Traditional methods, such as prospective or retrospective motion correction, have been proposed to avoid or alleviate motion artefacts. Recently, several other methods based on deep learning approaches have been proposed to solve this problem. This work pr… ▽ More In MRI, motion artefacts are among the most common types of artefacts. They can degrade images and render them unusable for accurate diagnosis. Traditional methods, such as prospective or retrospective motion correction, have been proposed to avoid or alleviate motion artefacts. Recently, several other methods based on deep learning approaches have been proposed to solve this problem. This work proposes to enhance the performance of existing deep learning models by the inclusion of additional information present as image priors. The proposed approach has shown promising results and will be further investigated for clinical validity. △ Less

Submitted 28 November, 2020; originally announced November 2020.

Journal ref: Medical Imaging Meets NeurIPS 2020

Upgraded W-Net with Attention Gates and its Application in Unsupervised 3D Liver Segmentation

Authors: Dhanunjaya Mitta, Soumick Chatterjee, Oliver Speck, Andreas Nürnberger

Abstract: Segmentation of biomedical images can assist radiologists to make a better diagnosis and take decisions faster by helping in the detection of abnormalities, such as tumors. Manual or semi-automated segmentation, however, can be a time-consuming task. Most deep learning based automated segmentation methods are supervised and rely on manually segmented ground-truth. A possible solution for the probl… ▽ More Segmentation of biomedical images can assist radiologists to make a better diagnosis and take decisions faster by helping in the detection of abnormalities, such as tumors. Manual or semi-automated segmentation, however, can be a time-consuming task. Most deep learning based automated segmentation methods are supervised and rely on manually segmented ground-truth. A possible solution for the problem would be an unsupervised deep learning based approach for automated segmentation, which this research work tries to address. We use a W-Net architecture and modified it, such that it can be applied to 3D volumes. In addition, to suppress noise in the segmentation we added attention gates to the skip connections. The loss for the segmentation output was calculated using soft N-Cuts and for the reconstruction output using SSIM. Conditional Random Fields were used as a post-processing step to fine-tune the results. The proposed method has shown promising results, with a dice coefficient of 0.88 for the liver segmentation compared against manual segmentation. △ Less

Submitted 20 November, 2020; originally announced November 2020.

Report number: ICPRAM, ISBN 978-989-758-486-2, pages 488-494

Journal ref: Proceedings of the 10th International Conference on Pattern Recognition Applications and Methods 2021 - Volume 1

DS6, Deformation-aware Semi-supervised Learning: Application to Small Vessel Segmentation with Noisy Training Data

Authors: Soumick Chatterjee, Kartik Prabhu, Mahantesh Pattadkal, Gerda Bortsova, Chompunuch Sarasaen, Florian Dubost, Hendrik Mattern, Marleen de Bruijne, Oliver Speck, Andreas Nürnberger

Abstract: Blood vessels of the brain provide the human brain with the required nutrients and oxygen. As a vulnerable part of the cerebral blood supply, pathology of small vessels can cause serious problems such as Cerebral Small Vessel Diseases (CSVD). It has also been shown that CSVD is related to neurodegeneration, such as Alzheimer's disease. With the advancement of 7 Tesla MRI systems, higher spatial im… ▽ More Blood vessels of the brain provide the human brain with the required nutrients and oxygen. As a vulnerable part of the cerebral blood supply, pathology of small vessels can cause serious problems such as Cerebral Small Vessel Diseases (CSVD). It has also been shown that CSVD is related to neurodegeneration, such as Alzheimer's disease. With the advancement of 7 Tesla MRI systems, higher spatial image resolution can be achieved, enabling the depiction of very small vessels in the brain. Non-Deep Learning-based approaches for vessel segmentation, e.g., Frangi's vessel enhancement with subsequent thresholding, are capable of segmenting medium to large vessels but often fail to segment small vessels. The sensitivity of these methods to small vessels can be increased by extensive parameter tuning or by manual corrections, albeit making them time-consuming, laborious, and not feasible for larger datasets. This paper proposes a deep learning architecture to automatically segment small vessels in 7 Tesla 3D Time-of-Flight (ToF) Magnetic Resonance Angiography (MRA) data. The algorithm was trained and evaluated on a small imperfect semi-automatically segmented dataset of only 11 subjects; using six for training, two for validation, and three for testing. The deep learning model based on U-Net Multi-Scale Supervision was trained using the training subset and was made equivariant to elastic deformations in a self-supervised manner using deformation-aware learning to improve the generalisation performance. The proposed technique was evaluated quantitatively and qualitatively against the test set and achieved a Dice score of 80.44 $\pm$ 0.83. Furthermore, the result of the proposed method was compared against a selected manually segmented region (62.07 resultant Dice) and has shown a considerable improvement (18.98\%) with deformation-aware learning. △ Less

Submitted 25 September, 2022; v1 submitted 18 June, 2020; originally announced June 2020.

MSC Class: 68T07 (Primary) 68T45 (Secondary) ACM Class: I.2.6; I.4.6

Journal ref: Journal of Imaging. 2022; 8(10):259

Exploration of Interpretability Techniques for Deep COVID-19 Classification using Chest X-ray Images

Authors: Soumick Chatterjee, Fatima Saad, Chompunuch Sarasaen, Suhita Ghosh, Valerie Krug, Rupali Khatun, Rahul Mishra, Nirja Desai, Petia Radeva, Georg Rose, Sebastian Stober, Oliver Speck, Andreas Nürnberger

Abstract: The outbreak of COVID-19 has shocked the entire world with its fairly rapid spread and has challenged different sectors. One of the most effective ways to limit its spread is the early and accurate diagnosing infected patients. Medical imaging, such as X-ray and Computed Tomography (CT), combined with the potential of Artificial Intelligence (AI), plays an essential role in supporting medical pers… ▽ More The outbreak of COVID-19 has shocked the entire world with its fairly rapid spread and has challenged different sectors. One of the most effective ways to limit its spread is the early and accurate diagnosing infected patients. Medical imaging, such as X-ray and Computed Tomography (CT), combined with the potential of Artificial Intelligence (AI), plays an essential role in supporting medical personnel in the diagnosis process. Thus, in this article five different deep learning models (ResNet18, ResNet34, InceptionV3, InceptionResNetV2 and DenseNet161) and their ensemble, using majority voting have been used to classify COVID-19, pneumoniæ and healthy subjects using chest X-ray images. Multilabel classification was performed to predict multiple pathologies for each patient, if present. Firstly, the interpretability of each of the networks was thoroughly studied using local interpretability methods - occlusion, saliency, input X gradient, guided backpropagation, integrated gradients, and DeepLIFT, and using a global technique - neuron activation profiles. The mean Micro-F1 score of the models for COVID-19 classifications ranges from 0.66 to 0.875, and is 0.89 for the ensemble of the network models. The qualitative results showed that the ResNets were the most interpretable models. This research demonstrates the importance of using interpretability methods to compare different models before making a decision regarding the best performing model. △ Less

Submitted 24 January, 2024; v1 submitted 3 June, 2020; originally announced June 2020.

Journal ref: Journal of Imaging. 2024; 10(2):45

CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentation

Authors: A. Emre Kavur, N. Sinem Gezer, Mustafa Barış, Sinem Aslan, Pierre-Henri Conze, Vladimir Groza, Duc Duy Pham, Soumick Chatterjee, Philipp Ernst, Savaş Özkan, Bora Baydar, Dmitry Lachinov, Shuo Han, Josef Pauli, Fabian Isensee, Matthias Perkonigg, Rachana Sathish, Ronnie Rajan, Debdoot Sheet, Gurbandurdy Dovletov, Oliver Speck, Andreas Nürnberger, Klaus H. Maier-Hein, Gözde Bozdağı Akar, Gözde Ünal , et al. (2 additional authors not shown)

Abstract: Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) have introduced new state-of-the-art segmentation systems. In order to expand the knowledge on these topics, the CHAOS - Combined (CT-MR) Healthy Abdominal Organ Segmentation challenge has been organized in conjunction with IEEE… ▽ More Segmentation of abdominal organs has been a comprehensive, yet unresolved, research field for many years. In the last decade, intensive developments in deep learning (DL) have introduced new state-of-the-art segmentation systems. In order to expand the knowledge on these topics, the CHAOS - Combined (CT-MR) Healthy Abdominal Organ Segmentation challenge has been organized in conjunction with IEEE International Symposium on Biomedical Imaging (ISBI), 2019, in Venice, Italy. CHAOS provides both abdominal CT and MR data from healthy subjects for single and multiple abdominal organ segmentation. Five different but complementary tasks have been designed to analyze the capabilities of current approaches from multiple perspectives. The results are investigated thoroughly, compared with manual annotations and interactive methods. The analysis shows that the performance of DL models for single modality (CT / MR) can show reliable volumetric analysis performance (DICE: 0.98 $\pm$ 0.00 / 0.95 $\pm$ 0.01) but the best MSSD performance remain limited (21.89 $\pm$ 13.94 / 20.85 $\pm$ 10.63 mm). The performances of participating models decrease significantly for cross-modality tasks for the liver (DICE: 0.88 $\pm$ 0.15 MSSD: 36.33 $\pm$ 21.97 mm) and all organs (DICE: 0.85 $\pm$ 0.21 MSSD: 33.17 $\pm$ 38.93 mm). Despite contrary examples on different applications, multi-tasking DL models designed to segment all organs seem to perform worse compared to organ-specific ones (performance drop around 5\%). Besides, such directions of further research for cross-modality segmentation would significantly support real-world clinical applications. Moreover, having more than 1500 participants, another important contribution of the paper is the analysis on shortcomings of challenge organizations such as the effects of multiple submissions and peeking phenomena. △ Less

Submitted 7 January, 2021; v1 submitted 17 January, 2020; originally announced January 2020.

Comments: 23 pages, 11 tables, 9 figures

Journal ref: Med. Image Anal. 69 (2021) 101950

VLT near- to mid-IR imaging and spectroscopy of the M17 UC1-IRS5 region

Authors: Zhiwei Chen, Dieter E. A. Nuernberger, Rolf Chini, Zhibo Jiang, Min Fang

Abstract: We investigate the surroundings of the hypercompact HII region M17 UC1 to probe the physical properties of the associated young stellar objects and the environment of massive star formation. Five of the seven point sources in this region show $L$-band excess emission. Geometric match is found between the H_2 emission and near-IR polarized light in the vicinity of IRS5A, and between the diffuse mid… ▽ More We investigate the surroundings of the hypercompact HII region M17 UC1 to probe the physical properties of the associated young stellar objects and the environment of massive star formation. Five of the seven point sources in this region show $L$-band excess emission. Geometric match is found between the H_2 emission and near-IR polarized light in the vicinity of IRS5A, and between the diffuse mid-IR emission and near-IR polarization north of UC1. The H_2 emission is typical for dense PDRs, which are FUV pumped initially and repopulated by collisional de-excitation. The spectral types of IRS5A and B273A are B3-B7 V/III and G4-G5 III, respectively. The observed infrared luminosity L_IR in the range 1-20 micron is derived for three objects; we obtain 2.0x10^3 L_\sun for IRS5A, 13 L_\sun for IRS5C, and 10 L_\sun for B273A. IRS5 might be a young quadruple system. Its primary star IRS5A is confirmed to be a high-mass protostellar object (~ 9 M_\sun, ~1x10^5 yrs); it might have terminated accretion due to the feedback from the stellar activities (radiation pressure, outflow) and the expanding HII region of M17. UC1 might also have terminated accretion because of the expanding hypercompact HII region ionized by itself. The disk clearing process of the low-mass YSOs in this region might be accelerated by the expanding HII region. The outflows driven by UC1 are running in south-north with its northeastern side suppressed by the expanding ionization front of M17; the blue-shifted outflow lobe of IRS5A is seen in two types of tracers along the same line of sight in the form of H_2 emission filament and mid-emission. The H_2 line ratios probe the properties of M17 SW PDR, which is confirmed to have a clumpy structure with two temperature distributions: warm, dense molecular clumps with n_H>10^5 cm^-3 and T~575 K and cooler atomic gas with n_H~3.7x10^3-1.5x10^4 cm-3 and T~50-200 K. △ Less

Submitted 17 February, 2015; originally announced February 2015.

Comments: accepted for publication in A&A, 19 pages, 15 figures, 5 tables

Journal ref: A&A 578, A82 (2015)

Mid-infrared interferometry towards the massive young stellar object CRL 2136: inside the dust rim

Authors: W. J. de Wit, M. G. Hoare, R. D. Oudmaijer, D. E. A Nuernberger, H. E. Wheelwright, S. L. Lumsden

Abstract: We apply mid-infrared spectro-interferometry to the massive young stellar object CRL2136. The observations were performed with the Very Large Telescope Interferometer and the MIDI instrument at a 42m baseline probing angular scales of 50 milli-arcseconds. We model the observed visibilities in parallel with diffraction-limited images at both 24.5micron and in the N-band (with resolutions of 0.6" an… ▽ More We apply mid-infrared spectro-interferometry to the massive young stellar object CRL2136. The observations were performed with the Very Large Telescope Interferometer and the MIDI instrument at a 42m baseline probing angular scales of 50 milli-arcseconds. We model the observed visibilities in parallel with diffraction-limited images at both 24.5micron and in the N-band (with resolutions of 0.6" and 0.3", respectively), as well as the spectral energy distribution. The arcsec-scale spatial information reveals the well-resolved emission from the dusty envelope. By simultaneously modelling the spatial and spectral data, we find that the bulk of the dust emission occurs at several dust sublimation radii (approximately 170 AU). This reproduces the high mid-infrared fluxes and at the same time the low visibilities observed in the MIDI data for wavelengths longward of 8.5micron. However, shortward of this wavelength the visibility data show a sharp up-turn indicative of compact emission. We discuss various potential sources of this emission. We exclude a dust disk being responsible for the observed spectral imprint on the visibilities. A cool supergiant star and an accretion disk are considered and both shown to be viable origins of the compact mid-infrared emission. We propose that CRL2136 is embedded in a dusty envelope, which truncates at several times the dust sublimation radius. A dust torus is manifest in the equatorial region. We find that the spectro-interferometric N-band signal can be reproduced by either a gaseous disk or a bloated central star. If the disk extends to the stellar surface, it accretes at a rate of 3.0 10^(-3) Msun/yr. △ Less

Submitted 1 December, 2010; originally announced December 2010.

Comments: Accepted for publication in A&A

A frozen super-Earth orbiting a star at the bottom of the Main Sequence

Authors: D. Kubas, J. P. Beaulieu, D. P. Bennett, A. Cassan, A. Cole, J. Lunine, J. B. Marquette, S. Dong, A. Gould, T. Sumi, V. Batista, P. Fouque, S. Brillant, S. Dieters, C. Coutures, J. Greenhill, I. Bond, T. Nagayama, A. Udalski, E. Pompei, D. E. A. Nuernberger, J. B. Le Bouquin

Abstract: We observed the microlensing event MOA-2007-BLG-192 at high angular resolution in JHKs with the NACO adaptive optics system on the VLT while the object was still amplified by a factor 1.23 and then at baseline 18 months later. We analyzed and calibrated the NACO photometry in the standard 2MASS system in order to accurately constrain the source and the lens star fluxes. We detect light from the ho… ▽ More We observed the microlensing event MOA-2007-BLG-192 at high angular resolution in JHKs with the NACO adaptive optics system on the VLT while the object was still amplified by a factor 1.23 and then at baseline 18 months later. We analyzed and calibrated the NACO photometry in the standard 2MASS system in order to accurately constrain the source and the lens star fluxes. We detect light from the host star of MOA-2007-BLG-192Lb, which significantly reduces the uncertainties in its char- acteristics as compared to earlier analyses. We find that MOA-2007-BLG-192L is most likely a very low mass late type M-dwarf (0.084 [+0.015] [-0.012] M\odot) at a distance of 660 [+100] [-70] pc orbited by a 3.2 [+5.2] [-1.8] M\oplus super-Earth at 0.66 [+0.51] [-0.22] AU. We then discuss the properties of this cold planetary system. △ Less

Submitted 31 March, 2012; v1 submitted 28 September, 2010; originally announced September 2010.

Comments: published version A&A 540, A78 (2012) A&A, 10 pages, 7 Figures

A brown dwarf companion to the intermediate-mass star HR6037

Authors: N. Huelamo, D. E. A. Nuernberger, V. D. Ivanov, G. Chauvin, G. Carraro, M. F. Sterzik, C. H. F. Melo, M. Bonnefoy, M. Hartung, X. Haubois, C. Foellmi

Abstract: In the course of an imaging survey we have detected a visual companion to the intermediate-mass star HR 6037. In this letter, we present two epoch observations of the binary with NACO/VLT, and near-IR spectroscopy of the secondary with ISAAC/VLT. The NACO observations allow us to confirm HR 6037B as a co-moving companion. Its J and H band ISAAC spectra suggest the object has an spectral type of M9… ▽ More In the course of an imaging survey we have detected a visual companion to the intermediate-mass star HR 6037. In this letter, we present two epoch observations of the binary with NACO/VLT, and near-IR spectroscopy of the secondary with ISAAC/VLT. The NACO observations allow us to confirm HR 6037B as a co-moving companion. Its J and H band ISAAC spectra suggest the object has an spectral type of M9+-1, with a surface gravity intermediate between that of 10 Myr dwarfs and field dwarfs with identical spectral type. The comparison of its Ks-band photometry with evolutionary tracks allows us to derive a mass, effective temperature, and surface gravity of 62+-20 MJup, Teff = 2330+-200 K, and log g = 5.1+-0.2, respectively. The small mass ratio of the binary, -0.03, and its long orbital period, -5000 yr, makes HR 6037 a rare and uncommon binary system. △ Less

Submitted 23 September, 2010; originally announced September 2010.

Comments: (5 pages, 4 figures, accepted for publication in A&A Letters)

Mid-infrared interferometry of the massive young stellar object NGC3603 - IRS 9A

Authors: S. Vehoff, C. A. Hummel, J. D. Monnier, P. Tuthill, D. E. A. Nuernberger, R. Siebenmorgen, O. Chesneau, W. J. Duschl

Abstract: We present observations and models for one of these MYSO candidates, NGC3603 IRS 9A. Our goal is to investigate with infrared interferometry the structure of IRS 9A on scales as small as 200AU, exploiting the fact that a cluster of O and B stars has blown away much of the obscuring foreground dust and gas. Observations in the N-band were carried out with the MIDI beam combiner attached to the VLTI… ▽ More We present observations and models for one of these MYSO candidates, NGC3603 IRS 9A. Our goal is to investigate with infrared interferometry the structure of IRS 9A on scales as small as 200AU, exploiting the fact that a cluster of O and B stars has blown away much of the obscuring foreground dust and gas. Observations in the N-band were carried out with the MIDI beam combiner attached to the VLTI. Additional interferometric observations which probe the structure of IRS 9A on larger scales were performed with an aperture mask installed in the T-ReCS instrument of Gemini South. The spectral energy distribution (SED) is constrained by the MIDI N-band spectrum and by data from the Spitzer Space Telescope. Our efforts to model the structure and SED of IRS 9A range from simple geometrical models of the brightness distribution to one- and two-dimensional radiative transfer computations. The target is resolved by T-ReCS, with an equivalent (elliptical) Gaussian width of 330mas by 280mas (2300 AU by 2000 AU). Despite this fact, a warm compact unresolved component was detected by MIDI which is possibly associated with the inner regions of a flattened dust distribution. Based on our interferometric data, no sign of multiplicity was found on scales between about 200AU and 700AU projected separation. A geometric model consisting of a warm (1000 K) ring (400 AU diameter) and a cool (140 K) large envelope provides a good fit to the data. No single model fitting all visibility and photometric data could be found, with disk models performing better than spherical models. While the data are clearly inconsistent with a spherical dust distribution they are insufficient to prove the existence of a disk but rather hint at a more complex dust distribution. △ Less

Submitted 8 September, 2010; originally announced September 2010.

Comments: 8 pages, 11 figures. Accepted for publication in A&A

Near-infrared follow-up to the May 2008 activation of SGR 1627-41

Authors: A. de Ugarte Postigo, A. J. Castro-Tirado, S. Covino, J. Gorosabel, P. D'Avanzo, D. E. A. Nuernberger

Abstract: On 28 May 2008, the Swift satellite detected the first reactivation of SGR 1627-41 since its discovery in 1998. Following this event we began an observing campaign in near infrared wavelengths to search for a possible counterpart inside the error circle of this SGR, which is expected to show flaring activity simultaneous to the high energy flares or at least some variability as compared to the… ▽ More On 28 May 2008, the Swift satellite detected the first reactivation of SGR 1627-41 since its discovery in 1998. Following this event we began an observing campaign in near infrared wavelengths to search for a possible counterpart inside the error circle of this SGR, which is expected to show flaring activity simultaneous to the high energy flares or at least some variability as compared to the quiescent state. For the follow-up we used the 0.6m REM robotic telescope at La Silla Observatory, which allowed a fast response within 24 hours and, through director discretionary time, the 8.2m Very Large Telescope at Paranal Observatory. There, we observed with NACO to produce high angular resolution imaging with the aid of adaptive optics. These observations represent the fastest near infrared observations after an activation of this SGR and the deepest and highest spatial resolution observations of the Chandra error circle. 5 sources are detected in the immediate vicinity of the most precise X-ray localisation of this source. For 4 of them we do not detect variability, although the X-ray counterpart experimented a significant decay during our observation period. The 5th source is only detected in one epoch, where we have the best image quality, so no variability constrains can be imposed and remains as the only plausible counterpart. We can impose a limit of Ks > 21.6 magnitudes to any other counterpart candidate one week after the onset of the activity. Our adaptive optics imaging, with a resolution of 0.2" provides a reference frame for subsequent studies of future periods of activity. △ Less

Submitted 26 January, 2009; originally announced January 2009.

Comments: Accepted for publication in A&A

Spatially resolved near-infrared spectroscopy of the massive star-forming region IRAS 19410+2336

Authors: N. L. Martin-Hernandez, A. Bik, E. Puga, D. E. A. Nurnberger, L. Bronfman

Abstract: IRAS19410+2336 is a young massive star forming region with an intense outflow activity. We present here spatially resolved NIR spectroscopy which allows us to verify whether the H2 emission detected in this object originates from thermal emission in shock fronts or from fluorescence excitation by non-ionizing UV photons. Moreover, NIR spectroscopy also offers the possibility of studying the char… ▽ More IRAS19410+2336 is a young massive star forming region with an intense outflow activity. We present here spatially resolved NIR spectroscopy which allows us to verify whether the H2 emission detected in this object originates from thermal emission in shock fronts or from fluorescence excitation by non-ionizing UV photons. Moreover, NIR spectroscopy also offers the possibility of studying the characteristics of the putative driving source(s) of the H2 emission by the detection of photospheric and circumstellar spectral features, and of the environmental conditions (e.g. extinction). We obtained long-slit, intermediate-resolution, NIR spectra of IRAS19410+2336 using LIRIS. As a complement, we also obtained J, H and K_s images with the Las Campanas 2.5m Du Pont Telescope, and archival mid-infrared (MIR) Spitzer images at 3.6, 4.5, 5.8 and 8.0 um. We confirm the shocked nature of the H2 emission, with an excitation temperature of about 2000 K. We have also identified objects with very different properties and evolutionary stages in IRAS19410+2336. The most massive source at millimeter wavelengths, mm1, with a mass of a few tens of solar masses, has a bright NIR (and MIR) counterpart. This suggests that emission is leaking at these wavelengths. The second most massive millimeter source, mm2, is only detected at lambda > 6 um, suggesting that it could be a high-mass protostar still in its main accretion phase. The NIR spectra of some neighboring sources show CO first-overtone bandhead emission which is associated with neutral material located in the inner regions of the circumstellar environment of YSOs. △ Less

Submitted 31 July, 2008; originally announced July 2008.

Comments: 12 pages, 9 figures, online material, accepted for publication in A&A

Probing the centre of the large circumstellar disc in M17

Authors: M. Nielbock, R. Chini, V. H. Hoffmeister, D. E. A. Nürnberger, C. M. Scheyda, J. Steinacker

Abstract: We investigated the nature of the hitherto unresolved elliptical infrared emission in the centre of the ~20000 AU disc silhouette in M 17. We combined high-resolution JHKsL'M' band imaging carried out with NAOS/CONICA at the VLT with [Fe II] narrow band imaging using SOFI at the NTT. The analysis is supported by Spitzer/GLIMPSE archival data and by already published SINFONI/VLT Integral Field Sp… ▽ More We investigated the nature of the hitherto unresolved elliptical infrared emission in the centre of the ~20000 AU disc silhouette in M 17. We combined high-resolution JHKsL'M' band imaging carried out with NAOS/CONICA at the VLT with [Fe II] narrow band imaging using SOFI at the NTT. The analysis is supported by Spitzer/GLIMPSE archival data and by already published SINFONI/VLT Integral Field Spectroscopy data. For the first time, we resolve the elongated central infrared emission into a point-source and a jet-like feature that extends to the northeast in the opposite direction of the recently discovered collimated H2 jet. They are both orientated almost perpendicular to the disc plane. In addition, our images reveal a curved southwestern emission nebula whose morphology resembles that of the previously detected northeastern one. Both nebulae are located at a distance of 1500 AU from the disc centre. We describe the infrared point-source in terms of a protostar that is embedded in circumstellar material producing a visual extinction of 60 <= Av <= 82. The observed Ks band magnitude is equivalent to a stellar mass range of 2.8 Msun <= Mstar <= 8 Msun adopting conversions for a main-sequence star. Altogether, we suggest that the large M 17 accretion disc is forming an intermediate to high-mass protostar. Part of the accreted material is expelled through a symmetric bipolar jet/outflow. △ Less

Submitted 26 May, 2008; v1 submitted 10 January, 2008; originally announced January 2008.

Comments: 6 pages, 3 figures, accepted by MNRAS (16 May 2008)

VLTI/MIDI Observations of the Massive Protostellar Candidate NGC 3603 IRS 9A

Authors: Stefan Vehoff, Dieter E. A. Nuernberger, Christian A. Hummel, Wolfgang J. Duschl

Abstract: We used MIDI, the mid-infrared interferometric instrument of the VLTI, to observe the massive protostellar candidate IRS 9A, located at a distance of about 7 kpc at the periphery of the NGC 3603 star cluster. Our ongoing analysis shows that MIDI almost fully resolves the object on all observed baselines, yet below 9 $μ$m we detect a steep rise of the visibility. This feature is modelled as a com… ▽ More We used MIDI, the mid-infrared interferometric instrument of the VLTI, to observe the massive protostellar candidate IRS 9A, located at a distance of about 7 kpc at the periphery of the NGC 3603 star cluster. Our ongoing analysis shows that MIDI almost fully resolves the object on all observed baselines, yet below 9 $μ$m we detect a steep rise of the visibility. This feature is modelled as a combination of a compact hot component and a resolved warm envelope which lowers the correlated flux at longer wavelengths. The extended envelope can already be seen in both MIDI's acquisition images and in complementary data from aperture masking observations at the Gemini South telescope. Its shape is asymmetric, which could indicate a circumstellar disk inclined against the line of sight. The compact component is possibly related to the inner edge of this (accretion) disk. The uncorrelated mid-infrared spectrum appears featureless and could be caused by optically thick emission without a significant contribution from the disk atmosphere. △ Less

Submitted 29 November, 2007; originally announced November 2007.

Comments: 4 pages, 4 figures, Proceedings of "Massive Star Formation: Observations confront Theory", Heidelberg 2007, ed. H. Beuther

Zooming into the large circumstellar disk in M 17

Authors: M. Nielbock, R. Chini, V. H. Hoffmeister, D. E. A. Nürnberger, C. M. Scheyda, J. Steinacker

Abstract: This paper has been withdrawn by the authors. This paper has been withdrawn by the authors. △ Less

Submitted 13 May, 2010; v1 submitted 31 August, 2007; originally announced August 2007.

Comments: This paper has been withdrawn

Molecular Outflows and a Mid-Infrared Census of the Massive Star-Formation Region Associated with IRAS 18507+0121

Authors: D. S. Shepherd, M. S. Povich, B. A. Whitney, T. P. Robitaille, D. E. A. Nurnberger, L. Bronfman, D. P. Stark, R. Indebetouw, M. R. Meade, B. L. Babler

Abstract: We have observed the central region of the IR-dark cloud filament associated with IRAS 18507+0121 at millimeter wavelengths in CO(1-0), 13CO(1-0), and C18O(1-0) line emission and with the Spitzer Space Telescope at mid-IR wavelengths. Five massive outflows from two cloud cores were discovered. Three outflows are centered on or near an Ultracompact HII region (G34.4+0.23) while the remaining two… ▽ More We have observed the central region of the IR-dark cloud filament associated with IRAS 18507+0121 at millimeter wavelengths in CO(1-0), 13CO(1-0), and C18O(1-0) line emission and with the Spitzer Space Telescope at mid-IR wavelengths. Five massive outflows from two cloud cores were discovered. Three outflows are centered on or near an Ultracompact HII region (G34.4+0.23) while the remaining two outflows originate from the millimeter core G34.4+0.23 MM. Modeling of the SEDs of the mid-IR sources identified 31 young stellar objects in the filament with a combined stellar mass of ~127 +/- 27 Msun. An additional 22 sources were identified as probable cluster members based on the presence of strong 24 micron emission. The total star formation efficiency in the G34.4 cloud filament is estimated to be ~7% while the massive and intermediate mass star formation efficiency in the entire cloud filament is estimated to be roughly 2%. A comparison of the gravitational binding energy with the outflow kinetic energy suggests that the compact core containing G34.4+0.23 MM is being destroyed by its molecular outflows whereas the outflows associated with more massive core surrounding the G34.4 UC HII region are not likely to totally disrupt the cloud. Additionally, a qualitative evaluation of the region appears to suggest that stars in this region may have formed in two stages: first lower mass stars formed and then, a few Myrs later, the more massive stars began to form. △ Less

Submitted 28 June, 2007; originally announced June 2007.

Comments: Accepted by ApJ, 46 pages, 12 figures

Journal ref: Astrophys.J.669:464-482,2007

On the infant weight loss of low- to intermediate-mass star clusters

Authors: C. Weidner, P. Kroupa, D. E. A. Nuernberger, M. F. Sterzik

Abstract: Star clusters are born in a highly compact configuration, typically with radii of less than about 1 pc roughly independently of mass. Since the star-formation efficiency is less than 50 per cent by observation and because the residual gas is removed from the embedded cluster, the cluster must expand. In the process of doing so it only retains a fraction f_st of its stars. To date there are no ob… ▽ More Star clusters are born in a highly compact configuration, typically with radii of less than about 1 pc roughly independently of mass. Since the star-formation efficiency is less than 50 per cent by observation and because the residual gas is removed from the embedded cluster, the cluster must expand. In the process of doing so it only retains a fraction f_st of its stars. To date there are no observational constrains for f_st, although Nbody calculations by Kroupa et al. (2001) suggest it to be about 20-30 per cent for Orion-type clusters. Here we use the data compiled by Testi et al. (1997, 1998, 1999) for clusters around young Ae/Be stars and by de Wit et al. (2004, 2005) around young O stars and the study of de Zeeuw et al. (1999) of OB associations and combine these measurements with the expected number of stars in clusters with primary Ae/Be and O stars, respectively, using the empirical correlation between maximal-stellar-mass and star-cluster mass of Weidner & Kroupa (2006). We find that f_st < 50 per cent with a decrease to higher cluster masses/more-massive primaries. The interpretation would be that cluster formation is very disruptive. It appears that clusters with a birth stellar mass in the range 10 to 10^3 Msun keep at most 50 per cent of their stars. △ Less

Submitted 31 January, 2007; originally announced February 2007.

Comments: 17 pages, 5 figures, to be published in MNRAS

Journal ref: Mon.Not.Roy.Astron.Soc.376:1879-1885,2007

Discovery of a Massive Protostar near IRAS 18507+0121

Authors: D. S. Shepherd, D. E. A. Nurnberger, L. Bronfman

Abstract: We have observed the massive star forming region, IRAS 18507+0121, at millimeter wavelengths in 3 mm continuum emission and H13CO+(J=1-0) and SiO(v=0, J=2-1) line emission, and at near-infrared wavelengths between 1.2 and 2.1 microns. Two compact molecular cores are detected: one north and one south separated by about 40". The northern molecular core contains a newly discovered, deeply embedded,… ▽ More We have observed the massive star forming region, IRAS 18507+0121, at millimeter wavelengths in 3 mm continuum emission and H13CO+(J=1-0) and SiO(v=0, J=2-1) line emission, and at near-infrared wavelengths between 1.2 and 2.1 microns. Two compact molecular cores are detected: one north and one south separated by about 40". The northern molecular core contains a newly discovered, deeply embedded, B2 protostar surrounded by several hundred solar masses of warm gas and dust, G34.4+0.23 MM. Based on the presence of warm dust emission and the lack of detection at near-infrared wavelengths, we suggest that G34.4+0.23 MM may represent the relatively rare discovery of a massive protostar (e.g. analogous to a low-mass "Class 0" protostar). The southern molecular core is associated with a near-infrared cluster of young stars and an ultracompact (UC) HII region, G34.4+0.23, with a central B0.5 star. The fraction of near-infrared stars with excess infrared emission indicative of circumstellar material is greater than 50% which suggests an upper limit on the age of the IRAS 18507+0121 star forming region of 3 Myrs. △ Less

Submitted 27 October, 2003; originally announced October 2003.

Comments: Astrophysical Journal, in press. 21 pages plus 6 figures (jpg format). See http://www.aoc.nrao.edu/~dshepher/science.shtml for reprint with full resolution figures

Journal ref: Astrophys.J. 602 (2004) 850-859