-
End-to-end Learning for Image-based Detection of Molecular Alterations in Digital Pathology
Authors:
Marvin Teichmann,
Andre Aichert,
Hanibal Bohnenberger,
Philipp Ströbel,
Tobias Heimann
Abstract:
Current approaches for classification of whole slide images (WSI) in digital pathology predominantly utilize a two-stage learning pipeline. The first stage identifies areas of interest (e.g. tumor tissue), while the second stage processes cropped tiles from these areas in a supervised fashion. During inference, a large number of tiles are combined into a unified prediction for the entire slide. A…
▽ More
Current approaches for classification of whole slide images (WSI) in digital pathology predominantly utilize a two-stage learning pipeline. The first stage identifies areas of interest (e.g. tumor tissue), while the second stage processes cropped tiles from these areas in a supervised fashion. During inference, a large number of tiles are combined into a unified prediction for the entire slide. A major drawback of such approaches is the requirement for task-specific auxiliary labels which are not acquired in clinical routine. We propose a novel learning pipeline for WSI classification that is trainable end-to-end and does not require any auxiliary annotations. We apply our approach to predict molecular alterations for a number of different use-cases, including detection of microsatellite instability in colorectal tumors and prediction of specific mutations for colon, lung, and breast cancer cases from The Cancer Genome Atlas. Results reach AUC scores of up to 94% and are shown to be competitive with state of the art two-stage pipelines. We believe our approach can facilitate future research in digital pathology and contribute to solve a large range of problems around the prediction of cancer phenotypes, hopefully enabling personalized therapies for more patients in future.
△ Less
Submitted 19 July, 2022; v1 submitted 30 June, 2022;
originally announced July 2022.
-
Anatomy of a superorganism -- structure and growth dynamics of army ant bivouacs
Authors:
Thomas Bochynek,
Florian Schiffers,
André Aichert,
Oliver Cossairt,
Simon Garnier,
Michael Rubenstein
Abstract:
Beyond unicellular and multicellular organisms, there is a third type of structural complexity in living animals: that of the mechanical self-assembly of groups of distinct multicellular organisms into dynamical, functional structures. One of the most striking examples of such structures is the army ant bivouac, a nest which self-assembles solely from the interconnected bodies of hundreds of thous…
▽ More
Beyond unicellular and multicellular organisms, there is a third type of structural complexity in living animals: that of the mechanical self-assembly of groups of distinct multicellular organisms into dynamical, functional structures. One of the most striking examples of such structures is the army ant bivouac, a nest which self-assembles solely from the interconnected bodies of hundreds of thousands of individuals. These bivouacs are difficult to study because they rapidly disassemble when disturbed, and hence little is known about the structure and rules that individuals follow during their formation. Here we use a custom-built Computed Tomography scanner to investigate the details of the internal structure and growth process of army ant bivouacs. We show that bivouacs are heterogeneous structures, which throughout their growth maintain a thick shell surrounding a less dense interior that contains empty spaces akin to nest chambers. We find that ants within the bivouac do not carry more than approximately eight times their weight regardless of the size of the structure or their position within it. This observation suggests that bivouac size is not limited by physical constraints of the ants' morphology. This study brings us closer to understanding the rules used by individuals to govern the formation of these exceptional superorganismal structures, and provides insight into how to create engineered self-assembling systems with, for instance, swarms of robots or active matter.
△ Less
Submitted 18 October, 2021;
originally announced October 2021.
-
Disassemblable Fieldwork CT Scanner Using a 3D-printed Calibration Phantom
Authors:
Florian Schiffers,
Thomas Bochynek,
Andre Aichert,
Tobias Würfl,
Michael Rubenstein,
Oliver Cossairt
Abstract:
The use of computed tomography (CT) imaging has become of increasing interest to academic areas outside of the field of medical imaging and industrial inspection, e.g., to biology and cultural heritage research. The pecularities of these fields, however, sometimes require that objects need to be imaged on-site, e.g., in field-work conditions or in museum collections. Under these circumstances, it…
▽ More
The use of computed tomography (CT) imaging has become of increasing interest to academic areas outside of the field of medical imaging and industrial inspection, e.g., to biology and cultural heritage research. The pecularities of these fields, however, sometimes require that objects need to be imaged on-site, e.g., in field-work conditions or in museum collections. Under these circumstances, it is often not possible to use a commercial device and a custom solution is the only viable option. In order to achieve high image quality under adverse conditions, reliable calibration and trajectory reproduction are usually key requirements for any custom CT scanning system. Here, we introduce the construction of a low-cost disassemblable CT scanner that allows calibration even when trajectory reproduction is not possible due to the limitations imposed by the project conditions. Using 3D-printed in-image calibration phantoms, we compute a projection matrix directly from each captured X-ray projection. We describe our method in detail and show successful tomographic reconstructions of several specimen as proof of concept.
△ Less
Submitted 12 November, 2020;
originally announced November 2020.
