Skip to main content

Showing 1–17 of 17 results for author: Ruff, L

Searching in archive cs. Search in all archives.
.
  1. arXiv:2501.05409  [pdf, other

    cs.CV cs.AI cs.LG

    Atlas: A Novel Pathology Foundation Model by Mayo Clinic, Charité, and Aignostics

    Authors: Maximilian Alber, Stephan Tietz, Jonas Dippel, Timo Milbich, Timothée Lesort, Panos Korfiatis, Moritz Krügener, Beatriz Perez Cancer, Neelay Shah, Alexander Möllers, Philipp Seegerer, Alexandra Carpen-Amarie, Kai Standvoss, Gabriel Dernbach, Edwin de Jong, Simon Schallenberg, Andreas Kunft, Helmut Hoffer von Ankershoffen, Gavin Schaeferle, Patrick Duffy, Matt Redlon, Philipp Jurmeister, David Horst, Lukas Ruff, Klaus-Robert Müller , et al. (2 additional authors not shown)

    Abstract: Recent advances in digital pathology have demonstrated the effectiveness of foundation models across diverse applications. In this report, we present Atlas, a novel vision foundation model based on the RudolfV approach. Our model was trained on a dataset comprising 1.2 million histopathology whole slide images, collected from two medical institutions: Mayo Clinic and Charité - Universtätsmedizin B… ▽ More

    Submitted 10 January, 2025; v1 submitted 9 January, 2025; originally announced January 2025.

  2. arXiv:2411.07643  [pdf, other

    cs.CV cs.LG

    xCG: Explainable Cell Graphs for Survival Prediction in Non-Small Cell Lung Cancer

    Authors: Marvin Sextro, Gabriel Dernbach, Kai Standvoss, Simon Schallenberg, Frederick Klauschen, Klaus-Robert Müller, Maximilian Alber, Lukas Ruff

    Abstract: Understanding how deep learning models predict oncology patient risk can provide critical insights into disease progression, support clinical decision-making, and pave the way for trustworthy and data-driven precision medicine. Building on recent advances in the spatial modeling of the tumor microenvironment using graph neural networks, we present an explainable cell graph (xCG) approach for survi… ▽ More

    Submitted 12 November, 2024; originally announced November 2024.

    Comments: Findings paper presented at Machine Learning for Health (ML4H) symposium 2024, December 15-16, 2024, Vancouver, Canada, 11 pages

  3. arXiv:2408.08041  [pdf, other

    cs.LG cs.AI stat.ML

    The Clever Hans Effect in Unsupervised Learning

    Authors: Jacob Kauffmann, Jonas Dippel, Lukas Ruff, Wojciech Samek, Klaus-Robert Müller, Grégoire Montavon

    Abstract: Unsupervised learning has become an essential building block of AI systems. The representations it produces, e.g. in foundation models, are critical to a wide variety of downstream applications. It is therefore important to carefully examine unsupervised models to ensure not only that they produce accurate predictions, but also that these predictions are not "right for the wrong reasons", the so-c… ▽ More

    Submitted 15 August, 2024; originally announced August 2024.

    Comments: 12 pages + supplement

  4. arXiv:2406.14866  [pdf, other

    cs.AI eess.IV

    AI-based Anomaly Detection for Clinical-Grade Histopathological Diagnostics

    Authors: Jonas Dippel, Niklas Prenißl, Julius Hense, Philipp Liznerski, Tobias Winterhoff, Simon Schallenberg, Marius Kloft, Oliver Buchstab, David Horst, Maximilian Alber, Lukas Ruff, Klaus-Robert Müller, Frederick Klauschen

    Abstract: While previous studies have demonstrated the potential of AI to diagnose diseases in imaging data, clinical implementation is still lagging behind. This is partly because AI models require training with large numbers of examples only available for common diseases. In clinical reality, however, only few diseases are common, whereas the majority of diseases are less frequent (long-tail distribution)… ▽ More

    Submitted 21 June, 2024; originally announced June 2024.

  5. arXiv:2401.04079  [pdf, ps, other

    eess.IV cs.CV cs.LG

    RudolfV: A Foundation Model by Pathologists for Pathologists

    Authors: Jonas Dippel, Barbara Feulner, Tobias Winterhoff, Timo Milbich, Stephan Tietz, Simon Schallenberg, Gabriel Dernbach, Andreas Kunft, Simon Heinke, Marie-Lisa Eich, Julika Ribbat-Idel, Rosemarie Krupar, Philipp Anders, Niklas Prenißl, Philipp Jurmeister, David Horst, Lukas Ruff, Klaus-Robert Müller, Frederick Klauschen, Maximilian Alber

    Abstract: Artificial intelligence has started to transform histopathology impacting clinical diagnostics and biomedical research. However, while many computational pathology approaches have been proposed, most current AI models are limited with respect to generalization, application variety, and handling rare diseases. Recent efforts introduced self-supervised foundation models to address these challenges,… ▽ More

    Submitted 11 June, 2024; v1 submitted 8 January, 2024; originally announced January 2024.

  6. arXiv:2306.13384  [pdf, other

    eess.IV cs.CV cs.LG

    DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathology

    Authors: Marco Aversa, Gabriel Nobis, Miriam Hägele, Kai Standvoss, Mihaela Chirica, Roderick Murray-Smith, Ahmed Alaa, Lukas Ruff, Daniela Ivanova, Wojciech Samek, Frederick Klauschen, Bruno Sanguinetti, Luis Oala

    Abstract: We present DiffInfinite, a hierarchical diffusion model that generates arbitrarily large histological images while preserving long-range correlation structural information. Our approach first generates synthetic segmentation masks, subsequently used as conditions for the high-fidelity generative diffusion process. The proposed sampling method can be scaled up to any desired image size while only r… ▽ More

    Submitted 25 October, 2023; v1 submitted 23 June, 2023; originally announced June 2023.

  7. arXiv:2302.01813  [pdf, other

    cs.CV cs.LG

    Leveraging weak complementary labels to improve semantic segmentation of hepatocellular carcinoma and cholangiocarcinoma in H&E-stained slides

    Authors: Miriam Hägele, Johannes Eschrich, Lukas Ruff, Maximilian Alber, Simon Schallenberg, Adrien Guillot, Christoph Roderburg, Frank Tacke, Frederick Klauschen

    Abstract: In this paper, we present a deep learning segmentation approach to classify and quantify the two most prevalent primary liver cancers - hepatocellular carcinoma and intrahepatic cholangiocarcinoma - from hematoxylin and eosin (H&E) stained whole slide images. While semantic segmentation of medical images typically requires costly pixel-level annotations by domain experts, there often exists additi… ▽ More

    Submitted 3 February, 2023; originally announced February 2023.

  8. arXiv:2205.11474  [pdf, other

    cs.CV cs.LG stat.ML

    Exposing Outlier Exposure: What Can Be Learned From Few, One, and Zero Outlier Images

    Authors: Philipp Liznerski, Lukas Ruff, Robert A. Vandermeulen, Billy Joe Franks, Klaus-Robert Müller, Marius Kloft

    Abstract: Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that unsupervised image AD can be drastically improved through the utilization of huge corpora of random images to represent anomalousness; a technique which is known a… ▽ More

    Submitted 14 November, 2022; v1 submitted 23 May, 2022; originally announced May 2022.

    Comments: 47 pages; extended experiments; published in Transactions on Machine Learning Research. arXiv admin note: substantial text overlap with arXiv:2006.00339

  9. arXiv:2010.02310  [pdf, other

    cs.LG stat.ML

    Deep Anomaly Detection by Residual Adaptation

    Authors: Lucas Deecke, Lukas Ruff, Robert A. Vandermeulen, Hakan Bilen

    Abstract: Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly detection based on augmenting large pretrained networks with residual corrections that adjusts them to the task of anomaly detection. Our method gives rise to a highly… ▽ More

    Submitted 5 October, 2020; originally announced October 2020.

  10. arXiv:2009.13987  [pdf, other

    cs.LG math.MG stat.ML

    Geometric Disentanglement by Random Convex Polytopes

    Authors: Michael Joswig, Marek Kaluba, Lukas Ruff

    Abstract: We propose a new geometric method for measuring the quality of representations obtained from deep learning. Our approach, called Random Polytope Descriptor, provides an efficient description of data points based on the construction of random convex polytopes. We demonstrate the use of our technique by qualitatively comparing the behavior of classic and regularized autoencoders. This reveals that a… ▽ More

    Submitted 13 February, 2021; v1 submitted 29 September, 2020; originally announced September 2020.

    Comments: 23 pages, preprint; extended experiments and theoretical analysis of RPD in v2

  11. arXiv:2009.11732  [pdf, other

    cs.LG cs.AI stat.ML

    A Unifying Review of Deep and Shallow Anomaly Detection

    Authors: Lukas Ruff, Jacob R. Kauffmann, Robert A. Vandermeulen, Grégoire Montavon, Wojciech Samek, Marius Kloft, Thomas G. Dietterich, Klaus-Robert Müller

    Abstract: Deep learning approaches to anomaly detection have recently improved the state of the art in detection performance on complex datasets such as large collections of images or text. These results have sparked a renewed interest in the anomaly detection problem and led to the introduction of a great variety of new methods. With the emergence of numerous such methods, including approaches based on gen… ▽ More

    Submitted 8 February, 2021; v1 submitted 24 September, 2020; originally announced September 2020.

    Comments: 40 pages; accepted for publication in the Proceedings of the IEEE;

    Journal ref: Proceedings of the IEEE (2021) 1-40

  12. arXiv:2007.01760  [pdf, other

    cs.CV cs.LG stat.ML

    Explainable Deep One-Class Classification

    Authors: Philipp Liznerski, Lukas Ruff, Robert A. Vandermeulen, Billy Joe Franks, Marius Kloft, Klaus-Robert Müller

    Abstract: Deep one-class classification variants for anomaly detection learn a mapping that concentrates nominal samples in feature space causing anomalies to be mapped away. Because this transformation is highly non-linear, finding interpretations poses a significant challenge. In this paper we present an explainable deep one-class classification method, Fully Convolutional Data Description (FCDD), where t… ▽ More

    Submitted 18 March, 2021; v1 submitted 3 July, 2020; originally announced July 2020.

    Comments: 25 pages, published as a conference paper at ICLR 2021

  13. arXiv:2006.10609  [pdf, other

    cs.LG cs.AI stat.ML

    The Clever Hans Effect in Anomaly Detection

    Authors: Jacob Kauffmann, Lukas Ruff, Grégoire Montavon, Klaus-Robert Müller

    Abstract: The 'Clever Hans' effect occurs when the learned model produces correct predictions based on the 'wrong' features. This effect which undermines the generalization capability of an ML model and goes undetected by standard validation techniques has been frequently observed for supervised learning where the training algorithm leverages spurious correlations in the data. The question whether Clever Ha… ▽ More

    Submitted 18 June, 2020; originally announced June 2020.

    Comments: 17 pages, preprint

  14. arXiv:2006.00339  [pdf, other

    cs.LG stat.ML

    Rethinking Assumptions in Deep Anomaly Detection

    Authors: Lukas Ruff, Robert A. Vandermeulen, Billy Joe Franks, Klaus-Robert Müller, Marius Kloft

    Abstract: Though anomaly detection (AD) can be viewed as a classification problem (nominal vs. anomalous) it is usually treated in an unsupervised manner since one typically does not have access to, or it is infeasible to utilize, a dataset that sufficiently characterizes what it means to be "anomalous." In this paper we present results demonstrating that this intuition surprisingly seems not to extend to d… ▽ More

    Submitted 27 January, 2023; v1 submitted 30 May, 2020; originally announced June 2020.

    Comments: 17 pages; accepted at the ICML 2021 Workshop on Uncertainty & Robustness in Deep Learning; An extended Journal paper of this work has been published in Transactions on Machine Learning Research: arXiv:2205.11474

  15. Simple and Effective Prevention of Mode Collapse in Deep One-Class Classification

    Authors: Penny Chong, Lukas Ruff, Marius Kloft, Alexander Binder

    Abstract: Anomaly detection algorithms find extensive use in various fields. This area of research has recently made great advances thanks to deep learning. A recent method, the deep Support Vector Data Description (deep SVDD), which is inspired by the classic kernel-based Support Vector Data Description (SVDD), is capable of simultaneously learning a feature representation of the data and a data-enclosing… ▽ More

    Submitted 19 January, 2021; v1 submitted 23 January, 2020; originally announced January 2020.

    Comments: Accepted in 2020 International Joint Conference on Neural Networks (IJCNN)

  16. From Clustering to Cluster Explanations via Neural Networks

    Authors: Jacob Kauffmann, Malte Esders, Lukas Ruff, Grégoire Montavon, Wojciech Samek, Klaus-Robert Müller

    Abstract: A recent trend in machine learning has been to enrich learned models with the ability to explain their own predictions. The emerging field of Explainable AI (XAI) has so far mainly focused on supervised learning, in particular, deep neural network classifiers. In many practical problems however, label information is not given and the goal is instead to discover the underlying structure of the data… ▽ More

    Submitted 16 December, 2021; v1 submitted 18 June, 2019; originally announced June 2019.

    Comments: 15 pages + supplement

  17. arXiv:1906.02694  [pdf, other

    cs.LG stat.ML

    Deep Semi-Supervised Anomaly Detection

    Authors: Lukas Ruff, Robert A. Vandermeulen, Nico Görnitz, Alexander Binder, Emmanuel Müller, Klaus-Robert Müller, Marius Kloft

    Abstract: Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may have---in addition to a large set of unlabeled samples---access to a small pool of labeled samples, e.g. a subset verified by some domain expert as being normal or anom… ▽ More

    Submitted 14 February, 2020; v1 submitted 6 June, 2019; originally announced June 2019.

    Comments: 23 pages, Published as a conference paper at ICLR 2020