Skip to main content

Showing 1–21 of 21 results for author: Bethge, M

Searching in archive q-bio. Search in all archives.
.
  1. arXiv:2401.05342  [pdf, other

    q-bio.NC cs.AI cs.LG

    Most discriminative stimuli for functional cell type clustering

    Authors: Max F. Burg, Thomas Zenkel, Michaela Vystrčilová, Jonathan Oesterle, Larissa Höfling, Konstantin F. Willeke, Jan Lause, Sarah Müller, Paul G. Fahey, Zhiwei Ding, Kelli Restivo, Shashwat Sridhar, Tim Gollisch, Philipp Berens, Andreas S. Tolias, Thomas Euler, Matthias Bethge, Alexander S. Ecker

    Abstract: Identifying cell types and understanding their functional properties is crucial for unraveling the mechanisms underlying perception and cognition. In the retina, functional types can be identified by carefully selected stimuli, but this requires expert domain knowledge and biases the procedure towards previously known cell types. In the visual cortex, it is still unknown what functional types exis… ▽ More

    Submitted 14 March, 2024; v1 submitted 29 November, 2023; originally announced January 2024.

  2. arXiv:2106.07411  [pdf, other

    cs.CV cs.AI cs.LG q-bio.NC

    Partial success in closing the gap between human and machine vision

    Authors: Robert Geirhos, Kantharaju Narayanappa, Benjamin Mitzkus, Tizian Thieringer, Matthias Bethge, Felix A. Wichmann, Wieland Brendel

    Abstract: A few years ago, the first CNN surpassed human performance on ImageNet. However, it soon became clear that machines lack robustness on more challenging test cases, a major obstacle towards deploying machines "in the wild" and towards obtaining better computational models of human visual perception. Here we ask: Are we making progress in closing the gap between human and machine vision? To answer t… ▽ More

    Submitted 25 October, 2021; v1 submitted 14 June, 2021; originally announced June 2021.

    Comments: NeurIPS 2021 Oral, camera ready version. A preliminary version of this work was presented as Oral at the 2020 NeurIPS workshop on "Shared Visual Representations in Human & Machine Intelligence" (arXiv:2010.08377)

  3. arXiv:2010.08377  [pdf, other

    cs.CV cs.AI cs.LG q-bio.NC

    On the surprising similarities between supervised and self-supervised models

    Authors: Robert Geirhos, Kantharaju Narayanappa, Benjamin Mitzkus, Matthias Bethge, Felix A. Wichmann, Wieland Brendel

    Abstract: How do humans learn to acquire a powerful, flexible and robust representation of objects? While much of this process remains unknown, it is clear that humans do not require millions of object labels. Excitingly, recent algorithmic advancements in self-supervised learning now enable convolutional neural networks (CNNs) to learn useful visual object representations without supervised labels, too. In… ▽ More

    Submitted 16 October, 2020; originally announced October 2020.

  4. arXiv:2004.09406  [pdf, other

    cs.CV cs.AI cs.LG q-bio.NC stat.ML

    Five Points to Check when Comparing Visual Perception in Humans and Machines

    Authors: Christina M. Funke, Judy Borowski, Karolina Stosio, Wieland Brendel, Thomas S. A. Wallis, Matthias Bethge

    Abstract: With the rise of machines to human-level performance in complex recognition tasks, a growing amount of work is directed towards comparing information processing in humans and machines. These studies are an exciting chance to learn about one system by studying the other. Here, we propose ideas on how to design, conduct and interpret experiments such that they adequately support the investigation of… ▽ More

    Submitted 13 April, 2021; v1 submitted 20 April, 2020; originally announced April 2020.

    Comments: V3: minor changes like in published JOV version (https://doi.org/10.1167/jov.21.3.16) V2: New title; added general section (checklist); manuscript restructured such that each case study is one chapter; adversarial examples in first study replaced by different analysis

    Journal ref: Journal of Vision 21, no. 3 (2021): 16-16

  5. arXiv:2004.07780  [pdf, other

    cs.CV cs.AI cs.LG q-bio.NC

    Shortcut Learning in Deep Neural Networks

    Authors: Robert Geirhos, Jörn-Henrik Jacobsen, Claudio Michaelis, Richard Zemel, Wieland Brendel, Matthias Bethge, Felix A. Wichmann

    Abstract: Deep learning has triggered the current rise of artificial intelligence and is the workhorse of today's machine intelligence. Numerous success stories have rapidly spread all over science, industry and society, but its limitations have only recently come into focus. In this perspective we seek to distill how many of deep learning's problems can be seen as different symptoms of the same underlying… ▽ More

    Submitted 21 November, 2023; v1 submitted 16 April, 2020; originally announced April 2020.

    Comments: perspective article published at Nature Machine Intelligence (https://doi.org/10.1038/s42256-020-00257-z)

  6. arXiv:1911.05072  [pdf, other

    cs.LG cs.AI cs.CV q-bio.NC

    Learning From Brains How to Regularize Machines

    Authors: Zhe Li, Wieland Brendel, Edgar Y. Walker, Erick Cobos, Taliah Muhammad, Jacob Reimer, Matthias Bethge, Fabian H. Sinz, Xaq Pitkow, Andreas S. Tolias

    Abstract: Despite impressive performance on numerous visual tasks, Convolutional Neural Networks (CNNs) --- unlike brains --- are often highly sensitive to small perturbations of their input, e.g. adversarial noise leading to erroneous decisions. We propose to regularize CNNs using large-scale neuroscience data to learn more robust neural features in terms of representational similarity. We presented natura… ▽ More

    Submitted 11 November, 2019; originally announced November 2019.

    Comments: 14 pages, 7 figures, NeurIPS 2019

  7. arXiv:1811.12231  [pdf, other

    cs.CV cs.AI cs.LG q-bio.NC stat.ML

    ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness

    Authors: Robert Geirhos, Patricia Rubisch, Claudio Michaelis, Matthias Bethge, Felix A. Wichmann, Wieland Brendel

    Abstract: Convolutional Neural Networks (CNNs) are commonly thought to recognise objects by learning increasingly complex representations of object shapes. Some recent studies suggest a more important role of image textures. We here put these conflicting hypotheses to a quantitative test by evaluating CNNs and human observers on images with a texture-shape cue conflict. We show that ImageNet-trained CNNs ar… ▽ More

    Submitted 9 November, 2022; v1 submitted 29 November, 2018; originally announced November 2018.

    Comments: Accepted at ICLR 2019 (oral)

  8. arXiv:1809.10504  [pdf, other

    q-bio.NC cs.LG stat.ML

    A rotation-equivariant convolutional neural network model of primary visual cortex

    Authors: Alexander S. Ecker, Fabian H. Sinz, Emmanouil Froudarakis, Paul G. Fahey, Santiago A. Cadena, Edgar Y. Walker, Erick Cobos, Jacob Reimer, Andreas S. Tolias, Matthias Bethge

    Abstract: Classical models describe primary visual cortex (V1) as a filter bank of orientation-selective linear-nonlinear (LN) or energy models, but these models fail to predict neural responses to natural stimuli accurately. Recent work shows that models based on convolutional neural networks (CNNs) lead to much more accurate predictions, but it remains unclear which features are extracted by V1 neurons be… ▽ More

    Submitted 27 September, 2018; originally announced September 2018.

  9. arXiv:1808.08750  [pdf, other

    cs.CV cs.AI cs.LG q-bio.NC stat.ML

    Generalisation in humans and deep neural networks

    Authors: Robert Geirhos, Carlos R. Medina Temme, Jonas Rauber, Heiko H. Schütt, Matthias Bethge, Felix A. Wichmann

    Abstract: We compare the robustness of humans and current convolutional deep neural networks (DNNs) on object recognition under twelve different types of image degradations. First, using three well known DNNs (ResNet-152, VGG-19, GoogLeNet) we find the human visual system to be more robust to nearly all of the tested image manipulations, and we observe progressively diverging classification error-patterns b… ▽ More

    Submitted 23 October, 2020; v1 submitted 27 August, 2018; originally announced August 2018.

    Comments: Added optimal probability aggregation method to appendix

  10. arXiv:1804.03142  [pdf, other

    cs.CV q-bio.NC q-bio.QM stat.ML

    Markerless tracking of user-defined features with deep learning

    Authors: Alexander Mathis, Pranav Mamidanna, Taiga Abe, Kevin M. Cury, Venkatesh N. Murthy, Mackenzie W. Mathis, Matthias Bethge

    Abstract: Quantifying behavior is crucial for many applications in neuroscience. Videography provides easy methods for the observation and recording of animal behavior in diverse settings, yet extracting particular aspects of a behavior for further analysis can be highly time consuming. In motor control studies, humans or other animals are often marked with reflective markers to assist with computer-based t… ▽ More

    Submitted 9 April, 2018; originally announced April 2018.

    Comments: Videos at http://www.mousemotorlab.org/deeplabcut

    Journal ref: Nature Neuroscience, Technical Report, published: 20 August 2018

  11. arXiv:1711.02653  [pdf, other

    stat.ML cs.LG q-bio.NC

    Neural system identification for large populations separating "what" and "where"

    Authors: David A. Klindt, Alexander S. Ecker, Thomas Euler, Matthias Bethge

    Abstract: Neuroscientists classify neurons into different types that perform similar computations at different locations in the visual field. Traditional methods for neural system identification do not capitalize on this separation of 'what' and 'where'. Learning deep convolutional feature spaces that are shared among many neurons provides an exciting path forward, but the architectural design needs to acco… ▽ More

    Submitted 29 January, 2018; v1 submitted 7 November, 2017; originally announced November 2017.

    Comments: NIPS 2017

  12. arXiv:1706.06969  [pdf, other

    cs.CV q-bio.NC stat.ML

    Comparing deep neural networks against humans: object recognition when the signal gets weaker

    Authors: Robert Geirhos, David H. J. Janssen, Heiko H. Schütt, Jonas Rauber, Matthias Bethge, Felix A. Wichmann

    Abstract: Human visual object recognition is typically rapid and seemingly effortless, as well as largely independent of viewpoint and object orientation. Until very recently, animate visual systems were the only ones capable of this remarkable computational feat. This has changed with the rise of a class of computer vision algorithms called deep neural networks (DNNs) that achieve human-level classificatio… ▽ More

    Submitted 11 December, 2018; v1 submitted 21 June, 2017; originally announced June 2017.

    Comments: updated article with reference to resulting publication (Geirhos et al, NeurIPS 2018)

  13. arXiv:1704.01547  [pdf, other

    stat.ML cs.LG q-bio.NC

    Comment on "Biologically inspired protection of deep networks from adversarial attacks"

    Authors: Wieland Brendel, Matthias Bethge

    Abstract: A recent paper suggests that Deep Neural Networks can be protected from gradient-based adversarial perturbations by driving the network activations into a highly saturated regime. Here we analyse such saturated networks and show that the attacks fail due to numerical limitations in the gradient computations. A simple stabilisation of the gradient estimates enables successful and efficient attacks.… ▽ More

    Submitted 5 April, 2017; originally announced April 2017.

    Comments: 4 pages, 3 figures

  14. arXiv:1610.01563  [pdf, other

    cs.CV q-bio.NC stat.AP

    DeepGaze II: Reading fixations from deep features trained on object recognition

    Authors: Matthias Kümmerer, Thomas S. A. Wallis, Matthias Bethge

    Abstract: Here we present DeepGaze II, a model that predicts where people look in images. The model uses the features from the VGG-19 deep neural network trained to identify objects in images. Contrary to other saliency models that use deep features, here we use the VGG features for saliency prediction with no additional fine-tuning (rather, a few readout layers are trained on top of the VGG features to pre… ▽ More

    Submitted 5 October, 2016; originally announced October 2016.

  15. Signatures of criticality arise in simple neural population models with correlations

    Authors: Marcel Nonnenmacher, Christian Behrens, Philipp Berens, Matthias Bethge, Jakob H Macke

    Abstract: Large-scale recordings of neuronal activity make it possible to gain insights into the collective activity of neural ensembles. It has been hypothesized that neural populations might be optimized to operate at a 'thermodynamic critical point', and that this property has implications for information processing. Support for this notion has come from a series of studies which identified statistical s… ▽ More

    Submitted 31 January, 2018; v1 submitted 29 February, 2016; originally announced March 2016.

    Comments: 36 pages, LaTeX; added journal reference on page 1, added link to code repository

    Journal ref: PLoS Comput Biol 13(10): e1005718 (2017)

  16. arXiv:1508.06576  [pdf, other

    cs.CV cs.NE q-bio.NC

    A Neural Algorithm of Artistic Style

    Authors: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

    Abstract: In fine art, especially painting, humans have mastered the skill to create unique visual experiences through composing a complex interplay between the content and style of an image. Thus far the algorithmic basis of this process is unknown and there exists no artificial system with similar capabilities. However, in other key areas of visual perception such as object and face recognition near-human… ▽ More

    Submitted 2 September, 2015; v1 submitted 26 August, 2015; originally announced August 2015.

  17. arXiv:1505.07376  [pdf, other

    cs.CV cs.NE q-bio.NC

    Texture Synthesis Using Convolutional Neural Networks

    Authors: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

    Abstract: Here we introduce a new model of natural textures based on the feature spaces of convolutional neural networks optimised for object recognition. Samples from the model are of high perceptual quality demonstrating the generative power of neural networks trained in a purely discriminative fashion. Within the model, textures are represented by the correlations between feature maps in several layers o… ▽ More

    Submitted 6 November, 2015; v1 submitted 27 May, 2015; originally announced May 2015.

    Comments: Revision for NIPS 2015 Camera Ready. In line with reviewer's comments we now focus on the texture model and texture synthesis performance. We limit the relationship of our texture model to the ventral stream and its potential use for neuroscience to the discussion of the paper

  18. arXiv:1411.1045  [pdf, other

    cs.CV q-bio.NC stat.AP

    Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNet

    Authors: Matthias Kümmerer, Lucas Theis, Matthias Bethge

    Abstract: Recent results suggest that state-of-the-art saliency models perform far from optimal in predicting fixations. This lack in performance has been attributed to an inability to model the influence of high-level image features such as objects. Recent seminal advances in applying deep neural networks to tasks like object recognition suggests that they are able to capture this kind of structure. Howeve… ▽ More

    Submitted 9 April, 2015; v1 submitted 4 November, 2014; originally announced November 2014.

  19. arXiv:1409.7686  [pdf, other

    cs.CV q-bio.NC stat.AP

    How close are we to understanding image-based saliency?

    Authors: Matthias Kümmerer, Thomas Wallis, Matthias Bethge

    Abstract: Within the set of the many complex factors driving gaze placement, the properities of an image that are associated with fixations under free viewing conditions have been studied extensively. There is a general impression that the field is close to understanding this particular association. Here we frame saliency models probabilistically as point processes, allowing the calculation of log-likelihoo… ▽ More

    Submitted 26 September, 2014; originally announced September 2014.

  20. arXiv:1009.2855  [pdf, other

    q-bio.NC cond-mat.dis-nn physics.data-an

    An analytically tractable model of neural population activity in the presence of common input explains higher-order correlations and entropy

    Authors: Jakob H Macke, Manfred Opper, Matthias Bethge

    Abstract: Simultaneously recorded neurons exhibit correlations whose underlying causes are not known. Here, we use a population of threshold neurons receiving correlated inputs to model neural population recordings. We show analytically that small changes in second-order correlations can lead to large changes in higher correlations, and that these higher-order correlations have a strong impact on the entrop… ▽ More

    Submitted 17 September, 2010; v1 submitted 15 September, 2010; originally announced September 2010.

  21. Natural Image Coding in V1: How Much Use is Orientation Selectivity?

    Authors: Jan Eichhorn, Fabian Sinz, Matthias Bethge

    Abstract: Orientation selectivity is the most striking feature of simple cell coding in V1 which has been shown to emerge from the reduction of higher-order correlations in natural images in a large variety of statistical image models. The most parsimonious one among these models is linear Independent Component Analysis (ICA), whereas second-order decorrelation transformations such as Principal Component… ▽ More

    Submitted 16 October, 2008; v1 submitted 16 October, 2008; originally announced October 2008.