Skip to main content

Showing 1–24 of 24 results for author: Ecker, A S

.
  1. arXiv:2506.03293  [pdf, ps, other

    q-bio.NC

    Learning to cluster neuronal function

    Authors: Nina S. Nellen, Polina Turishcheva, Michaela Vystrčilová, Shashwat Sridhar, Tim Gollisch, Andreas S. Tolias, Alexander S. Ecker

    Abstract: Deep neural networks trained to predict neural activity from visual input and behaviour have shown great potential to serve as digital twins of the visual cortex. Per-neuron embeddings derived from these models could potentially be used to map the functional landscape or identify cell types. However, state-of-the-art predictive models of mouse V1 do not generate functional embeddings that exhibit… ▽ More

    Submitted 3 June, 2025; originally announced June 2025.

  2. arXiv:2503.15582  [pdf, other

    stat.ML cs.LG

    Hierarchical clustering with maximum density paths and mixture models

    Authors: Martin Ritzert, Polina Turishcheva, Laura Hansel, Paul Wollenhaupt, Marissa A. Weis, Alexander S. Ecker

    Abstract: Hierarchical clustering is an effective, interpretable method for analyzing structure in data. It reveals insights at multiple scales without requiring a predefined number of clusters and captures nested patterns and subtle relationships, which are often missed by flat clustering approaches. However, existing hierarchical clustering methods struggle with high-dimensional data, especially when ther… ▽ More

    Submitted 21 May, 2025; v1 submitted 19 March, 2025; originally announced March 2025.

  3. arXiv:2412.02482  [pdf, other

    cs.IT cs.LG cs.NE

    What should a neuron aim for? Designing local objective functions based on information theory

    Authors: Andreas C. Schneider, Valentin Neuhaus, David A. Ehrlich, Abdullah Makkeh, Alexander S. Ecker, Viola Priesemann, Michael Wibral

    Abstract: In modern deep neural networks, the learning dynamics of the individual neurons is often obscure, as the networks are trained via global optimization. Conversely, biological systems build on self-organized, local learning, achieving robustness and efficiency with limited global information. We here show how self-organization between individual artificial neurons can be achieved by designing abstra… ▽ More

    Submitted 21 January, 2025; v1 submitted 3 December, 2024; originally announced December 2024.

    Comments: 24 pages, 11 figures

  4. arXiv:2410.16124  [pdf, other

    cs.LG stat.ML

    MNIST-Nd: a set of naturalistic datasets to benchmark clustering across dimensions

    Authors: Polina Turishcheva, Laura Hansel, Martin Ritzert, Marissa A. Weis, Alexander S. Ecker

    Abstract: Driven by advances in recording technology, large-scale high-dimensional datasets have emerged across many scientific disciplines. Especially in biology, clustering is often used to gain insights into the structure of such datasets, for instance to understand the organization of different cell types. However, clustering is known to scale poorly to high dimensions, even though the exact impact of d… ▽ More

    Submitted 21 October, 2024; originally announced October 2024.

  5. arXiv:2407.09100  [pdf, other

    q-bio.NC

    Retrospective for the Dynamic Sensorium Competition for predicting large-scale mouse primary visual cortex activity from videos

    Authors: Polina Turishcheva, Paul G. Fahey, Michaela Vystrčilová, Laura Hansel, Rachel Froebe, Kayla Ponder, Yongrong Qiu, Konstantin F. Willeke, Mohammad Bashiri, Ruslan Baikulov, Yu Zhu, Lei Ma, Shan Yu, Tiejun Huang, Bryan M. Li, Wolf De Wulf, Nina Kudryashova, Matthias H. Hennig, Nathalie L. Rochefort, Arno Onken, Eric Wang, Zhiwei Ding, Andreas S. Tolias, Fabian H. Sinz, Alexander S Ecker

    Abstract: Understanding how biological visual systems process information is challenging because of the nonlinear relationship between visual input and neuronal responses. Artificial neural networks allow computational neuroscientists to create predictive models that connect biological and machine vision. Machine learning has benefited tremendously from benchmarks that compare different model on the same ta… ▽ More

    Submitted 12 July, 2024; originally announced July 2024.

  6. arXiv:2402.19158  [pdf, other

    physics.flu-dyn

    Tailor-designed models for the turbulent velocity gradient through normalizing flow

    Authors: Maurizio Carbone, Vincent J. Peterhans, Alexander S. Ecker, Michael Wilczek

    Abstract: Small-scale turbulence can be comprehensively described in terms of velocity gradients, which makes them an appealing starting point for low-dimensional modeling. Typical models consist of stochastic equations based on closures for non-local pressure and viscous contributions. The fidelity of the resulting models depends on the accuracy of the underlying modeling assumptions. Here, we discuss an a… ▽ More

    Submitted 29 February, 2024; originally announced February 2024.

  7. arXiv:2401.16424  [pdf, other

    cs.CV q-bio.QM

    Computer Vision for Primate Behavior Analysis in the Wild

    Authors: Richard Vogg, Timo Lüddecke, Jonathan Henrich, Sharmita Dey, Matthias Nuske, Valentin Hassler, Derek Murphy, Julia Fischer, Julia Ostner, Oliver Schülke, Peter M. Kappeler, Claudia Fichtel, Alexander Gail, Stefan Treue, Hansjörg Scherberger, Florentin Wörgötter, Alexander S. Ecker

    Abstract: Advances in computer vision as well as increasingly widespread video-based behavioral monitoring have great potential for transforming how we study animal cognition and behavior. However, there is still a fairly large gap between the exciting prospects and what can actually be achieved in practice today, especially in videos from the wild. With this perspective paper, we want to contribute towards… ▽ More

    Submitted 12 August, 2024; v1 submitted 29 January, 2024; originally announced January 2024.

  8. arXiv:2401.05342  [pdf, other

    q-bio.NC cs.AI cs.LG

    Most discriminative stimuli for functional cell type clustering

    Authors: Max F. Burg, Thomas Zenkel, Michaela Vystrčilová, Jonathan Oesterle, Larissa Höfling, Konstantin F. Willeke, Jan Lause, Sarah Müller, Paul G. Fahey, Zhiwei Ding, Kelli Restivo, Shashwat Sridhar, Tim Gollisch, Philipp Berens, Andreas S. Tolias, Thomas Euler, Matthias Bethge, Alexander S. Ecker

    Abstract: Identifying cell types and understanding their functional properties is crucial for unraveling the mechanisms underlying perception and cognition. In the retina, functional types can be identified by carefully selected stimuli, but this requires expert domain knowledge and biases the procedure towards previously known cell types. In the visual cortex, it is still unknown what functional types exis… ▽ More

    Submitted 14 March, 2024; v1 submitted 29 November, 2023; originally announced January 2024.

  9. arXiv:2305.19654  [pdf, other

    q-bio.NC

    The Dynamic Sensorium competition for predicting large-scale mouse visual cortex activity from videos

    Authors: Polina Turishcheva, Paul G. Fahey, Laura Hansel, Rachel Froebe, Kayla Ponder, Michaela Vystrčilová, Konstantin F. Willeke, Mohammad Bashiri, Eric Wang, Zhiwei Ding, Andreas S. Tolias, Fabian H. Sinz, Alexander S. Ecker

    Abstract: Understanding how biological visual systems process information is challenging due to the complex nonlinear relationship between neuronal responses and high-dimensional visual input. Artificial neural networks have already improved our understanding of this system by allowing computational neuroscientists to create predictive models and bridge biological and machine vision. During the Sensorium 20… ▽ More

    Submitted 12 July, 2024; v1 submitted 31 May, 2023; originally announced May 2023.

    Comments: arXiv admin note: substantial text overlap with arXiv:2206.08666

  10. arXiv:2206.08666  [pdf, other

    q-bio.NC cs.AI cs.LG

    The Sensorium competition on predicting large-scale mouse primary visual cortex activity

    Authors: Konstantin F. Willeke, Paul G. Fahey, Mohammad Bashiri, Laura Pede, Max F. Burg, Christoph Blessing, Santiago A. Cadena, Zhiwei Ding, Konstantin-Klemens Lurz, Kayla Ponder, Taliah Muhammad, Saumil S. Patel, Alexander S. Ecker, Andreas S. Tolias, Fabian H. Sinz

    Abstract: The neural underpinning of the biological visual system is challenging to study experimentally, in particular as the neuronal activity becomes increasingly nonlinear with respect to visual input. Artificial neural networks (ANNs) can serve a variety of goals for improving our understanding of this complex system, not only serving as predictive digital twins of sensory cortex for novel hypothesis g… ▽ More

    Submitted 17 June, 2022; originally announced June 2022.

    Comments: NeurIPS 2022 Competition Track

  11. arXiv:2112.12482  [pdf, other

    stat.ML cs.LG q-bio.NC

    Self-Supervised Graph Representation Learning for Neuronal Morphologies

    Authors: Marissa A. Weis, Laura Hansel, Timo Lüddecke, Alexander S. Ecker

    Abstract: Unsupervised graph representation learning has recently gained interest in several application domains such as neuroscience, where modeling the diverse morphology of cell types in the brain is one of the key challenges. It is currently unknown how many excitatory cortical cell types exist and what their defining morphological features are. Here we present GraphDINO, a purely data-driven approach t… ▽ More

    Submitted 21 June, 2023; v1 submitted 23 December, 2021; originally announced December 2021.

    Journal ref: Transactions on Machine Learning Research (TMLR), 2023

  12. arXiv:2112.10003  [pdf, other

    cs.CV

    Image Segmentation Using Text and Image Prompts

    Authors: Timo Lüddecke, Alexander S. Ecker

    Abstract: Image segmentation is usually addressed by training a model for a fixed set of object classes. Incorporating additional classes or more complex queries later is expensive as it requires re-training the model on a dataset that encompasses these expressions. Here we propose a system that can generate image segmentations based on arbitrary prompts at test time. A prompt can be either a text or an ima… ▽ More

    Submitted 30 March, 2022; v1 submitted 18 December, 2021; originally announced December 2021.

    Comments: CVPR 2022

  13. arXiv:2011.04267  [pdf, other

    cs.CV cs.LG

    A Broad Dataset is All You Need for One-Shot Object Detection

    Authors: Claudio Michaelis, Matthias Bethge, Alexander S. Ecker

    Abstract: Is it possible to detect arbitrary objects from a single example? A central problem of all existing attempts at one-shot object detection is the generalization gap: Object categories used during training are detected much more reliably than novel ones. We here show that this generalization gap can be nearly closed by increasing the number of object categories used during training. Doing so allows… ▽ More

    Submitted 29 October, 2022; v1 submitted 9 November, 2020; originally announced November 2020.

  14. arXiv:2006.07034  [pdf, other

    cs.CV

    Benchmarking Unsupervised Object Representations for Video Sequences

    Authors: Marissa A. Weis, Kashyap Chitta, Yash Sharma, Wieland Brendel, Matthias Bethge, Andreas Geiger, Alexander S. Ecker

    Abstract: Perceiving the world in terms of objects and tracking them through time is a crucial prerequisite for reasoning and scene understanding. Recently, several methods have been proposed for unsupervised learning of object-centric representations. However, since these models were evaluated on different downstream tasks, it remains unclear how they compare in terms of basic perceptual abilities such as… ▽ More

    Submitted 29 June, 2021; v1 submitted 12 June, 2020; originally announced June 2020.

    Journal ref: Journal of Machine Learning Research 22 (183): 1-61, 2021

  15. arXiv:1907.07484  [pdf, other

    cs.CV cs.LG stat.ML

    Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Coming

    Authors: Claudio Michaelis, Benjamin Mitzkus, Robert Geirhos, Evgenia Rusak, Oliver Bringmann, Alexander S. Ecker, Matthias Bethge, Wieland Brendel

    Abstract: The ability to detect objects regardless of image distortions or weather conditions is crucial for real-world applications of deep learning like autonomous driving. We here provide an easy-to-use benchmark to assess how object detection models perform when image quality degrades. The three resulting benchmark datasets, termed Pascal-C, Coco-C and Cityscapes-C, contain a large variety of image corr… ▽ More

    Submitted 31 March, 2020; v1 submitted 17 July, 2019; originally announced July 2019.

    Comments: 21 pages, 10 figures, 1 dragon

  16. arXiv:1811.11507  [pdf, other

    cs.CV

    One-Shot Instance Segmentation

    Authors: Claudio Michaelis, Ivan Ustyuzhaninov, Matthias Bethge, Alexander S. Ecker

    Abstract: We tackle the problem of one-shot instance segmentation: Given an example image of a novel, previously unknown object category, find and segment all objects of this category within a complex scene. To address this challenging new task, we propose Siamese Mask R-CNN. It extends Mask R-CNN by a Siamese backbone encoding both reference image and scene, allowing it to target detection and segmentation… ▽ More

    Submitted 28 May, 2019; v1 submitted 28 November, 2018; originally announced November 2018.

  17. arXiv:1809.10504  [pdf, other

    q-bio.NC cs.LG stat.ML

    A rotation-equivariant convolutional neural network model of primary visual cortex

    Authors: Alexander S. Ecker, Fabian H. Sinz, Emmanouil Froudarakis, Paul G. Fahey, Santiago A. Cadena, Edgar Y. Walker, Erick Cobos, Jacob Reimer, Andreas S. Tolias, Matthias Bethge

    Abstract: Classical models describe primary visual cortex (V1) as a filter bank of orientation-selective linear-nonlinear (LN) or energy models, but these models fail to predict neural responses to natural stimuli accurately. Recent work shows that models based on convolutional neural networks (CNNs) lead to much more accurate predictions, but it remains unclear which features are extracted by V1 neurons be… ▽ More

    Submitted 27 September, 2018; originally announced September 2018.

  18. arXiv:1807.10589  [pdf, other

    cs.CV

    Diverse feature visualizations reveal invariances in early layers of deep neural networks

    Authors: Santiago A. Cadena, Marissa A. Weis, Leon A. Gatys, Matthias Bethge, Alexander S. Ecker

    Abstract: Visualizing features in deep neural networks (DNNs) can help understanding their computations. Many previous studies aimed to visualize the selectivity of individual units by finding meaningful images that maximize their activation. However, comparably little attention has been paid to visualizing to what image transformations units in DNNs are invariant. Here we propose a method to discover invar… ▽ More

    Submitted 27 July, 2018; originally announced July 2018.

    Comments: Accepted for ECCV 2018

  19. arXiv:1803.09597  [pdf, other

    cs.CV

    One-Shot Segmentation in Clutter

    Authors: Claudio Michaelis, Matthias Bethge, Alexander S. Ecker

    Abstract: We tackle the problem of one-shot segmentation: finding and segmenting a previously unseen object in a cluttered scene based on a single instruction example. We propose a novel dataset, which we call $\textit{cluttered Omniglot}$. Using a baseline architecture combining a Siamese embedding for detection with a U-net for segmentation we show that increasing levels of clutter make the task progressi… ▽ More

    Submitted 13 June, 2018; v1 submitted 26 March, 2018; originally announced March 2018.

    Comments: To appaer in: $\textit{Proceedings of the $\mathit{35}^{th}$ International Conference on Machine Learning}$, Stockholm, Sweden, PMLR 80, 2018

  20. arXiv:1711.02653  [pdf, other

    stat.ML cs.LG q-bio.NC

    Neural system identification for large populations separating "what" and "where"

    Authors: David A. Klindt, Alexander S. Ecker, Thomas Euler, Matthias Bethge

    Abstract: Neuroscientists classify neurons into different types that perform similar computations at different locations in the visual field. Traditional methods for neural system identification do not capitalize on this separation of 'what' and 'where'. Learning deep convolutional feature spaces that are shared among many neurons provides an exciting path forward, but the architectural design needs to acco… ▽ More

    Submitted 29 January, 2018; v1 submitted 7 November, 2017; originally announced November 2017.

    Comments: NIPS 2017

  21. arXiv:1702.07006  [pdf, other

    cs.CV

    Synthesising Dynamic Textures using Convolutional Neural Networks

    Authors: Christina M. Funke, Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

    Abstract: Here we present a parametric model for dynamic textures. The model is based on spatiotemporal summary statistics computed from the feature representations of a Convolutional Neural Network (CNN) trained on object recognition. We demonstrate how the model can be used to synthesise new samples of dynamic textures and to predict motion in simple movies.

    Submitted 22 February, 2017; originally announced February 2017.

  22. arXiv:1611.07865  [pdf, other

    cs.CV

    Controlling Perceptual Factors in Neural Style Transfer

    Authors: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge, Aaron Hertzmann, Eli Shechtman

    Abstract: Neural Style Transfer has shown very exciting results enabling new forms of image manipulation. Here we extend the existing method to introduce control over spatial location, colour information and across spatial scale. We demonstrate how this enhances the method by allowing high-resolution controlled stylisation and helps to alleviate common failure cases such as applying ground textures to sky r… ▽ More

    Submitted 11 May, 2017; v1 submitted 23 November, 2016; originally announced November 2016.

    Comments: Accepted at CVPR2017

  23. arXiv:1508.06576  [pdf, other

    cs.CV cs.NE q-bio.NC

    A Neural Algorithm of Artistic Style

    Authors: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

    Abstract: In fine art, especially painting, humans have mastered the skill to create unique visual experiences through composing a complex interplay between the content and style of an image. Thus far the algorithmic basis of this process is unknown and there exists no artificial system with similar capabilities. However, in other key areas of visual perception such as object and face recognition near-human… ▽ More

    Submitted 2 September, 2015; v1 submitted 26 August, 2015; originally announced August 2015.

  24. arXiv:1505.07376  [pdf, other

    cs.CV cs.NE q-bio.NC

    Texture Synthesis Using Convolutional Neural Networks

    Authors: Leon A. Gatys, Alexander S. Ecker, Matthias Bethge

    Abstract: Here we introduce a new model of natural textures based on the feature spaces of convolutional neural networks optimised for object recognition. Samples from the model are of high perceptual quality demonstrating the generative power of neural networks trained in a purely discriminative fashion. Within the model, textures are represented by the correlations between feature maps in several layers o… ▽ More

    Submitted 6 November, 2015; v1 submitted 27 May, 2015; originally announced May 2015.

    Comments: Revision for NIPS 2015 Camera Ready. In line with reviewer's comments we now focus on the texture model and texture synthesis performance. We limit the relationship of our texture model to the ventral stream and its potential use for neuroscience to the discussion of the paper