-
ICML Topological Deep Learning Challenge 2024: Beyond the Graph Domain
Authors:
Guillermo Bernárdez,
Lev Telyatnikov,
Marco Montagna,
Federica Baccini,
Mathilde Papillon,
Miquel Ferriol-Galmés,
Mustafa Hajij,
Theodore Papamarkou,
Maria Sofia Bucarelli,
Olga Zaghen,
Johan Mathe,
Audun Myers,
Scott Mahan,
Hansen Lillemark,
Sharvaree Vadgama,
Erik Bekkers,
Tim Doster,
Tegan Emerson,
Henry Kvinge,
Katrina Agate,
Nesreen K Ahmed,
Pengfei Bai,
Michael Banf,
Claudio Battiloro,
Maxim Beketov
, et al. (48 additional authors not shown)
Abstract:
This paper describes the 2nd edition of the ICML Topological Deep Learning Challenge that was hosted within the ICML 2024 ELLIS Workshop on Geometry-grounded Representation Learning and Generative Modeling (GRaM). The challenge focused on the problem of representing data in different discrete topological domains in order to bridge the gap between Topological Deep Learning (TDL) and other types of…
▽ More
This paper describes the 2nd edition of the ICML Topological Deep Learning Challenge that was hosted within the ICML 2024 ELLIS Workshop on Geometry-grounded Representation Learning and Generative Modeling (GRaM). The challenge focused on the problem of representing data in different discrete topological domains in order to bridge the gap between Topological Deep Learning (TDL) and other types of structured datasets (e.g. point clouds, graphs). Specifically, participants were asked to design and implement topological liftings, i.e. mappings between different data structures and topological domains --like hypergraphs, or simplicial/cell/combinatorial complexes. The challenge received 52 submissions satisfying all the requirements. This paper introduces the main scope of the challenge, and summarizes the main results and findings.
△ Less
Submitted 8 September, 2024;
originally announced September 2024.
-
Fast gradient-free activation maximization for neurons in spiking neural networks
Authors:
Nikita Pospelov,
Andrei Chertkov,
Maxim Beketov,
Ivan Oseledets,
Konstantin Anokhin
Abstract:
Elements of neural networks, both biological and artificial, can be described by their selectivity for specific cognitive features. Understanding these features is important for understanding the inner workings of neural networks. For a living system, such as a neuron, whose response to a stimulus is unknown and not differentiable, the only way to reveal these features is through a feedback loop t…
▽ More
Elements of neural networks, both biological and artificial, can be described by their selectivity for specific cognitive features. Understanding these features is important for understanding the inner workings of neural networks. For a living system, such as a neuron, whose response to a stimulus is unknown and not differentiable, the only way to reveal these features is through a feedback loop that exposes it to a large set of different stimuli. The properties of these stimuli should be varied iteratively in order to maximize the neuronal response. To utilize this feedback loop for a biological neural network, it is important to run it quickly and efficiently in order to reach the stimuli that maximizes certain neurons' activation with the least number of iterations possible. Here we present a framework with an efficient design for such a loop. We successfully tested it on an artificial spiking neural network (SNN), which is a model that simulates the asynchronous spiking activity of neurons in living brains. Our optimization method for activation maximization is based on the low-rank Tensor Train decomposition of the discrete activation function. The optimization space is the latent parameter space of images generated by SN-GAN or VQ-VAE generative models. To our knowledge, this is the first time that effective AM has been applied to SNNs. We track changes in the optimal stimuli for artificial neurons during training and show that highly selective neurons can form already in the early epochs of training and in the early layers of a convolutional spiking network. This formation of refined optimal stimuli is associated with an increase in classification accuracy. Some neurons, especially in the deeper layers, may gradually change the concepts they are selective for during learning, potentially explaining their importance for model performance.
△ Less
Submitted 25 June, 2024; v1 submitted 28 December, 2023;
originally announced January 2024.
-
Global cognitive graph properties dynamics of hippocampal formation
Authors:
Konstantin Sorokin,
Andrey Zaitsew,
Aleksandr Levin,
German Magai,
Maxim Beketov,
Vladimir Sotskov
Abstract:
In the present study we have used a set of methods and metrics to build a graph of relative neural connections in a hippocampus of a rodent. A set of graphs was built on top of time-sequenced data and analyzed in terms of dynamics of a connection genesis. The analysis has shown that during the process of a rodent exploring a novel environment, the relations between neurons constantly change which…
▽ More
In the present study we have used a set of methods and metrics to build a graph of relative neural connections in a hippocampus of a rodent. A set of graphs was built on top of time-sequenced data and analyzed in terms of dynamics of a connection genesis. The analysis has shown that during the process of a rodent exploring a novel environment, the relations between neurons constantly change which indicates that globally memory is constantly updated even for known areas of space. Even if some neurons gain cognitive specialization, the global network though remains relatively stable. Additionally we suggest a set of methods for building a graph of cognitive neural network.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
Topology of cognitive maps
Authors:
Konstantin Sorokin,
Anton Ayzenberg,
Konstantin Anokhin,
Vladimir Sotskov,
Maxim Beketov,
Andrey Zaitsew,
Robert Drynkin
Abstract:
In present paper we discuss several approaches to reconstructing the topology of the physical space from neural activity data of CA1 fields in mice hippocampus, in particular, having Cognitome theory of brain function in mind. In our experiments, animals were placed in different new environments and discovered these moving freely while their physical and neural activity was recorded. We test possi…
▽ More
In present paper we discuss several approaches to reconstructing the topology of the physical space from neural activity data of CA1 fields in mice hippocampus, in particular, having Cognitome theory of brain function in mind. In our experiments, animals were placed in different new environments and discovered these moving freely while their physical and neural activity was recorded. We test possible approaches to identifying place cell groups out of the observed CA1 neurons. We also test and discuss various methods of dimension reduction and topology reconstruction. In particular, two main strategies we focus on are the Nerve theorem and point cloud-based methods. Conclusions on the results of reconstruction are supported with illustrations and mathematical background which is also briefly discussed.
△ Less
Submitted 5 December, 2022; v1 submitted 16 November, 2022;
originally announced November 2022.
-
ICLR 2021 Challenge for Computational Geometry & Topology: Design and Results
Authors:
Nina Miolane,
Matteo Caorsi,
Umberto Lupo,
Marius Guerard,
Nicolas Guigui,
Johan Mathe,
Yann Cabanes,
Wojciech Reise,
Thomas Davies,
António Leitão,
Somesh Mohapatra,
Saiteja Utpala,
Shailja Shailja,
Gabriele Corso,
Guoxi Liu,
Federico Iuricich,
Andrei Manolache,
Mihaela Nistor,
Matei Bejan,
Armand Mihai Nicolicioiu,
Bogdan-Alexandru Luchian,
Mihai-Sorin Stupariu,
Florent Michel,
Khanh Dao Duc,
Bilal Abdulrahman
, et al. (8 additional authors not shown)
Abstract:
This paper presents the computational challenge on differential geometry and topology that happened within the ICLR 2021 workshop "Geometric and Topological Representation Learning". The competition asked participants to provide creative contributions to the fields of computational geometry and topology through the open-source repositories Geomstats and Giotto-TDA. The challenge attracted 16 teams…
▽ More
This paper presents the computational challenge on differential geometry and topology that happened within the ICLR 2021 workshop "Geometric and Topological Representation Learning". The competition asked participants to provide creative contributions to the fields of computational geometry and topology through the open-source repositories Geomstats and Giotto-TDA. The challenge attracted 16 teams in its two month duration. This paper describes the design of the challenge and summarizes its main findings.
△ Less
Submitted 25 August, 2021; v1 submitted 22 August, 2021;
originally announced August 2021.
-
Probing Criticality in Quantum Spin Chains with Neural Networks
Authors:
A Berezutskii,
M Beketov,
D Yudin,
Z Zimborás,
J Biamonte
Abstract:
The numerical emulation of quantum systems often requires an exponential number of degrees of freedom which translates to a computational bottleneck. Methods of machine learning have been used in adjacent fields for effective feature extraction and dimensionality reduction of high-dimensional datasets. Recent studies have revealed that neural networks are further suitable for the determination of…
▽ More
The numerical emulation of quantum systems often requires an exponential number of degrees of freedom which translates to a computational bottleneck. Methods of machine learning have been used in adjacent fields for effective feature extraction and dimensionality reduction of high-dimensional datasets. Recent studies have revealed that neural networks are further suitable for the determination of macroscopic phases of matter and associated phase transitions as well as efficient quantum state representation. In this work, we address quantum phase transitions in quantum spin chains, namely the transverse field Ising chain and the anisotropic XY chain, and show that even neural networks with no hidden layers can be effectively trained to distinguish between magnetically ordered and disordered phases. Our neural network acts to predict the corresponding crossovers finite-size systems undergo. Our results extend to a wide class of interacting quantum many-body systems and illustrate the wide applicability of neural networks to many-body quantum physics.
△ Less
Submitted 7 August, 2020; v1 submitted 5 May, 2020;
originally announced May 2020.
