-
Reducing Down(stream)time: Pretraining Molecular GNNs using Heterogeneous AI Accelerators
Authors:
Jenna A. Bilbrey,
Kristina M. Herman,
Henry Sprueill,
Soritis S. Xantheas,
Payel Das,
Manuel Lopez Roldan,
Mike Kraus,
Hatem Helal,
Sutanay Choudhury
Abstract:
The demonstrated success of transfer learning has popularized approaches that involve pretraining models from massive data sources and subsequent finetuning towards a specific task. While such approaches have become the norm in fields such as natural language processing, implementation and evaluation of transfer learning approaches for chemistry are in the early stages. In this work, we demonstrat…
▽ More
The demonstrated success of transfer learning has popularized approaches that involve pretraining models from massive data sources and subsequent finetuning towards a specific task. While such approaches have become the norm in fields such as natural language processing, implementation and evaluation of transfer learning approaches for chemistry are in the early stages. In this work, we demonstrate finetuning for downstream tasks on a graph neural network (GNN) trained over a molecular database containing 2.7 million water clusters. The use of Graphcore IPUs as an AI accelerator for training molecular GNNs reduces training time from a reported 2.7 days on 0.5M clusters to 1.2 hours on 2.7M clusters. Finetuning the pretrained model for downstream tasks of molecular dynamics and transfer to a different potential energy surface took only 8.3 hours and 28 minutes, respectively, on a single GPU.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
A Convolutional Neural Network for the Automatic Diagnosis of Collagen VI related Muscular Dystrophies
Authors:
Adrián Bazaga,
Mònica Roldán,
Carmen Badosa,
Cecilia Jiménez-Mallebrera,
Josep M. Porta
Abstract:
The development of machine learning systems for the diagnosis of rare diseases is challenging mainly due the lack of data to study them. Despite this challenge, this paper proposes a system for the Computer Aided Diagnosis (CAD) of low-prevalence, congenital muscular dystrophies from confocal microscopy images. The proposed CAD system relies on a Convolutional Neural Network (CNN) which performs a…
▽ More
The development of machine learning systems for the diagnosis of rare diseases is challenging mainly due the lack of data to study them. Despite this challenge, this paper proposes a system for the Computer Aided Diagnosis (CAD) of low-prevalence, congenital muscular dystrophies from confocal microscopy images. The proposed CAD system relies on a Convolutional Neural Network (CNN) which performs an independent classification for non-overlapping patches tiling the input image, and generates an overall decision summarizing the individual decisions for the patches on the query image. This decision scheme points to the possibly problematic areas in the input images and provides a global quantitative evaluation of the state of the patients, which is fundamental for diagnosis and to monitor the efficiency of therapies.
△ Less
Submitted 30 January, 2019;
originally announced January 2019.
-
Towards Per-user Flexible Management in 5G
Authors:
Aitor Zabala,
Elisa Rojas,
José María Roldan,
Luis Pulido
Abstract:
Flexible management is one of the key components of next-generation 5G networks. Currently, many approaches focus on network functionality (services) and translate it afterward into end-user requirements, which slightly constrains the flexibility for both management and end users. Furthermore, moving the intelligence of the network towards the edge (i.e. the users) has already proven its benefits,…
▽ More
Flexible management is one of the key components of next-generation 5G networks. Currently, many approaches focus on network functionality (services) and translate it afterward into end-user requirements, which slightly constrains the flexibility for both management and end users. Furthermore, moving the intelligence of the network towards the edge (i.e. the users) has already proven its benefits, such as computational offloading, lower latency and higher bandwidth utilization. In this article, we try to move management as close as possible to final users, providing per-user flexibility and unique user to service paths, enabling custom paths adapted for each user requirements instead of users adapting to service requirements. To validate our ideas, we work on two different use cases, implemented as proof-of-concepts in the ONOS platform. From the results obtained we conclude that there is still work to be done regarding the integration of SDN in the radio access and evolved packet core functions to provide the desired flexibility.
△ Less
Submitted 24 January, 2018;
originally announced January 2018.
-
Tracing Properties of UML and OCL Models with Maude
Authors:
Francisco Durán,
Martin Gogolla,
Manuel Roldán
Abstract:
The starting point of this paper is a system described in form of a UML class diagram where system states are characterized by OCL invariants and system transitions are defined by OCL pre- and postconditions. The aim of our approach is to assist the developer in learning about the consequences of the described system states and transitions and about the formal implications of the properties that a…
▽ More
The starting point of this paper is a system described in form of a UML class diagram where system states are characterized by OCL invariants and system transitions are defined by OCL pre- and postconditions. The aim of our approach is to assist the developer in learning about the consequences of the described system states and transitions and about the formal implications of the properties that are explicitly given. We propose to draw conclusions about the stated constraints by translating the UML and OCL model into the algebraic specification language and system Maude, which is based on rewrite logic. We will concentrate in this paper on employing Maude's capabilities for state search. Maude's state search offers the possibility to describe a start configuration of the system and then explore all configurations reachable by rewriting. The search can be adjusted by formulating requirements for the allowed states and the allowed transitions.
△ Less
Submitted 30 June, 2011;
originally announced July 2011.
