-
AutoMATES: Automated Model Assembly from Text, Equations, and Software
Authors:
Adarsh Pyarelal,
Marco A. Valenzuela-Escarcega,
Rebecca Sharp,
Paul D. Hein,
Jon Stephens,
Pratik Bhandari,
HeuiChan Lim,
Saumya Debray,
Clayton T. Morrison
Abstract:
Models of complicated systems can be represented in different ways - in scientific papers, they are represented using natural language text as well as equations. But to be of real use, they must also be implemented as software, thus making code a third form of representing models. We introduce the AutoMATES project, which aims to build semantically-rich unified representations of models from scien…
▽ More
Models of complicated systems can be represented in different ways - in scientific papers, they are represented using natural language text as well as equations. But to be of real use, they must also be implemented as software, thus making code a third form of representing models. We introduce the AutoMATES project, which aims to build semantically-rich unified representations of models from scientific code and publications to facilitate the integration of computational models from different domains and allow for modeling large, complicated systems that span multiple domains and levels of abstraction.
△ Less
Submitted 20 January, 2020;
originally announced January 2020.
-
Meta-Learning Initializations for Image Segmentation
Authors:
Sean M. Hendryx,
Andrew B. Leach,
Paul D. Hein,
Clayton T. Morrison
Abstract:
We extend first-order model agnostic meta-learning algorithms (including FOMAML and Reptile) to image segmentation, present a novel neural network architecture built for fast learning which we call EfficientLab, and leverage a formal definition of the test error of meta-learning algorithms to decrease error on out of distribution tasks. We show state of the art results on the FSS-1000 dataset by m…
▽ More
We extend first-order model agnostic meta-learning algorithms (including FOMAML and Reptile) to image segmentation, present a novel neural network architecture built for fast learning which we call EfficientLab, and leverage a formal definition of the test error of meta-learning algorithms to decrease error on out of distribution tasks. We show state of the art results on the FSS-1000 dataset by meta-training EfficientLab with FOMAML and using Bayesian optimization to infer the optimal test-time adaptation routine hyperparameters. We also construct a small benchmark dataset, FP-k, for the empirical study of how meta-learning systems perform in both few- and many-shot settings. On the FP-k dataset, we show that meta-learned initializations provide value for canonical few-shot image segmentation but their performance is quickly matched by conventional transfer learning with performance being equal beyond 10 labeled examples. Our code, meta-learned model, and the FP-k dataset are available at https://github.com/ml4ai/mliis .
△ Less
Submitted 7 May, 2020; v1 submitted 12 December, 2019;
originally announced December 2019.
-
Inter-sentence Relation Extraction for Associating Biological Context with Events in Biomedical Texts
Authors:
Enrique Noriega-Atala,
Paul D. Hein,
Shraddha S. Thumsi,
Zechy Wong,
Xia Wang,
Clayton T. Morrison
Abstract:
We present an analysis of the problem of identifying biological context and associating it with biochemical events in biomedical texts. This constitutes a non-trivial, inter-sentential relation extraction task. We focus on biological context as descriptions of the species, tissue type and cell type that are associated with biochemical events. We describe the properties of an annotated corpus of co…
▽ More
We present an analysis of the problem of identifying biological context and associating it with biochemical events in biomedical texts. This constitutes a non-trivial, inter-sentential relation extraction task. We focus on biological context as descriptions of the species, tissue type and cell type that are associated with biochemical events. We describe the properties of an annotated corpus of context-event relations and present and evaluate several classifiers for context-event association trained on syntactic, distance and frequency features.
△ Less
Submitted 14 December, 2018;
originally announced December 2018.