-
Sparse Super-Regular Networks
Authors:
Andrew W. E. McDonald,
Ali Shokoufandeh
Abstract:
It has been argued by Thom and Palm that sparsely-connected neural networks (SCNs) show improved performance over fully-connected networks (FCNs). Super-regular networks (SRNs) are neural networks composed of a set of stacked sparse layers of (epsilon, delta)-super-regular pairs, and randomly permuted node order. Using the Blow-up Lemma, we prove that as a result of the individual super-regularity…
▽ More
It has been argued by Thom and Palm that sparsely-connected neural networks (SCNs) show improved performance over fully-connected networks (FCNs). Super-regular networks (SRNs) are neural networks composed of a set of stacked sparse layers of (epsilon, delta)-super-regular pairs, and randomly permuted node order. Using the Blow-up Lemma, we prove that as a result of the individual super-regularity of each pair of layers, SRNs guarantee a number of properties that make them suitable replacements for FCNs for many tasks. These guarantees include edge uniformity across all large-enough subsets, minimum node in- and out-degree, input-output sensitivity, and the ability to embed pre-trained constructs. Indeed, SRNs have the capacity to act like FCNs, and eliminate the need for costly regularization schemes like Dropout. We show that SRNs perform similarly to X-Nets via readily reproducible experiments, and offer far greater guarantees and control over network structure.
△ Less
Submitted 4 January, 2022;
originally announced January 2022.
-
Ortus: an Emotion-Driven Approach to (artificial) Biological Intelligence
Authors:
Andrew W. E. McDonald,
Sean Grimes,
David E. Breen
Abstract:
Ortus is a simple virtual organism that also serves as an initial framework for investigating and developing biologically-based artificial intelligence. Born from a goal to create complex virtual intelligence and an initial attempt to model C. elegans, Ortus implements a number of mechanisms observed in organic nervous systems, and attempts to fill in unknowns based upon plausible biological imple…
▽ More
Ortus is a simple virtual organism that also serves as an initial framework for investigating and developing biologically-based artificial intelligence. Born from a goal to create complex virtual intelligence and an initial attempt to model C. elegans, Ortus implements a number of mechanisms observed in organic nervous systems, and attempts to fill in unknowns based upon plausible biological implementations and psychological observations. Implemented mechanisms include excitatory and inhibitory chemical synapses, bidirectional gap junctions, and Hebbian learning with its Stentian extension. We present an initial experiment that showcases Ortus' fundamental principles; specifically, a cyclic respiratory circuit, and emotionally-driven associative learning with respect to an input stimulus. Finally, we discuss the implications and future directions for Ortus and similar systems.
△ Less
Submitted 16 February, 2021; v1 submitted 11 August, 2020;
originally announced August 2020.
-
Directing Chemotaxis-Based Spatial Self-Organization via Biased, Random Initial Conditions
Authors:
Sean Grimes,
Linge Bai,
Andrew W. E. McDonald,
David E. Breen
Abstract:
Inspired by the chemotaxis interaction of living cells, we have developed an agent-based approach for self-organizing shape formation. Since all our simulations begin with a different uniform random configuration and our agents move stochastically, it has been observed that the self-organization process may form two or more stable final configurations. These differing configurations may be charact…
▽ More
Inspired by the chemotaxis interaction of living cells, we have developed an agent-based approach for self-organizing shape formation. Since all our simulations begin with a different uniform random configuration and our agents move stochastically, it has been observed that the self-organization process may form two or more stable final configurations. These differing configurations may be characterized via statistical moments of the agents' locations. In order to direct the agents to robustly form one specific configuration, we generate biased initial conditions whose statistical moments are related to moments of the desired configuration. With this approach, we are able to successfully direct the aggregating swarms to produced a desired macroscopic shape, starting from randomized initial conditions with controlled statistical properties.
△ Less
Submitted 9 March, 2018;
originally announced March 2018.
-
khmer: Working with Big Data in Bioinformatics
Authors:
Eric McDonald,
C. Titus Brown
Abstract:
We introduce design and optimization considerations for the 'khmer' package.
We introduce design and optimization considerations for the 'khmer' package.
△ Less
Submitted 9 March, 2013;
originally announced March 2013.
