-
On the potential for open-endedness in neural networks
Authors:
Nicholas Guttenberg,
Nathaniel Virgo,
Alexandra Penn
Abstract:
Natural evolution gives the impression of leading to an open-ended process of increasing diversity and complexity. If our goal is to produce such open-endedness artificially, this suggests an approach driven by evolutionary metaphor. On the other hand, techniques from machine learning and artificial intelligence are often considered too narrow to provide the sort of exploratory dynamics associated…
▽ More
Natural evolution gives the impression of leading to an open-ended process of increasing diversity and complexity. If our goal is to produce such open-endedness artificially, this suggests an approach driven by evolutionary metaphor. On the other hand, techniques from machine learning and artificial intelligence are often considered too narrow to provide the sort of exploratory dynamics associated with evolution. In this paper, we hope to bridge that gap by reviewing common barriers to open-endedness in the evolution-inspired approach and how they are dealt with in the evolutionary case - collapse of diversity, saturation of complexity, and failure to form new kinds of individuality. We then show how these problems map onto similar issues in the machine learning approach, and discuss how the same insights and solutions which alleviated those barriers in evolutionary approaches can be ported over. At the same time, the form these issues take in the machine learning formulation suggests new ways to analyze and resolve barriers to open-endedness. Ultimately, we hope to inspire researchers to be able to interchangeably use evolutionary and gradient-descent-based machine learning methods to approach the design and creation of open-ended systems.
△ Less
Submitted 12 December, 2018;
originally announced December 2018.
-
A Web-based Tool for Identifying Strategic Intervention Points in Complex Systems
Authors:
Sotiris Moschoyiannis,
Nicholas Elia,
Alexandra S. Penn,
David J. B. Lloyd,
Chris Knight
Abstract:
Steering a complex system towards a desired outcome is a challenging task. The lack of clarity on the system's exact architecture and the often scarce scientific data upon which to base the operationalisation of the dynamic rules that underpin the interactions between participant entities are two contributing factors. We describe an analytical approach that builds on Fuzzy Cognitive Mapping (FCM)…
▽ More
Steering a complex system towards a desired outcome is a challenging task. The lack of clarity on the system's exact architecture and the often scarce scientific data upon which to base the operationalisation of the dynamic rules that underpin the interactions between participant entities are two contributing factors. We describe an analytical approach that builds on Fuzzy Cognitive Mapping (FCM) to address the latter and represent the system as a complex network. We apply results from network controllability to address the former and determine minimal control configurations - subsets of factors, or system levers, which comprise points for strategic intervention in steering the system. We have implemented the combination of these techniques in an analytical tool that runs in the browser, and generates all minimal control configurations of a complex network. We demonstrate our approach by reporting on our experience of working alongside industrial, local-government, and NGO stakeholders in the Humber region, UK. Our results are applied to the decision-making process involved in the transition of the region to a bio-based economy.
△ Less
Submitted 1 August, 2016;
originally announced August 2016.
-
The concurrent evolution of cooperation and the population structures that support it
Authors:
Simon T. Powers,
Alexandra S. Penn,
Richard A. Watson
Abstract:
The evolution of cooperation often depends upon population structure, yet nearly all models of cooperation implicitly assume that this structure remains static. This is a simplifying assumption, because most organisms possess genetic traits that affect their population structure to some degree. These traits, such as a group size preference, affect the relatedness of interacting individuals and hen…
▽ More
The evolution of cooperation often depends upon population structure, yet nearly all models of cooperation implicitly assume that this structure remains static. This is a simplifying assumption, because most organisms possess genetic traits that affect their population structure to some degree. These traits, such as a group size preference, affect the relatedness of interacting individuals and hence the opportunity for kin or group selection. We argue that models that do not explicitly consider their evolution cannot provide a satisfactory account of the origin of cooperation, because they cannot explain how the prerequisite population structures arise. Here, we consider the concurrent evolution of genetic traits that affect population structure, with those that affect social behavior. We show that not only does population structure drive social evolution, as in previous models, but that the opportunity for cooperation can in turn drive the creation of population structures that support it. This occurs through the generation of linkage disequilibrium between socio-behavioral and population-structuring traits, such that direct kin selection on social behavior creates indirect selection pressure on population structure. We illustrate our argument with a model of the concurrent evolution of group size preference and social behavior.
△ Less
Submitted 2 August, 2012;
originally announced August 2012.
-
Discovering shared and individual latent structure in multiple time series
Authors:
Suchi Saria,
Daphne Koller,
Anna Penn
Abstract:
This paper proposes a nonparametric Bayesian method for exploratory data analysis and feature construction in continuous time series. Our method focuses on understanding shared features in a set of time series that exhibit significant individual variability. Our method builds on the framework of latent Diricihlet allocation (LDA) and its extension to hierarchical Dirichlet processes, which allows…
▽ More
This paper proposes a nonparametric Bayesian method for exploratory data analysis and feature construction in continuous time series. Our method focuses on understanding shared features in a set of time series that exhibit significant individual variability. Our method builds on the framework of latent Diricihlet allocation (LDA) and its extension to hierarchical Dirichlet processes, which allows us to characterize each series as switching between latent ``topics'', where each topic is characterized as a distribution over ``words'' that specify the series dynamics. However, unlike standard applications of LDA, we discover the words as we learn the model. We apply this model to the task of tracking the physiological signals of premature infants; our model obtains clinically significant insights as well as useful features for supervised learning tasks.
△ Less
Submitted 11 August, 2010;
originally announced August 2010.
-
Brief encounter networks
Authors:
Vassilis Kostakos,
Eamonn O'Neill,
Alan Penn
Abstract:
Many complex human and natural phenomena can usefully be represented as networks describing the relationships between individuals. While these relationships are typically intermittent, previous research has used network representations that aggregate the relationships at discrete intervals. However, such an aggregation discards important temporal information, thus inhibiting our understanding of…
▽ More
Many complex human and natural phenomena can usefully be represented as networks describing the relationships between individuals. While these relationships are typically intermittent, previous research has used network representations that aggregate the relationships at discrete intervals. However, such an aggregation discards important temporal information, thus inhibiting our understanding of the networks dynamic behaviour and evolution. We have recorded patterns of human urban encounter using Bluetooth technology thus retaining the temporal properties of this network. Here we show how this temporal information influences the structural properties of the network. We show that the temporal properties of human urban encounter are scale-free, leading to an overwhelming proportion of brief encounters between individuals. While previous research has shown preferential attachment to result in scale-free connectivity in aggregated network data, we found that scale-free connectivity results from the temporal properties of the network. In addition, we show that brief encounters act as weak social ties in the diffusion of non-expiring information, yet persistent encounters provide the means for sustaining time-expiring information through a network.
△ Less
Submitted 3 September, 2007;
originally announced September 2007.
