-
Markov Brains: A Technical Introduction
Authors:
Arend Hintze,
Jeffrey A. Edlund,
Randal S. Olson,
David B. Knoester,
Jory Schossau,
Larissa Albantakis,
Ali Tehrani-Saleh,
Peter Kvam,
Leigh Sheneman,
Heather Goldsby,
Clifford Bohm,
Christoph Adami
Abstract:
Markov Brains are a class of evolvable artificial neural networks (ANN). They differ from conventional ANNs in many aspects, but the key difference is that instead of a layered architecture, with each node performing the same function, Markov Brains are networks built from individual computational components. These computational components interact with each other, receive inputs from sensors, and…
▽ More
Markov Brains are a class of evolvable artificial neural networks (ANN). They differ from conventional ANNs in many aspects, but the key difference is that instead of a layered architecture, with each node performing the same function, Markov Brains are networks built from individual computational components. These computational components interact with each other, receive inputs from sensors, and control motor outputs. The function of the computational components, their connections to each other, as well as connections to sensors and motors are all subject to evolutionary optimization. Here we describe in detail how a Markov Brain works, what techniques can be used to study them, and how they can be evolved.
△ Less
Submitted 16 September, 2017;
originally announced September 2017.
-
The Reasonable Effectiveness of Agent-Based Simulations in Evolutionary Game Theory
Authors:
Christoph Adami,
Jory Schossau,
Arend Hintze
Abstract:
This is a Reply to comments published in Physics of Life Reviews, on our article "Evolutionary game theory using agent-based methods" (Physics of Life Reviews, 2016, arXiv:1404.0994).
This is a Reply to comments published in Physics of Life Reviews, on our article "Evolutionary game theory using agent-based methods" (Physics of Life Reviews, 2016, arXiv:1404.0994).
△ Less
Submitted 12 November, 2016;
originally announced November 2016.
-
Information-theoretic neuro-correlates boost evolution of cognitive systems
Authors:
Jory Schossau,
Christoph Adami,
Arend Hintze
Abstract:
Genetic Algorithms (GA) are a powerful set of tools for search and optimization that mimic the process of natural selection, and have been used successfully in a wide variety of problems, including evolving neural networks to solve cognitive tasks. Despite their success, GAs sometimes fail to locate the highest peaks of the fitness landscape, in particular if the landscape is rugged and contains m…
▽ More
Genetic Algorithms (GA) are a powerful set of tools for search and optimization that mimic the process of natural selection, and have been used successfully in a wide variety of problems, including evolving neural networks to solve cognitive tasks. Despite their success, GAs sometimes fail to locate the highest peaks of the fitness landscape, in particular if the landscape is rugged and contains multiple peaks. Reaching distant and higher peaks is difficult because valleys need to be crossed, in a process that (at least temporarily) runs against the fitness maximization objective. Here we propose and test a number of information-theoretic (as well as network-based) measures that can be used in conjunction with a fitness maximization objective (so-called ``neuro-correlates") to evolve neural controllers for two widely different tasks: a behavioral task that requires information integration, and a cognitive task that requires memory and logic. We find that judiciously chosen neuro-correlates can significantly aid GAs to find the highest peaks.
△ Less
Submitted 25 November, 2015;
originally announced November 2015.
-
Computational evolution of decision-making strategies
Authors:
Peter Kvam,
Joseph Cesario,
Jory Schossau,
Heather Eisthen,
Arend Hintze
Abstract:
Most research on adaptive decision-making takes a strategy-first approach, proposing a method of solving a problem and then examining whether it can be implemented in the brain and in what environments it succeeds. We present a method for studying strategy development based on computational evolution that takes the opposite approach, allowing strategies to develop in response to the decision-makin…
▽ More
Most research on adaptive decision-making takes a strategy-first approach, proposing a method of solving a problem and then examining whether it can be implemented in the brain and in what environments it succeeds. We present a method for studying strategy development based on computational evolution that takes the opposite approach, allowing strategies to develop in response to the decision-making environment via Darwinian evolution. We apply this approach to a dynamic decision-making problem where artificial agents make decisions about the source of incoming information. In doing so, we show that the complexity of the brains and strategies of evolved agents are a function of the environment in which they develop. More difficult environments lead to larger brains and more information use, resulting in strategies resembling a sequential sampling approach. Less difficult environments drive evolution toward smaller brains and less information use, resulting in simpler heuristic-like strategies.
△ Less
Submitted 18 September, 2015;
originally announced September 2015.
-
Evolutionary game theory using agent-based methods
Authors:
Christoph Adami,
Jory Schossau,
Arend Hintze
Abstract:
Evolutionary game theory is a successful mathematical framework geared towards understanding the selective pressures that affect the evolution of the strategies of agents engaged in interactions with potential conflicts. While a mathematical treatment of the costs and benefits of decisions can predict the optimal strategy in simple settings, more realistic settings such as finite populations, non-…
▽ More
Evolutionary game theory is a successful mathematical framework geared towards understanding the selective pressures that affect the evolution of the strategies of agents engaged in interactions with potential conflicts. While a mathematical treatment of the costs and benefits of decisions can predict the optimal strategy in simple settings, more realistic settings such as finite populations, non-vanishing mutations rates, stochastic decisions, communication between agents, and spatial interactions, require agent-based methods where each agent is modeled as an individual, carries its own genes that determine its decisions, and where the evolutionary outcome can only be ascertained by evolving the population of agents forward in time. While highlighting standard mathematical results, we compare those to agent-based methods that can go beyond the limitations of equations and simulate the complexity of heterogeneous populations and an ever-changing set of interactors. We conclude that agent-based methods can predict evolutionary outcomes where purely mathematical treatments cannot tread (for example in the weak selection--strong mutation limit), but that mathematics is crucial to validate the computational simulations.
△ Less
Submitted 31 August, 2016; v1 submitted 3 April, 2014;
originally announced April 2014.
-
A genome wide dosage suppressor network reveals genetic robustness and a novel mechanism for Huntington's disease
Authors:
B. Patra,
Y. Kon,
G. Yadav,
A. W. Sevold,
J. P. Frumkin,
R. R. Vallabhajosyula,
A. Hintze,
B. Østman,
J. Schossau,
A. Bhan,
B. Marzolf,
J. K. Tamashiro,
A. Kaur,
N. S. Baliga,
E. J. Grayhack,
C. Adami,
D. J. Galas,
A. Raval,
E. M. Phizicky,
A. Ray
Abstract:
Mutational robustness is the extent to which an organism has evolved to withstand the effects of deleterious mutations. We explored the extent of mutational robustness in the budding yeast by genome wide dosage suppressor analysis of 53 conditional lethal mutations in cell division cycle and RNA synthesis related genes, revealing 660 suppressor interactions of which 642 are novel. This collection…
▽ More
Mutational robustness is the extent to which an organism has evolved to withstand the effects of deleterious mutations. We explored the extent of mutational robustness in the budding yeast by genome wide dosage suppressor analysis of 53 conditional lethal mutations in cell division cycle and RNA synthesis related genes, revealing 660 suppressor interactions of which 642 are novel. This collection has several distinctive features, including high co-occurrence of mutant-suppressor pairs within protein modules, highly correlated functions between the pairs, and higher diversity of functions among the co-suppressors than previously observed. Dosage suppression of essential genes encoding RNA polymerase subunits and chromosome cohesion complex suggest a surprising degree of functional plasticity of macromolecular complexes and the existence od degenerate pathways for circumventing potentially lethal mutations. The utility of dosage-suppressor networks is illustrated by the discovery of a novel connection between chromosome cohesion-condensation pathways involving homologous recombination, and Huntington's disease.
△ Less
Submitted 11 November, 2013;
originally announced November 2013.
-
Evolution and stability of altruist strategies in microbial games
Authors:
Christoph Adami,
Jory Schossau,
Arend Hintze
Abstract:
When microbes compete for limited resources, they often engage in chemical warfare using bacterial toxins. This competition can be understood in terms of evolutionary game theory (EGT). We study the predictions of EGT for the bacterial "suicide bomber" game in terms of the phase portraits of population dynamics, for parameter combinations that cover all interesting games for two-players, and seven…
▽ More
When microbes compete for limited resources, they often engage in chemical warfare using bacterial toxins. This competition can be understood in terms of evolutionary game theory (EGT). We study the predictions of EGT for the bacterial "suicide bomber" game in terms of the phase portraits of population dynamics, for parameter combinations that cover all interesting games for two-players, and seven of the 38 possible phase portraits of the three-player game. We compare these predictions to simulations of these competitions in finite well-mixed populations, but also allowing for probabilistic rather than pure strategies, as well as Darwinian adaptation over tens of thousands of generations. We find that Darwinian evolution of probabilistic strategies stabilizes games of the rock-paper-scissors type that emerge for parameters describing realistic bacterial populations, and point to ways in which the population fixed point can be selected by changing those parameters.
△ Less
Submitted 4 November, 2011; v1 submitted 1 December, 2010;
originally announced December 2010.
