-
Optimal input reverberation and homeostatic self-organization towards the edge of synchronization
Authors:
Sue L. Rhâmidda,
Mauricio Girardi-Schappo,
Osame Kinouchi
Abstract:
Transient or partial synchronization can be used to do computations, although a fully synchronized network is frequently related to epileptic seizures. Here, we propose a homeostatic mechanism that is capable of maintaining a neuronal network at the edge of a synchronization transition, thereby avoiding the harmful consequences of a fully synchronized network. We model neurons by maps since they a…
▽ More
Transient or partial synchronization can be used to do computations, although a fully synchronized network is frequently related to epileptic seizures. Here, we propose a homeostatic mechanism that is capable of maintaining a neuronal network at the edge of a synchronization transition, thereby avoiding the harmful consequences of a fully synchronized network. We model neurons by maps since they are dynamically richer than integrate-and-fire models and more computationally efficient than conductance-based approaches. We first describe the synchronization phase transition of a dense network of neurons with different tonic spiking frequencies coupled by gap junctions. We show that at the transition critical point, inputs optimally reverberate through the network activity through transient synchronization. Then, we introduce a local homeostatic dynamic in the synaptic coupling and show that it produces a robust self-organization toward the edge of this phase transition. We discuss the potential biological consequences of this self-organization process, such as its relation to the Brain Criticality hypothesis, its input processing capacity, and how its malfunction could lead to pathological synchronization.
△ Less
Submitted 20 May, 2024; v1 submitted 7 February, 2024;
originally announced February 2024.
-
Less is different: why sparse networks with inhibition differ from complete graphs
Authors:
Gustavo Menesse,
Osame Kinouchi
Abstract:
In neuronal systems, inhibition contributes to stabilizing dynamics and regulating pattern formation. Through developing mean field theories of neuronal models, using complete graph networks, inhibition is commonly viewed as one ``control parameter'' of the system, promoting an absorbing phase transition. Here, we show that for low connectivity sparse networks, inhibition weight is not a control p…
▽ More
In neuronal systems, inhibition contributes to stabilizing dynamics and regulating pattern formation. Through developing mean field theories of neuronal models, using complete graph networks, inhibition is commonly viewed as one ``control parameter'' of the system, promoting an absorbing phase transition. Here, we show that for low connectivity sparse networks, inhibition weight is not a control parameter of the transition. We present analytical and simulation results using generic stochastic integrate-and-fire neurons that, under specific restrictions, become other simpler stochastic neuron models common in literature, which allow us to show that our results are valid for those models as well. We also give a simple explanation about why the inhibition role depends on topology, even when the topology has a dimensionality greater than the critical one. The absorbing transition independence of the inhibitory weight may be an important feature of a sparse network, as it will allow the network to maintain a near-critical regime, self-tuning average excitation, but at the same time, have the freedom to adjust inhibitory weights for computation, learning, and memory, exploiting the benefits of criticality.
△ Less
Submitted 30 June, 2023; v1 submitted 15 February, 2023;
originally announced February 2023.
-
Homeostatic Criticality in Neuronal Networks
Authors:
Gustavo Menesse,
Bóris Marin,
Mauricio Girardi-Schappo,
Osame Kinouchi
Abstract:
In self-organized criticality (SOC) models, as well as in standard phase transitions, criticality is only present for vanishing external fields $h \to 0$. Considering that this is rarely the case for natural systems, such a restriction poses a challenge to the explanatory power of these models. Besides that, in models of dissipative systems like earthquakes, forest fires, and neuronal networks, th…
▽ More
In self-organized criticality (SOC) models, as well as in standard phase transitions, criticality is only present for vanishing external fields $h \to 0$. Considering that this is rarely the case for natural systems, such a restriction poses a challenge to the explanatory power of these models. Besides that, in models of dissipative systems like earthquakes, forest fires, and neuronal networks, there is no true critical behavior, as expressed in clean power laws obeying finite-size scaling, but a scenario called "dirty" criticality or self-organized quasi-criticality (SOqC). Here, we propose simple homeostatic mechanisms which promote self-organization of coupling strengths, gains, and firing thresholds in neuronal networks. We show that with an adequate separation of the timescales for the coupling strength and firing threshold dynamics, near criticality (SOqC) can be reached and sustained even in the presence of significant external input. The firing thresholds adapt to and cancel the inputs ($h$ decreases towards zero). Similar mechanisms can be proposed for the couplings and local thresholds in spin systems and cellular automata, which could lead to applications in earthquake, forest fire, stellar flare, voting, and epidemic modeling.
△ Less
Submitted 3 February, 2022; v1 submitted 6 September, 2021;
originally announced September 2021.
-
Mechanisms of self-organized quasicriticality in neuronal networks models
Authors:
Osame Kinouchi,
Renata Pazzini,
Mauro Copelli
Abstract:
The critical brain hypothesis states that there are information processing advantages for neuronal networks working close to the critical region of a phase transition. If this is true, we must ask how the networks achieve and maintain this critical state. Here we review several proposed biological mechanisms that turn the critical region into an attractor of a dynamics in network parameters like s…
▽ More
The critical brain hypothesis states that there are information processing advantages for neuronal networks working close to the critical region of a phase transition. If this is true, we must ask how the networks achieve and maintain this critical state. Here we review several proposed biological mechanisms that turn the critical region into an attractor of a dynamics in network parameters like synapses, neuronal gains and firing thresholds. Since neuronal networks (biological and models) are nonconservative but dissipative, we expect not exact criticality but self-organized quasicriticality (SOqC), where the system hovers around the critical point.
△ Less
Submitted 20 October, 2020;
originally announced October 2020.
-
Physics of Psychophysics: two coupled square lattices of spiking neurons have huge dynamic range at criticality
Authors:
Emilio F. Galera,
Osame Kinouchi
Abstract:
Psychophysics try to relate physical input magnitudes to psychological or neural correlates. Microscopic models to account for macroscopic psychophysical laws, in the sense of statistical physics, are an almost unexplored area. Here we examine a sensory epithelium composed of two connected square lattices of stochastic integrate-and-fire cells. With one square lattice we obtain a Stevens's law…
▽ More
Psychophysics try to relate physical input magnitudes to psychological or neural correlates. Microscopic models to account for macroscopic psychophysical laws, in the sense of statistical physics, are an almost unexplored area. Here we examine a sensory epithelium composed of two connected square lattices of stochastic integrate-and-fire cells. With one square lattice we obtain a Stevens's law $ρ\propto h^m$ with Stevens's exponent $m = 0.254$ and a sigmoidal saturation, where $ρ$ is the neuronal network activity and $h$ is the input intensity (external field). We relate Stevens's power law exponent with the field critical exponent as $m = 1/δ_h = β/σ$. We also show that this system pertains to the Directed Percolation (DP) universality class (or perhaps the Compact-DP class). With stacked two layers of square lattices, and a fraction of connectivity between the first and second layer, we obtain at the output layer $ρ_ 2 \propto h^{m_2}$, with $m_2 = 0.08 \approx m^2$, which corresponds to a huge dynamic range. This enhancement of the dynamic range only occurs when the layers are close to their critical point.
△ Less
Submitted 18 June, 2020;
originally announced June 2020.
-
Synaptic balance due to homeostatically self-organized quasicritical dynamics
Authors:
Mauricio Girardi-Schappo,
Ludmila Brochini,
Ariadne A. Costa,
Tawan T. A. Carvalho,
Osame Kinouchi
Abstract:
Recent experiments suggested that homeostatic regulation of synaptic balance leads the visual system to recover and maintain a regime of power-law avalanches. Here we study an excitatory/inhibitory (E/I) mean-field neuronal network that has a critical point with power-law avalanches and synaptic balance. When short term depression in inhibitory synapses and firing threshold adaptation are added, t…
▽ More
Recent experiments suggested that homeostatic regulation of synaptic balance leads the visual system to recover and maintain a regime of power-law avalanches. Here we study an excitatory/inhibitory (E/I) mean-field neuronal network that has a critical point with power-law avalanches and synaptic balance. When short term depression in inhibitory synapses and firing threshold adaptation are added, the system hovers around the critical point. This homeostatically self-organized quasi-critical (SOqC) dynamics generates E/I synaptic current cancellation in fast time scales, causing fluctuation-driven asynchronous-irregular (AI) firing. We present the full phase diagram of the model without adaptation varying external input versus synaptic coupling. This system has a rich dynamical repertoire of spiking patterns: synchronous regular (SR), asynchronous regular (AR), synchronous irregular (SI), slow oscillations (SO) and AI. It also presents dynamic balance of synaptic currents, since inhibitory currents try and compensate excitatory currents over time, resulting in both of them scaling linearly with external input. Our model thus unifies two different perspectives on cortical spontaneous activity: both critical avalanches and fluctuation-driven AI firing arise from SOqC homeostatic adaptation, and are indeed two sides of the same coin.
△ Less
Submitted 20 February, 2020;
originally announced February 2020.
-
Citation network centrality: a scientific awards predictor?
Authors:
Osame Kinouchi,
Adriano J. Holanda,
George C. Cardoso
Abstract:
The $K$-index is an easily computable centrality index in complex networks, such as a scientific citations network. A researcher has a $K$-index equal to $K$ if he or she is cited by $K$ articles that have at least $K$ citations. The $K$-index has several advantages over Hirsh's $h$-index and, in previous studies, has shown better correlation with Nobel prizes than any other index given by the {\e…
▽ More
The $K$-index is an easily computable centrality index in complex networks, such as a scientific citations network. A researcher has a $K$-index equal to $K$ if he or she is cited by $K$ articles that have at least $K$ citations. The $K$-index has several advantages over Hirsh's $h$-index and, in previous studies, has shown better correlation with Nobel prizes than any other index given by the {\em Web of Science}, including the $h$-index. It is plausible that researchers who are the most connected to other scientifically well-connected researchers are the most likely to be doing important work and more likely to be awarded major prizes in a given area. However, the correlation found does not imply causation. Here we perform an experiment using the $K$-index, producing a shortlist of twelve candidates for major scientific prizes, including the Physics Nobel award, in the near future. For example, our top-12 $K$-index list naturally selects the 2019 Nobel laureate, James Peebles. The list can be updated annually and should be compared to laureates of the following years
△ Less
Submitted 18 October, 2019; v1 submitted 6 October, 2019;
originally announced October 2019.
-
Nonsynchronous updating in the multiverse of cellular automata
Authors:
Sandro M. Reia,
Osame Kinouchi
Abstract:
In this paper we study updating effects on cellular automata rule space. We consider a subset of 6144 order-3 automata from the space of 262144 bi-dimensional outer-totalistic rules. We compare synchronous to asynchronous and sequential updatings. Focusing on two automata, we discuss how update changes destroy typical structures of these rules. Besides, we show that the first-order phase-transitio…
▽ More
In this paper we study updating effects on cellular automata rule space. We consider a subset of 6144 order-3 automata from the space of 262144 bi-dimensional outer-totalistic rules. We compare synchronous to asynchronous and sequential updatings. Focusing on two automata, we discuss how update changes destroy typical structures of these rules. Besides, we show that the first-order phase-transition in the multiverse of synchronous cellular automata, revealed with the use of a recently introduced control parameter, seems to be robust not only to changes in update schema but also to different initial densities.
△ Less
Submitted 4 March, 2015;
originally announced March 2015.
-
Conway's game of life is a near-critical metastable state in the multiverse of cellular automata
Authors:
Sandro Martinelli Reia,
Osame Kinouchi
Abstract:
Conway's cellular automaton Game of LIFE has been conjectured to be a critical (or quasicritical) dynamical system. This criticality is generally seen as a continuous order-disorder transition in cellular automata (CA) rule space. LIFE's mean-field return map predicts an absorbing vacuum phase ($ρ=0$) and an active phase density, with $ρ=0.37$, which contrasts with LIFE's absorbing states in a squ…
▽ More
Conway's cellular automaton Game of LIFE has been conjectured to be a critical (or quasicritical) dynamical system. This criticality is generally seen as a continuous order-disorder transition in cellular automata (CA) rule space. LIFE's mean-field return map predicts an absorbing vacuum phase ($ρ=0$) and an active phase density, with $ρ=0.37$, which contrasts with LIFE's absorbing states in a square lattice, which have a stationary density $ρ_{2D} \approx 0.03$. Here, we study and classify mean-field maps for $6144$ outer-totalistic CA and compare them with the corresponding behavior found in the square lattice. We show that the single-site mean-field approach gives qualitative (and even quantitative) predictions for most of them. The transition region in rule space seems to correspond to a nonequilibrium discontinuous absorbing phase transition instead of a continuous order-disorder one. We claim that LIFE is a quasicritical nucleation process where vacuum phase domains invade the alive phase. Therefore, LIFE is not at the "border of chaos," but thrives on the "border of extinction."
△ Less
Submitted 3 July, 2014;
originally announced July 2014.
-
Can dynamical synapses produce true self-organized criticality?
Authors:
Ariadne de A. Costa,
Mauro Copelli,
Osame Kinouchi
Abstract:
Neuronal networks can present activity described by power-law distributed avalanches presumed to be a signature of a critical state. Here we study a random-neighbor network of excitable cellular automata coupled by dynamical synapses. The model exhibits a very similar to conservative self-organized criticality (SOC) models behavior even with dissipative bulk dynamics. This occurs because in the st…
▽ More
Neuronal networks can present activity described by power-law distributed avalanches presumed to be a signature of a critical state. Here we study a random-neighbor network of excitable cellular automata coupled by dynamical synapses. The model exhibits a very similar to conservative self-organized criticality (SOC) models behavior even with dissipative bulk dynamics. This occurs because in the stationary regime the model is conservative on average, and, in the thermodynamic limit, the probability distribution for the global branching ratio converges to a delta-function centered at its critical value. So, this non-conservative model pertain to the same universality class of conservative SOC models and contrasts with other dynamical synapses models that present only self-organized quasi-criticality (SOqC). Analytical results show very good agreement with simulations of the model and enable us to study the emergence of SOC as a function of the parametric derivatives of the stationary branching ratio.
△ Less
Submitted 18 July, 2015; v1 submitted 29 May, 2014;
originally announced May 2014.
-
Single-Neuron Criticality Optimizes Analog Dendritic Computation
Authors:
Leonardo L. Gollo,
Osame Kinouchi,
Mauro Copelli
Abstract:
Neurons are thought of as the building blocks of excitable brain tissue. However, at the single neuron level, the neuronal membrane, the dendritic arbor and the axonal projections can also be considered an extended active medium. Active dendritic branchlets enable the propagation of dendritic spikes, whose computational functions, despite several proposals, remain an open question. Here we propose…
▽ More
Neurons are thought of as the building blocks of excitable brain tissue. However, at the single neuron level, the neuronal membrane, the dendritic arbor and the axonal projections can also be considered an extended active medium. Active dendritic branchlets enable the propagation of dendritic spikes, whose computational functions, despite several proposals, remain an open question. Here we propose a concrete function to the active channels in large dendritic trees. By using a probabilistic cellular automaton approach, we model the input-output response of large active dendritic arbors subjected to complex spatio-temporal inputs and exhibiting non-stereotyped dendritic spikes. We find that, if dendritic spikes have a non-deterministic duration, the dendritic arbor can undergo a continuous phase transition from a quiescent to an active state, thereby exhibiting spontaneous and self-sustained localized activity as suggested by experiments. Analogously to the critical brain hypothesis, which states that neuronal networks self-organize near a phase transition to take advantage of specific properties of the critical state, here we propose that neurons with large dendritic arbors optimize their capacity to distinguish incoming stimuli at the critical state. We suggest that "computation at the edge of a phase transition" is more compatible with the view that dendritic arbors perform an analog rather than a digital dendritic computation.
△ Less
Submitted 22 November, 2013; v1 submitted 16 April, 2013;
originally announced April 2013.
-
A Brief History of Excitable Map-Based Neurons and Neural Networks
Authors:
M. Girardi-Schappo,
M. H. R. Tragtenberg,
O. Kinouchi
Abstract:
This review gives a short historical account of the excitable maps approach for modeling neurons and neuronal networks. Some early models, due to Pasemann (1993), Chialvo (1995) and Kinouchi and Tragtenberg (1996), are compared with more recent proposals by Rulkov (2002) and Izhikevich (2003). We also review map-based schemes for electrical and chemical synapses and some recent findings as critica…
▽ More
This review gives a short historical account of the excitable maps approach for modeling neurons and neuronal networks. Some early models, due to Pasemann (1993), Chialvo (1995) and Kinouchi and Tragtenberg (1996), are compared with more recent proposals by Rulkov (2002) and Izhikevich (2003). We also review map-based schemes for electrical and chemical synapses and some recent findings as critical avalanches in map-based neural networks. We conclude with suggestions for further work in this area like more efficient maps, compartmental modeling and close dynamical comparison with conductance-based models.
△ Less
Submitted 1 March, 2013;
originally announced March 2013.
-
Critical Avalanches and Subsampling in Map-based Neural Networks
Authors:
Mauricio Girardi-Schappo,
Osame Kinouchi,
Marcelo H. R. Tragtenberg
Abstract:
We investigate the synaptic noise as a novel mechanism for creating critical avalanches in the activity of neural networks. We model neurons and chemical synapses by dynamical maps with a uniform noise term in the synaptic coupling. An advantage of utilizing maps is that the dynamical properties (action potential profile, excitability properties, post synaptic potential summation etc.) are not imp…
▽ More
We investigate the synaptic noise as a novel mechanism for creating critical avalanches in the activity of neural networks. We model neurons and chemical synapses by dynamical maps with a uniform noise term in the synaptic coupling. An advantage of utilizing maps is that the dynamical properties (action potential profile, excitability properties, post synaptic potential summation etc.) are not imposed to the system, but occur naturally by solving the system equations. We discuss the relevant neuronal and synaptic properties to achieve the critical state. We verify that networks of excitatory by rebound neurons with fast synapses present power law avalanches. We also discuss the measuring of neuronal avalanches by subsampling our data, shedding light on the experimental search for Self-Organized Criticality in neural networks.
△ Less
Submitted 11 February, 2013; v1 submitted 14 September, 2012;
originally announced September 2012.
-
Statistical Physics approach to dendritic computation: The excitable-wave mean-field approximation
Authors:
Leonardo L. Gollo,
Osame Kinouchi,
Mauro Copelli
Abstract:
We analytically study the input-output properties of a neuron whose active dendritic tree, modeled as a Cayley tree of excitable elements, is subjected to Poisson stimulus. Both single-site and two-site mean-field approximations incorrectly predict a non-equilibrium phase transition which is not allowed in the model. We propose an excitable-wave mean-field approximation which shows good agreement…
▽ More
We analytically study the input-output properties of a neuron whose active dendritic tree, modeled as a Cayley tree of excitable elements, is subjected to Poisson stimulus. Both single-site and two-site mean-field approximations incorrectly predict a non-equilibrium phase transition which is not allowed in the model. We propose an excitable-wave mean-field approximation which shows good agreement with previously published simulation results [Gollo et al., PLoS Comput. Biol. 5(6) e1000402 (2009)] and accounts for finite-size effects. We also discuss the relevance of our results to experiments in neuroscience, emphasizing the role of active dendrites in the enhancement of dynamic range and in gain control modulation.
△ Less
Submitted 13 January, 2012; v1 submitted 9 September, 2011;
originally announced September 2011.
-
Hirsch index as a network centrality measure
Authors:
Monica G. Campiteli,
Adriano J. Holanda,
Paulo R. C. Soles,
Leonardo H. D. Soares,
Osame Kinouchi
Abstract:
We study the h Hirsch index as a local node centrality measure for complex networks in general. The h index is compared with the Degree centrality (a local measure), the Betweenness and Eigenvector centralities (two non-local measures) in the case of a biological network (Yeast interaction protein-protein network) and a linguistic network (Moby Thesaurus II) as test environments. In both networks,…
▽ More
We study the h Hirsch index as a local node centrality measure for complex networks in general. The h index is compared with the Degree centrality (a local measure), the Betweenness and Eigenvector centralities (two non-local measures) in the case of a biological network (Yeast interaction protein-protein network) and a linguistic network (Moby Thesaurus II) as test environments. In both networks, the Hirsch index has poor correlation with Betweenness centrality but correlates well with Eigenvector centrality, specially for the more important nodes that are relevant for ranking purposes, say in Search Machine Optimization. In the thesaurus network, the h index seems even to outperform the Eigenvector centrality measure as evaluated by simple linguistic criteria.
△ Less
Submitted 27 June, 2010; v1 submitted 26 May, 2010;
originally announced May 2010.
-
Optimal Dynamical Range of Excitable Networks at Criticality
Authors:
Osame Kinouchi,
Mauro Copelli
Abstract:
A recurrent idea in the study of complex systems is that optimal information processing is to be found near bifurcation points or phase transitions. However, this heuristic hypothesis has few (if any) concrete realizations where a standard and biologically relevant quantity is optimized at criticality. Here we give a clear example of such a phenomenon: a network of excitable elements has its sen…
▽ More
A recurrent idea in the study of complex systems is that optimal information processing is to be found near bifurcation points or phase transitions. However, this heuristic hypothesis has few (if any) concrete realizations where a standard and biologically relevant quantity is optimized at criticality. Here we give a clear example of such a phenomenon: a network of excitable elements has its sensitivity and dynamic range maximized at the critical point of a non-equilibrium phase transition. Our results are compatible with the essential role of gap junctions in olfactory glomeruli and retinal ganglionar cell output. Synchronization and global oscillations also appear in the network dynamics. We propose that the main functional role of electrical coupling is to provide an enhancement of dynamic range, therefore allowing the coding of information spanning several orders of magnitude. The mechanism could provide a microscopic neural basis for psychophysical laws.
△ Less
Submitted 15 May, 2007; v1 submitted 23 January, 2006;
originally announced January 2006.
-
Intensity Coding in Two-Dimensional Excitable Neural Networks
Authors:
Mauro Copelli,
Osame Kinouchi
Abstract:
In the light of recent experimental findings that gap junctions are essential for low level intensity detection in the sensory periphery, the Greenberg-Hastings cellular automaton is employed to model the response of a two-dimensional sensory network to external stimuli. We show that excitable elements (sensory neurons) that have a small dynamical range are shown to give rise to a collective lar…
▽ More
In the light of recent experimental findings that gap junctions are essential for low level intensity detection in the sensory periphery, the Greenberg-Hastings cellular automaton is employed to model the response of a two-dimensional sensory network to external stimuli. We show that excitable elements (sensory neurons) that have a small dynamical range are shown to give rise to a collective large dynamical range. Therefore the network transfer (gain) function (which is Hill or Stevens law-like) is an emergent property generated from a pool of small dynamical range cells, providing a basis for a "neural psychophysics". The growth of the dynamical range with the system size is approximately logarithmic, suggesting a functional role for electrical coupling. For a fixed number of neurons, the dynamical range displays a maximum as a function of the refractory period, which suggests experimental tests for the model. A biological application to ephaptic interactions in olfactory nerve fascicles is proposed.
△ Less
Submitted 28 September, 2004;
originally announced September 2004.
-
Stability diagrams for bursting neurons modeled by three-variable maps
Authors:
M. Copelli,
M. H. R. Tragtenberg,
O. Kinouchi
Abstract:
We study a simple map as a minimal model of excitable cells. The map has two fast variables which mimic the behavior of class I neurons, undergoing a sub-critical Hopf bifurcation. Adding a third slow variable allows the system to present bursts and other interesting biological behaviors. Bifurcation lines which locate the excitability region are obtained for different planes in parameter space.
We study a simple map as a minimal model of excitable cells. The map has two fast variables which mimic the behavior of class I neurons, undergoing a sub-critical Hopf bifurcation. Adding a third slow variable allows the system to present bursts and other interesting biological behaviors. Bifurcation lines which locate the excitability region are obtained for different planes in parameter space.
△ Less
Submitted 13 February, 2004;
originally announced February 2004.
-
Thesaurus as a complex network
Authors:
Adriano de Jesus Holanda,
Ivan Torres Pisa,
Osame Kinouchi,
Alexandre Souto Martinez,
Evandro Eduardo Seron Ruiz
Abstract:
A thesaurus is one, out of many, possible representations of term (or word) connectivity. The terms of a thesaurus are seen as the nodes and their relationship as the links of a directed graph. The directionality of the links retains all the thesaurus information and allows the measurement of several quantities. This has lead to a new term classification according to the characteristics of the n…
▽ More
A thesaurus is one, out of many, possible representations of term (or word) connectivity. The terms of a thesaurus are seen as the nodes and their relationship as the links of a directed graph. The directionality of the links retains all the thesaurus information and allows the measurement of several quantities. This has lead to a new term classification according to the characteristics of the nodes, for example, nodes with no links in, no links out, etc. Using an electronic available thesaurus we have obtained the incoming and outgoing link distributions. While the incoming link distribution follows a stretched exponential function, the lower bound for the outgoing link distribution has the same envelope of the scientific paper citation distribution proposed by Albuquerque and Tsallis. However, a better fit is obtained by simpler function which is the solution of Ricatti's differential equation. We conjecture that this differential equation is the continuous limit of a stochastic growth model of the thesaurus network. We also propose a new manner to arrange a thesaurus using the ``inversion method''.
△ Less
Submitted 22 December, 2003;
originally announced December 2003.
-
Escaping from cycles through a glass transition
Authors:
Sebastian Risau-Gusman,
Alexandre S. Martinez,
Osame Kinouchi
Abstract:
A random walk is performed over a disordered media composed of $N$ sites random and uniformly distributed inside a $d$-dimensional hypercube. The walker cannot remain in the same site and hops to one of its $n$ neighboring sites with a transition probability that depends on the distance $D$ between sites according to a cost function $E(D)$. The stochasticity level is parametrized by a formal tem…
▽ More
A random walk is performed over a disordered media composed of $N$ sites random and uniformly distributed inside a $d$-dimensional hypercube. The walker cannot remain in the same site and hops to one of its $n$ neighboring sites with a transition probability that depends on the distance $D$ between sites according to a cost function $E(D)$. The stochasticity level is parametrized by a formal temperature $T$. In the case $T = 0$, the walk is deterministic and ergodicity is broken: the phase space is divided in a ${\cal O}(N)$ number of attractor basins of two-cycles that trap the walker. For $d = 1$, analytic results indicate the existence of a glass transition at $T_1 = 1/2$ as $N \to \infty$. Below $T_1$, the average trapping time in two-cycles diverges and out-of-equilibrium behavior appears. Similar glass transitions occur in higher dimensions choosing a proper cost function. We also present some results for the statistics of distances for Poisson spatial point processes.
△ Less
Submitted 13 March, 2003; v1 submitted 10 January, 2003;
originally announced January 2003.
-
Exploratory Behavior, Trap Models and Glass Transitions
Authors:
Alexandre S. Martinez,
Osame Kinouchi,
Sebastian Risau-Gusman
Abstract:
A random walk is performed on a disordered landscape composed of $N$ sites randomly and uniformly distributed inside a $d$-dimensional hypercube. The walker hops from one site to another with probability proportional to $\exp [- βE(D)]$, where $β= 1/T$ is the inverse of a formal temperature and $E(D)$ is an arbitrary cost function which depends on the hop distance $D$. Analytic results indicate…
▽ More
A random walk is performed on a disordered landscape composed of $N$ sites randomly and uniformly distributed inside a $d$-dimensional hypercube. The walker hops from one site to another with probability proportional to $\exp [- βE(D)]$, where $β= 1/T$ is the inverse of a formal temperature and $E(D)$ is an arbitrary cost function which depends on the hop distance $D$. Analytic results indicate that, if $E(D) = D^{d}$ and $N \to \infty$, there exists a glass transition at $β_d = π^{d/2}/Γ(d/2 + 1)$. Below $T_d$, the average trapping time diverges and the system falls into an out-of-equilibrium regime with aging phenomena. A Lévy flight scenario and applications to exploratory behavior are considered.
△ Less
Submitted 13 June, 2003; v1 submitted 24 October, 2002;
originally announced October 2002.
-
Dreams, endocannabinoids and itinerant dynamics in neural networks: re elaborating Crick-Mitchison unlearning hypothesis
Authors:
Osame Kinouchi,
Renato Rodrigues Kinouchi
Abstract:
In this work we reevaluate and elaborate Crick-Mitchison's proposal that REM-sleep corresponds to a self-organized process for unlearning attractors in neural networks. This reformulation is made at the face of recent findings concerning the intense activation of the amygdalar complex during REM-sleep, the role of endocannabinoids in synaptic weakening and neural network models with itinerant asso…
▽ More
In this work we reevaluate and elaborate Crick-Mitchison's proposal that REM-sleep corresponds to a self-organized process for unlearning attractors in neural networks. This reformulation is made at the face of recent findings concerning the intense activation of the amygdalar complex during REM-sleep, the role of endocannabinoids in synaptic weakening and neural network models with itinerant associative dynamics. We distinguish between a neurological REM-sleep function and a related evolutionary/behavioral dreaming function. At the neurological level, we propose that REM-sleep regulates excessive plasticity and weakens over stable brain activation patterns, specially in the amygdala, hippocampus and motor systems. At the behavioral level, we propose that dream narrative evolved as exploratory behavior made in a virtual environment promoting "emotional (un)learning", that is, habituation of emotional responses, anxiety and fear. We make several experimental predictions at variance with those of Memory Consolidation Hipothesis. We also predict that the "replay" of cells ensembles is done at an increasing faster pace along REM-sleep.
△ Less
Submitted 12 July, 2010; v1 submitted 29 August, 2002;
originally announced August 2002.
-
Physics of Psychophysics: Stevens and Weber-Fechner laws are transfer functions of excitable media
Authors:
Mauro Copelli,
Antonio C. Roque,
Rodrigo F. Oliveira,
Osame Kinouchi
Abstract:
Sensory arrays made of coupled excitable elements can improve both their input sensitivity and dynamic range due to collective non-linear wave properties. This mechanism is studied in a neural network of electrically coupled (e.g. via gap junctions) elements subject to a Poisson signal process. The network response interpolates between a Weber-Fechner logarithmic law and a Stevens power law depe…
▽ More
Sensory arrays made of coupled excitable elements can improve both their input sensitivity and dynamic range due to collective non-linear wave properties. This mechanism is studied in a neural network of electrically coupled (e.g. via gap junctions) elements subject to a Poisson signal process. The network response interpolates between a Weber-Fechner logarithmic law and a Stevens power law depending on the relative refractory period of the cell. Therefore, these non-linear transformations of the input level could be performed in the sensory periphery simply due to a basic property: the transfer function of excitable media.
△ Less
Submitted 19 October, 2004; v1 submitted 20 December, 2001;
originally announced December 2001.
-
Persistence solves Fermi Paradox but challenges SETI projects
Authors:
Osame Kinouchi
Abstract:
Persistence phenomena in colonization processes could explain the negative results of SETI search preserving the possibility of a galactic civilization. However, persistence phenomena also indicates that search of technological civilizations in stars in the neighbourhood of Sun is a misdirected SETI strategy. This last conclusion is also suggested by a weaker form of the Fermi paradox. A simple…
▽ More
Persistence phenomena in colonization processes could explain the negative results of SETI search preserving the possibility of a galactic civilization. However, persistence phenomena also indicates that search of technological civilizations in stars in the neighbourhood of Sun is a misdirected SETI strategy. This last conclusion is also suggested by a weaker form of the Fermi paradox. A simple model of a branching colonization which includes emergence, decay and branching of civilizations is proposed. The model could also be used in the context of ant nests diffusion.
△ Less
Submitted 8 December, 2001;
originally announced December 2001.
-
Deterministic walks in random networks: an application to thesaurus graphs
Authors:
O. Kinouchi,
A. S. Martinez,
G. F. Lima,
G. M. Lourenco,
S. Risau-Gusman
Abstract:
In a landscape composed of N randomly distributed sites in Euclidean space, a walker (``tourist'') goes to the nearest one that has not been visited in the last τsteps. This procedure leads to trajectories composed of a transient part and a final cyclic attractor of period p. The tourist walk presents universal aspects with respect to τand can be done in a wide range of networks that can be view…
▽ More
In a landscape composed of N randomly distributed sites in Euclidean space, a walker (``tourist'') goes to the nearest one that has not been visited in the last τsteps. This procedure leads to trajectories composed of a transient part and a final cyclic attractor of period p. The tourist walk presents universal aspects with respect to τand can be done in a wide range of networks that can be viewed as ordinal neighborhood graphs. As an example, we show that graphs defined by thesaurus dictionaries share some of the statistical properties of low dimensional (d=2) Euclidean graphs and are easily distinguished from random graphs. This approach furnishes complementary information to the usual clustering coefficient and mean minimum separation length.
△ Less
Submitted 23 April, 2002; v1 submitted 10 October, 2001;
originally announced October 2001.
-
Extended dynamical range as a collective property of excitable cells
Authors:
Osame Kinouchi
Abstract:
Receptor cells with electrically coupled axons can improve both their input sensitivity and dynamical range due to collective non-linear wave properties. This mechanism is illustrated by a network of axons modeled by excitable maps subjected to a Poison signal process with rate r. We find that, in a network of N cells, the amplification factor A (number of cells excited by a single signal event)…
▽ More
Receptor cells with electrically coupled axons can improve both their input sensitivity and dynamical range due to collective non-linear wave properties. This mechanism is illustrated by a network of axons modeled by excitable maps subjected to a Poison signal process with rate r. We find that, in a network of N cells, the amplification factor A (number of cells excited by a single signal event) decreases smoothly from A= O(N) to A=1 as r increases, preventing saturation in a self-organized way and leading to a Weber-Fechner law behavior. This self-limited amplification mechanism is generic for excitable media and could be implemented in other biological contexts and artificial sensor devices.
△ Less
Submitted 24 August, 2001;
originally announced August 2001.
-
Deterministic walks in random media: evidence of generic scale invariance
Authors:
Gilson F. Lima,
Alexandre S. Martinez,
Osame Kinouchi
Abstract:
Deterministic walks over a random set of points in one and two dimensions (d=1,2) are considered. Points (``cities'') are randomly scattered in R^d following a uniform distribution. A walker (a ``tourist''), at each time step, goes to the nearest neighbor city that has not been visited in the past τsteps. Each initial city leads to a trajectory composed of a transient part and a final p-cycle at…
▽ More
Deterministic walks over a random set of points in one and two dimensions (d=1,2) are considered. Points (``cities'') are randomly scattered in R^d following a uniform distribution. A walker (a ``tourist''), at each time step, goes to the nearest neighbor city that has not been visited in the past τsteps. Each initial city leads to a trajectory composed of a transient part and a final p-cycle attractor. The distribution of transient times, p-cycles and number of cities per attractor are studied. It is shown numerically that transient times (for d=1,2) follow a Poisson law with a $τ$ dependent decay but the density of p-cycles follows a power law D(p) \propto p^{-α(τ)} for d=2. For large τ, the expoent tends to α~ 5/2. Some analytical results are given for the d=1 case. Since the power law is robust and does not depend on free parameters, this system presents ``generic scale invariance''. Applications to animal exploratory behavior and other local minimization problems are suggested.
△ Less
Submitted 25 May, 2000;
originally announced May 2000.
-
On the robustness of scale invariance in SOC models
Authors:
Osame Kinouchi,
Carmen P. C. do Prado
Abstract:
A random neighbor extremal stick-slip model is introduced. In the thermodynamic limit, the distribution of states has a simple analytical form and the mean avalanche size, as a function of the coupling parameter, is exactly calculable. The system is critical only at a special point Jc in the coupling parameter space. However, the critical region around this point, where approximate scale invaria…
▽ More
A random neighbor extremal stick-slip model is introduced. In the thermodynamic limit, the distribution of states has a simple analytical form and the mean avalanche size, as a function of the coupling parameter, is exactly calculable. The system is critical only at a special point Jc in the coupling parameter space. However, the critical region around this point, where approximate scale invariance holds, is very large, suggesting a mechanism for explaining the ubiquity of scale invariance in Nature.
△ Less
Submitted 21 January, 1999;
originally announced January 1999.
-
On the random neighbor Olami-Feder-Christensen slip-stick model
Authors:
Osame Kinouchi,
Suani T. R. Pinho,
Carmen P. C. do Prado
Abstract:
We reconsider the treatment of Lise and Jensen (Phys. Rev. Lett. 76, 2326 (1996)) on the random neighbor Olami-Feder-Christensen stik-slip model, and examine the strong dependence of the results on the approximations used for the distribution of states p(E).
We reconsider the treatment of Lise and Jensen (Phys. Rev. Lett. 76, 2326 (1996)) on the random neighbor Olami-Feder-Christensen stik-slip model, and examine the strong dependence of the results on the approximations used for the distribution of states p(E).
△ Less
Submitted 14 May, 1998;
originally announced May 1998.
-
Self-organized (quasi-)criticality: the extremal Feder and Feder model
Authors:
Osame Kinouchi
Abstract:
A simple random-neighbor SOC model that combines properties of the Bak-Sneppen and the relaxation oscillators (slip-stick) models is introduced. The analysis in terms of branching processes is transparent and gives insight about the development of large but finite mean avalanche sizes in dissipative models. In the thermodynamic limit, the distribution of states has a simple analytical form and t…
▽ More
A simple random-neighbor SOC model that combines properties of the Bak-Sneppen and the relaxation oscillators (slip-stick) models is introduced. The analysis in terms of branching processes is transparent and gives insight about the development of large but finite mean avalanche sizes in dissipative models. In the thermodynamic limit, the distribution of states has a simple analytical form and the mean avalanche size, as a function of the coupling parameter strength, is exactly calculable.
△ Less
Submitted 27 February, 1998;
originally announced February 1998.
-
Statistical Mechanics of Online Learning of Drifting Concepts : A Variational Approach
Authors:
Renato Vicente,
Osame Kinouchi,
Nestor Caticha
Abstract:
We review the application of Statistical Mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent teacher of the same architecture is analyzed. The best possible generalization ability is determined exactly, through the use of a variational method. The construct…
▽ More
We review the application of Statistical Mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent teacher of the same architecture is analyzed. The best possible generalization ability is determined exactly, through the use of a variational method. The constructive variational method also suggests a learning algorithm. It depends, however, on some unavailable quantities, such as the present performance of the student. The construction of estimators for these quantities permits the implementation of a very effective, highly adaptive algorithm. Several other algorithms are also studied for comparison with the optimal bound and the adaptive algorithm, for different types of time evolution of the rule.
△ Less
Submitted 28 January, 1998;
originally announced January 1998.
-
Learning a spin glass: determining Hamiltonians from metastable states
Authors:
Silvia Kuva,
Osame Kinouchi,
Nestor Caticha
Abstract:
We study the problem of determining the Hamiltonian of a fully connected Ising Spin Glass of $N$ units from a set of measurements, whose sizes needs to be ${\cal O}(N^2)$ bits. The student-teacher scenario, used to study learning in feed-forward neural networks, is here extended to spin systems with arbitrary couplings. The set of measurements consists of data about the local minima of the rugge…
▽ More
We study the problem of determining the Hamiltonian of a fully connected Ising Spin Glass of $N$ units from a set of measurements, whose sizes needs to be ${\cal O}(N^2)$ bits. The student-teacher scenario, used to study learning in feed-forward neural networks, is here extended to spin systems with arbitrary couplings. The set of measurements consists of data about the local minima of the rugged energy landscape. We compare simulations and analytical approximations for the resulting learning curves obtained by using different algorithms.
△ Less
Submitted 15 December, 1997;
originally announced December 1997.
-
Time ordering in the evolution of information processing and modulation systems
Authors:
N. Caticha,
O. Kinouchi
Abstract:
The ideas of optimization of learning algorithms in Artificial Neural Networks are reviewed emphasizing generic properties and the online implementations are interpreted from a biological perspective. A simple model of the relevant subsidiary variables needed to improve learning in artificial feedforward networks and the `time ordering' of the appearance of the respective information processing…
▽ More
The ideas of optimization of learning algorithms in Artificial Neural Networks are reviewed emphasizing generic properties and the online implementations are interpreted from a biological perspective. A simple model of the relevant subsidiary variables needed to improve learning in artificial feedforward networks and the `time ordering' of the appearance of the respective information processing systems is proposed. We discuss the possibility that these results might be relevant in other contexts, not being restricted to the simple models from which they stem. The analysis of a few examples, which range from the lowest cellular scale to the macroscopic level, suggests that similar ideas could be applied to biological systems.
△ Less
Submitted 11 June, 1997;
originally announced June 1997.
