-
Optimal short-term memory before the edge of chaos in driven random recurrent networks
Authors:
Taichi Haruna,
Kohei Nakajima
Abstract:
The ability of discrete-time nonlinear recurrent neural networks to store time-varying small input signals is investigated by mean-field theory. The combination of a small input strength and mean-field assumptions makes it possible to derive an approximate expression for the conditional probability density of the state of a neuron given a past input signal. From this conditional probability densit…
▽ More
The ability of discrete-time nonlinear recurrent neural networks to store time-varying small input signals is investigated by mean-field theory. The combination of a small input strength and mean-field assumptions makes it possible to derive an approximate expression for the conditional probability density of the state of a neuron given a past input signal. From this conditional probability density, we can analytically calculate short-term memory measures, such as memory capacity, mutual information, and Fisher information, and determine the relationships among these measures, which have not been clarified to date to the best of our knowledge. We show that the network contribution of these short-term memory measures peaks before the edge of chaos, where the dynamics of input-driven networks is stable but corresponding systems without input signals are unstable.
△ Less
Submitted 24 December, 2019;
originally announced December 2019.
-
Theory of Interface: Category Theory, Directed Networks and Evolution of Biological Networks
Authors:
Taichi Haruna
Abstract:
Biological networks have two modes. The first mode is static: a network is a passage on which something flows. The second mode is dynamic: a network is a pattern constructed by gluing functions of entities constituting the network. In this paper, first we discuss that these two modes can be associated with the category theoretic duality (adjunction) and derive a natural network structure (a path n…
▽ More
Biological networks have two modes. The first mode is static: a network is a passage on which something flows. The second mode is dynamic: a network is a pattern constructed by gluing functions of entities constituting the network. In this paper, first we discuss that these two modes can be associated with the category theoretic duality (adjunction) and derive a natural network structure (a path notion) for each mode by appealing to the category theoretic universality. The path notion corresponding to the static mode is just the usual directed path. The path notion for the dynamic mode is called lateral path which is the alternating path considered on the set of arcs. Their general functionalities in a network are transport and coherence, respectively. Second, we introduce a betweenness centrality of arcs for each mode and see how the two modes are embedded in various real biological network data. We find that there is a trade-off relationship between the two centralities: if the value of one is large then the value of the other is small. This can be seen as a kind of division of labor in a network into transport on the network and coherence of the network. Finally, we propose an optimization model of networks based on a quality function involving intensities of the two modes in order to see how networks with the above trade-off relationship can emerge through evolution. We show that the trade-off relationship can be observed in the evolved networks only when the dynamic mode is dominant in the quality function by numerical simulations. We also show that the evolved networks have features qualitatively similar to real biological networks by standard complex network analysis.
△ Less
Submitted 20 November, 2012; v1 submitted 23 October, 2012;
originally announced October 2012.
-
Temperature dependent Luttinger surfaces
Authors:
T. Ito,
A. Chainani,
T. Haruna,
K. Kanai,
T. Yokoya,
S. Shin,
R. Kato
Abstract:
The Luttinger surface of an organic metal (TTF-TCNQ), possessing charge order and spin-charge separation, is investigated using temperature dependent angle-resolved photoemission spectroscopy. The Luttinger surface topology, obtained from momentum distribution curves, changes from quasi-2D(dimensional) to quasi-1D with temperature. The high temperature quasi-2D surface exhibits 4$k_F$ charge-den…
▽ More
The Luttinger surface of an organic metal (TTF-TCNQ), possessing charge order and spin-charge separation, is investigated using temperature dependent angle-resolved photoemission spectroscopy. The Luttinger surface topology, obtained from momentum distribution curves, changes from quasi-2D(dimensional) to quasi-1D with temperature. The high temperature quasi-2D surface exhibits 4$k_F$ charge-density-wave (CDW) superstructure in the TCNQ derived holon band, in the absence of 2$k_F$ order. Decreasing temperature results in quasi-1D nested 2$k_F$ CDW order in the TCNQ spinon band and in the TTF surface. The results establish the link in momentum-space between charge order and spin-charge separation in a Luttinger liquid.
△ Less
Submitted 14 July, 2005;
originally announced July 2005.
