-
The Global Structure of Codimension-2 Local Bifurcations in Continuous-Time Recurrent Neural Networks
Authors:
Randall D. Beer
Abstract:
If we are ever to move beyond the study of isolated special cases in theoretical neuroscience, we need to develop more general theories of neural circuits over a given neural model. The present paper considers this challenge in the context of continuous-time recurrent neural networks (CTRNNs), a simple but dynamically-universal model that has been widely utilized in both computational neuroscience…
▽ More
If we are ever to move beyond the study of isolated special cases in theoretical neuroscience, we need to develop more general theories of neural circuits over a given neural model. The present paper considers this challenge in the context of continuous-time recurrent neural networks (CTRNNs), a simple but dynamically-universal model that has been widely utilized in both computational neuroscience and neural networks. Here we extend previous work on the parameter space structure of codimension-1 local bifurcations in CTRNNs to include codimension-2 local bifurcation manifolds. Specifically, we derive the necessary conditions for all generic local codimension-2 bifurcations for general CTRNNs, specialize these conditions to circuits containing from one to four neurons, illustrate in full detail the application of these conditions to example circuits, derive closed-form expressions for these bifurcation manifolds where possible, and demonstrate how this analysis allows us to find and trace several global codimension-1 bifurcation manifolds that originate from the codimension-2 bifurcations.
△ Less
Submitted 8 November, 2021;
originally announced November 2021.
-
A modeler's guide to handle complexity in energy systems optimization
Authors:
Leander Kotzur,
Lars Nolting,
Maximilian Hoffmann,
Theresa Groß,
Andreas Smolenko,
Jan Priesmann,
Henrik Büsing,
Robin Beer,
Felix Kullmann,
Bismark Singh,
Aaron Praktiknjo,
Detlef Stolten,
Martin Robinius
Abstract:
The determination of environmentally- and economically-optimal energy system designs and operations is complex. In particular, the integration of weather-dependent renewable energy technologies into energy system optimization models presents new challenges to computational tractability that cannot only be solved by advancements in computational resources. In consequence, energy system modelers mus…
▽ More
The determination of environmentally- and economically-optimal energy system designs and operations is complex. In particular, the integration of weather-dependent renewable energy technologies into energy system optimization models presents new challenges to computational tractability that cannot only be solved by advancements in computational resources. In consequence, energy system modelers must tackle the complexity of their models daily and introduce various methods to manipulate the underlying data and model structure, with the ultimate goal of finding optimal solutions. As which complexity reduction method is suitable for which research question is often unclear, herein we review some approaches to handling complexity. Thus, we first analyze the determinants of complexity and note that many drivers of complexity could be avoided a priori with a tailored model design. Second, we conduct a review of systematic complexity reduction methods for energy system optimization models, which can range from simple linearization performed by modelers to sophisticated multi-level approaches combining aggregation and decomposition methods. Based on this overview, we develop a guide for modelers who encounter computational limitations.
△ Less
Submitted 17 August, 2021; v1 submitted 15 September, 2020;
originally announced September 2020.
-
Maximal Ergodic Inequalities for Banach Function Spaces
Authors:
Richard de Beer,
Louis Labuschagne
Abstract:
We analyse the Transfer Principle, which is used to generate weak type maximal inequalities for ergodic operators, and extend it to the general case of $σ$-compact locally compact Hausdorff groups acting measure-preservingly on $σ$-finite measure spaces. We show how the techniques developed here generate various weak type maximal inequalities on different Banach function spaces, and how the proper…
▽ More
We analyse the Transfer Principle, which is used to generate weak type maximal inequalities for ergodic operators, and extend it to the general case of $σ$-compact locally compact Hausdorff groups acting measure-preservingly on $σ$-finite measure spaces. We show how the techniques developed here generate various weak type maximal inequalities on different Banach function spaces, and how the properties of these function spaces influence the weak type inequalities that can be obtained. Finally, we demonstrate how the techniques developed imply almost sure pointwise convergence of a wide class of ergodic averages.
△ Less
Submitted 7 April, 2015; v1 submitted 31 August, 2013;
originally announced September 2013.
-
Generalized Measures of Information Transfer
Authors:
Paul L. Williams,
Randall D. Beer
Abstract:
Transfer entropy provides a general tool for analyzing the magnitudes and directions---but not the \emph{kinds}---of information transfer in a system. We extend transfer entropy in two complementary ways. First, we distinguish state-dependent from state-independent transfer, based on whether a source's influence depends on the state of the target. Second, for multiple sources, we distinguish betwe…
▽ More
Transfer entropy provides a general tool for analyzing the magnitudes and directions---but not the \emph{kinds}---of information transfer in a system. We extend transfer entropy in two complementary ways. First, we distinguish state-dependent from state-independent transfer, based on whether a source's influence depends on the state of the target. Second, for multiple sources, we distinguish between unique, redundant, and synergistic transfer. The new measures are demonstrated on several systems that extend examples from previous literature.
△ Less
Submitted 7 February, 2011;
originally announced February 2011.
-
Saturation Probabilities of Continuous-Time Sigmoidal Networks
Authors:
Randall D. Beer,
Bryan Daniels
Abstract:
From genetic regulatory networks to nervous systems, the interactions between elements in biological networks often take a sigmoidal or S-shaped form. This paper develops a probabilistic characterization of the parameter space of continuous-time sigmoidal networks (CTSNs), a simple but dynamically-universal model of such interactions. We describe an efficient and accurate method for calculating th…
▽ More
From genetic regulatory networks to nervous systems, the interactions between elements in biological networks often take a sigmoidal or S-shaped form. This paper develops a probabilistic characterization of the parameter space of continuous-time sigmoidal networks (CTSNs), a simple but dynamically-universal model of such interactions. We describe an efficient and accurate method for calculating the probability of observing effectively M-dimensional dynamics in an N-element CTSN, as well as a closed-form but approximate method. We then study the dependence of this probability on N, M, and the parameter ranges over which sampling occurs. This analysis provides insight into the overall structure of CTSN parameter space.
△ Less
Submitted 8 October, 2010;
originally announced October 2010.
-
Noncommutative recurrence over locally compact Hausdorff groups
Authors:
Richard de Beer,
Rocco Duvenhage,
Anton Stroh
Abstract:
We extend previous results on noncommutative recurrence in unital *-algebras over the integers, to the case where one works over locally compact Hausdorff groups. We derive a generalization of Khintchine's recurrence theorem, as well as a form of multiple recurrence. This is done using the mean ergodic theorem in Hilbert space, via the GNS construction.
We extend previous results on noncommutative recurrence in unital *-algebras over the integers, to the case where one works over locally compact Hausdorff groups. We derive a generalization of Khintchine's recurrence theorem, as well as a form of multiple recurrence. This is done using the mean ergodic theorem in Hilbert space, via the GNS construction.
△ Less
Submitted 16 September, 2005;
originally announced September 2005.
