Showing 1–8 of 8 results for author: Kates-Harbeck, J

Trust based attachment

Authors: Julian Kates-Harbeck, Martin A. Nowak

Abstract: In social systems subject to indirect reciprocity, a positive reputation is key for increasing one's likelihood of future positive interactions. The flow of gossip can amplify the impact of a person's actions on their reputation depending on how widely it spreads across the social network, which leads to a percolation problem. To quantify this notion, we calculate the expected number of individual… ▽ More In social systems subject to indirect reciprocity, a positive reputation is key for increasing one's likelihood of future positive interactions. The flow of gossip can amplify the impact of a person's actions on their reputation depending on how widely it spreads across the social network, which leads to a percolation problem. To quantify this notion, we calculate the expected number of individuals, the "audience", who find out about a particular interaction. For a potential donor, a larger audience constitutes higher reputational stakes, and thus a higher incentive, to perform "good" actions in line with current social norms. For a receiver, a larger audience therefore increases the trust that the partner will be cooperative. This idea can be used for an algorithm that generates social networks, which we call trust based attachment (TBA). TBA produces graphs that share crucial quantitative properties with real-world networks, such as high clustering, small-world behavior, and power law degree distributions. We also show that TBA can be approximated by simple friend-of-friend routines based on triadic closure, which are known to be highly effective at generating realistic social network structures. Therefore, our work provides a new justification for triadic closure in social contexts based on notions of trust, gossip, and social information spread. These factors are thus identified as potential significant influences on how humans form social ties. △ Less

Submitted 29 August, 2023; v1 submitted 4 August, 2022; originally announced August 2022.

Social network structure and the spread of complex contagions from a population genetics perspective

Authors: Julian Kates-Harbeck, Michael M. Desai

Abstract: Ideas, behaviors, and opinions spread through social networks. If the probability of spreading to a new individual is a non-linear function of the fraction of the individuals' affected neighbors, such a spreading process becomes a "complex contagion". This non-linearity does not typically appear with physically spreading infections, but instead can emerge when the concept that is spreading is subj… ▽ More Ideas, behaviors, and opinions spread through social networks. If the probability of spreading to a new individual is a non-linear function of the fraction of the individuals' affected neighbors, such a spreading process becomes a "complex contagion". This non-linearity does not typically appear with physically spreading infections, but instead can emerge when the concept that is spreading is subject to game theoretical considerations (e.g. for choices of strategy or behavior) or psychological effects such as social reinforcement and other forms of peer influence (e.g. for ideas, preferences, or opinions). Here we study how the stochastic dynamics of such complex contagions are affected by the underlying network structure. Motivated by simulations of complex epidemics on real social networks, we present a general framework for analyzing the statistics of contagions with arbitrary non-linear adoption probabilities based on the mathematical tools of population genetics. Our framework provides a unified approach that illustrates intuitively several key properties of complex contagions: stronger community structure and network sparsity can significantly enhance the spread, while broad degree distributions dampen the effect of selection. Finally, we show that some structural features can exhibit critical values that demarcate regimes where global epidemics become possible for networks of arbitrary size. Our results draw parallels between the competition of genes in a population and memes in a world of minds and ideas. Our tools provide insight into the spread of information, behaviors, and ideas via social influence, and highlight the role of macroscopic network structure in determining their fate. △ Less

Submitted 29 August, 2023; v1 submitted 4 August, 2022; originally announced August 2022.

Implementation of AI/Deep Learning Disruption Predictor into a Plasma Control System

Authors: William Tang, Ge Dong, Jayson Barr, Keith Erickson, Rory Conlin, M. Dan Boyer, Julian Kates-Harbeck, Kyle Felker, Cristina Rea, Nikolas C. Logan, Alexey Svyatkovskiy, Eliot Feibush, Joseph Abbatte, Mitchell Clement, Brian Grierson, Raffi Nazikian, Zhihong Lin, David Eldon, Auna Moser, Mikhail Maslov

Abstract: This paper reports on advances to the state-of-the-art deep-learning disruption prediction models based on the Fusion Recurrent Neural Network (FRNN) originally introduced a 2019 Nature publication. In particular, the predictor now features not only the disruption score, as an indicator of the probability of an imminent disruption, but also a sensitivity score in real-time to indicate the underlyi… ▽ More This paper reports on advances to the state-of-the-art deep-learning disruption prediction models based on the Fusion Recurrent Neural Network (FRNN) originally introduced a 2019 Nature publication. In particular, the predictor now features not only the disruption score, as an indicator of the probability of an imminent disruption, but also a sensitivity score in real-time to indicate the underlying reasons for the imminent disruption. This adds valuable physics-interpretability for the deep-learning model and can provide helpful guidance for control actuators now that it is fully implemented into a modern Plasma Control System (PCS). The advance is a significant step forward in moving from modern deep-learning disruption prediction to real-time control and brings novel AI-enabled capabilities relevant for application to the future burning plasma ITER system. Our analyses use large amounts of data from JET and DIII-D vetted in the earlier NATURE publication. In addition to when a shot is predicted to disrupt, this paper addresses reasons why by carrying out sensitivity studies. FRNN is accordingly extended to use many more channels of information, including measured DIII-D signals such as (i) the n1rms signal that is correlated with the n =1 modes with finite frequency, including neoclassical tearing mode and sawtooth dynamics, (ii) the bolometer data indicative of plasma impurity content, and (iii) q-min, the minimum value of the safety factor relevant to the key physics of kink modes. The additional channels and interpretability features expand the ability of the deep learning FRNN software to provide information about disruption subcategories as well as more precise and direct guidance for the actuators in a plasma control system. △ Less

Submitted 4 April, 2022; originally announced April 2022.

Evolutionary instability of selfish learning in repeated games

Authors: Alex McAvoy, Julian Kates-Harbeck, Krishnendu Chatterjee, Christian Hilbe

Abstract: Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own success. However, when two such "selfish" learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of int… ▽ More Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own success. However, when two such "selfish" learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of interest. Here, we explore how a learner can align incentives with a selfish opponent. Moreover, we consider the dynamics that arise when learning rules themselves are subject to evolutionary pressure. By combining extensive simulations and analytical techniques, we demonstrate that selfish learning is unstable in most classical two-player repeated games. If evolution operates on the level of long-run payoffs, selection instead favors learning rules that incorporate social (other-regarding) preferences. To further corroborate these results, we analyze data from a repeated prisoner's dilemma experiment. We find that selfish learning is insufficient to explain human behavior when there is a trade-off between payoff maximization and fairness. △ Less

Submitted 31 August, 2022; v1 submitted 13 May, 2021; originally announced May 2021.

Comments: 73 pages; final version

Fully Convolutional Spatio-Temporal Models for Representation Learning in Plasma Science

Authors: Ge Dong, Kyle Gerard Felker, Alexey Svyatkovskiy, William Tang, Julian Kates-Harbeck

Abstract: We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important fusion energy science (FES) issue that must be resolved for advanced tokamak. While a variety of statistical methods have been used to address the problem of t… ▽ More We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important fusion energy science (FES) issue that must be resolved for advanced tokamak. While a variety of statistical methods have been used to address the problem of tokamak disruption prediction and control, recent approaches based on deep learning have proven particularly compelling. In the present paper, we introduce further improvements to the fusion recurrent neural network (FRNN) software suite. Up to now, FRNN was based on the long short-term memory (LSTM) variant of recurrent neural networks to leverage the temporal information in the data. Here, we implement and apply the temporal convolutional neural network (TCN) architecture to the time-dependent input signals, thus rendering the FRNN architecture fully convolutional. This allows highly optimized convolution operations to carry the majority of the computational load of training, thus enabling a reduction in training time, and the effective use of high performance computing (HPC) resources for hyperparameter tuning. At the same time, the TCN based architecture achieves equal or better predictive performance when compared with the LSTM architecture for a large, representative fusion database. Across data-rich scientific disciplines, these results have implications for the resource-effective training of general spatio-temporal feature extractors based on deep learning. Moreover, this challenging exemplar case study illustrates the advantages of a predictive platform with flexible architecture selection options capable of being readily tuned and adapted for responding to prediction needs that increasingly arise in large modern observational dataset. △ Less

Submitted 26 September, 2020; v1 submitted 20 July, 2020; originally announced July 2020.

Training Distributed Deep Recurrent Neural Networks with Mixed Precision on GPU Clusters

Authors: Alexey Svyatkovskiy, Julian Kates-Harbeck, William Tang

Abstract: In this paper, we evaluate training of deep recurrent neural networks with half-precision floats. We implement a distributed, data-parallel, synchronous training algorithm by integrating TensorFlow and CUDA-aware MPI to enable execution across multiple GPU nodes and making use of high-speed interconnects. We introduce a learning rate schedule facilitating neural network convergence at up to… ▽ More In this paper, we evaluate training of deep recurrent neural networks with half-precision floats. We implement a distributed, data-parallel, synchronous training algorithm by integrating TensorFlow and CUDA-aware MPI to enable execution across multiple GPU nodes and making use of high-speed interconnects. We introduce a learning rate schedule facilitating neural network convergence at up to $O(100)$ workers. Strong scaling tests performed on clusters of NVIDIA Pascal P100 GPUs show linear runtime and logarithmic communication time scaling for both single and mixed precision training modes. Performance is evaluated on a scientific dataset taken from the Joint European Torus (JET) tokamak, containing multi-modal time series of sensory measurements leading up to deleterious events called plasma disruptions, and the benchmark Large Movie Review Dataset~\cite{imdb}. Half-precision significantly reduces memory and network bandwidth, allowing training of state-of-the-art models with over 70 million trainable parameters while achieving a comparable test set performance as single precision. △ Less

Submitted 30 November, 2019; originally announced December 2019.

Journal ref: Published in Proceedings of the Machine Learning on HPC Environments (MLHPC) at the Supercomputing conference 2017

Simplex-in-Cell Technique for Collisionless Plasma Simulations

Authors: Julian Kates-Harbeck, Samuel Totorica, Jonathan Zrake, Tom Abel

Abstract: We extend the simplex-in-cell (SIC) technique recently introduced in the context of collisionless dark matter fluids (Abel et al. 2012; Hahn et al. 2012) to the case of collisionless plasmas. The six-dimensional phase space distribution function $f(\mathbf x,\mathbf v)$ is represented by an ensemble of three-dimensional manifolds, which we refer to as sheets. The electric potential field is obtain… ▽ More We extend the simplex-in-cell (SIC) technique recently introduced in the context of collisionless dark matter fluids (Abel et al. 2012; Hahn et al. 2012) to the case of collisionless plasmas. The six-dimensional phase space distribution function $f(\mathbf x,\mathbf v)$ is represented by an ensemble of three-dimensional manifolds, which we refer to as sheets. The electric potential field is obtained by solving the Poisson equation on a uniform mesh, where the charge density is evaluated by a spatial projection of the phase space sheets. The SIC representation of phase space density facilitates robust, high accuracy numerical evolution of the Vlasov-Poisson system using significantly fewer tracer particles than comparable particle-in-cell (PIC) approaches by reducing the numerical shot-noise associated with the latter. We introduce the SIC formulation and describe its implementation in a new code, which we validate using standard test problems including plasma oscillations, Landau damping, and two stream instabilities in one dimension. Merits of the new scheme are shown to include higher accuracy and faster convergence rates in the number of particles. We finally motivate and outline the efficient application of SIC to higher dimensional problems. △ Less

Submitted 23 June, 2015; originally announced June 2015.

Comments: 22 pages, 9 figures

The Tension on dsDNA Bound to ssDNA/RecA Filaments May Play an Important Role in Driving Efficient and Accurate Homology Recognition and Strand Exchange

Authors: Julea Vlassakis, Efraim Feinstein, Darren Yang, Antoine Tilloy, Dominic Weiller, Julian Kates-Harbeck, Vincent Coljee, Mara Prentiss

Abstract: It is well known that during homology recognition and strand exchange the double stranded DNA (dsDNA) in DNA/RecA filaments is highly extended, but the functional role of the extension has been unclear. We present an analytical model that calculates the distribution of tension in the extended dsDNA during strand exchange. The model suggests that the binding of additional dsDNA base pairs to the DN… ▽ More It is well known that during homology recognition and strand exchange the double stranded DNA (dsDNA) in DNA/RecA filaments is highly extended, but the functional role of the extension has been unclear. We present an analytical model that calculates the distribution of tension in the extended dsDNA during strand exchange. The model suggests that the binding of additional dsDNA base pairs to the DNA/RecA filament alters the tension in dsDNA that was already bound to the filament, resulting in a non-linear increase in the mechanical energy as a function of the number of bound base pairs. This collective mechanical response may promote homology stringency and underlie unexplained experimental results. △ Less

Submitted 6 November, 2012; v1 submitted 24 August, 2011; originally announced August 2011.