-
Statistics of Turbulence in the Solar Wind. I. What is the Reynolds Number of the Solar Wind?
Authors:
Daniel Wrench,
Tulasi N. Parashar,
Sean Oughton,
Kevin de Lange,
Marcus Frean
Abstract:
The Reynolds number, Re, is an important quantity for describing a turbulent flow. It tells us about the bandwidth over which energy can cascade from large scales to smaller ones, prior to the onset of dissipation. However, calculating it for nearly collisionless plasmas like the solar wind is challenging. Previous studies have used "effective" Reynolds number formulations, expressing Re as a func…
▽ More
The Reynolds number, Re, is an important quantity for describing a turbulent flow. It tells us about the bandwidth over which energy can cascade from large scales to smaller ones, prior to the onset of dissipation. However, calculating it for nearly collisionless plasmas like the solar wind is challenging. Previous studies have used "effective" Reynolds number formulations, expressing Re as a function of the correlation scale and either the Taylor scale or a proxy for the dissipation scale. We find that the Taylor scale definition of the Reynolds number has a sizeable prefactor of approximately 27, which has not been employed in previous works. Drawing from 18 years of data from the Wind spacecraft at 1 au, we calculate the magnetic Taylor scale directly and use both the ion inertial length and the magnetic spectrum break scale as approximations for the dissipation scale, yielding three distinct Re estimates for each 12-hour interval. Average values of Re range between 116,000 and 3,406,000, within the general distribution of past work. We also find considerable disagreement between the methods, with linear associations of between 0.38 and 0.72. Although the Taylor scale method is arguably more physically motivated, due to its dependence on the energy cascade rate, more theoretical work is needed in order to identify the most appropriate way of calculating effective Reynolds numbers for kinetic plasmas. As a summary of our observational analysis, we make available a data product of 28 years of 1 au solar wind and magnetospheric plasma measurements from Wind.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Exploring the potential of neural networks to predict statistics of solar wind turbulence
Authors:
Daniel Wrench,
Tulasi N. Parashar,
Ritesh K. Singh,
Marcus Frean,
Ramesh Rayudu
Abstract:
Time series datasets often have missing or corrupted entries, which need to be ignored in subsequent data analysis. For example, in the context of space physics, calibration issues, satellite telemetry issues, and unexpected events can make parts of a time series unusable. Various approaches exist to tackle this problem, including mean/median imputation, linear interpolation, and autoregressive mo…
▽ More
Time series datasets often have missing or corrupted entries, which need to be ignored in subsequent data analysis. For example, in the context of space physics, calibration issues, satellite telemetry issues, and unexpected events can make parts of a time series unusable. Various approaches exist to tackle this problem, including mean/median imputation, linear interpolation, and autoregressive modeling. Here we study the utility of artificial neural networks (ANNs) to predict statistics, particularly second-order structure functions, of turbulent time series concerning the solar wind. Using a dataset with artificial gaps, a neural network is trained to predict second-order structure functions and then tested on an unseen dataset to quantify its performance. A small feedforward ANN, with only 20 hidden neurons, can predict the large-scale fluctuation amplitudes better than mean imputation or linear interpolation when the percentage of missing data is high. Although, they perform worse than the other methods when it comes to capturing both the shape and fluctuation amplitude together, their performance is better in a statistical sense for large fractions of missing data. Caveats regarding their utility, the optimisation procedure, and potential future improvements are discussed.
△ Less
Submitted 24 August, 2022; v1 submitted 17 April, 2022;
originally announced April 2022.
-
The Shattered Gradients Problem: If resnets are the answer, then what is the question?
Authors:
David Balduzzi,
Marcus Frean,
Lennox Leary,
JP Lewis,
Kurt Wan-Duo Ma,
Brian McWilliams
Abstract:
A long-standing obstacle to progress in deep learning is the problem of vanishing and exploding gradients. Although, the problem has largely been overcome via carefully constructed initializations and batch normalization, architectures incorporating skip-connections such as highway and resnets perform much better than standard feedforward architectures despite well-chosen initialization and batch…
▽ More
A long-standing obstacle to progress in deep learning is the problem of vanishing and exploding gradients. Although, the problem has largely been overcome via carefully constructed initializations and batch normalization, architectures incorporating skip-connections such as highway and resnets perform much better than standard feedforward architectures despite well-chosen initialization and batch normalization. In this paper, we identify the shattered gradients problem. Specifically, we show that the correlation between gradients in standard feedforward networks decays exponentially with depth resulting in gradients that resemble white noise whereas, in contrast, the gradients in architectures with skip-connections are far more resistant to shattering, decaying sublinearly. Detailed empirical evidence is presented in support of the analysis, on both fully-connected networks and convnets. Finally, we present a new "looks linear" (LL) initialization that prevents shattering, with preliminary experiments showing the new initialization allows to train very deep networks without the addition of skip-connections.
△ Less
Submitted 6 June, 2018; v1 submitted 27 February, 2017;
originally announced February 2017.
-
An Overview of the SKA Science Analysis Pipeline
Authors:
C. Hollitt,
M. Johnston-Hollitt,
S. Dehghan,
M. Frean,
T. Bulter-Yeoman
Abstract:
When completed the Square Kilometre Array (SKA) will feature an unprecedented rate of image generation. While previous generations of telescopes have relied on human expertise to extract scientifically interesting information from the images, the sheer data volume of the data will now make this impractical. Additionally, the rate at which data are accrued will not allow traditional imaging product…
▽ More
When completed the Square Kilometre Array (SKA) will feature an unprecedented rate of image generation. While previous generations of telescopes have relied on human expertise to extract scientifically interesting information from the images, the sheer data volume of the data will now make this impractical. Additionally, the rate at which data are accrued will not allow traditional imaging products to be stored indefinitely for later inspection meaning there is a strong imperative to discard uninteresting data in pseudo-real time. Here we outline components of the SKA science analysis pipeline being developed to produce a series of data products including continuum images, spectral cubes and Faraday depth spectra. We discuss a scheme to automatically extract value from these products and discard scientifically uninteresting data. This pipeline is thus expected to give both an increase in scientific productivity, and offers the possibility of reduced data archive size producing a considerable saving.
△ Less
Submitted 15 January, 2016;
originally announced January 2016.
-
Detecting Diffuse Sources in Astronomical Images
Authors:
T. Butler-Yeoman,
M. Frean,
C. P. Hollitt,
D. W. Hogg,
M. Johnston-Hollitt
Abstract:
We present an algorithm capable of detecting diffuse, dim sources of any size in an astronomical image. These sources often defeat traditional methods for source finding, which expand regions around points of high intensity. Extended sources often have no bright points and are only detectable when viewed as a whole, so a more sophisticated approach is required. Our algorithm operates at all scales…
▽ More
We present an algorithm capable of detecting diffuse, dim sources of any size in an astronomical image. These sources often defeat traditional methods for source finding, which expand regions around points of high intensity. Extended sources often have no bright points and are only detectable when viewed as a whole, so a more sophisticated approach is required. Our algorithm operates at all scales simultaneously by considering a tree of nested candidate bounding boxes, and inverts a hierarchical Bayesian generative model to obtain the probability of sources existing at given locations and sizes. This model naturally accommodates the detection of nested sources, and no prior knowledge of the distribution of a source, or even the background, is required. The algorithm scales nearly linear with the number of pixels making it feasible to run on large images, and requires minimal parameter tweaking to be effective. We demonstrate the algorithm on several types of astronomical and artificial images.
△ Less
Submitted 3 January, 2016;
originally announced January 2016.
-
Dissecting magnetar variability with Bayesian hierarchical models
Authors:
D. Huppenkothen,
B. J. Brewer,
D. W. Hogg,
I. Murray,
M. Frean,
C. Elenbaas,
A. L. Watts,
Y. Levin,
A. J. van der Horst,
C. Kouveliotou
Abstract:
Neutron stars are a prime laboratory for testing physical processes under conditions of strong gravity, high density, and extreme magnetic fields. Among the zoo of neutron star phenomena, magnetars stand out for their bursting behaviour, ranging from extremely bright, rare giant flares to numerous, less energetic recurrent bursts. The exact trigger and emission mechanisms for these bursts are not…
▽ More
Neutron stars are a prime laboratory for testing physical processes under conditions of strong gravity, high density, and extreme magnetic fields. Among the zoo of neutron star phenomena, magnetars stand out for their bursting behaviour, ranging from extremely bright, rare giant flares to numerous, less energetic recurrent bursts. The exact trigger and emission mechanisms for these bursts are not known; favoured models involve either a crust fracture and subsequent energy release into the magnetosphere, or explosive reconnection of magnetic field lines. In the absence of a predictive model, understanding the physical processes responsible for magnetar burst variability is difficult. Here, we develop an empirical model that decomposes magnetar bursts into a superposition of small spike-like features with a simple functional form, where the number of model components is itself part of the inference problem. The cascades of spikes that we model might be formed by avalanches of reconnection, or crust rupture aftershocks. Using Markov Chain Monte Carlo (MCMC) sampling augmented with reversible jumps between models with different numbers of parameters, we characterise the posterior distributions of the model parameters and the number of components per burst. We relate these model parameters to physical quantities in the system, and show for the first time that the variability within a burst does not conform to predictions from ideas of self-organised criticality. We also examine how well the properties of the spikes fit the predictions of simplified cascade models for the different trigger mechanisms.
△ Less
Submitted 29 June, 2015; v1 submitted 21 January, 2015;
originally announced January 2015.
-
Software graphs and programmer awareness
Authors:
G. J. Baxter,
M. R. Frean
Abstract:
Dependencies between types in object-oriented software can be viewed as directed graphs, with types as nodes and dependencies as edges. The in-degree and out-degree distributions of such graphs have quite different forms, with the former resembling a power-law distribution and the latter an exponential distribution. This effect appears to be independent of application or type relationship. A sim…
▽ More
Dependencies between types in object-oriented software can be viewed as directed graphs, with types as nodes and dependencies as edges. The in-degree and out-degree distributions of such graphs have quite different forms, with the former resembling a power-law distribution and the latter an exponential distribution. This effect appears to be independent of application or type relationship. A simple generative model is proposed to explore the proposition that the difference arises because the programmer is aware of the out-degree of a type but not of its in-degree. The model reproduces the two distributions, and compares reasonably well to those observed in 14 different type relationships across 12 different Java applications.
△ Less
Submitted 15 February, 2008;
originally announced February 2008.
-
Adaptation and enslavement in endosymbiont-host associations
Authors:
Marcus R. Frean,
Edward R. Abraham
Abstract:
The evolutionary persistence of symbiotic associations is a puzzle. Adaptation should eliminate cooperative traits if it is possible to enjoy the advantages of cooperation without reciprocating - a facet of cooperation known in game theory as the Prisoner's Dilemma. Despite this barrier, symbioses are widespread, and may have been necessary for the evolution of complex life. The discovery of str…
▽ More
The evolutionary persistence of symbiotic associations is a puzzle. Adaptation should eliminate cooperative traits if it is possible to enjoy the advantages of cooperation without reciprocating - a facet of cooperation known in game theory as the Prisoner's Dilemma. Despite this barrier, symbioses are widespread, and may have been necessary for the evolution of complex life. The discovery of strategies such as tit-for-tat has been presented as a general solution to the problem of cooperation. However, this only holds for within-species cooperation, where a single strategy will come to dominate the population. In a symbiotic association each species may have a different strategy, and the theoretical analysis of the single species problem is no guide to the outcome. We present basic analysis of two-species cooperation and show that a species with a fast adaptation rate is enslaved by a slowly evolving one. Paradoxically, the rapidly evolving species becomes highly cooperative, whereas the slowly evolving one gives little in return. This helps understand the occurrence of endosymbioses where the host benefits, but the symbionts appear to gain little from the association.
△ Less
Submitted 23 February, 2004; v1 submitted 9 December, 2003;
originally announced December 2003.
