-
Enhancing Satellite Imagery using Deep Learning for the Sensor To Shooter Timeline
Authors:
Matthew Ciolino,
Dominick Hambrick,
David Noever
Abstract:
The sensor to shooter timeline is affected by two main variables: satellite positioning and asset positioning. Speeding up satellite positioning by adding more sensors or by decreasing processing time is important only if there is a prepared shooter, otherwise the main source of time is getting the shooter into position. However, the intelligence community should work towards the exploitation of s…
▽ More
The sensor to shooter timeline is affected by two main variables: satellite positioning and asset positioning. Speeding up satellite positioning by adding more sensors or by decreasing processing time is important only if there is a prepared shooter, otherwise the main source of time is getting the shooter into position. However, the intelligence community should work towards the exploitation of sensors to the highest speed and effectiveness possible. Achieving a high effectiveness while keeping speed high is a tradeoff that must be considered in the sensor to shooter timeline. In this paper we investigate two main ideas, increasing the effectiveness of satellite imagery through image manipulation and how on-board image manipulation would affect the sensor to shooter timeline. We cover these ideas in four scenarios: Discrete Event Simulation of onboard processing versus ground station processing, quality of information with cloud cover removal, information improvement with super resolution, and data reduction with image to caption. This paper will show how image manipulation techniques such as Super Resolution, Cloud Removal, and Image to Caption will improve the quality of delivered information in addition to showing how those processes effect the sensor to shooter timeline.
△ Less
Submitted 30 March, 2022; v1 submitted 28 February, 2022;
originally announced March 2022.
-
Automating Defense Against Adversarial Attacks: Discovery of Vulnerabilities and Application of Multi-INT Imagery to Protect Deployed Models
Authors:
Josh Kalin,
David Noever,
Matthew Ciolino,
Dominick Hambrick,
Gerry Dozier
Abstract:
Image classification is a common step in image recognition for machine learning in overhead applications. When applying popular model architectures like MobileNetV2, known vulnerabilities expose the model to counter-attacks, either mislabeling a known class or altering box location. This work proposes an automated approach to defend these models. We evaluate the use of multi-spectral image arrays…
▽ More
Image classification is a common step in image recognition for machine learning in overhead applications. When applying popular model architectures like MobileNetV2, known vulnerabilities expose the model to counter-attacks, either mislabeling a known class or altering box location. This work proposes an automated approach to defend these models. We evaluate the use of multi-spectral image arrays and ensemble learners to combat adversarial attacks. The original contribution demonstrates the attack, proposes a remedy, and automates some key outcomes for protecting the model's predictions against adversaries. In rough analogy to defending cyber-networks, we combine techniques from both offensive ("red team") and defensive ("blue team") approaches, thus generating a hybrid protective outcome ("green team"). For machine learning, we demonstrate these methods with 3-color channels plus infrared for vehicles. The outcome uncovers vulnerabilities and corrects them with supplemental data inputs commonly found in overhead cases particularly.
△ Less
Submitted 29 March, 2021;
originally announced March 2021.
-
Local Translation Services for Neglected Languages
Authors:
David Noever,
Josh Kalin,
Matt Ciolino,
Dom Hambrick,
Gerry Dozier
Abstract:
Taking advantage of computationally lightweight, but high-quality translators prompt consideration of new applications that address neglected languages. Locally run translators for less popular languages may assist data projects with protected or personal data that may require specific compliance checks before posting to a public translation API, but which could render reasonable, cost-effective s…
▽ More
Taking advantage of computationally lightweight, but high-quality translators prompt consideration of new applications that address neglected languages. Locally run translators for less popular languages may assist data projects with protected or personal data that may require specific compliance checks before posting to a public translation API, but which could render reasonable, cost-effective solutions if done with an army of local, small-scale pair translators. Like handling a specialist's dialect, this research illustrates translating two historically interesting, but obfuscated languages: 1) hacker-speak ("l33t") and 2) reverse (or "mirror") writing as practiced by Leonardo da Vinci. The work generalizes a deep learning architecture to translatable variants of hacker-speak with lite, medium, and hard vocabularies. The original contribution highlights a fluent translator of hacker-speak in under 50 megabytes and demonstrates a generator for augmenting future datasets with greater than a million bilingual sentence pairs. The long short-term memory, recurrent neural network (LSTM-RNN) extends previous work demonstrating an English-to-foreign translation service built from as little as 10,000 bilingual sentence pairs. This work further solves the equivalent translation problem in twenty-six additional (non-obfuscated) languages and rank orders those models and their proficiency quantitatively with Italian as the most successful and Mandarin Chinese as the most challenging. For neglected languages, the method prototypes novel services for smaller niche translations such as Kabyle (Algerian dialect) which covers between 5-7 million speakers but one which for most enterprise translators, has not yet reached development. One anticipates the extension of this approach to other important dialects, such as translating technical (medical or legal) jargon and processing health records.
△ Less
Submitted 13 January, 2021; v1 submitted 5 January, 2021;
originally announced January 2021.
-
Discoverability in Satellite Imagery: A Good Sentence is Worth a Thousand Pictures
Authors:
David Noever,
Wes Regian,
Matt Ciolino,
Josh Kalin,
Dom Hambrick,
Kaye Blankenship
Abstract:
Small satellite constellations provide daily global coverage of the earth's landmass, but image enrichment relies on automating key tasks like change detection or feature searches. For example, to extract text annotations from raw pixels requires two dependent machine learning models, one to analyze the overhead image and the other to generate a descriptive caption. We evaluate seven models on the…
▽ More
Small satellite constellations provide daily global coverage of the earth's landmass, but image enrichment relies on automating key tasks like change detection or feature searches. For example, to extract text annotations from raw pixels requires two dependent machine learning models, one to analyze the overhead image and the other to generate a descriptive caption. We evaluate seven models on the previously largest benchmark for satellite image captions. We extend the labeled image samples five-fold, then augment, correct and prune the vocabulary to approach a rough min-max (minimum word, maximum description). This outcome compares favorably to previous work with large pre-trained image models but offers a hundred-fold reduction in model size without sacrificing overall accuracy (when measured with log entropy loss). These smaller models provide new deployment opportunities, particularly when pushed to edge processors, on-board satellites, or distributed ground stations. To quantify a caption's descriptiveness, we introduce a novel multi-class confusion or error matrix to score both human-labeled test data and never-labeled images that include bounding box detection but lack full sentence captions. This work suggests future captioning strategies, particularly ones that can enrich the class coverage beyond land use applications and that lessen color-centered and adjacency adjectives ("green", "near", "between", etc.). Many modern language transformers present novel and exploitable models with world knowledge gleaned from training from their vast online corpus. One interesting, but easy example might learn the word association between wind and waves, thus enriching a beach scene with more than just color descriptions that otherwise might be accessed from raw pixels without text annotation.
△ Less
Submitted 3 January, 2020;
originally announced January 2020.
-
The Effects of X-Ray Feedback from AGN on Host Galaxy Evolution
Authors:
D. Clay Hambrick,
Jeremiah P. Ostriker,
Thorsten Naab,
Peter H. Johansson
Abstract:
Hydrodynamic simulations of galaxies with active galactic nuclei (AGN) have typically employed feedback that is purely local: i.e., an injection of energy to the immediate neighborhood of the black hole. We perform GADGET-2 simulations of massive elliptical galaxies with an additional feedback component: an observationally calibrated X-ray radiation field which emanates from the black hole and hea…
▽ More
Hydrodynamic simulations of galaxies with active galactic nuclei (AGN) have typically employed feedback that is purely local: i.e., an injection of energy to the immediate neighborhood of the black hole. We perform GADGET-2 simulations of massive elliptical galaxies with an additional feedback component: an observationally calibrated X-ray radiation field which emanates from the black hole and heats gas out to large radii from the galaxy center. We find that including the heating and radiation pressure associated with this X-ray flux in our simulations enhances the effects which are commonly reported from AGN feedback. This new feedback model is twice as effective as traditional feedback at suppressing star formation, produces 3 times less star formation in the last 6 Gyr, and modestly lowers the final BH mass (30%). It is also significantly more effective than an X-ray background in reducing the number of satellite galaxies.
△ Less
Submitted 7 June, 2011;
originally announced June 2011.
-
The Effects of X-Ray and UV Background Radiation on the Low-Mass Slope of the Galaxy Mass Function
Authors:
D. C. Hambrick,
J. P. Ostriker,
P. H. Johansson,
T. Naab
Abstract:
Even though the dark-matter power spectrum in the absence of biasing predicts a number density of halos n(M) ~ M^-2 (i.e. a Schechter alpha value of -2) at the low-mass end (M < 10^10 M_solar), hydrodynamic simulations have typically produced values for stellar systems in good agreement with the observed value alpha ~ -1. We explain this with a simple physical argument and show that an efficient e…
▽ More
Even though the dark-matter power spectrum in the absence of biasing predicts a number density of halos n(M) ~ M^-2 (i.e. a Schechter alpha value of -2) at the low-mass end (M < 10^10 M_solar), hydrodynamic simulations have typically produced values for stellar systems in good agreement with the observed value alpha ~ -1. We explain this with a simple physical argument and show that an efficient external gas-heating mechanism (such as the UV background included in all hydro codes) will produce a critical halo mass below which halos cannot retain their gas and form stars. We test this conclusion with GADGET-2-based simulations using various UV backgrounds, and for the first time we also investigate the effect of an X-ray background. We show that at the present epoch alpha is depends primarily on the mean gas temperature at the star-formation epoch for low-mass systems (z <~ 3): with no background we find alpha ~ -1.5, with UV only alpha ~ -1.0, and with UV and X-rays alpha ~ -0.75. We find the critical final halo mass for star formation to be ~4x10^8 M_solar with a UV background and ~7x10^8 M_solar with UV and X-rays.
△ Less
Submitted 29 September, 2010;
originally announced September 2010.
-
The Effects of the Ionizing Radiation Background on Galaxy Evolution
Authors:
D. Clay Hambrick,
Jeremiah P. Ostriker,
Thorsten Naab,
Peter H. Johansson
Abstract:
We find that the amount and nature of the assumed ionizing background can strongly affect galaxy formation and evolution. Galaxy evolution simulations typically incorporate an ultraviolet background which falls off rapidly above z=3; e.g., that of Haardt & Madau (1996). However, this decline may be too steep to fit the WMAP constraints on electron scattering optical depth or observations of inte…
▽ More
We find that the amount and nature of the assumed ionizing background can strongly affect galaxy formation and evolution. Galaxy evolution simulations typically incorporate an ultraviolet background which falls off rapidly above z=3; e.g., that of Haardt & Madau (1996). However, this decline may be too steep to fit the WMAP constraints on electron scattering optical depth or observations of intermediate redshift (z ~ 2-4) Ly-alpha forest transmission. As an alternative, we present simulations of the cosmological formation of individual galaxies with UV backgrounds that decline more slowly at high redshift: both a simple intensity rescaling and the background recently derived by Faucher-Giguere (2009), which softens the spectrum at higher redshifts. We also test an approximation of the X-ray background with a similar z-dependence. We find for the test galaxies that an increase in either the intensity or hardness of ionizing radiation generically pushes star formation towards lower redshifts: although overall star formation in the simulation boxes is reduced by 10-25%, the galaxies show a factor of ~2 increase in the fraction of stars within a 30 kpc radius that are formed after z=1. Other effects include late gas inflows enhanced up to 30 times, stellar half-mass radii decreased by up to 30%, central velocity dispersions increased up to 40%, and a strong reduction in substructure. The magnitude of the effects depends on the environmental/accretion properties of the particular galaxy.
△ Less
Submitted 1 September, 2009;
originally announced September 2009.
-
Topology of structure in the Sloan Digital Sky Survey: model testing
Authors:
J. Richard Gott III,
D. Clay Hambrick,
Michael S. Vogeley,
Juhan Kim,
Changbom Park,
Yun-Young Choi,
Renyue Cen,
Jeremiah P. Ostriker,
Kentaro Nagamine
Abstract:
We measure the three-dimensional topology of large-scale structure in the Sloan Digital Sky Survey (SDSS). This allows the genus statistic to be measured with unprecedented statistical accuracy. The sample size is now sufficiently large to allow the topology to be an important tool for testing galaxy formation models. For comparison, we make mock SDSS samples using several state-of-the-art N-bod…
▽ More
We measure the three-dimensional topology of large-scale structure in the Sloan Digital Sky Survey (SDSS). This allows the genus statistic to be measured with unprecedented statistical accuracy. The sample size is now sufficiently large to allow the topology to be an important tool for testing galaxy formation models. For comparison, we make mock SDSS samples using several state-of-the-art N-body simulations: the Millennium run of Springel et al. (2005)(10 billion particles), Kim & Park (2006) CDM models (1.1 billion particles), and Cen & Ostriker (2006) hydrodynamic code models (8.6 billion cell hydro mesh). Each of these simulations uses a different method for modeling galaxy formation. The SDSS data show a genus curve that is broadly characteristic of that produced by Gaussian random phase initial conditions. Thus the data strongly support the standard model of inflation where Gaussian random phase initial conditions are produced by random quantum fluctuations in the early universe. But on top of this general shape there are measurable differences produced by non-linear gravitational effects (cf. Matsubara 1994), and biasing connected with galaxy formation. The N-body simulations have been tuned to reproduce the power spectrum and multiplicity function but not topology, so topology is an acid test for these models. The data show a ``meatball'' shift (only partly due to the Sloan Great Wall of Galaxies; this shift also appears in a sub-sample not containing the Wall) which differs at the 2.5σlevel from the results of the Millennium run and the Kim & Park dark halo models, even including the effects of cosmic variance.
△ Less
Submitted 25 October, 2006;
originally announced October 2006.
-
The powerful outburst in Hercules A
Authors:
P. E. J. Nulsen,
D. C. Hambrick,
B. R. McNamara,
D. Rafferty,
L. Birzan,
M. W. Wise,
L. P. David
Abstract:
The radio source Hercules A resides at the center of a cooling flow cluster of galaxies at redshift z = 0.154. A Chandra X-ray image reveals a shock front in the intracluster medium (ICM) surrounding the radio source, about 160 kpc from the active galactic nucleus (AGN) that hosts it. The shock has a Mach number of 1.65, making it the strongest of the cluster-scale shocks driven by an AGN outbur…
▽ More
The radio source Hercules A resides at the center of a cooling flow cluster of galaxies at redshift z = 0.154. A Chandra X-ray image reveals a shock front in the intracluster medium (ICM) surrounding the radio source, about 160 kpc from the active galactic nucleus (AGN) that hosts it. The shock has a Mach number of 1.65, making it the strongest of the cluster-scale shocks driven by an AGN outburst found so far. The age of the outburst ~5.9e7 y, its energy about 3e61 erg and its mean power ~1.6e46 erg/s. As for the other large AGN outbursts in cooling flow clusters, this outburst overwhelms radiative losses from the ICM of the Hercules A cluster by a factor of ~100. It adds to the case that AGN outbursts are a significant source of preheating for the ICM. Unless the mechanical efficiency of the AGN in Hercules A exceeds 10%, the central black hole must have grown by more than 1.7e8 Msun to power this one outburst.
△ Less
Submitted 15 April, 2005;
originally announced April 2005.
-
Exploring optimization for the random-field Ising model
Authors:
D. Clay Hambrick,
Jan H. Meinke,
A. Alan Middleton
Abstract:
The push-relabel algorithm can be used to calculate rapidly the exact ground states for a given sample with a random-field Ising model (RFIM) Hamiltonian. Although the algorithm is guaranteed to terminate after a time polynomial in the number of spins, implementation details are important for practical performance. Empirical results for the timing in dimensions d=1,2, and 3 are used to determine…
▽ More
The push-relabel algorithm can be used to calculate rapidly the exact ground states for a given sample with a random-field Ising model (RFIM) Hamiltonian. Although the algorithm is guaranteed to terminate after a time polynomial in the number of spins, implementation details are important for practical performance. Empirical results for the timing in dimensions d=1,2, and 3 are used to determine the fastest among several implementations. Direct visualization of the auxiliary fields used by the algorithm provides insight into its operation and suggests how to optimize the algorithm. Recommendations are given for further study of the RFIM.
△ Less
Submitted 12 January, 2005;
originally announced January 2005.
