-
Visual Language Models as Operator Agents in the Space Domain
Authors:
Alejandro Carrasco,
Marco Nedungadi,
Enrico M. Zucchelli,
Amit Jain,
Victor Rodriguez-Fernandez,
Richard Linares
Abstract:
This paper explores the application of Vision-Language Models (VLMs) as operator agents in the space domain, focusing on both software and hardware operational paradigms. Building on advances in Large Language Models (LLMs) and their multimodal extensions, we investigate how VLMs can enhance autonomous control and decision-making in space missions. In the software context, we employ VLMs within th…
▽ More
This paper explores the application of Vision-Language Models (VLMs) as operator agents in the space domain, focusing on both software and hardware operational paradigms. Building on advances in Large Language Models (LLMs) and their multimodal extensions, we investigate how VLMs can enhance autonomous control and decision-making in space missions. In the software context, we employ VLMs within the Kerbal Space Program Differential Games (KSPDG) simulation environment, enabling the agent to interpret visual screenshots of the graphical user interface to perform complex orbital maneuvers. In the hardware context, we integrate VLMs with robotic systems equipped with cameras to inspect and diagnose physical space objects, such as satellites. Our results demonstrate that VLMs can effectively process visual and textual data to generate contextually appropriate actions, competing with traditional methods and non-multimodal LLMs in simulation tasks, and showing promise in real-world applications.
△ Less
Submitted 13 January, 2025;
originally announced January 2025.
-
Language Models are Spacecraft Operators
Authors:
Victor Rodriguez-Fernandez,
Alejandro Carrasco,
Jason Cheng,
Eli Scharf,
Peng Mun Siew,
Richard Linares
Abstract:
Recent trends are emerging in the use of Large Language Models (LLMs) as autonomous agents that take actions based on the content of the user text prompts. We intend to apply these concepts to the field of Guidance, Navigation, and Control in space, enabling LLMs to have a significant role in the decision-making process for autonomous satellite operations. As a first step towards this goal, we hav…
▽ More
Recent trends are emerging in the use of Large Language Models (LLMs) as autonomous agents that take actions based on the content of the user text prompts. We intend to apply these concepts to the field of Guidance, Navigation, and Control in space, enabling LLMs to have a significant role in the decision-making process for autonomous satellite operations. As a first step towards this goal, we have developed a pure LLM-based solution for the Kerbal Space Program Differential Games (KSPDG) challenge, a public software design competition where participants create autonomous agents for maneuvering satellites involved in non-cooperative space operations, running on the KSP game engine. Our approach leverages prompt engineering, few-shot prompting, and fine-tuning techniques to create an effective LLM-based agent that ranked 2nd in the competition. To the best of our knowledge, this work pioneers the integration of LLM agents into space research. Code is available at https://github.com/ARCLab-MIT/kspdg.
△ Less
Submitted 30 March, 2024;
originally announced April 2024.
-
Buoy measurements of strong waves in ice amplitude modulation: a signature of complex physics governing waves in ice attenuation
Authors:
J. Rabault,
T. Halsne,
A. Carrasco,
A. Korosov,
J. Voermans,
P. Bohlinger,
J. B. Debernard,
M. Müller,
Ø. Breivik,
T. Nose,
G. Hope,
F. Collard,
S. Herlédan,
T. Kodaira,
N. Hughes,
Q. Zhang,
K. H. Christensen,
A. Babanin,
L. W. Dreyer,
C. Palerme,
L. Aouf,
K. Christakos,
A. Jensen,
J. Röhrs,
A. Marchenko
, et al. (3 additional authors not shown)
Abstract:
The Marginal Ice Zone (MIZ) forms a critical transition region between the ocean and sea ice cover as it protects the close ice further in from the effect of the steepest and most energetic open ocean waves. As waves propagate through the MIZ, they get exponentially attenuated. Unfortunately, the associated attenuation coefficient is difficult to accurately estimate and model, and there are still…
▽ More
The Marginal Ice Zone (MIZ) forms a critical transition region between the ocean and sea ice cover as it protects the close ice further in from the effect of the steepest and most energetic open ocean waves. As waves propagate through the MIZ, they get exponentially attenuated. Unfortunately, the associated attenuation coefficient is difficult to accurately estimate and model, and there are still large uncertainties around which attenuation mechanisms dominate depending on the conditions. This makes it challenging to predict waves in ice attenuation, as well as sea ice breakup and dynamics. Here, we report in-situ observations of strongly modulated waves-in-ice amplitude, with a modulation period of around 12 hours. We show that simple explanations, such as changes in the incoming open water waves, or the effect of tides and currents and bathymetry, cannot explain for the observed modulation. Therefore, the significant wave height modulation observed in the ice most likely comes from a modulation of the waves-in-ice attenuation coefficient. To explain this, we conjecture that one or several waves-in-ice attenuation mechanisms are periodically modulated and switched on and off in the area of interest. We gather evidence that sea ice convergence and divergence is likely the factor driving this change in the waves in ice attenuation mechanisms and attenuation coefficient, for example by modulating the intensity of floe-floe interaction mechanisms.
△ Less
Submitted 19 August, 2024; v1 submitted 15 January, 2024;
originally announced January 2024.
-
Oil Spill Risk Analysis For The NEOM Shoreline
Authors:
HVR Mittal,
Mohamad Abed El Rahman Hammoud,
Ana K. Carrasco,
Ibrahim Hoteit,
Omar Knio
Abstract:
A risk analysis is conducted considering several release sources located around the NEOM shoreline. The sources are selected close to the coast and in neighboring regions of high marine traffic. The evolution of oil spills released by these sources is simulated using the MOHID model, driven by validated, high-resolution met-ocean fields of the Red Sea. For each source, simulations are conducted ov…
▽ More
A risk analysis is conducted considering several release sources located around the NEOM shoreline. The sources are selected close to the coast and in neighboring regions of high marine traffic. The evolution of oil spills released by these sources is simulated using the MOHID model, driven by validated, high-resolution met-ocean fields of the Red Sea. For each source, simulations are conducted over a 4-week period, starting from first, tenth and twentieth days of each month, covering five consecutive years. A total of 48 simulations are thus conducted for each source location, adequately reflecting the variability of met-ocean conditions in the region. The risk associated with each source is described in terms of amount of oil beached, and by the elapsed time required for the spilled oil to reach the NEOM coast, extending from the Gulf of Aqaba in the North to Duba in the South. A finer analysis is performed by segmenting the NEOM shoreline, based on important coastal development and installation sites. For each subregion, source and release event considered, a histogram of the amount of volume beached is generated, also classifying individual events in terms of the corresponding arrival times. In addition, for each subregion considered, an inverse analysis is conducted to identify regions of dependence of the cumulative risk, estimated using the collection of all sources and events considered. The transport of oil around the NEOM shorelines is promoted by chaotic circulations and northwest winds in summer, and a dominant cyclonic eddy in winter. Hence, spills originating from release sources located close to the NEOM shorelines are characterized by large monthly variations in arrival times, ranging from less than a week to more than two weeks. Large variations in the volume fraction of beached oil, ranging from less then 50\% to more than 80% are reported.
△ Less
Submitted 21 September, 2023;
originally announced September 2023.
-
The Impact of a Reduced High-wind Charnock Parameter on Wave Growth With Application to the North Sea, the Norwegian Sea and the Arctic Ocean
Authors:
Øyvind Breivik,
Ana Carrasco,
Hilde Haakenstad,
Ole Johan Aarnes,
Arno Behrens,
Jean-Raymond Bidlot,
Jan-Victor Björkqvist,
Patrik Bohlinger,
Birgitte R Furevik,
Joanna Staneva,
Magnar Reistad
Abstract:
As atmospheric models move to higher resolution and resolve smaller scales, the maximum modeled wind speed also tends to increase. Wave models tuned to coarser wind fields tend to overestimate the wave growth under strong winds. A recently developed semi-empirical parameterization of the Charnock parameter, which controls the roughness length over surface waves, substantially reduces the aerodynam…
▽ More
As atmospheric models move to higher resolution and resolve smaller scales, the maximum modeled wind speed also tends to increase. Wave models tuned to coarser wind fields tend to overestimate the wave growth under strong winds. A recently developed semi-empirical parameterization of the Charnock parameter, which controls the roughness length over surface waves, substantially reduces the aerodynamic drag of waves in high winds (above a threshold of 30 m/s). Here we apply the formulation in a recent version of the wave model WAM (Cycle 4.7), which uses a modified version of the physics parameterizations by Ardhuin et al (2010) as well as subgrid obstructions for better performance around complex topography. The new Charnock formulation is tested with wind forcing from NORA3, a recently completed non-hydrostatic atmospheric downscaling of the global reanalysis ERA5 for the North Sea, the Norwegian Sea and the Barents Sea. Such high-resolution atmospheric model integrations tend to have stronger (and more realistic) upper-percentile winds than what is typically found in coarser atmospheric models. A two-year comparison (2011-2012) of a control run against the run with the modified Charnock parameter shows a dramatic reduction of the wave height bias in high-wind cases. The added computational cost of the new physics and the reduction of the Charnock parameter compared to the earlier WAM physics is modest (14%). A longer (1998-2020) hindcast integration with the new Charnock parameter is found to compare well against in situ and altimeter wave measurements both for intermediate and high sea states.
△ Less
Submitted 14 March, 2022;
originally announced March 2022.
-
First year of energetic particle measurements in the inner heliosphere with Solar Orbiter's Energetic Particle Detector
Authors:
R. F. Wimmer-Schweingruber,
N. Janitzek,
D. Pacheco,
I. Cernuda,
F. Espinosa Lara,
R. Gómez-Herrero,
G. M. Mason,
R. C. Allen,
Z. G. Xu,
F. Carcaboso,
A. Kollhoff,
P. Kühl,
J. L. Freiherr von Forstner,
L. Berger,
J. Rodriguez-Pacheco,
G. C. Ho,
G. B. Andrews,
V. Angelini,
A. Aran,
S. Boden,
S. I. Böttcher,
A. Carrasco,
N. Dresing,
S. Eldrum,
R. Elftmann
, et al. (23 additional authors not shown)
Abstract:
Solar Orbiter strives to unveil how the Sun controls and shapes the heliosphere and fills it with energetic particle radiation. To this end, its Energetic Particle Detector (EPD) has now been in operation, providing excellent data, for just over a year. EPD measures suprathermal and energetic particles in the energy range from a few keV up to (near-) relativistic energies (few MeV for electrons an…
▽ More
Solar Orbiter strives to unveil how the Sun controls and shapes the heliosphere and fills it with energetic particle radiation. To this end, its Energetic Particle Detector (EPD) has now been in operation, providing excellent data, for just over a year. EPD measures suprathermal and energetic particles in the energy range from a few keV up to (near-) relativistic energies (few MeV for electrons and about 500 MeV/nuc for ions). We present an overview of the initial results from the first year of operations and we provide a first assessment of issues and limitations. During this first year of operations of the Solar Orbiter mission, EPD has recorded several particle events at distances between 0.5 and 1 au from the Sun. We present dynamic and time-averaged energy spectra for ions that were measured with a combination of all four EPD sensors, namely: the SupraThermal Electron and Proton sensor (STEP), the Electron Proton Telescope (EPT), the Suprathermal Ion Spectrograph (SIS), and the High-Energy Telescope (HET) as well as the associated energy spectra for electrons measured with STEP and EPT. We illustrate the capabilities of the EPD suite using the 10-11 December 2020 solar particle event. This event showed an enrichment of heavy ions as well as $^3$He, for which we also present dynamic spectra measured with SIS. The high anisotropy of electrons at the onset of the event and its temporal evolution is also shown using data from these sensors. We discuss the ongoing in-flight calibration and a few open instrumental issues using data from the 21 July and the 10-11 December 2020 events and give guidelines and examples for the usage of the EPD data. We explain how spacecraft operations may affect EPD data and we present a list of such time periods in the appendix. A list of the most significant particle enhancements as observed by EPT during this first year is also provided.
△ Less
Submitted 4 August, 2021;
originally announced August 2021.
-
Using smartphone photographs of the Moon to acquaint students with non-Euclidean geometry
Authors:
Hugo Caerols,
Rodrigo A. Carrasco,
Felipe A. Asenjo
Abstract:
Although they are sometimes considered problematic to grasp by students, the concepts behind non-Euclidean geometry can be taught using astronomical images. By using photographs of the Moon taken with a smartphone through a simple telescope, we were able to introduce these concepts to high-school students and college newcomers. By recognizing different Moon geological structures within the photogr…
▽ More
Although they are sometimes considered problematic to grasp by students, the concepts behind non-Euclidean geometry can be taught using astronomical images. By using photographs of the Moon taken with a smartphone through a simple telescope, we were able to introduce these concepts to high-school students and college newcomers. By recognizing different Moon geological structures within the photograph, we teach students how to calculate distances of mountain ranges or areas of craters on the Moon's surface, introducing the notions of geodesics and spherical triangles. Furthermore, students can empirically see that the correct estimations for the actual values cannot be obtained using flat geometry. Instead, by using three--dimensional curved geometry, precise estimates of lengths and areas of geological elements in the Moon can be computed with less than 4\% error. These procedures help students understand, concretely, non-Euclidean geometry concepts.
△ Less
Submitted 22 July, 2021;
originally announced July 2021.
-
Alkoxide-intercalated NiFe-layered double hydroxides magnetic nanosheets as efficient water oxidation electrocatalysts
Authors:
Jose A. Carrasco,
Jorge Romero,
María Varela,
Frank Hauke,
Gonzalo Abellán,
Andreas Hirsch,
Eugenio Coronado
Abstract:
Alkoxide-intercalated NiFe-layered double hydroxides were synthesized via the nonaqueous methanolic route. These nanoplatelets exhibit high crystalline quality as demonstrated by atomic resolution scanning transmission electron microscopy combined with electron energy-loss spectroscopy. Moreover, the presence of the alkoxide moieties has been unambiguously demonstrated by means of thermogravimetri…
▽ More
Alkoxide-intercalated NiFe-layered double hydroxides were synthesized via the nonaqueous methanolic route. These nanoplatelets exhibit high crystalline quality as demonstrated by atomic resolution scanning transmission electron microscopy combined with electron energy-loss spectroscopy. Moreover, the presence of the alkoxide moieties has been unambiguously demonstrated by means of thermogravimetric analysis coupled to a mass spectrometer. These NiFe-LDHs can be exfoliated in water or organic solvents and processed into homogeneous ultra-thin films (< 3nm thick) with the assistance of O2-plasma. The study of their behaviour as water oxidation electrocatalysts has shown an outstanding performance at basic pHs (small overpotential of ca. 249 mV and Tafel slopes in the range of 52-55 mV per decade).
△ Less
Submitted 6 May, 2018;
originally announced May 2018.
-
Wave Extremes in the North East Atlantic from Ensemble Forecasts
Authors:
Øyvind Breivik,
Ole Johan Aarnes,
Jean-Raymond Bidlot,
Ana Carrasco,
Øyvind Saetra
Abstract:
A method for estimating return values from ensembles of forecasts at advanced lead times is presented. Return values of significant wave height in the North-East Atlantic, the Norwegian Sea and the North Sea are computed from archived +240-h forecasts of the ECMWF ensemble prediction system (EPS) from 1999 to 2009.
We make three assumptions: First, each forecast is representative of a six-hour i…
▽ More
A method for estimating return values from ensembles of forecasts at advanced lead times is presented. Return values of significant wave height in the North-East Atlantic, the Norwegian Sea and the North Sea are computed from archived +240-h forecasts of the ECMWF ensemble prediction system (EPS) from 1999 to 2009.
We make three assumptions: First, each forecast is representative of a six-hour interval and collectively the data set is then comparable to a time period of 226 years. Second, the model climate matches the observed distribution, which we confirm by comparing with buoy data. Third, the ensemble members are sufficiently uncorrelated to be considered independent realizations of the model climate. We find anomaly correlations of 0.20, but peak events (>P97) are entirely uncorrelated. By comparing return values from individual members with return values of subsamples of the data set we also find that the estimates follow the same distribution and appear unaffected by correlations in the ensemble. The annual mean and variance over the 11-year archived period exhibit no significant departures from stationarity compared with a recent reforecast, i.e., there is no spurious trend due to model upgrades.
EPS yields significantly higher return values than ERA-40 and ERA-Interim and is in good agreement with the high-resolution hindcast NORA10, except in the lee of unresolved islands where EPS overestimates and in enclosed seas where it is biased low. Confidence intervals are half the width of those found for ERA-Interim due to the magnitude of the data set.
△ Less
Submitted 4 April, 2013;
originally announced April 2013.
-
The principle of superposition for waves
Authors:
L. M. Arévalo Aguilar,
C. Robledo-Sánchez,
M. L. Arroyo Carrasco,
M. M. Mendez Otero
Abstract:
In this paper we will argue that the superposition of waves can be calculated and taught in a simple way. We show, using the Gauss's method to sum an arithmetic sequence, how we can construct the superposition of waves - with different frequencies - in a simple conceptual way that it is easy to teach. By this method we arrive to the usual result where we can express the superposition of waves as t…
▽ More
In this paper we will argue that the superposition of waves can be calculated and taught in a simple way. We show, using the Gauss's method to sum an arithmetic sequence, how we can construct the superposition of waves - with different frequencies - in a simple conceptual way that it is easy to teach. By this method we arrive to the usual result where we can express the superposition of waves as the product of factors, one of them with a cosine funtion where the argument is the average frequency. Most important, we will show that the superposition of waves with sligthly different frequencies produces a \emph{phase modulation} thogether with an amplitude moldulation. It is important to emphasize this result because, to the best of our knowledge, almost all textbooks only mention that there is an amplitude modulation.
△ Less
Submitted 18 May, 2010;
originally announced May 2010.
