-
ARCANE -- Early Detection of Interplanetary Coronal Mass Ejections
Authors:
H. T. Rüdisser,
G. Nguyen,
J. Le Louëdec,
C. Möstl
Abstract:
Interplanetary coronal mass ejections (ICMEs) are major drivers of space weather disturbances, posing risks to both technological infrastructure and human activities. Automatic detection of ICMEs in solar wind in situ data is essential for early warning systems. While several methods have been proposed to identify these structures in time series data, robust real-time detection remains a significa…
▽ More
Interplanetary coronal mass ejections (ICMEs) are major drivers of space weather disturbances, posing risks to both technological infrastructure and human activities. Automatic detection of ICMEs in solar wind in situ data is essential for early warning systems. While several methods have been proposed to identify these structures in time series data, robust real-time detection remains a significant challenge. In this work, we present ARCANE - the first framework explicitly designed for early ICME detection in streaming solar wind data under realistic operational constraints, enabling event identification without requiring observation of the full structure. Our approach evaluates the strengths and limitations of detection models by comparing a machine learning-based method to a threshold-based baseline. The ResUNet++ model, previously validated on science data, significantly outperforms the baseline, particularly in detecting high-impact events, while retaining solid performance on lower-impact cases. Notably, we find that using real-time solar wind (RTSW) data instead of high-resolution science data leads to only minimal performance degradation. Despite the challenges of operational settings, our detection pipeline achieves an F1 score of 0.53, with an average detection delay of 21.5% of the event's duration while only seeing a minimal amount of data. As more data becomes available, the performance increases significantly. These results mark a substantial step forward in automated space weather monitoring and lay the groundwork for enhanced real-time forecasting capabilities.
△ Less
Submitted 14 May, 2025;
originally announced May 2025.
-
Beacon2Science: Enhancing STEREO/HI beacon data1 with machine learning for efficient CME tracking
Authors:
Justin Le Louëdec,
Maike Bauer,
Tanja Amerstorfer,
Jackie A. Davies
Abstract:
Observing and forecasting coronal mass ejections (CME) in real-time is crucial due to the strong geomagnetic storms they can generate that can have a potentially damaging effect, for example, on satellites and electrical devices. With its near-real-time availability, STEREO/HI beacon data is the perfect candidate for early forecasting of CMEs. However, previous work concluded that CME arrival pred…
▽ More
Observing and forecasting coronal mass ejections (CME) in real-time is crucial due to the strong geomagnetic storms they can generate that can have a potentially damaging effect, for example, on satellites and electrical devices. With its near-real-time availability, STEREO/HI beacon data is the perfect candidate for early forecasting of CMEs. However, previous work concluded that CME arrival prediction based on beacon data could not achieve the same accuracy as with high-resolution science data due to data gaps and lower quality. We present our novel pipeline entitled ''Beacon2Science'', bridging the gap between beacon and science data to improve CME tracking. Through this pipeline, we first enhance the quality (signal-to-noise ratio and spatial resolution) of beacon data. We then increase the time resolution of enhanced beacon images through learned interpolation to match science data's 40-minute resolution. We maximize information coherence between consecutive frames with adapted model architecture and loss functions through the different steps. The improved beacon images are comparable to science data, showing better CME visibility than the original beacon data. Furthermore, we compare CMEs tracked in beacon, enhanced beacon, and science images. The tracks extracted from enhanced beacon data are closer to those from science images, with a mean average error of $\sim 0.5 ^\circ$ of elongation compared to $1^\circ$ with original beacon data. The work presented in this paper paves the way for its application to forthcoming missions such as Vigil and PUNCH.
△ Less
Submitted 19 March, 2025;
originally announced March 2025.
-
First observations of a geomagnetic superstorm with a sub-L1 monitor
Authors:
Eva Weiler,
Christian Möstl,
Emma E. Davies,
Astrid Veronig,
Ute V. Amerstorfer,
Tanja Amerstorfer,
Justin Le Louëdec,
Maike Bauer,
Noé Lugaz,
Veronika Haberle,
Hannah T. Rüdisser,
Satabdwa Majumdar,
Martin Reiss
Abstract:
Forecasting the geomagnetic effects of solar coronal mass ejections (CMEs) is currently an unsolved problem. CMEs, responsible for the largest values of the north-south component of the interplanetary magnetic field, are the key driver of intense and extreme geomagnetic activity. Observations of southward interplanetary magnetic fields are currently only accessible directly through in situ measure…
▽ More
Forecasting the geomagnetic effects of solar coronal mass ejections (CMEs) is currently an unsolved problem. CMEs, responsible for the largest values of the north-south component of the interplanetary magnetic field, are the key driver of intense and extreme geomagnetic activity. Observations of southward interplanetary magnetic fields are currently only accessible directly through in situ measurements by spacecraft in the solar wind. On 10-12 May 2024, the strongest geomagnetic storm since 2003 took place, caused by five interacting CMEs. We clarify the relationship between the CMEs, their solar source regions, and the resulting signatures at the Sun-Earth L1 point observed by the ACE spacecraft at 1.00 AU. The STEREO-A spacecraft was situated at 0.956 AU and 12.6° west of Earth during the event, serving as a fortuitous sub-L1 monitor providing interplanetary magnetic field measurements of the solar wind. We demonstrate an extension of the prediction lead time, as the shock was observed 2.57 hours earlier at STEREO-A than at L1, consistent with the measured shock speed at L1, 710 km/s, and the radial distance of 0.04 AU. By deriving the geomagnetic indices based on the STEREO-A beacon data, we show that the strength of the geomagnetic storm would have been decently forecasted, with the modeled minimum SYM-H=-478.5 nT, underestimating the observed minimum by only 8%. Our study sets an unprecedented benchmark for future mission design using upstream monitoring for space weather prediction.
△ Less
Submitted 20 March, 2025; v1 submitted 19 November, 2024;
originally announced November 2024.
-
Understanding the effects of spacecraft trajectories through solar coronal mass ejection flux ropes using 3DCOREweb
Authors:
Hannah Theresa Rüdisser,
Andreas Jeffrey Weiss,
Justin Le Louëdec,
Ute V. Amerstorfer,
Christian Möstl,
Emma E. Davies,
Helmut Lammer
Abstract:
This study investigates the impact of spacecraft positioning and trajectory on in situ signatures of coronal mass ejections (CMEs). Employing the 3DCORE model, a 3D flux rope model that can generate in situ profiles for any given point in space and time, we conduct forward modeling to analyze such signatures for various latitudinal and longitudinal positions, with respect to the flux rope apex, at…
▽ More
This study investigates the impact of spacecraft positioning and trajectory on in situ signatures of coronal mass ejections (CMEs). Employing the 3DCORE model, a 3D flux rope model that can generate in situ profiles for any given point in space and time, we conduct forward modeling to analyze such signatures for various latitudinal and longitudinal positions, with respect to the flux rope apex, at 0.8~au. Using this approach, we explore the appearance of the resulting in situ profiles for different flux rope types, with different handedness and inclination angles, for both high and low twist CMEs. Our findings reveal that CMEs exhibit distinct differences in signatures between apex hits and flank encounters, with the latter displaying elongated profiles with reduced rotation. However, constant, non-rotating in situ signatures are only observed for flank encounters of low twist CMEs, suggesting the existence of untwisted magnetic field lines within CME legs. Additionally, our study confirms the unambiguous appearance of different flux rope types in in situ signatures, contributing to the broader understanding and interpretation of observational data. Given the model assumptions, this may refute trajectory effects to be the cause for mismatching flux rope types as identified in solar signatures. While acknowledging limitations inherent in our model, such as the assumption of constant twist and non-deformable torus-like shape, we still draw relevant conclusions within the context of global magnetic field structures of CMEs and the potential for distinguishing flux rope types based on in situ observations.
△ Less
Submitted 17 July, 2024; v1 submitted 6 May, 2024;
originally announced May 2024.
-
Key Point-based Orientation Estimation of Strawberries for Robotic Fruit Picking
Authors:
Justin Le Louëdec,
Grzegorz Cielniak
Abstract:
Selective robotic harvesting is a promising technological solution to address labour shortages which are affecting modern agriculture in many parts of the world. For an accurate and efficient picking process, a robotic harvester requires the precise location and orientation of the fruit to effectively plan the trajectory of the end effector. The current methods for estimating fruit orientation emp…
▽ More
Selective robotic harvesting is a promising technological solution to address labour shortages which are affecting modern agriculture in many parts of the world. For an accurate and efficient picking process, a robotic harvester requires the precise location and orientation of the fruit to effectively plan the trajectory of the end effector. The current methods for estimating fruit orientation employ either complete 3D information which typically requires registration from multiple views or rely on fully-supervised learning techniques, which require difficult-to-obtain manual annotation of the reference orientation. In this paper, we introduce a novel key-point-based fruit orientation estimation method allowing for the prediction of 3D orientation from 2D images directly. The proposed technique can work without full 3D orientation annotations but can also exploit such information for improved accuracy. We evaluate our work on two separate datasets of strawberry images obtained from real-world data collection scenarios. Our proposed method achieves state-of-the-art performance with an average error as low as $8^{\circ}$, improving predictions by $\sim30\%$ compared to previous work presented in~\cite{wagner2021efficient}. Furthermore, our method is suited for real-time robotic applications with fast inference times of $\sim30$ms.
△ Less
Submitted 17 October, 2023;
originally announced October 2023.
-
Gaussian map predictions for 3D surface feature localisation and counting
Authors:
Justin Le Louëdec,
Grzegorz Cielniak
Abstract:
In this paper, we propose to employ a Gaussian map representation to estimate precise location and count of 3D surface features, addressing the limitations of state-of-the-art methods based on density estimation which struggle in presence of local disturbances. Gaussian maps indicate probable object location and can be generated directly from keypoint annotations avoiding laborious and costly per-…
▽ More
In this paper, we propose to employ a Gaussian map representation to estimate precise location and count of 3D surface features, addressing the limitations of state-of-the-art methods based on density estimation which struggle in presence of local disturbances. Gaussian maps indicate probable object location and can be generated directly from keypoint annotations avoiding laborious and costly per-pixel annotations. We apply this method to the 3D spheroidal class of objects which can be projected into 2D shape representation enabling efficient processing by a neural network GNet, an improved UNet architecture, which generates the likely locations of surface features and their precise count. We demonstrate a practical use of this technique for counting strawberry achenes which is used as a fruit quality measure in phenotyping applications. The results of training the proposed system on several hundreds of 3D scans of strawberries from a publicly available dataset demonstrate the accuracy and precision of the system which outperforms the state-of-the-art density-based methods for this application.
△ Less
Submitted 7 December, 2021;
originally announced December 2021.
-
3D shape sensing and deep learning-based segmentation of strawberries
Authors:
Justin Le Louëdec,
Grzegorz Cielniak
Abstract:
Automation and robotisation of the agricultural sector are seen as a viable solution to socio-economic challenges faced by this industry. This technology often relies on intelligent perception systems providing information about crops, plants and the entire environment. The challenges faced by traditional 2D vision systems can be addressed by modern 3D vision systems which enable straightforward l…
▽ More
Automation and robotisation of the agricultural sector are seen as a viable solution to socio-economic challenges faced by this industry. This technology often relies on intelligent perception systems providing information about crops, plants and the entire environment. The challenges faced by traditional 2D vision systems can be addressed by modern 3D vision systems which enable straightforward localisation of objects, size and shape estimation, or handling of occlusions. So far, the use of 3D sensing was mainly limited to indoor or structured environments. In this paper, we evaluate modern sensing technologies including stereo and time-of-flight cameras for 3D perception of shape in agriculture and study their usability for segmenting out soft fruit from background based on their shape. To that end, we propose a novel 3D deep neural network which exploits the organised nature of information originating from the camera-based 3D sensors. We demonstrate the superior performance and efficiency of the proposed architecture compared to the state-of-the-art 3D networks. Through a simulated study, we also show the potential of the 3D sensing paradigm for object segmentation in agriculture and provide insights and analysis of what shape quality is needed and expected for further analysis of crops. The results of this work should encourage researchers and companies to develop more accurate and robust 3D sensing technologies to assure their wider adoption in practical agricultural applications.
△ Less
Submitted 26 November, 2021;
originally announced November 2021.
-
Deep learning investigation for chess player attention prediction using eye-tracking and game data
Authors:
Justin Le Louedec,
Thomas Guntz,
James Crowley,
Dominique Vaufreydaz
Abstract:
This article reports on an investigation of the use of convolutional neural networks to predict the visual attention of chess players. The visual attention model described in this article has been created to generate saliency maps that capture hierarchical and spatial features of chessboard, in order to predict the probability fixation for individual pixels Using a skip-layer architecture of an au…
▽ More
This article reports on an investigation of the use of convolutional neural networks to predict the visual attention of chess players. The visual attention model described in this article has been created to generate saliency maps that capture hierarchical and spatial features of chessboard, in order to predict the probability fixation for individual pixels Using a skip-layer architecture of an autoencoder, with a unified decoder, we are able to use multiscale features to predict saliency of part of the board at different scales, showing multiple relations between pieces. We have used scan path and fixation data from players engaged in solving chess problems, to compute 6600 saliency maps associated to the corresponding chess piece configurations. This corpus is completed with synthetically generated data from actual games gathered from an online chess platform. Experiments realized using both scan-paths from chess players and the CAT2000 saliency dataset of natural images, highlights several results. Deep features, pretrained on natural images, were found to be helpful in training visual attention prediction for chess. The proposed neural network architecture is able to generate meaningful saliency maps on unseen chess configurations with good scores on standard metrics. This work provides a baseline for future work on visual attention prediction in similar contexts.
△ Less
Submitted 17 April, 2019;
originally announced April 2019.
