Unifying the Validation of Ambient Solar Wind Models
Authors:
Martin A. Reiss,
Karin Muglach,
Richard Mullinix,
Maria M. Kuznetsova,
Chiu Wiegand,
Manuela Temmer,
Charles N. Arge,
Sergio Dasso,
Shing F. Fung,
Jose Juan Gonzalez Aviles,
Siegfried Gonzi,
Lan Jian,
Peter MacNeice,
Christian Möstl,
Mathew Owens,
Barbara Perri,
Rui F. Pinto,
Lutz Rastätter,
Pete Riley,
Evangelia Samara,
ISWAT H1-01 Team Members
Abstract:
Progress in space weather research and awareness needs community-wide strategies and procedures to evaluate our modeling assets. Here we present the activities of the Ambient Solar Wind Validation Team embedded in the COSPAR ISWAT initiative. We aim to bridge the gap between model developers and end-users to provide the community with an assessment of the state-of-the-art in solar wind forecasting…
▽ More
Progress in space weather research and awareness needs community-wide strategies and procedures to evaluate our modeling assets. Here we present the activities of the Ambient Solar Wind Validation Team embedded in the COSPAR ISWAT initiative. We aim to bridge the gap between model developers and end-users to provide the community with an assessment of the state-of-the-art in solar wind forecasting. To this end, we develop an open online platform for validating solar wind models by comparing their solutions with in situ spacecraft measurements. The online platform will allow the space weather community to test the quality of state-of-the-art solar wind models with unified metrics providing an unbiased assessment of progress over time. In this study, we propose a metadata architecture and recommend community-wide forecasting goals and validation metrics. We conclude with a status update of the online platform and outline future perspectives.
△ Less
Submitted 16 May, 2022; v1 submitted 31 January, 2022;
originally announced January 2022.
Benchmarking CME Arrival Time and Impact: Progress on Metadata, Metrics, and Events
Authors:
C. Verbeke,
M. L. Mays,
M. Temmer,
S. Bingham,
R. Steenburgh,
M. Dumbović,
M. Núñez,
L. K. Jian,
P. Hess,
C. Wiegand,
A. Taktakishvili,
J. Andries
Abstract:
Accurate forecasting of the arrival time and subsequent geomagnetic impacts of Coronal Mass Ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress towards defining community-agreed metrics and validation methods to assess the current state of CME modeling capabilities. This will all…
▽ More
Accurate forecasting of the arrival time and subsequent geomagnetic impacts of Coronal Mass Ejections (CMEs) at Earth is an important objective for space weather forecasting agencies. Recently, the CME Arrival and Impact working team has made significant progress towards defining community-agreed metrics and validation methods to assess the current state of CME modeling capabilities. This will allow the community to quantify our current capabilities and track progress in models over time. Firstly, it is crucial that the community focuses on the collection of the necessary metadata for transparency and reproducibility of results. Concerning CME arrival and impact we have identified 6 different metadata types: 3D CME measurement, model description, model input, CME (non-)arrival observation, model output data and metrics and validation methods. Secondly, the working team has also identified a validation time period, where all events within the following two periods will be considered: 1 January 2011-31 December 2012 and January 2015-31 December 2015. Those two periods amount to a total of about 100 hit events at Earth and a large amount of misses. Considering a time period will remove any bias in selecting events and the event set will represent a sample set that will not be biased by user selection. Lastly, we have defined the basic metrics and skill scores that the CME Arrival and Impact working team will focus on.
△ Less
Submitted 26 November, 2018;
originally announced November 2018.
