-
A Machine Learning Outlook: Post-processing of Global Medium-range Forecasts
Authors:
Shreya Agrawal,
Rob Carver,
Cenk Gazen,
Eric Maddy,
Vladimir Krasnopolsky,
Carla Bromberg,
Zack Ontiveros,
Tyler Russell,
Jason Hickey,
Sid Boukabara
Abstract:
Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques to produce improve localized forecasts, by including additional observations, or determining systematic errors at a finer scale. In this pilot study, we investigate the benefits and challenges of using non-linear neural network (NN) based methods to post-process multi…
▽ More
Post-processing typically takes the outputs of a Numerical Weather Prediction (NWP) model and applies linear statistical techniques to produce improve localized forecasts, by including additional observations, or determining systematic errors at a finer scale. In this pilot study, we investigate the benefits and challenges of using non-linear neural network (NN) based methods to post-process multiple weather features -- temperature, moisture, wind, geopotential height, precipitable water -- at 30 vertical levels, globally and at lead times up to 7 days. We show that we can achieve accuracy improvements of up to 12% (RMSE) in a field such as temperature at 850hPa for a 7 day forecast. However, we recognize the need to strengthen foundational work on objectively measuring a sharp and correct forecast. We discuss the challenges of using standard metrics such as root mean squared error (RMSE) or anomaly correlation coefficient (ACC) as we move from linear statistical models to more complex non-linear machine learning approaches for post-processing global weather forecasts.
△ Less
Submitted 28 March, 2023;
originally announced March 2023.
-
Stable Emulation of an Entire Suite of Model Physics in a State-of-the-Art GCM using a Neural Network
Authors:
Alexei Belochitski,
Vladimir Krasnopolsky
Abstract:
There has been a lot of recent interest in developing hybrid models that couple deterministic numerical model components to statistical model components derived using machine learning techniques. One approach that we follow in this pilot study is to replace an existing computationally expensive deterministic model component with its fast machine-learning-based emulator, leading to the model speed-…
▽ More
There has been a lot of recent interest in developing hybrid models that couple deterministic numerical model components to statistical model components derived using machine learning techniques. One approach that we follow in this pilot study is to replace an existing computationally expensive deterministic model component with its fast machine-learning-based emulator, leading to the model speed-up and/or improvement. We developed a shallow neural network-based emulator of a complete suite of atmospheric physics parameterizations in NCEP Global Forecast System (GFS) general circulation model (GCM). The suite emulated by a single NN includes radiative transfer, cloud macro- and micro-physics, shallow and deep convection, boundary layer processes, gravity wave drag, land model, etc. NCEP GFS with the neural network replacing the original suite of atmospheric parameterizations produces stable and realistic medium range weather forecasts for 24 initial conditions spanning all months of 2018. It also remains stable in a year-long AMIP-like experiment and in the run with a quadrupled horizontal resolution. We present preliminary results of parallel runs, evaluating the accuracy and speedup of the resulting hybrid GCM.
△ Less
Submitted 7 October, 2021; v1 submitted 11 March, 2021;
originally announced March 2021.
-
Robustness of Neural Network Emulations of Radiative Transfer Parameterizations in a State-of-the-Art General Circulation Model
Authors:
Alexei Belochitski,
Vladimir Krasnopolsky
Abstract:
The ability of Machine-Learning (ML) based model components to generalize to the previously unseen inputs, and the resulting stability of the models that use these components, has been receiving a lot of recent attention, especially when it comes to ML-based parameterizations. At the same time, ML-based emulators of existing parameterizations can be stable, accurate, and fast when used in the mode…
▽ More
The ability of Machine-Learning (ML) based model components to generalize to the previously unseen inputs, and the resulting stability of the models that use these components, has been receiving a lot of recent attention, especially when it comes to ML-based parameterizations. At the same time, ML-based emulators of existing parameterizations can be stable, accurate, and fast when used in the model they were specifically designed for. In this work we show that shallow-neural-network-based emulators of radiative transfer parameterizations developed almost a decade ago for a state-of-the-art GCM are robust with respect to the substantial structural and parametric change in the host model: when used in the AMIP-like experiment with the new model, they not only remain stable, but generate realistic output. Aspects of neural network architecture and training set design potentially contributing to stability of ML-based model components are discussed.
△ Less
Submitted 7 April, 2021; v1 submitted 11 March, 2021;
originally announced March 2021.
-
Using Machine Learning for Model Physics: an Overview
Authors:
Vladimir Krasnopolsky,
Aleksei A. Belochitski
Abstract:
In the overview, a generic mathematical object (mapping) is introduced, and its relation to model physics parameterization is explained. Machine learning (ML) tools that can be used to emulate and/or approximate mappings are introduced. Applications of ML to emulate existing parameterizations, to develop new parameterizations, to ensure physical constraints, and control the accuracy of developed a…
▽ More
In the overview, a generic mathematical object (mapping) is introduced, and its relation to model physics parameterization is explained. Machine learning (ML) tools that can be used to emulate and/or approximate mappings are introduced. Applications of ML to emulate existing parameterizations, to develop new parameterizations, to ensure physical constraints, and control the accuracy of developed applications are described. Some ML approaches that allow developers to go beyond the standard parameterization paradigm are discussed.
△ Less
Submitted 20 June, 2022; v1 submitted 2 February, 2020;
originally announced February 2020.
