Skip to main content

Showing 1–23 of 23 results for author: Kashinath, K

.
  1. arXiv:2505.06474  [pdf, ps, other

    physics.ao-ph

    Climate in a Bottle: Towards a Generative Foundation Model for the Kilometer-Scale Global Atmosphere

    Authors: Noah D. Brenowitz, Tao Ge, Akshay Subramaniam, Aayush Gupta, David M. Hall, Morteza Mardani, Arash Vahdat, Karthik Kashinath, Michael S. Pritchard

    Abstract: AI emulators offer a path to compressing, boosting limited ensembles, and improving the latency of interacting with petabyte-scale climate prediction data. However, prevailing auto-regressive paradigms offer limited flexibility, and are challenging to train on climate time horizons due to drifts, instabilities and component-coupling challenges. Conditionally generative models offer an appealing al… ▽ More

    Submitted 9 May, 2025; originally announced May 2025.

  2. arXiv:2408.10958  [pdf, other

    physics.ao-ph cs.LG

    Kilometer-Scale Convection Allowing Model Emulation using Generative Diffusion Modeling

    Authors: Jaideep Pathak, Yair Cohen, Piyush Garg, Peter Harrington, Noah Brenowitz, Dale Durran, Morteza Mardani, Arash Vahdat, Shaoming Xu, Karthik Kashinath, Michael Pritchard

    Abstract: Storm-scale convection-allowing models (CAMs) are an important tool for predicting the evolution of thunderstorms and mesoscale convective systems that result in damaging extreme weather. By explicitly resolving convective dynamics within the atmosphere they afford meteorologists the nuance needed to provide outlook on hazard. Deep learning models have thus far not proven skilful at km-scale atmos… ▽ More

    Submitted 20 August, 2024; originally announced August 2024.

  3. arXiv:2408.03100  [pdf, other

    physics.ao-ph cs.LG

    Huge Ensembles Part I: Design of Ensemble Weather Forecasts using Spherical Fourier Neural Operators

    Authors: Ankur Mahesh, William Collins, Boris Bonev, Noah Brenowitz, Yair Cohen, Joshua Elms, Peter Harrington, Karthik Kashinath, Thorsten Kurth, Joshua North, Travis OBrien, Michael Pritchard, David Pruitt, Mark Risser, Shashank Subramanian, Jared Willard

    Abstract: Studying low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computatio… ▽ More

    Submitted 3 April, 2025; v1 submitted 6 August, 2024; originally announced August 2024.

  4. arXiv:2408.01581  [pdf, other

    cs.LG physics.ao-ph

    Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators

    Authors: Ankur Mahesh, William Collins, Boris Bonev, Noah Brenowitz, Yair Cohen, Peter Harrington, Karthik Kashinath, Thorsten Kurth, Joshua North, Travis OBrien, Michael Pritchard, David Pruitt, Mark Risser, Shashank Subramanian, Jared Willard

    Abstract: In Part I, we created an ensemble based on Spherical Fourier Neural Operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it require… ▽ More

    Submitted 3 April, 2025; v1 submitted 2 August, 2024; originally announced August 2024.

  5. arXiv:2406.16947  [pdf, other

    cs.LG physics.ao-ph

    Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales

    Authors: Peter Manshausen, Yair Cohen, Peter Harrington, Jaideep Pathak, Mike Pritchard, Piyush Garg, Morteza Mardani, Karthik Kashinath, Simon Byrne, Noah Brenowitz

    Abstract: Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data without retraining the model. They could also dramatically accelerate the costly data assimilation process used in operational regional weather models. Here, in a… ▽ More

    Submitted 1 April, 2025; v1 submitted 19 June, 2024; originally announced June 2024.

    Comments: 22 pages, 9 figures

    ACM Class: J.2

  6. arXiv:2310.02074  [pdf, other

    physics.ao-ph cs.LG

    ACE: A fast, skillful learned global atmospheric model for climate prediction

    Authors: Oliver Watt-Meyer, Gideon Dresdner, Jeremy McGibbon, Spencer K. Clark, Brian Henn, James Duncan, Noah D. Brenowitz, Karthik Kashinath, Michael S. Pritchard, Boris Bonev, Matthew E. Peters, Christopher S. Bretherton

    Abstract: Existing ML-based atmospheric models are not suitable for climate prediction, which requires long-term stability and physical consistency. We present ACE (AI2 Climate Emulator), a 200M-parameter, autoregressive machine learning emulator of an existing comprehensive 100-km resolution global atmospheric model. The formulation of ACE allows evaluation of physical laws such as the conservation of mass… ▽ More

    Submitted 6 December, 2023; v1 submitted 3 October, 2023; originally announced October 2023.

    Comments: Accepted at Tackling Climate Change with Machine Learning: workshop at NeurIPS 2023

  7. arXiv:2309.15214  [pdf, other

    cs.LG physics.ao-ph

    Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling

    Authors: Morteza Mardani, Noah Brenowitz, Yair Cohen, Jaideep Pathak, Chieh-Yu Chen, Cheng-Chin Liu, Arash Vahdat, Mohammad Amin Nabian, Tao Ge, Akshay Subramaniam, Karthik Kashinath, Jan Kautz, Mike Pritchard

    Abstract: The state of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over T… ▽ More

    Submitted 11 August, 2024; v1 submitted 24 September, 2023; originally announced September 2023.

  8. arXiv:2309.09002  [pdf

    physics.ao-ph cs.AI cs.CE cs.CY physics.soc-ph

    Earth Virtualization Engines -- A Technical Perspective

    Authors: Torsten Hoefler, Bjorn Stevens, Andreas F. Prein, Johanna Baehr, Thomas Schulthess, Thomas F. Stocker, John Taylor, Daniel Klocke, Pekka Manninen, Piers M. Forster, Tobias Kölling, Nicolas Gruber, Hartwig Anzt, Claudia Frauen, Florian Ziemen, Milan Klöwer, Karthik Kashinath, Christoph Schär, Oliver Fuhrer, Bryan N. Lawrence

    Abstract: Participants of the Berlin Summit on Earth Virtualization Engines (EVEs) discussed ideas and concepts to improve our ability to cope with climate change. EVEs aim to provide interactive and accessible climate simulations and data for a wide range of users. They combine high-resolution physics-based models with machine learning techniques to improve the fidelity, efficiency, and interpretability of… ▽ More

    Submitted 16 September, 2023; originally announced September 2023.

  9. arXiv:2306.03838  [pdf, other

    cs.LG math.NA physics.ao-ph physics.comp-ph

    Spherical Fourier Neural Operators: Learning Stable Dynamics on the Sphere

    Authors: Boris Bonev, Thorsten Kurth, Christian Hundt, Jaideep Pathak, Maximilian Baust, Karthik Kashinath, Anima Anandkumar

    Abstract: Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is their ability to accurately model long-range dependencies in spatio-temporal data by learning global convolutions in a computationally efficient manner. To this… ▽ More

    Submitted 6 June, 2023; originally announced June 2023.

  10. arXiv:2304.12586  [pdf, other

    physics.comp-ph cs.LG math.DS nlin.PS

    Unsupervised Discovery of Extreme Weather Events Using Universal Representations of Emergent Organization

    Authors: Adam Rupe, Karthik Kashinath, Nalini Kumar, James P. Crutchfield

    Abstract: Spontaneous self-organization is ubiquitous in systems far from thermodynamic equilibrium. While organized structures that emerge dominate transport properties, universal representations that identify and describe these key objects remain elusive. Here, we introduce a theoretically-grounded framework for describing emergent organization that, via data-driven algorithms, is constructive in practice… ▽ More

    Submitted 28 September, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

  11. arXiv:2210.12293  [pdf, other

    physics.ao-ph cs.LG

    DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting

    Authors: Tao Ge, Jaideep Pathak, Akshay Subramaniam, Karthik Kashinath

    Abstract: Data-driven models, such as FourCastNet (FCN), have shown exemplary performance in high-resolution global weather forecasting. This performance, however, is based on supervision on mesh-gridded weather data without the utilization of raw climate observational data, the gold standard ground truth. In this work we develop a methodology to correct, remap, and fine-tune gridded uniform forecasts of FC… ▽ More

    Submitted 21 October, 2022; originally announced October 2022.

  12. arXiv:2208.05419  [pdf, ps, other

    physics.ao-ph cs.AI cs.CV cs.LG cs.PF

    FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operators

    Authors: Thorsten Kurth, Shashank Subramanian, Peter Harrington, Jaideep Pathak, Morteza Mardani, David Hall, Andrea Miele, Karthik Kashinath, Animashree Anandkumar

    Abstract: Extreme weather amplified by climate change is causing increasingly devastating impacts across the globe. The current use of physics-based numerical weather prediction (NWP) limits accuracy due to high computational cost and strict time-to-solution limits. We report that a data-driven deep learning Earth system emulator, FourCastNet, can predict global weather and generate medium-range forecasts f… ▽ More

    Submitted 8 August, 2022; originally announced August 2022.

  13. arXiv:2202.11214  [pdf, other

    physics.ao-ph cs.LG

    FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators

    Authors: Jaideep Pathak, Shashank Subramanian, Peter Harrington, Sanjeev Raja, Ashesh Chattopadhyay, Morteza Mardani, Thorsten Kurth, David Hall, Zongyi Li, Kamyar Azizzadenesheli, Pedram Hassanzadeh, Karthik Kashinath, Animashree Anandkumar

    Abstract: FourCastNet, short for Fourier Forecasting Neural Network, is a global data-driven weather forecasting model that provides accurate short to medium-range global predictions at $0.25^{\circ}$ resolution. FourCastNet accurately forecasts high-resolution, fast-timescale variables such as the surface wind speed, precipitation, and atmospheric water vapor. It has important implications for planning win… ▽ More

    Submitted 22 February, 2022; originally announced February 2022.

  14. arXiv:2103.09360  [pdf, other

    physics.ao-ph cs.AI cs.LG physics.comp-ph

    Towards physically consistent data-driven weather forecasting: Integrating data assimilation with equivariance-preserving deep spatial transformers

    Authors: Ashesh Chattopadhyay, Mustafa Mustafa, Pedram Hassanzadeh, Eviatar Bach, Karthik Kashinath

    Abstract: There is growing interest in data-driven weather prediction (DDWP), for example using convolutional neural networks such as U-NETs that are trained on data from models or reanalysis. Here, we propose 3 components to integrate with commonly used DDWP models in order to improve their physical consistency and forecast accuracy. These components are 1) a deep spatial transformer added to the latent sp… ▽ More

    Submitted 16 March, 2021; originally announced March 2021.

    Comments: Under review in Geoscientific Model Development

  15. arXiv:2010.00072  [pdf, ps, other

    physics.comp-ph cs.LG physics.geo-ph

    Using Machine Learning to Augment Coarse-Grid Computational Fluid Dynamics Simulations

    Authors: Jaideep Pathak, Mustafa Mustafa, Karthik Kashinath, Emmanuel Motheau, Thorsten Kurth, Marcus Day

    Abstract: Simulation of turbulent flows at high Reynolds number is a computationally challenging task relevant to a large number of engineering and scientific applications in diverse fields such as climate science, aerodynamics, and combustion. Turbulent flows are typically modeled by the Navier-Stokes equations. Direct Numerical Simulation (DNS) of the Navier-Stokes equations with sufficient numerical reso… ▽ More

    Submitted 3 October, 2020; v1 submitted 30 September, 2020; originally announced October 2020.

    Comments: Corrected typographical errors in the previous version related to the incorrectly formatted accented character "é" appearing in various places in the manuscript

  16. arXiv:2005.01463  [pdf, other

    cs.LG eess.IV physics.flu-dyn stat.ML

    MeshfreeFlowNet: A Physics-Constrained Deep Continuous Space-Time Super-Resolution Framework

    Authors: Chiyu Max Jiang, Soheil Esmaeilzadeh, Kamyar Azizzadenesheli, Karthik Kashinath, Mustafa Mustafa, Hamdi A. Tchelepi, Philip Marcus, Prabhat, Anima Anandkumar

    Abstract: We propose MeshfreeFlowNet, a novel deep learning-based super-resolution framework to generate continuous (grid-free) spatio-temporal solutions from the low-resolution inputs. While being computationally efficient, MeshfreeFlowNet accurately recovers the fine-scale quantities of interest. MeshfreeFlowNet allows for: (i) the output to be sampled at all spatio-temporal resolutions, (ii) a set of Par… ▽ More

    Submitted 21 August, 2020; v1 submitted 1 May, 2020; originally announced May 2020.

    Comments: Supplementary Video: https://youtu.be/mjqwPch9gDo. Accepted to SC20

  17. arXiv:1911.08655  [pdf, other

    physics.comp-ph cs.LG stat.ML

    Towards Physics-informed Deep Learning for Turbulent Flow Prediction

    Authors: Rui Wang, Karthik Kashinath, Mustafa Mustafa, Adrian Albert, Rose Yu

    Abstract: While deep learning has shown tremendous success in a wide range of domains, it remains a grand challenge to incorporate physical principles in a systematic manner to the design, training, and inference of such models. In this paper, we aim to predict turbulent flow by learning its highly nonlinear dynamics from spatiotemporal velocity fields of large-scale fluid flow simulations of relevance to t… ▽ More

    Submitted 13 June, 2020; v1 submitted 19 November, 2019; originally announced November 2019.

  18. arXiv:1909.11822  [pdf, other

    physics.comp-ph cs.LG cs.PF

    DisCo: Physics-Based Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems

    Authors: Adam Rupe, Nalini Kumar, Vladislav Epifanov, Karthik Kashinath, Oleksandr Pavlyk, Frank Schlimbach, Mostofa Patwary, Sergey Maidanov, Victor Lee, Prabhat, James P. Crutchfield

    Abstract: Extracting actionable insight from complex unlabeled scientific data is an open challenge and key to unlocking data-driven discovery in science. Complementary and alternative to supervised machine learning approaches, unsupervised physics-based methods based on behavior-driven theories hold great promise. Due to computational limitations, practical application on real-world domain science problems… ▽ More

    Submitted 25 September, 2019; originally announced September 2019.

  19. arXiv:1909.07520  [pdf, other

    physics.comp-ph cs.LG physics.ao-ph physics.flu-dyn

    Towards Unsupervised Segmentation of Extreme Weather Events

    Authors: Adam Rupe, Karthik Kashinath, Nalini Kumar, Victor Lee, Prabhat, James P. Crutchfield

    Abstract: Extreme weather is one of the main mechanisms through which climate change will directly impact human society. Coping with such change as a global community requires markedly improved understanding of how global warming drives extreme weather events. While alternative climate scenarios can be simulated using sophisticated models, identifying extreme weather events in these simulations requires aut… ▽ More

    Submitted 16 September, 2019; originally announced September 2019.

  20. arXiv:1905.06841  [pdf, other

    physics.comp-ph physics.flu-dyn stat.ML

    Enforcing Statistical Constraints in Generative Adversarial Networks for Modeling Chaotic Dynamical Systems

    Authors: Jin-Long Wu, Karthik Kashinath, Adrian Albert, Dragos Chirila, Prabhat, Heng Xiao

    Abstract: Simulating complex physical systems often involves solving partial differential equations (PDEs) with some closures due to the presence of multi-scale physics that cannot be fully resolved. Therefore, reliable and accurate closure models for unresolved physics remains an important requirement for many computational physics problems, e.g., turbulence simulation. Recently, several researchers have a… ▽ More

    Submitted 13 May, 2019; originally announced May 2019.

  21. arXiv:1902.04621  [pdf, other

    physics.ao-ph

    Testing the Reliability of Interpretable Neural Networks in Geoscience Using the Madden-Julian Oscillation

    Authors: Benjamin A. Toms, Karthik Kashinath, Prabhat, Da Yang

    Abstract: We test the reliability of two neural network interpretation techniques, backward optimization and layerwise relevance propagation, within geoscientific applications by applying them to a commonly studied geophysical phenomenon, the Madden-Julian Oscillation. The Madden-Julian Oscillation is a multi-scale pattern within the tropical atmosphere that has been extensively studied over the past decade… ▽ More

    Submitted 27 May, 2020; v1 submitted 12 February, 2019; originally announced February 2019.

    Comments: This manuscript has been submitted for peer review

  22. arXiv:1901.02039  [pdf, other

    cs.CV cs.AI cs.LG

    Spherical CNNs on Unstructured Grids

    Authors: Chiyu "Max" Jiang, Jingwei Huang, Karthik Kashinath, Prabhat, Philip Marcus, Matthias Niessner

    Abstract: We present an efficient convolution kernel for Convolutional Neural Networks (CNNs) on unstructured grids using parameterized differential operators while focusing on spherical signals such as panorama images or planetary signals. To this end, we replace conventional convolution kernels with linear combinations of differential operators that are weighted by learnable parameters. Differential opera… ▽ More

    Submitted 7 January, 2019; originally announced January 2019.

    Comments: Accepted as a conference paper at ICLR 2019. Codes available at https://github.com/maxjiang93/ugscnn

  23. arXiv:1709.03184  [pdf, other

    physics.flu-dyn cond-mat.stat-mech nlin.PS physics.ao-ph

    A Physics-Based Approach to Unsupervised Discovery of Coherent Structures in Spatiotemporal Systems

    Authors: A. Rupe, J. P. Crutchfield, K. Kashinath, Prabhat

    Abstract: Given that observational and numerical climate data are being produced at ever more prodigious rates, increasingly sophisticated and automated analysis techniques have become essential. Deep learning is quickly becoming a standard approach for such analyses and, while great progress is being made, major challenges remain. Unlike commercial applications in which deep learning has led to surprising… ▽ More

    Submitted 10 September, 2017; originally announced September 2017.

    Comments: 4 pages, 1 figure; http://csc.ucdavis.edu/~cmg/compmech/pubs/ci2017_Rupe_et_al.htm