Skip to main content

Showing 1–18 of 18 results for author: Hoyer, S

Searching in archive physics. Search in all archives.
.
  1. arXiv:2412.11973  [pdf, other

    physics.ao-ph cs.LG

    Neural general circulation models optimized to predict satellite-based precipitation observations

    Authors: Janni Yuval, Ian Langmore, Dmitrii Kochkov, Stephan Hoyer

    Abstract: Climate models struggle to accurately simulate precipitation, particularly extremes and the diurnal cycle. Here, we present a hybrid model that is trained directly on satellite-based precipitation observations. Our model runs at 2.8$^\circ$ resolution and is built on the differentiable NeuralGCM framework. The model demonstrates significant improvements over existing general circulation models, th… ▽ More

    Submitted 16 December, 2024; originally announced December 2024.

    Comments: 20 pages, 6 figures in Main. 29 pages, 30 figures in SI

  2. arXiv:2408.02767  [pdf, other

    cs.LG math.DS physics.geo-ph

    4D-Var using Hessian approximation and backpropagation applied to automatically-differentiable numerical and machine learning models

    Authors: Kylen Solvik, Stephen G. Penny, Stephan Hoyer

    Abstract: Constraining a numerical weather prediction (NWP) model with observations via 4D variational (4D-Var) data assimilation is often difficult to implement in practice due to the need to develop and maintain a software-based tangent linear model and adjoint model. One of the most common 4D-Var algorithms uses an incremental update procedure, which has been shown to be an approximation of the Gauss-New… ▽ More

    Submitted 5 August, 2024; originally announced August 2024.

    Comments: 24 pages, 7 figures

    ACM Class: J.2; I.6.5; G.1.6

  3. arXiv:2311.07222  [pdf, other

    physics.ao-ph cs.LG physics.comp-ph

    Neural General Circulation Models for Weather and Climate

    Authors: Dmitrii Kochkov, Janni Yuval, Ian Langmore, Peter Norgaard, Jamie Smith, Griffin Mooers, Milan Klöwer, James Lottes, Stephan Rasp, Peter Düben, Sam Hatfield, Peter Battaglia, Alvaro Sanchez-Gonzalez, Matthew Willson, Michael P. Brenner, Stephan Hoyer

    Abstract: General circulation models (GCMs) are the foundation of weather and climate prediction. GCMs are physics-based simulators which combine a numerical solver for large-scale dynamics with tuned representations for small-scale processes such as cloud formation. Recently, machine learning (ML) models trained on reanalysis data achieved comparable or better skill than GCMs for deterministic weather fore… ▽ More

    Submitted 7 March, 2024; v1 submitted 13 November, 2023; originally announced November 2023.

    Comments: 92 pages, 54 figures. Nature (2024)

  4. arXiv:2308.15560  [pdf, other

    physics.ao-ph cs.AI

    WeatherBench 2: A benchmark for the next generation of data-driven global weather models

    Authors: Stephan Rasp, Stephan Hoyer, Alexander Merose, Ian Langmore, Peter Battaglia, Tyler Russel, Alvaro Sanchez-Gonzalez, Vivian Yang, Rob Carver, Shreya Agrawal, Matthew Chantry, Zied Ben Bouallegue, Peter Dueben, Carla Bromberg, Jared Sisk, Luke Barrington, Aaron Bell, Fei Sha

    Abstract: WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and… ▽ More

    Submitted 26 January, 2024; v1 submitted 29 August, 2023; originally announced August 2023.

  5. arXiv:2212.12794  [pdf, other

    cs.LG physics.ao-ph

    GraphCast: Learning skillful medium-range global weather forecasting

    Authors: Remi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson, Peter Wirnsberger, Meire Fortunato, Ferran Alet, Suman Ravuri, Timo Ewalds, Zach Eaton-Rosen, Weihua Hu, Alexander Merose, Stephan Hoyer, George Holland, Oriol Vinyals, Jacklynn Stott, Alexander Pritzel, Shakir Mohamed, Peter Battaglia

    Abstract: Global medium-range weather forecasting is critical to decision-making across many social and economic domains. Traditional numerical weather prediction uses increased compute resources to improve forecast accuracy, but cannot directly use historical weather data to improve the underlying model. We introduce a machine learning-based method called "GraphCast", which can be trained directly from rea… ▽ More

    Submitted 4 August, 2023; v1 submitted 24 December, 2022; originally announced December 2022.

    Comments: GraphCast code and trained weights are available at: https://github.com/deepmind/graphcast

  6. arXiv:2207.00556  [pdf, other

    cs.LG physics.flu-dyn

    Learning to correct spectral methods for simulating turbulent flows

    Authors: Gideon Dresdner, Dmitrii Kochkov, Peter Norgaard, Leonardo Zepeda-Núñez, Jamie A. Smith, Michael P. Brenner, Stephan Hoyer

    Abstract: Despite their ubiquity throughout science and engineering, only a handful of partial differential equations (PDEs) have analytical, or closed-form solutions. This motivates a vast amount of classical work on numerical simulation of PDEs and more recently, a whirlwind of research into data-driven techniques leveraging machine learning (ML). A recent line of work indicates that a hybrid of classical… ▽ More

    Submitted 25 June, 2023; v1 submitted 1 July, 2022; originally announced July 2022.

  7. arXiv:2102.11192  [pdf, other

    cs.LG physics.ao-ph

    Variational Data Assimilation with a Learned Inverse Observation Operator

    Authors: Thomas Frerix, Dmitrii Kochkov, Jamie A. Smith, Daniel Cremers, Michael P. Brenner, Stephan Hoyer

    Abstract: Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a cornerstone of large scale forecasting applications such as numerical weather prediction. As such, it is implemented in current operational systems of weather forec… ▽ More

    Submitted 20 May, 2021; v1 submitted 22 February, 2021; originally announced February 2021.

    Comments: Published at the International Conference on Machine Learning (ICML) 2021

  8. arXiv:2102.01010  [pdf, other

    physics.flu-dyn cs.LG

    Machine learning accelerated computational fluid dynamics

    Authors: Dmitrii Kochkov, Jamie A. Smith, Ayya Alieva, Qing Wang, Michael P. Brenner, Stephan Hoyer

    Abstract: Numerical simulation of fluids plays an essential role in modeling many physical phenomena, such as weather, climate, aerodynamics and plasma physics. Fluids are well described by the Navier-Stokes equations, but solving these equations at scale remains daunting, limited by the computational cost of resolving the smallest spatiotemporal features. This leads to unfavorable trade-offs between accura… ▽ More

    Submitted 28 January, 2021; originally announced February 2021.

    Comments: 13 pages, 9 figures

  9. arXiv:2009.08551  [pdf, other

    physics.comp-ph cs.LG

    Kohn-Sham equations as regularizer: building prior knowledge into machine-learned physics

    Authors: Li Li, Stephan Hoyer, Ryan Pederson, Ruoxi Sun, Ekin D. Cubuk, Patrick Riley, Kieron Burke

    Abstract: Including prior knowledge is important for effective machine learning models in physics, and is usually achieved by explicitly adding loss terms or constraints on model architectures. Prior knowledge embedded in the physics computation itself rarely draws attention. We show that solving the Kohn-Sham equations when training neural networks for the exchange-correlation functional provides an implic… ▽ More

    Submitted 17 November, 2020; v1 submitted 17 September, 2020; originally announced September 2020.

    Journal ref: Phys. Rev. Lett. 126, 036401 (2021)

  10. arXiv:2004.05477  [pdf, other

    physics.comp-ph cond-mat.dis-nn physics.flu-dyn

    Learned discretizations for passive scalar advection in a 2-D turbulent flow

    Authors: Jiawei Zhuang, Dmitrii Kochkov, Yohai Bar-Sinai, Michael P. Brenner, Stephan Hoyer

    Abstract: The computational cost of fluid simulations increases rapidly with grid resolution. This has given a hard limit on the ability of simulations to accurately resolve small scale features of complex flows. Here we use a machine learning approach to learn a numerical discretization that retains high accuracy even when the solution is under-resolved with classical methods. We apply this approach to pas… ▽ More

    Submitted 5 November, 2020; v1 submitted 11 April, 2020; originally announced April 2020.

    Comments: 14 pages, 13 figures

    Journal ref: Phys. Rev. Fluids 6, 064605 (2021)

  11. arXiv:2003.04630  [pdf, other

    cs.LG math.DS physics.comp-ph physics.data-an stat.ML

    Lagrangian Neural Networks

    Authors: Miles Cranmer, Sam Greydanus, Stephan Hoyer, Peter Battaglia, David Spergel, Shirley Ho

    Abstract: Accurate models of the world are built upon notions of its underlying symmetries. In physics, these symmetries correspond to conservation laws, such as for energy and momentum. Yet even though neural network models see increasing use in the physical sciences, they struggle to learn these symmetries. In this paper, we propose Lagrangian Neural Networks (LNNs), which can parameterize arbitrary Lagra… ▽ More

    Submitted 30 July, 2020; v1 submitted 10 March, 2020; originally announced March 2020.

    Comments: 7 pages (+2 appendix). Published in ICLR 2020 Deep Differential Equations Workshop. Code at github.com/MilesCranmer/lagrangian_nns

  12. arXiv:1811.12436  [pdf

    physics.optics cs.LG

    Freeform Diffractive Metagrating Design Based on Generative Adversarial Networks

    Authors: Jiaqi Jiang, David Sell, Stephan Hoyer, Jason Hickey, Jianji Yang, Jonathan A. Fan

    Abstract: A key challenge in metasurface design is the development of algorithms that can effectively and efficiently produce high performance devices. Design methods based on iterative optimization can push the performance limits of metasurfaces, but they require extensive computational resources that limit their implementation to small numbers of microscale devices. We show that generative neural networks… ▽ More

    Submitted 18 June, 2019; v1 submitted 29 November, 2018; originally announced November 2018.

    Comments: 15 pages, 5 figures

  13. arXiv:1808.04930  [pdf, other

    cond-mat.dis-nn physics.comp-ph

    Learning data driven discretizations for partial differential equations

    Authors: Yohai Bar-Sinai, Stephan Hoyer, Jason Hickey, Michael P. Brenner

    Abstract: The numerical solution of partial differential equations (PDEs) is challenging because of the need to resolve spatiotemporal features over wide length and timescales. Often, it is computationally intractable to resolve the finest features in the solution. The only recourse is to use approximate coarse-grained representations, which aim to accurately represent long-wavelength dynamics while properl… ▽ More

    Submitted 25 June, 2019; v1 submitted 14 August, 2018; originally announced August 2018.

    Comments: YBS and SH contributed equally to this work. 7 pages, 4 figures (+ Appendix: 9 pages, 10 figures)

    Journal ref: PNAS July 30, 2019 116 (31) 15344-15349

  14. arXiv:1311.2091  [pdf, other

    quant-ph cond-mat.mes-hall physics.bio-ph

    Generalized master equation for modular exciton density transfer

    Authors: Seogjoo Jang, Stephan Hoyer, Graham Fleming, K. Birgitta Whaley

    Abstract: A generalized master equation (GME) governing quantum evolution of modular exciton density (MED) is derived for large scale light harvesting systems composed of weakly interacting modules of multiple chromophores. The GME-MED offers a practical framework to incorporate real time coherent quantum dynamics calculations at small length scales into dynamics over large length scales, without assumption… ▽ More

    Submitted 8 November, 2013; originally announced November 2013.

    Comments: 5 pages, 3 figures

  15. arXiv:1307.4807  [pdf, other

    quant-ph physics.chem-ph

    Realistic and verifiable coherent control of excitonic states in a light harvesting complex

    Authors: Stephan Hoyer, Filippo Caruso, Simone Montangero, Mohan Sarovar, Tommaso Calarco, Martin B. Plenio, K. Birgitta Whaley

    Abstract: We explore the feasibility of coherent control of excitonic dynamics in light harvesting complexes, analyzing the limits imposed by the open nature of these quantum systems. We establish feasible targets for phase and phase/amplitude control of the electronically excited state populations in the Fenna-Mathews-Olson (FMO) complex and analyze the robustness of this control with respect to orientatio… ▽ More

    Submitted 20 January, 2014; v1 submitted 17 July, 2013; originally announced July 2013.

    Comments: 12 pages, 8 figures

    Journal ref: New J. Phys. 16 045007 (2014)

  16. arXiv:1209.6625  [pdf, other

    quant-ph physics.chem-ph

    Inverting pump-probe spectroscopy for state tomography of excitonic systems

    Authors: Stephan Hoyer, K. Birgitta Whaley

    Abstract: We propose a two-step protocol for inverting ultrafast spectroscopy experiments on a molecular aggregate to extract the time-evolution of the excited state density matrix. The first step is a deconvolution of the experimental signal to determine a pump-dependent response function. The second step inverts the quantum state of the system from this response function, given a model for how the system… ▽ More

    Submitted 2 April, 2013; v1 submitted 28 September, 2012; originally announced September 2012.

    Comments: 15 pages, 6 figures. This is the accepted version for publication in the Journal of Chemical Physics

    Journal ref: J. Chem. Phys. 138, 164102 (2013)

  17. arXiv:1106.2911  [pdf, other

    quant-ph physics.bio-ph physics.chem-ph

    Spatial propagation of excitonic coherence enables ratcheted energy transfer

    Authors: Stephan Hoyer, Akihito Ishizaki, K. Birgitta Whaley

    Abstract: Experimental evidence shows that a variety of photosynthetic systems can preserve quantum beats in the process of electronic energy transfer, even at room temperature. However, whether this quantum coherence arises in vivo and whether it has any biological function have remained unclear. Here we present a theoretical model that suggests that the creation and recreation of coherence under natural c… ▽ More

    Submitted 17 September, 2012; v1 submitted 15 June, 2011; originally announced June 2011.

    Comments: Accepted version for Phys. Rev. E. 14 pages, 7 figures

    Journal ref: Phys. Rev. E 86, 041911 (2012)

  18. arXiv:0910.1847  [pdf, other

    quant-ph physics.bio-ph physics.chem-ph

    Limits of quantum speedup in photosynthetic light harvesting

    Authors: Stephan Hoyer, Mohan Sarovar, K. Birgitta Whaley

    Abstract: It has been suggested that excitation transport in photosynthetic light harvesting complexes features speedups analogous to those found in quantum algorithms. Here we compare the dynamics in these light harvesting systems to the dynamics of quantum walks, in order to elucidate the limits of such quantum speedups. For the Fenna-Matthews-Olson (FMO) complex of green sulfur bacteria, we show that whi… ▽ More

    Submitted 7 May, 2010; v1 submitted 12 October, 2009; originally announced October 2009.

    Comments: 9 pages, 6 figures. To appear in New Journal Physics, special issue on "Quantum Effects and Noise in Biomolecules." Updated to accepted version

    Journal ref: New J. Phys. 12, 065041 (2010)