-
Fourier Neural Operator based surrogates for $CO_2$ storage in realistic geologies
Authors:
Anirban Chandra,
Marius Koch,
Suraj Pawar,
Aniruddha Panda,
Kamyar Azizzadenesheli,
Jeroen Snippe,
Faruk O. Alpak,
Farah Hariri,
Clement Etienam,
Pandu Devarakota,
Anima Anandkumar,
Detlef Hohl
Abstract:
This study aims to develop surrogate models for accelerating decision making processes associated with carbon capture and storage (CCS) technologies. Selection of sub-surface $CO_2$ storage sites often necessitates expensive and involved simulations of $CO_2$ flow fields. Here, we develop a Fourier Neural Operator (FNO) based model for real-time, high-resolution simulation of $CO_2$ plume migratio…
▽ More
This study aims to develop surrogate models for accelerating decision making processes associated with carbon capture and storage (CCS) technologies. Selection of sub-surface $CO_2$ storage sites often necessitates expensive and involved simulations of $CO_2$ flow fields. Here, we develop a Fourier Neural Operator (FNO) based model for real-time, high-resolution simulation of $CO_2$ plume migration. The model is trained on a comprehensive dataset generated from realistic subsurface parameters and offers $O(10^5)$ computational acceleration with minimal sacrifice in prediction accuracy. We also explore super-resolution experiments to improve the computational cost of training the FNO based models. Additionally, we present various strategies for improving the reliability of predictions from the model, which is crucial while assessing actual geological sites. This novel framework, based on NVIDIA's Modulus library, will allow rapid screening of sites for CCS. The discussed workflows and strategies can be applied to other energy solutions like geothermal reservoir modeling and hydrogen storage. Our work scales scientific machine learning models to realistic 3D systems that are more consistent with real-life subsurface aquifers/reservoirs, paving the way for next-generation digital twins for subsurface CCS applications.
△ Less
Submitted 20 March, 2025; v1 submitted 13 March, 2025;
originally announced March 2025.
-
A compact frozen-spin trap for the search for the electric dipole moment of the muon
Authors:
A. Adelmann,
A. R. Bainbridge,
I. Bailey,
A. Baldini,
S. Basnet,
N. Berger,
C. Calzolaio,
L. Caminada,
G. Cavoto,
F. Cei,
R. Chakraborty,
C. Chavez Barajas,
M. Chiappini,
A. Crivellin,
C. Dutsov,
A. Ebrahimi,
M. Francesconi,
L. Galli,
G. Gallucci,
M. Giovannozzi,
H. Goyal,
M. Grassi,
A. Gurgone,
M. Hildebrandt,
M. Hoferichter
, et al. (35 additional authors not shown)
Abstract:
The electric dipole moments~(EDM) of fundamental particles inherently violate parity~(P) and time-reversal~(T) symmetries. By virtue of the CPT theorem in quantum field theory, the latter also implies the violation of the combined charge-conjugation and parity~(CP) symmetry. We aim to measure the EDM of the muon using the frozen-spin technique within a compact storage trap. This method exploits th…
▽ More
The electric dipole moments~(EDM) of fundamental particles inherently violate parity~(P) and time-reversal~(T) symmetries. By virtue of the CPT theorem in quantum field theory, the latter also implies the violation of the combined charge-conjugation and parity~(CP) symmetry. We aim to measure the EDM of the muon using the frozen-spin technique within a compact storage trap. This method exploits the high effective electric field, \$E \approx 165\$ MV/m, experienced in the rest frame of the muon with a momentum of about 23 MeV/c when it passes through a solenoidal magnetic field of \$|\vec{B}|=2.5\$ T. In this paper, we outline the fundamental considerations for a muon EDM search and present a conceptual design for a demonstration experiment to be conducted at secondary muon beamlines of the Paul Scherrer Institute in Switzerland. In Phase~I, with an anticipated data acquisition period of 200 days, the expected sensitivity to a muon EDM is 4E-21 ecm. In a subsequent phase, Phase~II, we propose to improve the sensitivity to 6E-23 ecm using a dedicated instrument installed on a different beamline that produces muons of momentum 125 MeV/c}.
△ Less
Submitted 31 January, 2025;
originally announced January 2025.
-
Dynamic Metal-Support Interaction Dictates Cu Nanoparticle Sintering on Al$_2$O$_3$ Surfaces
Authors:
Jiayan Xu,
Shreeja Das,
Amar Deep Pathak,
Abhirup Patra,
Sharan Shetty,
Detlef Hohl,
Roberto Car
Abstract:
Nanoparticle sintering remains a critical challenge in heterogeneous catalysis. In this work, we present a unified deep potential (DP) model for Cu nanoparticles on three Al$_2$O$_3$ surfaces ($γ$-Al$_2$O$_3$(100), $γ$-Al$_2$O$_3$(110), and $α$-Al$_2$O$_3$(0001)). Using DP-accelerated simulations, we reveal striking facet-dependent nanoparticle stability and mobility patterns across the three surf…
▽ More
Nanoparticle sintering remains a critical challenge in heterogeneous catalysis. In this work, we present a unified deep potential (DP) model for Cu nanoparticles on three Al$_2$O$_3$ surfaces ($γ$-Al$_2$O$_3$(100), $γ$-Al$_2$O$_3$(110), and $α$-Al$_2$O$_3$(0001)). Using DP-accelerated simulations, we reveal striking facet-dependent nanoparticle stability and mobility patterns across the three surfaces. The nanoparticles diffuse several times faster on $α$-Al$_2$O$_3$(0001) than on $γ$-Al$_2$O$_3$(100) at 800 K while expected to be more sluggish based on their larger binding energy at 0 K. Diffusion is facilitated by dynamic metal-support interaction (MSI), where the Al atoms switch out of the surface plane to optimize contact with the nanoparticle and relax back to the plane as the nanoparticle moves away. In contrast, the MSI on $γ$-Al$_2$O$_3$(100) and on $γ$-Al$_2$O$_3$(110) is dominated by more stable and directional Cu-O bonds, consistent with the limited diffusion observed on these surfaces. Our extended long-time MD simulations provide quantitative insights into the sintering processes, showing that the dispersity of nanoparticles (the initial inter-nanoparticle distance) strongly influences coalescence driven by nanoparticle diffusion. We observed that the coalescence of Cu$_{13}$ nanoparticles on $α$-Al$_2$O$_3$(0001) can occur in a short time (10 ns) at 800 K even with an initial inter-nanoparticle distance increased to 30 Å, while the coalescence on $γ$-Al$_2$O$_3$(100) is inhibited significantly by increasing the initial inter-nanoparticle distance from 15 Å to 30 Å. These findings demonstrate that the dynamics of the supporting surface is crucial to understanding the sintering mechanism and offer guidance for designing sinter-resistant catalysts by engineering the support morphology.
△ Less
Submitted 28 January, 2025; v1 submitted 21 January, 2025;
originally announced January 2025.
-
Local Off-Grid Weather Forecasting with Multi-Modal Earth Observation Data
Authors:
Qidong Yang,
Jonathan Giezendanner,
Daniel Salles Civitarese,
Johannes Jakubik,
Eric Schmitt,
Anirban Chandra,
Jeremy Vila,
Detlef Hohl,
Chris Hill,
Campbell Watson,
Sherrie Wang
Abstract:
Urgent applications like wildfire management and renewable energy generation require precise, localized weather forecasts near the Earth's surface. However, forecasts produced by machine learning models or numerical weather prediction systems are typically generated on large-scale regular grids, where direct downscaling fails to capture fine-grained, near-surface weather patterns. In this work, we…
▽ More
Urgent applications like wildfire management and renewable energy generation require precise, localized weather forecasts near the Earth's surface. However, forecasts produced by machine learning models or numerical weather prediction systems are typically generated on large-scale regular grids, where direct downscaling fails to capture fine-grained, near-surface weather patterns. In this work, we propose a multi-modal transformer model trained end-to-end to downscale gridded forecasts to off-grid locations of interest. Our model directly combines local historical weather observations (e.g., wind, temperature, dewpoint) with gridded forecasts to produce locally accurate predictions at various lead times. Multiple data modalities are collected and concatenated at station-level locations, treated as a token at each station. Using self-attention, the token corresponding to the target location aggregates information from its neighboring tokens. Experiments using weather stations across the Northeastern United States show that our model outperforms a range of data-driven and non-data-driven off-grid forecasting methods. They also reveal that direct input of station data provides a phase shift in local weather forecasting accuracy, reducing the prediction error by up to 80% compared to pure gridded data based models. This approach demonstrates how to bridge the gap between large-scale weather models and locally accurate forecasts to support high-stakes, location-sensitive decision-making.
△ Less
Submitted 5 May, 2025; v1 submitted 16 October, 2024;
originally announced October 2024.
-
Generating a highly uniform magnetic field inside the magnetically shielded room of the n2EDM experiment
Authors:
C. Abel,
N. J. Ayres,
G. Ban,
G. Bison,
K. Bodek,
V. Bondar,
T. Bouillaud,
D. C. Bowles,
G. L. Caratsch,
E. Chanel,
W. Chen,
P. -J. Chiu,
C. Crawford,
B. Dechenaux,
C. B. Doorenbos,
S. Emmenegger,
L. Ferraris-Bouchez,
M. Fertl,
P. Flaux,
A. Fratangelo,
D. Goupillière,
W. C. Griffith,
D. Höhl,
M. Kasprzak,
K. Kirch
, et al. (41 additional authors not shown)
Abstract:
We present a coil system designed to generate a highly uniform magnetic field for the n2EDM experiment at the Paul Scherrer Institute. It consists of a main $B_0$ coil and a set of auxiliary coils mounted on a cubic structure with a side length of 273 cm, inside a large magnetically shielded room (MSR). We have assembled this system and characerized its performances with a mapping robot. The appar…
▽ More
We present a coil system designed to generate a highly uniform magnetic field for the n2EDM experiment at the Paul Scherrer Institute. It consists of a main $B_0$ coil and a set of auxiliary coils mounted on a cubic structure with a side length of 273 cm, inside a large magnetically shielded room (MSR). We have assembled this system and characerized its performances with a mapping robot. The apparatus is able to generate a 1 $μ$ T vertical field with a relative root mean square deviation $σ$ ($B_z$)/$B_z$ = 3 $\times$ $10^{-5}$ over the volume of interest, a cylinder of radius 40 cm and height 30 cm. This level of uniformity overcomes the n2EDM requirements, allowing a measurement of the neutron Electric Dipole Moment with a sensitivity better than 1 $\times$ $10^{-27}$ ecm.
△ Less
Submitted 15 February, 2025; v1 submitted 10 October, 2024;
originally announced October 2024.
-
Deep Neural Network Learning with Second-Order Optimizers -- a Practical Study with a Stochastic Quasi-Gauss-Newton Method
Authors:
Christopher Thiele,
Mauricio Araya-Polo,
Detlef Hohl
Abstract:
Training in supervised deep learning is computationally demanding, and the convergence behavior is usually not fully understood. We introduce and study a second-order stochastic quasi-Gauss-Newton (SQGN) optimization method that combines ideas from stochastic quasi-Newton methods, Gauss-Newton methods, and variance reduction to address this problem. SQGN provides excellent accuracy without the nee…
▽ More
Training in supervised deep learning is computationally demanding, and the convergence behavior is usually not fully understood. We introduce and study a second-order stochastic quasi-Gauss-Newton (SQGN) optimization method that combines ideas from stochastic quasi-Newton methods, Gauss-Newton methods, and variance reduction to address this problem. SQGN provides excellent accuracy without the need for experimenting with many hyper-parameter configurations, which is often computationally prohibitive given the number of combinations and the cost of each training process. We discuss the implementation of SQGN with TensorFlow, and we compare its convergence and computational performance to selected first-order methods using the MNIST benchmark and a large-scale seismic tomography application from Earth science.
△ Less
Submitted 30 June, 2020; v1 submitted 6 April, 2020;
originally announced April 2020.
-
Equation of state of fluid methane from first principles with machine learning potentials
Authors:
Max Veit,
Sandeep Kumar Jain,
Satyanarayana Bonakala,
Indranil Rudra,
Detlef Hohl,
Gábor Csányi
Abstract:
The predictive simulation of molecular liquids requires models that are not only accurate, but computationally efficient enough to handle the large systems and long time scales required for reliable prediction of macroscopic properties. We present a new approach to the systematic approximation of the first-principles potential energy surface (PES) of molecular liquids using the GAP (Gaussian Appro…
▽ More
The predictive simulation of molecular liquids requires models that are not only accurate, but computationally efficient enough to handle the large systems and long time scales required for reliable prediction of macroscopic properties. We present a new approach to the systematic approximation of the first-principles potential energy surface (PES) of molecular liquids using the GAP (Gaussian Approximation Potential) framework. The approach allows us to create potentials at several different levels of accuracy in reproducing the true PES, which allows us to test the level of quantum chemistry that is necessary to accurately predict its macroscopic properties. We test the approach by building potentials for liquid methane (CH$_4$), which is difficult to model from first principles because its behavior is dominated by weak dispersion interactions with a significant many-body component. We find that an accurate, consistent prediction of its bulk density across a wide range of temperature and pressure requires not only many-body dispersion, but also quantum nuclear effects to be modeled accurately.
△ Less
Submitted 24 October, 2018;
originally announced October 2018.
-
A data-driven workflow for predicting horizontal well production using vertical well logs
Authors:
Jorge Guevara,
Matthias Kormaksson,
Bianca Zadrozny,
Ligang Lu,
John Tolle,
Tyler Croft,
Mingqi Wu,
Jan Limbeck,
Detlef Hohl
Abstract:
In recent work, data-driven sweet spotting technique for shale plays previously explored with vertical wells has been proposed. Here, we extend this technique to multiple formations and formalize a general data-driven workflow to facilitate feature extraction from vertical well logs and predictive modeling of horizontal well production. We also develop an experimental framework that facilitates mo…
▽ More
In recent work, data-driven sweet spotting technique for shale plays previously explored with vertical wells has been proposed. Here, we extend this technique to multiple formations and formalize a general data-driven workflow to facilitate feature extraction from vertical well logs and predictive modeling of horizontal well production. We also develop an experimental framework that facilitates model selection and validation in a realistic drilling scenario. We present some experimental results using this methodology in a field with 90 vertical wells and 98 horizontal wells, showing that it can achieve better results in terms of predictive ability than kriging of known production values.
△ Less
Submitted 15 May, 2017;
originally announced May 2017.
-
Performance Analysis and Optimization of a Hybrid Distributed Reverse Time Migration Application
Authors:
Sri Raj Paul,
John Mellor-Crummey,
Mauricio Araya-Polo,
Detlef Hohl
Abstract:
Applications to process seismic data employ scalable parallel systems to produce timely results. To fully exploit emerging processor architectures, application will need to employ threaded parallelism within a node and message passing across nodes. Today, MPI+OpenMP is the preferred programming model for this task. However, tuning hybrid programs for clusters is difficult. Performance tools can he…
▽ More
Applications to process seismic data employ scalable parallel systems to produce timely results. To fully exploit emerging processor architectures, application will need to employ threaded parallelism within a node and message passing across nodes. Today, MPI+OpenMP is the preferred programming model for this task. However, tuning hybrid programs for clusters is difficult. Performance tools can help users identify bottlenecks and uncover opportunities for improvement. This poster describes our experiences of applying Rice University's HPCToolkit and hardware performance counters to gain insight into an MPI+OpenMP code that performs Reverse Time Migration (RTM) on a cluster of multicore processors. The tools provided us with insights into the effectiveness of the domain decomposition strategy, the use of threaded parallelism, and functional unit utilization in individual cores. By applying insights obtained from the tools, we were able to improve the performance of the RTM code by roughly 30 percent.
△ Less
Submitted 12 March, 2016;
originally announced March 2016.
-
Theoretical investigation of methane under pressure
Authors:
Leonardo Spanu,
Davide Donadio,
Detlef Hohl,
Giulia Galli
Abstract:
We present computer simulations of liquid and solid phases of condensed methane at pressures below 25 GPa, between 150 and 300 K, where no appreciable molecular dissociation occurs. We used molecular dynamics (MD) and metadynamics techniques, and empirical potentials in the rigid molecule approximation, whose validity was confirmed a posteriori by carrying out it ab initio MD simulations for sel…
▽ More
We present computer simulations of liquid and solid phases of condensed methane at pressures below 25 GPa, between 150 and 300 K, where no appreciable molecular dissociation occurs. We used molecular dynamics (MD) and metadynamics techniques, and empirical potentials in the rigid molecule approximation, whose validity was confirmed a posteriori by carrying out it ab initio MD simulations for selected pressure and temperature conditions. Our results for the melting line are in satisfactory agreement with existing measurements. We find that the fcc crystal transforms into a hcp structure with 4 molecules per unit cell (B phase) at about 10 GPa and 150 K, and that the B phase transforms into a monoclinic high pressure phase above 20 GPa. Our results for solid/solid phase transitions are consistent with those of Raman studies but the phase boundaries estimated in our calculations are at higher pressure than those inferred from spectroscopic data.
△ Less
Submitted 27 March, 2009;
originally announced March 2009.
