-
Model-Agnostic Knowledge Guided Correction for Improved Neural Surrogate Rollout
Authors:
Bharat Srikishan,
Daniel O'Malley,
Mohamed Mehana,
Nicholas Lubbers,
Nikhil Muralidhar
Abstract:
Modeling the evolution of physical systems is critical to many applications in science and engineering. As the evolution of these systems is governed by partial differential equations (PDEs), there are a number of computational simulations which resolve these systems with high accuracy. However, as these simulations incur high computational costs, they are infeasible to be employed for large-scale…
▽ More
Modeling the evolution of physical systems is critical to many applications in science and engineering. As the evolution of these systems is governed by partial differential equations (PDEs), there are a number of computational simulations which resolve these systems with high accuracy. However, as these simulations incur high computational costs, they are infeasible to be employed for large-scale analysis. A popular alternative to simulators are neural network surrogates which are trained in a data-driven manner and are much more computationally efficient. However, these surrogate models suffer from high rollout error when used autoregressively, especially when confronted with training data paucity. Existing work proposes to improve surrogate rollout error by either including physical loss terms directly in the optimization of the model or incorporating computational simulators as `differentiable layers' in the neural network. Both of these approaches have their challenges, with physical loss functions suffering from slow convergence for stiff PDEs and simulator layers requiring gradients which are not always available, especially in legacy simulators. We propose the Hybrid PDE Predictor with Reinforcement Learning (HyPER) model: a model-agnostic, RL based, cost-aware model which combines a neural surrogate, RL decision model, and a physics simulator (with or without gradients) to reduce surrogate rollout error significantly. In addition to reducing in-distribution rollout error by 47%-78%, HyPER learns an intelligent policy that is adaptable to changing physical conditions and resistant to noise corruption. Code available at https://github.com/scailab/HyPER.
△ Less
Submitted 14 March, 2025; v1 submitted 13 March, 2025;
originally announced March 2025.
-
Enabling Clean Energy Resilience with Machine Learning-Empowered Underground Hydrogen Storage
Authors:
Alvaro Carbonero,
Shaowen Mao,
Mohamed Mehana
Abstract:
To address the urgent challenge of climate change, there is a critical need to transition away from fossil fuels towards sustainable energy systems, with renewable energy sources playing a pivotal role. However, the inherent variability of renewable energy, without effective storage solutions, often leads to imbalances between energy supply and demand. Underground Hydrogen Storage (UHS) emerges as…
▽ More
To address the urgent challenge of climate change, there is a critical need to transition away from fossil fuels towards sustainable energy systems, with renewable energy sources playing a pivotal role. However, the inherent variability of renewable energy, without effective storage solutions, often leads to imbalances between energy supply and demand. Underground Hydrogen Storage (UHS) emerges as a promising long-term storage solution to bridge this gap, yet its widespread implementation is impeded by the high computational costs associated with high fidelity UHS simulations. This paper introduces UHS from a data-driven perspective and outlines a roadmap for integrating machine learning into UHS, thereby facilitating the large-scale deployment of UHS.
△ Less
Submitted 4 April, 2024;
originally announced April 2024.
-
Learning a General Model of Single Phase Flow in Complex 3D Porous Media
Authors:
Javier E. Santos,
Agnese Marcato,
Qinjun Kang,
Mohamed Mehana,
Daniel O'Malley,
Hari Viswanathan,
Nicholas Lubbers
Abstract:
Modeling effective transport properties of 3D porous media, such as permeability, at multiple scales is challenging as a result of the combined complexity of the pore structures and fluid physics - in particular, confinement effects which vary across the nanoscale to the microscale. While numerical simulation is possible, the computational cost is prohibitive for realistic domains, which are large…
▽ More
Modeling effective transport properties of 3D porous media, such as permeability, at multiple scales is challenging as a result of the combined complexity of the pore structures and fluid physics - in particular, confinement effects which vary across the nanoscale to the microscale. While numerical simulation is possible, the computational cost is prohibitive for realistic domains, which are large and complex. Although machine learning models have been proposed to circumvent simulation, none so far has simultaneously accounted for heterogeneous 3D structures, fluid confinement effects, and multiple simulation resolutions. By utilizing numerous computer science techniques to improve the scalability of training, we have for the first time developed a general flow model that accounts for the pore-structure and corresponding physical phenomena at scales from Angstrom to the micrometer. Using synthetic computational domains for training, our machine learning model exhibits strong performance (R$^2$=0.9) when tested on extremely diverse real domains at multiple scales.
△ Less
Submitted 22 October, 2023;
originally announced October 2023.
-
A Critical Review of Physics-Informed Machine Learning Applications in Subsurface Energy Systems
Authors:
Abdeldjalil Latrach,
Mohamed Lamine Malki,
Misael Morales,
Mohamed Mehana,
Minou Rabiei
Abstract:
Machine learning has emerged as a powerful tool in various fields, including computer vision, natural language processing, and speech recognition. It can unravel hidden patterns within large data sets and reveal unparalleled insights, revolutionizing many industries and disciplines. However, machine and deep learning models lack interpretability and limited domain-specific knowledge, especially in…
▽ More
Machine learning has emerged as a powerful tool in various fields, including computer vision, natural language processing, and speech recognition. It can unravel hidden patterns within large data sets and reveal unparalleled insights, revolutionizing many industries and disciplines. However, machine and deep learning models lack interpretability and limited domain-specific knowledge, especially in applications such as physics and engineering. Alternatively, physics-informed machine learning (PIML) techniques integrate physics principles into data-driven models. By combining deep learning with domain knowledge, PIML improves the generalization of the model, abidance by the governing physical laws, and interpretability. This paper comprehensively reviews PIML applications related to subsurface energy systems, mainly in the oil and gas industry. The review highlights the successful utilization of PIML for tasks such as seismic applications, reservoir simulation, hydrocarbons production forecasting, and intelligent decision-making in the exploration and production stages. Additionally, it demonstrates PIML's capabilities to revolutionize the oil and gas industry and other emerging areas of interest, such as carbon and hydrogen storage; and geothermal systems by providing more accurate and reliable predictions for resource management and operational efficiency.
△ Less
Submitted 6 August, 2023;
originally announced August 2023.
-
Predictive Scale-Bridging Simulations through Active Learning
Authors:
Satish Karra,
Mohamed Mehana,
Nicholas Lubbers,
Yu Chen,
Abdourahmane Diaw,
Javier E. Santos,
Aleksandra Pachalieva,
Robert S. Pavel,
Jeffrey R. Haack,
Michael McKerns,
Christoph Junghans,
Qinjun Kang,
Daniel Livescu,
Timothy C. Germann,
Hari S. Viswanathan
Abstract:
Throughout computational science, there is a growing need to utilize the continual improvements in raw computational horsepower to achieve greater physical fidelity through scale-bridging over brute-force increases in the number of mesh elements. For instance, quantitative predictions of transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, are impossible w…
▽ More
Throughout computational science, there is a growing need to utilize the continual improvements in raw computational horsepower to achieve greater physical fidelity through scale-bridging over brute-force increases in the number of mesh elements. For instance, quantitative predictions of transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, are impossible without accounting for molecular-level interactions. Similarly, inertial confinement fusion simulations rely on numerical diffusion to simulate molecular effects such as non-local transport and mixing without truly accounting for molecular interactions. With these two disparate applications in mind, we develop a novel capability which uses an active learning approach to optimize the use of local fine-scale simulations for informing coarse-scale hydrodynamics. Our approach addresses three challenges: forecasting continuum coarse-scale trajectory to speculatively execute new fine-scale molecular dynamics calculations, dynamically updating coarse-scale from fine-scale calculations, and quantifying uncertainty in neural network models.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
Technical and Economic Feasibility Analysis of Underground Hydrogen Storage: A Case Study in Intermountain-West Region USA
Authors:
Fangxuan Chen,
Zhiwei Ma,
Hadi Nasrabadi,
Bailian Chen,
Mohamed Mehana,
Jolante Wieke Van Wijk
Abstract:
Hydrogen is an integral component of the current energy transition roadmap to decarbonize the economy and create an environmentally-sustainable future. However, surface storage options (e.g., tanks) do not provide the required capacity or durability to deploy a regional or nationwide hydrogen economy. In this study, we have analyzed the techno-economic feasibility of the geologic storage of hydrog…
▽ More
Hydrogen is an integral component of the current energy transition roadmap to decarbonize the economy and create an environmentally-sustainable future. However, surface storage options (e.g., tanks) do not provide the required capacity or durability to deploy a regional or nationwide hydrogen economy. In this study, we have analyzed the techno-economic feasibility of the geologic storage of hydrogen in depleted gas reservoirs, salt caverns, and aquifers in the Intermountain-West (I-WEST) region. We have identified the most favorable candidate sites for hydrogen storage and estimated the volumetric storage capacity. Our results show that the geologic storage of hydrogen can provide at least 72% of total energy consumption of I-WEST region in 2020. We also calculated the capital and levelized costs of each storage option. We found that a depleted gas reservoir is the most cost-effective candidate among the three geologic storage options. Interestingly, the cushion gas type and volume play a significant role in the storage cost when we consider hydrogen storage in saline aquifers. The levelized costs of hydrogen storage in depleted gas reservoirs, salt caverns, and saline aquifers with large-scale storage capacity are approximately $1.3, $2.3, and $3.4 per kg of H2, respectively. This work provides essential guidance for the geologic hydrogen storage in the I-WEST region.
△ Less
Submitted 7 September, 2022;
originally announced September 2022.
-
Modeling nanoconfinement effects using active learning
Authors:
Javier E. Santos,
Mohammed Mehana,
Hao Wu,
Masa Prodanovic,
Michael J. Pyrcz,
Qinjun Kang,
Nicholas Lubbers,
Hari Viswanathan
Abstract:
Predicting the spatial configuration of gas molecules in nanopores of shale formations is crucial for fluid flow forecasting and hydrocarbon reserves estimation. The key challenge in these tight formations is that the majority of the pore sizes are less than 50 nm. At this scale, the fluid properties are affected by nanoconfinement effects due to the increased fluid-solid interactions. For instanc…
▽ More
Predicting the spatial configuration of gas molecules in nanopores of shale formations is crucial for fluid flow forecasting and hydrocarbon reserves estimation. The key challenge in these tight formations is that the majority of the pore sizes are less than 50 nm. At this scale, the fluid properties are affected by nanoconfinement effects due to the increased fluid-solid interactions. For instance, gas adsorption to the pore walls could account for up to 85% of the total hydrocarbon volume in a tight reservoir. Although there are analytical solutions that describe this phenomenon for simple geometries, they are not suitable for describing realistic pores, where surface roughness and geometric anisotropy play important roles. To describe these, molecular dynamics (MD) simulations are used since they consider fluid-solid and fluid-fluid interactions at the molecular level. However, MD simulations are computationally expensive, and are not able to simulate scales larger than a few connected nanopores. We present a method for building and training physics-based deep learning surrogate models to carry out fast and accurate predictions of molecular configurations of gas inside nanopores. Since training deep learning models requires extensive databases that are computationally expensive to create, we employ active learning (AL). AL reduces the overhead of creating comprehensive sets of high-fidelity data by determining where the model uncertainty is greatest, and running simulations on the fly to minimize it. The proposed workflow enables nanoconfinement effects to be rigorously considered at the mesoscale where complex connected sets of nanopores control key applications such as hydrocarbon recovery and CO2 sequestration.
△ Less
Submitted 6 May, 2020; v1 submitted 6 May, 2020;
originally announced May 2020.