-
MFC 5.0: An exascale many-physics flow solver
Authors:
Benjamin Wilfong,
Henry A. Le Berre,
Anand Radhakrishnan,
Ansh Gupta,
Diego Vaca-Revelo,
Dimitrios Adam,
Haocheng Yu,
Hyeoksu Lee,
Jose Rodolfo Chreim,
Mirelys Carcana Barbosa,
Yanjun Zhang,
Esteban Cisneros-Garibay,
Aswin Gnanaskandan,
Mauro Rodriguez Jr.,
Reuben D. Budiardja,
Stephen Abbott,
Tim Colonius,
Spencer H. Bryngelson
Abstract:
Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. A previous work (Bryngelson et al., Comp. Phys. Comm. (2021)) published MFC 3.0 with numerous physical features, numerics, and scalability. MFC 5.0 is a marked update to MFC 3…
▽ More
Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. A previous work (Bryngelson et al., Comp. Phys. Comm. (2021)) published MFC 3.0 with numerous physical features, numerics, and scalability. MFC 5.0 is a marked update to MFC 3.0, including a broad set of well-established and novel physical models and numerical methods, and the introduction of XPU acceleration. We exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF Frontier and LLNL El Capitan. Combined with MFC's single-accelerator performance, MFC achieves exascale computation in practice. New physical features include the immersed boundary method, N-fluid phase change, Euler--Euler and Euler--Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF Summit and Frontier and LLNL El Capitan sees efficiencies within 5% of ideal to their full system sizes. Strong scaling results for a 16-times increase in device count show parallel efficiencies over 90% on OLCF Frontier. MFC's software stack has improved, including continuous integration, ensuring code resilience and correctness through over 300 regression tests; metaprogramming, reducing code length and maintaining performance portability; and code generation for computing chemical reactions.
△ Less
Submitted 16 April, 2025; v1 submitted 10 March, 2025;
originally announced March 2025.
-
Wetting in Associating Lattice Gas Model Confined by Hydrophilic Walls
Authors:
Tássylla O. Fonseca,
Bruno H. S. Mendonça,
Elizane E. de Moraes,
Alan B. de Oliveira,
Marcia C. Barbosa
Abstract:
Through Monte Carlo simulations and the Associating Lattice Gas Model, the phases of a two-dimensional fluid under hydrophilic confinement are evaluated. The model, in its unconfined version, reproduces the anomalous behavior of water regarding its density, diffusion, and solubility, among other dynamic and thermodynamic properties. Extreme confinements suppress phase transitions since fluctuation…
▽ More
Through Monte Carlo simulations and the Associating Lattice Gas Model, the phases of a two-dimensional fluid under hydrophilic confinement are evaluated. The model, in its unconfined version, reproduces the anomalous behavior of water regarding its density, diffusion, and solubility, among other dynamic and thermodynamic properties. Extreme confinements suppress phase transitions since fluctuations suppress ordering. The fluid under hydrophilic confinement forms a single wetting layer that gradually wets the wall. From the wetting layer, the low-density liquid structure is formed. The confined fluid presents a first-order liquid-liquid transition, but always at lower temperatures than that observed in the bulk.
△ Less
Submitted 19 September, 2024;
originally announced September 2024.
-
A tunable photonic band gap resonator for axion dark matter searches
Authors:
Samantha M. Lewis,
Dillon T. Goulart,
Mirelys Carcana Barbosa,
Alexander F. Leder,
Aarav M. Sindhwad,
Isabella Urdinaran,
Karl van Bibber
Abstract:
Axions are a well-motivated dark matter candidate particle. Haloscopes aim to detect axions in the galactic halo by measuring the photon signal resulting from axions interacting with a strong magnetic field. Existing haloscopes are primarily targeting axion masses which produce microwave-range photons and rely on microwave resonators to enhance the signal power. Only a limited subset of resonator…
▽ More
Axions are a well-motivated dark matter candidate particle. Haloscopes aim to detect axions in the galactic halo by measuring the photon signal resulting from axions interacting with a strong magnetic field. Existing haloscopes are primarily targeting axion masses which produce microwave-range photons and rely on microwave resonators to enhance the signal power. Only a limited subset of resonator modes are useful for this process, and current cylindrical-style cavities suffer from mode mixing and crowding from other fundamental modes. The majority of these modes can be eliminated by using photonic band gap (PBG) resonators. The band gap behavior of these structures allows for a resonator with mode selectivity based on frequency. We present results from the first tunable PBG resonator, a proof-of-concept design with a footprint compatible with axion haloscopes. We have thoroughly characterized the tuning range of two versions of the structure and report the successful confinement of the operating TM$_{010}$ mode and the elimination of all TE modes within the tuning range.
△ Less
Submitted 7 August, 2024;
originally announced August 2024.
-
Water permeability in nanopores: when size, shape, and charge matter
Authors:
João P. K. Abal,
Marcia C. Barbosa
Abstract:
Nanoscale materials are a promising desalination technology. While fast water flow in nanotubes is well understood, this is not the case for water permeability in single-layer membranes. The physical-chemical balance between nanopore size, shape, and charge might be the answer.
Nanoscale materials are a promising desalination technology. While fast water flow in nanotubes is well understood, this is not the case for water permeability in single-layer membranes. The physical-chemical balance between nanopore size, shape, and charge might be the answer.
△ Less
Submitted 14 December, 2020;
originally announced December 2020.
-
Molecular Fluid Flow in MoS$_2$ Nanoporous Membranes and Hydrodynamics Interactions
Authors:
João P. K. Abal,
Marcia C. Barbosa
Abstract:
The shift in water security demands improvements in alternative solutions such as saltwater desalination. One of the most efficient technologies in this scope is the reverse osmosis systems, a technology based on a membrane separation process. MoS$_2$ nanoporous membranes are gained attention as a promise for the next-generation high selective and permeable membranes technology. Besides that, one…
▽ More
The shift in water security demands improvements in alternative solutions such as saltwater desalination. One of the most efficient technologies in this scope is the reverse osmosis systems, a technology based on a membrane separation process. MoS$_2$ nanoporous membranes are gained attention as a promise for the next-generation high selective and permeable membranes technology. Besides that, one aspect of nanoconfined fluid flow not yet investigated but studied from the fluid mechanics calculations is the impact of induced pressure fields in the water flux in neighboring microfilters, described as hydrodynamic interactions. For this purpose, we studied the water flow through adjacent MoS$_2$ nanopores by running Non-Equilibrium Molecular Dynamics simulations and obtained that in this scale the hydrodynamics interactions are not significant as expected.
△ Less
Submitted 1 October, 2020;
originally announced October 2020.
-
Water diffusion in carbon nanotubes: interplay between confinement, surface deformation and temperature
Authors:
Bruno H. S. Mendonça,
Patricia Ternes,
Evy Salcedo,
Alan B. de Oliveira,
Marcia C. Barbosa
Abstract:
In this article we investigate through molecular dynamics simulations the diffusion behavior of the TIP4P/2005 water when confined in pristine and deformed carbon nanotubes (armchair and zigzag). To analyze different diffusive mechanisms, the water temperature was varied from $210\leq T\leq 380$~K. The results of our simulations reveal that water present a non-Arrhenius to Arrhenius diffusion cros…
▽ More
In this article we investigate through molecular dynamics simulations the diffusion behavior of the TIP4P/2005 water when confined in pristine and deformed carbon nanotubes (armchair and zigzag). To analyze different diffusive mechanisms, the water temperature was varied from $210\leq T\leq 380$~K. The results of our simulations reveal that water present a non-Arrhenius to Arrhenius diffusion crossover. The confinement shifts the diffusion transition to higher temperatures when compared with the bulk system. In addition, for narrower nanotubes, water diffuses in a single line which leads to a mobility independent of the activation energy.
△ Less
Submitted 28 September, 2020;
originally announced September 2020.
-
Salt parameterization can drastically affect the results from classical atomistic simulations of water desalination by MoS$_2$ nanopores
Authors:
João P. K. Abal,
José Rafael Bordin,
Marcia C. Barbosa
Abstract:
Water scarcity is a reality in our world, and scenarios predicted by leading scientists in this area indicate that it will worsen in the next decades. However, new technologies based in low-cost seawater desalination can prevent the worst scenarios, providing fresh water for humanity. With this goal, membranes based in nanoporous materials have been suggested in recent years. One of the materials…
▽ More
Water scarcity is a reality in our world, and scenarios predicted by leading scientists in this area indicate that it will worsen in the next decades. However, new technologies based in low-cost seawater desalination can prevent the worst scenarios, providing fresh water for humanity. With this goal, membranes based in nanoporous materials have been suggested in recent years. One of the materials suggested is MoS$_2$, and classical Molecular Dynamics (MD) simulation is one of the most powerful tools to explore these nanomaterials. However, distinct Force Fields employed in MD simulations are parameterized based on distinct experimental quantities. In this paper, we compare two models of salt that were build based on distinct properties of water-salt mixtures. One model fits the hydration free energy and lattice properties, the second fits the crystal density and the density and the dielectric constant of water and salt mixtures. To compare the models, MD simulations for salty water flow through two nanopores sizes were used -- one pore big enough to accommodate hydrated ions, and one smaller in which the ion has to dehydrate to enter, and two rigid water models from the TIP4P family -- the TIP4P/2005 and TIP4P/$ε$. Our results indicate that the water permeability and salt rejection by the membrane are more influenced by the salt model than by the water model, especially for the narrow pore. In fact, completely distinct mechanisms were observed, and they are related to the characteristics employed in the ion model parameterization. The results show that not only the water model can influence the outcomes, but the ion model plays a crucial role.
△ Less
Submitted 3 February, 2020;
originally announced February 2020.
-
Flexible Bond and Angle, FBA/epsilon model of water
Authors:
Raúl Fuentes-Azcatl,
Marcia C. Barbosa
Abstract:
We propose a new flexible force field for water. The model in addition to the Lennard-Jones and electrostatic parameters, includes the flexibility of the OH bonds and angles. The parameters are selected to give the experimental values of the density and dielectric constant of water at at 1 bar at 240K and the dipole moment of minimum density. The FBA/epsilon reproduces the experimental values of s…
▽ More
We propose a new flexible force field for water. The model in addition to the Lennard-Jones and electrostatic parameters, includes the flexibility of the OH bonds and angles. The parameters are selected to give the experimental values of the density and dielectric constant of water at at 1 bar at 240K and the dipole moment of minimum density. The FBA/epsilon reproduces the experimental values of structural, thermodynamic and the phase behavior of water in a wide range of temperatures with better accuracy than atomistic and other flexible models. We expect that this new approach would be suitable for studying water solutions.
△ Less
Submitted 9 July, 2018;
originally announced July 2018.
-
Universality, Correlations, and Rankings in the Brazilian Universities National Admission Examinations
Authors:
Roberto da Silva,
Luis C. Lamb,
Marcia C. Barbosa
Abstract:
The scores obtained by students that have performed the ENEM exam, the Brazilian High School National Examination used to admit students at the Brazilian universities, is analyzed. The average high school's scores are compared between different disciplines through the Pearson correlation coefficient. The results show a very large correlation between the performance in the different subjects. Even…
▽ More
The scores obtained by students that have performed the ENEM exam, the Brazilian High School National Examination used to admit students at the Brazilian universities, is analyzed. The average high school's scores are compared between different disciplines through the Pearson correlation coefficient. The results show a very large correlation between the performance in the different subjects. Even thought the students' scores in the ENEM due to the standardization form a Gaussian, we show that the high schools' scores form a bimodal distribution that can not be used to evaluate and compare performance over time. We also show that this high schools distribution reflects the correlation between school performance and economic level of the students. The ENEM's scores are compared with a Brazilian non standardized exam, the entrance exam at the Universidade Federal do Rio Grande do Sul. The comparison of the performance of the same individuals in both tests is compared showing that the two tests not only select different abilities but chooses a different set of individuals. Our results indicates that standardized exams might be an interesting tool to compare performance over the years but only of individuals and not of institutions.
△ Less
Submitted 15 September, 2015;
originally announced September 2015.
-
Order-Disorder structural transition in a confined fluid
Authors:
Elsa M. de la Calleja-Mora,
Leandro B. Krott,
Marcia C. Barbosa
Abstract:
In this paper the amorphous/solid to disorder liquid structural phase transitions of an anomalous confined fluid is analyzed using their local fractal dimension. The model is a system of particles interacting through a two length scales potentials confined by two infinite plates. In the bulk, this fluid exhibit water-like anomalies and under confinement forms layers of particles. The particle dist…
▽ More
In this paper the amorphous/solid to disorder liquid structural phase transitions of an anomalous confined fluid is analyzed using their local fractal dimension. The model is a system of particles interacting through a two length scales potentials confined by two infinite plates. In the bulk, this fluid exhibit water-like anomalies and under confinement forms layers of particles. The particle distributions of them, present different arrangements related to amorphous/solid phases. Here only the contact layer is analyzed through fractal singularity spectrum. At high densities the structural transition its quantify by the order degree to determine the phases affected by the confinement. This mapping shows that the system as the temperature increased, the fractal dimension decreases, which is consistent with the behavior studying in such systems. This result suggests that under thermodynamic perturbations, an anomalous confined liquid, presents different phase transitions achieving be characterized by its fractality.
△ Less
Submitted 7 August, 2015;
originally announced August 2015.
-
Influence of disordered porous media in the anomalous properties of a simple water model
Authors:
A. P. Furlan,
Carlos E. Fiore,
M. C. Barbosa
Abstract:
The thermodynamic, dynamic and structural behavior of a water-like system confined in a matrix is analyzed for increasing confining geometries. The liquid is modeled by a two dimensional associating lattice gas model that exhibits density and diffusion anomalies, in similarity to the anomalies present in liquid water. The matrix is a triangular lattice in which fixed obstacles impose restrictions…
▽ More
The thermodynamic, dynamic and structural behavior of a water-like system confined in a matrix is analyzed for increasing confining geometries. The liquid is modeled by a two dimensional associating lattice gas model that exhibits density and diffusion anomalies, in similarity to the anomalies present in liquid water. The matrix is a triangular lattice in which fixed obstacles impose restrictions to the occupation of the particles. We show that obstacules shortens all lines, including the phase coexistence, the critical and the anomalous lines. The inclusion of a very dense matrix not only suppress the anomalies but also the liquid-liquid critical point.
△ Less
Submitted 17 April, 2015;
originally announced April 2015.
-
Anomalies in a waterlike model confined between plates
Authors:
Leandro Batirolla Krott,
Marcia Cristina Bernardes Barbosa
Abstract:
Using molecular dynamic simulations we study a waterlike model confined between two fixed hydrophobic plates. The system is tested for density, diffusion and structural anomalous behavior and compared with the bulk results. Within the range of confining distances we had explored we observe that in the pressure-temperature phase diagram the temperature of maximum density (TMD line), the temperature…
▽ More
Using molecular dynamic simulations we study a waterlike model confined between two fixed hydrophobic plates. The system is tested for density, diffusion and structural anomalous behavior and compared with the bulk results. Within the range of confining distances we had explored we observe that in the pressure-temperature phase diagram the temperature of maximum density (TMD line), the temperature of maximum and minimum diffusion occur at lower temperatures when compared with the bulk values. For distances between the two layers below a certain threshold ,$d\le d_c$, only two layers of particles are formed, for $d\ge d_c$ three or more layers are formed. In the case of three layers the central layer stays liquid while the contact layers crystallize. This result is in agreement with simulations for atomistic models.
△ Less
Submitted 14 December, 2012;
originally announced December 2012.
-
Ion fluxes through nano-pores and transmembrane channels
Authors:
José Rafael Bordin,
Alexandre Diehl,
Marcia C. Barbosa,
Yan Levin
Abstract:
We introduce an implicit solvent Molecular Dynamics approach for calculating ionic fluxes through narrow nano-pores and transmembrane channels. The method relies on a dual-control- volume grand-canonical molecular dynamics (DCV-GCMD) simulation and the analytical solution for the electrostatic potential inside a cylindrical nano-pore recently obtained by Levin [Europhys. Lett., 76, 163 (2006)]. Th…
▽ More
We introduce an implicit solvent Molecular Dynamics approach for calculating ionic fluxes through narrow nano-pores and transmembrane channels. The method relies on a dual-control- volume grand-canonical molecular dynamics (DCV-GCMD) simulation and the analytical solution for the electrostatic potential inside a cylindrical nano-pore recently obtained by Levin [Europhys. Lett., 76, 163 (2006)]. The theory is used to calculate the ionic fluxes through an artificial trans-membrane c hannel which mimics the antibacterial gramicidin A channel. Both current-voltage and current-concentration relations are calculated under various experimental conditions. We show that our results are comparable to the characteristics associated to the gramicidin A pore, specially the existence of two binding sites inside the pore and the observed saturation in the current-concentration profiles.
△ Less
Submitted 12 March, 2012; v1 submitted 26 August, 2011;
originally announced August 2011.
-
Improving the Global Fitting Method on Non-Linear Time Series Analysis
Authors:
L. M. C. R. Barbosa,
L. G. S. Duarte,
C. A. Linhares,
L. A. C. P. da Mota
Abstract:
In this paper, we are concerned with improving the forecast capabilities of the Global approach to Time Series. We assume that the normal techniques of Global mapping are applied, the noise reduction is performed, etc. Then, using the mathematical foundations behind such approaches, we propose a method that, without a great computational cost, greatly increase the accuracy of the corresponding f…
▽ More
In this paper, we are concerned with improving the forecast capabilities of the Global approach to Time Series. We assume that the normal techniques of Global mapping are applied, the noise reduction is performed, etc. Then, using the mathematical foundations behind such approaches, we propose a method that, without a great computational cost, greatly increase the accuracy of the corresponding forecasting.
△ Less
Submitted 9 May, 2006;
originally announced May 2006.