-
Neural Integral Equations
Authors:
Emanuele Zappala,
Antonio Henrique de Oliveira Fonseca,
Josue Ortega Caro,
Andrew Henry Moberly,
Michael James Higley,
Jessica Cardin,
David van Dijk
Abstract:
Nonlinear operators with long distance spatiotemporal dependencies are fundamental in modeling complex systems across sciences, yet learning these nonlocal operators remains challenging in machine learning. Integral equations (IEs), which model such nonlocal systems, have wide ranging applications in physics, chemistry, biology, and engineering. We introduce Neural Integral Equations (NIE), a meth…
▽ More
Nonlinear operators with long distance spatiotemporal dependencies are fundamental in modeling complex systems across sciences, yet learning these nonlocal operators remains challenging in machine learning. Integral equations (IEs), which model such nonlocal systems, have wide ranging applications in physics, chemistry, biology, and engineering. We introduce Neural Integral Equations (NIE), a method for learning unknown integral operators from data using an IE solver. To improve scalability and model capacity, we also present Attentional Neural Integral Equations (ANIE), which replaces the integral with self-attention. Both models are grounded in the theory of second kind integral equations, where the indeterminate appears both inside and outside the integral operator. We provide theoretical analysis showing how self-attention can approximate integral operators under mild regularity assumptions, further deepening previously reported connections between transformers and integration, and deriving corresponding approximation results for integral operators. Through numerical benchmarks on synthetic and real world data, including Lotka-Volterra, Navier-Stokes, and Burgers' equations, as well as brain dynamics and integral equations, we showcase the models' capabilities and their ability to derive interpretable dynamics embeddings. Our experiments demonstrate that ANIE outperforms existing methods, especially for longer time intervals and higher dimensional problems. Our work addresses a critical gap in machine learning for nonlocal operators and offers a powerful tool for studying unknown complex systems with long range dependencies.
△ Less
Submitted 10 September, 2024; v1 submitted 29 September, 2022;
originally announced September 2022.
-
High CO2-tolerance oxygen permeation dual-phase membranes Ce0.9Pr0.1O2-δ-Pr0.6Sr0.4Fe0.8Al0.2O3-δ
Authors:
Lei Shi,
Shu Wang,
Tianni Lu,
Yuan He,
Dong Yan,
Qi Lan,
Zhiang Xie,
Haoqi Wang,
Man-Rong Li,
Juergen Caro,
Huixia Luo
Abstract:
High stability and oxygen permeability are two prominent requirements for the oxygen transport membrane candidates used as industrialization. Herein, we report several composite membranes based on xwt.%Ce0.9Pr0.1O2(CPO)-(100-x)wt.%Pr0.6Sr0.4Fe0.8Al0.2O3(PSFAO) (x = 50, 60 and 75) prepared via a modified Pechini method. Oxygen permeability test reveals that the 60CPO-40PSFAO composition exhibits th…
▽ More
High stability and oxygen permeability are two prominent requirements for the oxygen transport membrane candidates used as industrialization. Herein, we report several composite membranes based on xwt.%Ce0.9Pr0.1O2(CPO)-(100-x)wt.%Pr0.6Sr0.4Fe0.8Al0.2O3(PSFAO) (x = 50, 60 and 75) prepared via a modified Pechini method. Oxygen permeability test reveals that the 60CPO-40PSFAO composition exhibits the highest oxygen permeability. The oxygen permeation flux through the optimal uncoated 0.33 mm-thickness 60CPO-40PSFAO composite can reach 1.03 mL cm-2 min-1 (over the general requirement value of 1 mL cm-2 min-1) in air/He atmosphere at 1000 °C. In situ XRD performance confirms the optimal 60CPO-40PSFAO sample shows excellent stability in CO2-containing atmospheres. The 60CPO-40PSFAO membrane still exhibits simultaneously excellent oxygen permeability and phase stability after operating for over 100 h at air/CO2 condition at 1000 °C, which further indicates that the 60CPO-40PSFAO composite is likely to be used for oxygen supply in CO2 capture
△ Less
Submitted 27 July, 2019;
originally announced July 2019.
-
High-flux dual-phase percolation membrane for oxygen separation
Authors:
Shu Wang,
Lei Shi,
Zhiang Xie,
Yuan He,
Dong Yan,
Man-Rong Li,
Juergen Caro,
Huixia Luo
Abstract:
A series of composites based on (100-x)wt.%Ce0.9Pr0.1O2-δ-xwt.%Pr0.6Ca0.4FeO3-δ (x = 25, 40 and 50) doped with the cheap and abundant alkaline earth metal Ca2+ at the A-site has been successfully designed and fabricated. The crystal structure, oxygen permeability, phase and CO2 stability were evaluated. The composition of 60wt.%Ce0.9Pr0.1O2-δ-40wt.%Pr0.6Ca0.4FeO3-δ(60CPO-40PCFO) possesses the high…
▽ More
A series of composites based on (100-x)wt.%Ce0.9Pr0.1O2-δ-xwt.%Pr0.6Ca0.4FeO3-δ (x = 25, 40 and 50) doped with the cheap and abundant alkaline earth metal Ca2+ at the A-site has been successfully designed and fabricated. The crystal structure, oxygen permeability, phase and CO2 stability were evaluated. The composition of 60wt.%Ce0.9Pr0.1O2-δ-40wt.%Pr0.6Ca0.4FeO3-δ(60CPO-40PCFO) possesses the highest oxygen permeability among three studied composites. At 1000 oC, the oxygen permeation fluxes through the 0.3 mm-thickness 60CPO-40PCFO membranes after porous La0.6Sr0.4CoO3-δ each to 1.00 mL cm-2 min-1 and 0.62 mL cm-2 min-1 under air/He and air/CO2 gradients, respectively. In situ XRD results demonstrated that the 60CPO-40PCFO sample displayed a perfect structural stability in air as well as CO2-containing atmosphere. Thus, low-cost, Co-free and Sr-free 60CPO-40PCFO has high CO2 stability and is economical and environmental friendly since the expensive and volatile element Co was replaced by Fe and Sr was waived since it easily forms carbonates.
△ Less
Submitted 3 July, 2019;
originally announced July 2019.
-
Numerical studies towards practical large-eddy simulation
Authors:
Jérôme Boudet,
Joëlle Caro,
L. Shao,
Emmanuel Lévêque
Abstract:
Large-eddy simulation developments and validations are presented for an improved simulation of turbulent internal flows. Numerical methods are proposed according to two competing criteria: numerical qualities (precision and spectral characteristics), and adaptability to complex configurations. First, methods are tested on academic test-cases, in order to abridge with fundamental studies. Consist…
▽ More
Large-eddy simulation developments and validations are presented for an improved simulation of turbulent internal flows. Numerical methods are proposed according to two competing criteria: numerical qualities (precision and spectral characteristics), and adaptability to complex configurations. First, methods are tested on academic test-cases, in order to abridge with fundamental studies. Consistent results are obtained using adaptable finite volume method, with higher order advection fluxes, implicit grid filtering and "low-cost" shear-improved Smagorinsky model. This analysis particularly focuses on mean flow, fluctuations, two-point correlations and spectra. Moreover, it is shown that exponential averaging is a promising tool for LES implementation in complex geometry with deterministic unsteadiness. Finally, adaptability of the method is demonstrated by application to a configuration representative of blade-tip clearance flow in a turbomachine.
△ Less
Submitted 14 January, 2008;
originally announced January 2008.
-
On the evaluation of some three-body variational integrals
Authors:
Jose Caro
Abstract:
Stable recursive relations are presented for the numerical computation of the integrals
$$\int d{\bf r}_1 d{\bf r}_2 r_1^{l-1} r_2^{m-1} r_{12}^{n-1}
\exp{\{-αr_1 -βr_2 -γr_{12}\}}$$
($l$, $m$ and $n$ integer, $α$, $β$ and $γ$ real) when the indices $l$, $m$ or $n$ are negative. Useful formulas are given for particular values of the parameters $α$, $β$ and $γ$.
Stable recursive relations are presented for the numerical computation of the integrals
$$\int d{\bf r}_1 d{\bf r}_2 r_1^{l-1} r_2^{m-1} r_{12}^{n-1}
\exp{\{-αr_1 -βr_2 -γr_{12}\}}$$
($l$, $m$ and $n$ integer, $α$, $β$ and $γ$ real) when the indices $l$, $m$ or $n$ are negative. Useful formulas are given for particular values of the parameters $α$, $β$ and $γ$.
△ Less
Submitted 26 May, 1998; v1 submitted 3 March, 1998;
originally announced March 1998.
