-
Generating observation guided ensembles for data assimilation with denoising diffusion probabilistic model
Authors:
Yuuichi Asahi,
Yuta Hasegawa,
Naoyuki Onodera,
Takashi Shimokawabe,
Hayato Shiba,
Yasuhiro Idomura
Abstract:
This paper presents an ensemble data assimilation method using the pseudo ensembles generated by denoising diffusion probabilistic model. Since the model is trained against noisy and sparse observation data, this model can produce divergent ensembles close to observations. Thanks to the variance in generated ensembles, our proposed method displays better performance than the well-established ensem…
▽ More
This paper presents an ensemble data assimilation method using the pseudo ensembles generated by denoising diffusion probabilistic model. Since the model is trained against noisy and sparse observation data, this model can produce divergent ensembles close to observations. Thanks to the variance in generated ensembles, our proposed method displays better performance than the well-established ensemble data assimilation method when the simulation model is imperfect.
△ Less
Submitted 13 August, 2023;
originally announced August 2023.
-
Continuous data assimilation of large eddy simulation by lattice Boltzmann method and local ensemble transform Kalman filter (LBM-LETKF)
Authors:
Yuta Hasegawa,
Naoyuki Onodera,
Yuuichi Asahi,
Takuya Ina,
Toshiyuki Imamura,
Yasuhiro Idomura
Abstract:
We investigate the applicability of the data assimilation (DA) to large eddy simulations (LESs) based on the lattice Boltzmann method (LBM). We carry out the observing system simulation experiment of a two-dimensional (2D) forced isotropic turbulence, and examine the DA accuracy of the nudging and the local ensemble transform Kalman filter (LETKF) with spatially sparse and noisy observation data o…
▽ More
We investigate the applicability of the data assimilation (DA) to large eddy simulations (LESs) based on the lattice Boltzmann method (LBM). We carry out the observing system simulation experiment of a two-dimensional (2D) forced isotropic turbulence, and examine the DA accuracy of the nudging and the local ensemble transform Kalman filter (LETKF) with spatially sparse and noisy observation data of flow fields. The advantage of the LETKF is that it does not require computing spatial interpolation and/or an inverse problem between the macroscopic variables (the density and the pressure) and the velocity distribution function of the LBM, while the nudging introduces additional models for them. The numerical experiments with $256\times256$ grids and $10\%$ observation noise in the velocity showed that the root mean square error of the velocity in the LETKF with $8\times 8$ observation points ($\sim 0.1\%$ of the total grids) and 64 ensemble members becomes smaller than the observation noise, while the nudging requires an order of magnitude larger number of observation points to achieve the same accuracy. Another advantage of the LETKF is that it well keeps the amplitude of the energy spectrum, while only the phase error becomes larger with more sparse observation. We also see that a lack of observation data in the LETKF produces a spurious energy injection in high wavenumber regimes, leading to numerical instability. Such numerical instability is known as the catastrophic filter divergence problem, which can be suppressed by increasing the number of ensemble members. From these results, it was shown that the LETKF enables robust and accurate DA for the 2D LBM with sparse and noisy observation data.
△ Less
Submitted 16 October, 2023; v1 submitted 7 August, 2023;
originally announced August 2023.
-
GPU Optimization of Lattice Boltzmann Method with Local Ensemble Transform Kalman Filter
Authors:
Yuta Hasegawa,
Toshiyuki Imamura,
Takuya Ina,
Naoyuki Onodera,
Yuuichi Asahi,
Yasuhiro Idomura
Abstract:
The ensemble data assimilation of computational fluid dynamics simulations based on the lattice Boltzmann method (LBM) and the local ensemble transform Kalman filter (LETKF) is implemented and optimized on a GPU supercomputer based on NVIDIA A100 GPUs. To connect the LBM and LETKF parts, data transpose communication is optimized by overlapping computation, file I/O, and communication based on data…
▽ More
The ensemble data assimilation of computational fluid dynamics simulations based on the lattice Boltzmann method (LBM) and the local ensemble transform Kalman filter (LETKF) is implemented and optimized on a GPU supercomputer based on NVIDIA A100 GPUs. To connect the LBM and LETKF parts, data transpose communication is optimized by overlapping computation, file I/O, and communication based on data dependency in each LETKF kernel. In two dimensional forced isotropic turbulence simulations with the ensemble size of $M=64$ and the number of grid points of $N_x=128^2$, the optimized implementation achieved $\times3.80$ speedup from the naive implementation, in which the LETKF part is not parallelized. The main computing kernel of the local problem is the eigenvalue decomposition (EVD) of $M\times M$ real symmetric dense matrices, which is computed by a newly developed batched EVD in $\verb|EigenG|$. The batched EVD in $\verb|EigenG|$ outperforms that in $\verb|cuSOLVER|$, and $\times65.3$ speedup was achieved.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
