-
BO-SA-PINNs: Self-adaptive physics-informed neural networks based on Bayesian optimization for automatically designing PDE solvers
Authors:
Rui Zhang,
Liang Li,
Stéphane Lanteri,
Hao Kang,
Jiaqi Li
Abstract:
Physics-informed neural networks (PINNs) is becoming a popular alternative method for solving partial differential equations (PDEs). However, they require dedicated manual modifications to the hyperparameters of the network, the sampling methods and loss function weights for different PDEs, which reduces the efficiency of the solvers. In this paper, we pro- pose a general multi-stage framework, i.…
▽ More
Physics-informed neural networks (PINNs) is becoming a popular alternative method for solving partial differential equations (PDEs). However, they require dedicated manual modifications to the hyperparameters of the network, the sampling methods and loss function weights for different PDEs, which reduces the efficiency of the solvers. In this paper, we pro- pose a general multi-stage framework, i.e. BO-SA-PINNs to alleviate this issue. In the first stage, Bayesian optimization (BO) is used to select hyperparameters for the training process, and based on the results of the pre-training, the network architecture, learning rate, sampling points distribution and loss function weights suitable for the PDEs are automatically determined. The proposed hyperparameters search space based on experimental results can enhance the efficiency of BO in identifying optimal hyperparameters. After selecting the appropriate hyperparameters, we incorporate a global self-adaptive (SA) mechanism the second stage. Using the pre-trained model and loss information in the second-stage training, the exponential moving average (EMA) method is employed to optimize the loss function weights, and residual-based adaptive refinement with distribution (RAR-D) is used to optimize the sampling points distribution. In the third stage, L-BFGS is used for stable training. In addition, we introduce a new activation function that enables BO-SA-PINNs to achieve higher accuracy. In numerical experiments, we conduct comparative and ablation experiments to verify the performance of the model on Helmholtz, Maxwell, Burgers and high-dimensional Poisson equations. The comparative experiment results show that our model can achieve higher accuracy and fewer iterations in test cases, and the ablation experiments demonstrate the positive impact of every improvement.
△ Less
Submitted 13 April, 2025;
originally announced April 2025.
-
Model order reduction for parameterized electromagnetic problems using matrix decomposition and deep neural networks
Authors:
Xiao-Feng He,
Liang Li,
Stephane Lanteri,
Kun Li
Abstract:
A non-intrusive model order reduction (MOR) method for solving parameterized electromagnetic scattering problems is proposed in this paper. A database collecting snapshots of high-fidelity solutions is built by solving the parameterized time-domain Maxwell equations for some values of the material parameters using a fullwave solver based on a high order discontinuous Galerkin time-domain (DGTD) me…
▽ More
A non-intrusive model order reduction (MOR) method for solving parameterized electromagnetic scattering problems is proposed in this paper. A database collecting snapshots of high-fidelity solutions is built by solving the parameterized time-domain Maxwell equations for some values of the material parameters using a fullwave solver based on a high order discontinuous Galerkin time-domain (DGTD) method. To perform a prior dimensionality reduction, a set of reduced basis (RB) functions are extracted from the database via a two-step proper orthogonal decomposition (POD) method. Projection coefficients of the reduced basis functions are further compressed through a convolutional autoencoder (CAE) network. Singular value decomposition (SVD) is then used to extract the principal components of the reduced-order matrices generated by CAE, and a cubic spline interpolation-based (CSI) approach is employed for approximating the dominating time- and parameter-modes of the reduced-order matrices. The generation of the reduced basis and the training of the CAE and CSI are accomplished in the offline stage, thus the RB solution for given time/parameter values can be quickly recovered via outputs of the interpolation model and decoder network. In particular, the offline and online stages of the proposed RB method are completely decoupled, which ensures the validity of the method. The performance of the proposed CAE-CSI ROM is illustrated with numerical experiments for scattering of a plane wave by a 2-D dielectric disk and a multi-layer heterogeneous medium.
△ Less
Submitted 15 July, 2022;
originally announced July 2022.
-
A controllability method for Maxwell's equations
Authors:
T. Chaumont-Frelet,
M. J. Grote,
S. Lanteri,
J. H. Tang
Abstract:
We propose a controllability method for the numerical solution of time-harmonic Maxwell's equations in their first-order formulation. By minimizing a quadratic cost functional, which measures the deviation from periodicity, the controllability method determines iteratively a periodic solution in the time domain. At each conjugate gradient iteration, the gradient of the cost functional is simply co…
▽ More
We propose a controllability method for the numerical solution of time-harmonic Maxwell's equations in their first-order formulation. By minimizing a quadratic cost functional, which measures the deviation from periodicity, the controllability method determines iteratively a periodic solution in the time domain. At each conjugate gradient iteration, the gradient of the cost functional is simply computed by running any time-dependent simulation code forward and backward for one period, thus leading to a non-intrusive implementation easily integrated into existing software. Moreover, the proposed algorithm automatically inherits the parallelism, scalability, and low memory footprint of the underlying time-domain solver. Since the time-periodic solution obtained by minimization is not necessarily unique, we apply a cheap post-processing filtering procedure which recovers the time-harmonic solution from any minimizer. Finally, we present a series of numerical examples which show that our algorithm greatly speeds up the convergence towards the desired time-harmonic solution when compared to simply running the time-marching code until the time-harmonic regime is eventually reached.
△ Less
Submitted 5 June, 2021;
originally announced June 2021.
-
A posteriori error estimates for finite element discretizations of time-harmonic Maxwell's equations coupled with a non-local hydrodynamic Drude model
Authors:
T. Chaumont-Frelet,
S. Lanteri,
P. Vega
Abstract:
We consider finite element discretizations of Maxwell's equations coupled with a non-local hydrodynamic Drude model that accurately accounts for electron motions in metallic nanostructures. Specifically, we focus on a posteriori error estimation and mesh adaptivity, which is of particular interest since the electromagnetic field usually exhibits strongly localized features near the interface betwe…
▽ More
We consider finite element discretizations of Maxwell's equations coupled with a non-local hydrodynamic Drude model that accurately accounts for electron motions in metallic nanostructures. Specifically, we focus on a posteriori error estimation and mesh adaptivity, which is of particular interest since the electromagnetic field usually exhibits strongly localized features near the interface between metals and their surrounding media. We propose a novel residual-based error estimator that is shown to be reliable and efficient. We also present a set of numerical examples where the estimator drives a mesh adaptive process. These examples highlight the quality of the proposed estimator, and the potential computational savings offered by mesh adaptivity.
△ Less
Submitted 9 March, 2021;
originally announced March 2021.
-
A postprocessing technique for a discontinuous Galerkin discretization of time-dependent Maxwell's equations
Authors:
G. Nehmetallah,
T. Chaumont-Frelet,
S. Descombes,
S. Lanteri
Abstract:
We present a novel postprocessing technique for a discontinuous Galerkin (DG) discretization of time-dependent Maxwell's equations that we couple with an explicit Runge-Kutta time-marching scheme. The postprocessed electromagnetic field converges one order faster than the unprocessed solution in the H(curl)-norm. The proposed approach is local, in the sense that the enhanced solution is computed i…
▽ More
We present a novel postprocessing technique for a discontinuous Galerkin (DG) discretization of time-dependent Maxwell's equations that we couple with an explicit Runge-Kutta time-marching scheme. The postprocessed electromagnetic field converges one order faster than the unprocessed solution in the H(curl)-norm. The proposed approach is local, in the sense that the enhanced solution is computed independently in each cell of the computational mesh, and at each time step of interest. As a result, it is inexpensive to compute, especially if the region of interest is localized, either in time or space. The key ideas behind this postprocessing technique stem from hybridizable discontinuous Galerkin (HDG) methods, which are equivalent to the analyzed DG scheme for specific choices of penalization parameters. We present several numerical experiments that highlight the superconvergence properties of the postprocessed electromagnetic field approximation.
△ Less
Submitted 3 October, 2020;
originally announced October 2020.
-
A hybridizable discontinuous Galerkin method for solving nonlocal optical response models
Authors:
Liang Li,
Stéphane Lanteri,
N. Asger Mortensen,
Martijn Wubs
Abstract:
We propose Hybridizable Discontinuous Galerkin (HDG) methods for solving the frequency-domain Maxwell's equations coupled to the Nonlocal Hydrodynamic Drude (NHD) and Generalized Nonlocal Optical Response (GNOR) models, which are employed to describe the optical properties of nano-plasmonic scatterers and waveguides. Brief derivations for both the NHD model and the GNOR model are presented. The fo…
▽ More
We propose Hybridizable Discontinuous Galerkin (HDG) methods for solving the frequency-domain Maxwell's equations coupled to the Nonlocal Hydrodynamic Drude (NHD) and Generalized Nonlocal Optical Response (GNOR) models, which are employed to describe the optical properties of nano-plasmonic scatterers and waveguides. Brief derivations for both the NHD model and the GNOR model are presented. The formulations of the HDG method are given, in which we introduce two hybrid variables living only on the skeleton of the mesh. The local field solutions are expressed in terms of the hybrid variables in each element. Two conservativity conditions are globally enforced to make the problem solvable and to guarantee the continuity of the tangential component of the electric field and the normal component of the current density. Numerical results show that the proposed HDG methods converge at optimal rate. We benchmark our implementation and demonstrate that the HDG method has the potential to solve complex nanophotonic problems.
△ Less
Submitted 24 November, 2016;
originally announced November 2016.
-
Stabilization in relation to wavenumber in HDG methods
Authors:
J. Gopalakrishnan,
S. Lanteri,
N. Olivares,
R. Perrussel
Abstract:
Simulation of wave propagation through complex media relies on proper understanding of the properties of numerical methods when the wavenumber is real and complex. Numerical methods of the Hybrid Discontinuous Galerkin (HDG) type are considered for simulating waves that satisfy the Helmholtz and Maxwell equations. It is shown that these methods, when wrongly used, give rise to singular systems for…
▽ More
Simulation of wave propagation through complex media relies on proper understanding of the properties of numerical methods when the wavenumber is real and complex. Numerical methods of the Hybrid Discontinuous Galerkin (HDG) type are considered for simulating waves that satisfy the Helmholtz and Maxwell equations. It is shown that these methods, when wrongly used, give rise to singular systems for complex wavenumbers. A sufficient condition on the HDG stabilization parameter for guaranteeing unique solvability of the numerical HDG system, both for Helmholtz and Maxwell systems, is obtained for complex wavenumbers. For real wavenumbers, results from a dispersion analysis are presented. An asymptotic expansion of the dispersion relation, as the number of mesh elements per wave increase, reveal that some choices of the stabilization parameter are better than others. To summarize the findings, there are values of the HDG stabilization parameter that will cause the HDG method to fail for complex wavenumbers. However, this failure is remedied if the real part of the stabilization parameter has the opposite sign of the imaginary part of the wavenumber. When the wavenumber is real, values of the stabilization parameter that asymptotically minimize the HDG wavenumber errors are found on the imaginary axis. Finally, a dispersion analysis of the mixed hybrid Raviart-Thomas method showed that its wavenumber errors are an order smaller than those of the HDG method.
△ Less
Submitted 20 March, 2015;
originally announced March 2015.
-
Solution of the time-harmonic Maxwell equations using discontinuous Galerkin methods
Authors:
Victorita Dolean,
Hugo Fol,
Stephane Lanteri,
Ronan Perrussel
Abstract:
We present numerical results concerning the solution of the time-harmonic Maxwell's equations discretized by discontinuous Galerkin methods. In particular, a numerical study of the convergence, which compares different strategies proposed in the literature for the elliptic Maxwell equations, is performed in the two-dimensional case.
We present numerical results concerning the solution of the time-harmonic Maxwell's equations discretized by discontinuous Galerkin methods. In particular, a numerical study of the convergence, which compares different strategies proposed in the literature for the elliptic Maxwell equations, is performed in the two-dimensional case.
△ Less
Submitted 11 April, 2007; v1 submitted 17 October, 2006;
originally announced October 2006.
