Showing 1–17 of 17 results for author: Lee, Y J

R-PINN: Recovery-type a-posteriori estimator enhanced adaptive PINN

Authors: Rongxin Lu, Jiwei Jia, Young Ju Lee, Zheng Lu, Chensong Zhang

Abstract: In recent years, with the advancements in machine learning and neural networks, algorithms using physics-informed neural networks (PINNs) to solve PDEs have gained widespread applications. While these algorithms are well-suited for a wide range of equations, they often exhibit suboptimal performance when applied to equations with large local gradients, resulting in substantial localized errors. To… ▽ More In recent years, with the advancements in machine learning and neural networks, algorithms using physics-informed neural networks (PINNs) to solve PDEs have gained widespread applications. While these algorithms are well-suited for a wide range of equations, they often exhibit suboptimal performance when applied to equations with large local gradients, resulting in substantial localized errors. To address this issue, this paper proposes an adaptive PINN algorithm designed to improve accuracy in such cases. The core idea of the algorithm is to adaptively adjust the distribution of collocation points based on the recovery-type a-posterior error of the current numerical solution, enabling a better approximation of the true solution. This approach is inspired by the adaptive finite element method. By combining the recovery-type a-posteriori estimator, a gradient-recovery estimator commonly used in the adaptive finite element method (FEM) with PINNs, we introduce the Recovery-type a-posteriori estimator enhanced adaptive PINN (R-PINN) and compare its performance with a typical adaptive PINN algorithm, FI-PINN. Our results demonstrate that R-PINN achieves faster convergence with fewer adaptive points and significantly outperforms in the cases with multiple regions of large errors than FI-PINN. Notably, our method is a hybrid numerical approach for solving partial differential equations, integrating adaptive FEM with PINNs. △ Less

Submitted 11 June, 2025; originally announced June 2025.

Polynomially growing integer sequences all whose terms are composite

Authors: Dan Ismailescu, Yunkyu James Lee

Abstract: We identify pairs of positive integers $(t, d)$ with the property that the integer sequence with general term $\lfloor{n^t/d\rfloor}$ contains at most finitely many primes. We identify pairs of positive integers $(t, d)$ with the property that the integer sequence with general term $\lfloor{n^t/d\rfloor}$ contains at most finitely many primes. △ Less

Submitted 8 January, 2025; originally announced January 2025.

Comments: 12 pages, 1 table

MSC Class: 11B50; 11A41; 11Y55

Orthogonal greedy algorithm for linear operator learning with shallow neural network

Authors: Ye Lin, Jiwei Jia, Young Ju Lee, Ran Zhang

Abstract: Greedy algorithms, particularly the orthogonal greedy algorithm (OGA), have proven effective in training shallow neural networks for fitting functions and solving partial differential equations (PDEs). In this paper, we extend the application of OGA to the tasks of linear operator learning, which is equivalent to learning the kernel function through integral transforms. Firstly, a novel greedy alg… ▽ More Greedy algorithms, particularly the orthogonal greedy algorithm (OGA), have proven effective in training shallow neural networks for fitting functions and solving partial differential equations (PDEs). In this paper, we extend the application of OGA to the tasks of linear operator learning, which is equivalent to learning the kernel function through integral transforms. Firstly, a novel greedy algorithm is developed for kernel estimation rate in a new semi-inner product, which can be utilized to approximate the Green's function of linear PDEs from data. Secondly, we introduce the OGA for point-wise kernel estimation to further improve the approximation rate, achieving orders of accuracy improvement across various tasks and baseline models. In addition, we provide a theoretical analysis on the kernel estimation problem and the optimal approximation rates for both algorithms, establishing their efficacy and potential for future applications in PDEs and operator learning tasks. △ Less

Submitted 6 January, 2025; originally announced January 2025.

Greedy Algorithm for Neural Networks for Indefinite Elliptic Problems

Authors: Qingguo Hong, Jiwei Jia, Young Ju Lee, Ziqian Li

Abstract: The paper presents a priori error analysis of the shallow neural network approximation to the solution to the indefinite elliptic equation and and cutting-edge implementation of the Orthogonal Greedy Algorithm (OGA) tailored to overcome the challenges of indefinite elliptic problems, which is a domain where conventional approaches often struggle due to nontraditional difficulties due to the lack o… ▽ More The paper presents a priori error analysis of the shallow neural network approximation to the solution to the indefinite elliptic equation and and cutting-edge implementation of the Orthogonal Greedy Algorithm (OGA) tailored to overcome the challenges of indefinite elliptic problems, which is a domain where conventional approaches often struggle due to nontraditional difficulties due to the lack of coerciveness. A rigorous a priori error analysis that shows the neural networks ability to approximate indefinite problems is confirmed numerically by OGA methods. We also present a discretization error analysis of the relevant numerical quadrature. In particular, massive numerical implementations are conducted to justify the theory, some of which showcase the OGAs superior performance in comparison to the traditional finite element method. This advancement illustrates the potential of neural networks enhanced by OGA to solve intricate computational problems more efficiently, thereby marking a significant leap forward in the application of machine learning techniques to mathematical problem-solving. △ Less

Submitted 24 October, 2024; originally announced October 2024.

Comments: 17 pages

fOGA: Orthogonal Greedy Algorithm for Fractional Laplace Equations

Authors: Ruitong Shan, Young Ju Lee, Jiwei Jia

Abstract: In this paper, we explore the finite difference approximation of the fractional Laplace operator in conjunction with a neural network method for solving it. We discretized the fractional Laplace operator using the Riemann-Liouville formula relevant to fractional equations. A shallow neural network was constructed to address the discrete fractional operator, coupled with the OGA algorithm. To valid… ▽ More In this paper, we explore the finite difference approximation of the fractional Laplace operator in conjunction with a neural network method for solving it. We discretized the fractional Laplace operator using the Riemann-Liouville formula relevant to fractional equations. A shallow neural network was constructed to address the discrete fractional operator, coupled with the OGA algorithm. To validate the feasibility of our approach, we conducted numerical experiments, testing both the Laplace operator and the fractional Laplace operator, yielding favorable convergence results. △ Less

Submitted 24 September, 2024; originally announced September 2024.

Comments: 15 pages

Green Multigrid Network

Authors: Ye Lin, Young Ju Lee, Jiwei Jia

Abstract: GreenLearning networks (GL) directly learn Green's function in physical space, making them an interpretable model for capturing unknown solution operators of partial differential equations (PDEs). For many PDEs, the corresponding Green's function exhibits asymptotic smoothness. In this paper, we propose a framework named Green Multigrid networks (GreenMGNet), an operator learning algorithm designe… ▽ More GreenLearning networks (GL) directly learn Green's function in physical space, making them an interpretable model for capturing unknown solution operators of partial differential equations (PDEs). For many PDEs, the corresponding Green's function exhibits asymptotic smoothness. In this paper, we propose a framework named Green Multigrid networks (GreenMGNet), an operator learning algorithm designed for a class of asymptotically smooth Green's functions. Compared with the pioneering GL, the new framework presents itself with better accuracy and efficiency, thereby achieving a significant improvement. GreenMGNet is composed of two technical novelties. First, Green's function is modeled as a piecewise function to take into account its singular behavior in some parts of the hyperplane. Such piecewise function is then approximated by a neural network with augmented output(AugNN) so that it can capture singularity accurately. Second, the asymptotic smoothness property of Green's function is used to leverage the Multi-Level Multi-Integration (MLMI) algorithm for both the training and inference stages. Several test cases of operator learning are presented to demonstrate the accuracy and effectiveness of the proposed method. On average, GreenMGNet achieves $3.8\%$ to $39.15\%$ accuracy improvement. To match the accuracy level of GL, GreenMGNet requires only about $10\%$ of the full grid data, resulting in a $55.9\%$ and $92.5\%$ reduction in training time and GPU memory cost for one-dimensional test problems, and a $37.7\%$ and $62.5\%$ reduction for two-dimensional test problems. △ Less

Submitted 3 July, 2024; originally announced July 2024.

An Unconstrained Formulation of Some Constrained Partial Differential Equations and its Application to Finite Neuron Methods

Authors: Jiwei Jia, Young Ju Lee, Ruitong Shan

Abstract: In this paper, we present a new framework how a PDE with constraints can be formulated into a sequence of PDEs with no constraints, whose solutions are convergent to the solution of the PDE with constraints. This framework is then used to build a novel finite neuron method to solve the 2nd order elliptic equations with the Dirichlet boundary condition. Our algorithm is the first algorithm, proven… ▽ More In this paper, we present a new framework how a PDE with constraints can be formulated into a sequence of PDEs with no constraints, whose solutions are convergent to the solution of the PDE with constraints. This framework is then used to build a novel finite neuron method to solve the 2nd order elliptic equations with the Dirichlet boundary condition. Our algorithm is the first algorithm, proven to lead to shallow neural network solutions with an optimal H1 norm error. We show that a widely used penalized PDE, which imposes the Dirichlet boundary condition weakly can be interpreted as the first element of the sequence of PDEs within our framework. Furthermore, numerically, we show that it may not lead to the solution with the optimal H1 norm error bound in general. On the other hand, we theoretically demonstrate that the second and later elements of a sequence of PDEs can lead to an adequate solution with the optimal H1 norm error bound. A number of sample tests are performed to confirm the effectiveness of the proposed algorithm and the relevant theory. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Carleson measures for weighted Bergman--Zygmund spaces

Authors: Hong Rae Cho, Hyungwoon Koo, Young Joo Lee, Atte Pennanen, Jouni Rättyä, Fanglei Wu

Abstract: For $0<p<\infty$, $Ψ:[0,\infty)\to(0,\infty)$ and a finite positive Borel measure $μ$ on the unit disc $\mathbb{D}$, the Lebesgue--Zygmund space $L^p_{μ,Ψ}$ consists of all measurable functions $f$ such that $\lVert f \rVert_{L_{μ, Ψ}^{p}}^p =\int_{\mathbb{D}}|f|^pΨ(|f|)\,dμ< \infty$. For an integrable radial function $ω$ on $\mathbb{D}$, the corresponding weighted Bergman-Zygmund space… ▽ More For $0<p<\infty$, $Ψ:[0,\infty)\to(0,\infty)$ and a finite positive Borel measure $μ$ on the unit disc $\mathbb{D}$, the Lebesgue--Zygmund space $L^p_{μ,Ψ}$ consists of all measurable functions $f$ such that $\lVert f \rVert_{L_{μ, Ψ}^{p}}^p =\int_{\mathbb{D}}|f|^pΨ(|f|)\,dμ< \infty$. For an integrable radial function $ω$ on $\mathbb{D}$, the corresponding weighted Bergman-Zygmund space $A_{ω, Ψ}^{p}$ is the set of all analytic functions in $L_{μ, Ψ}^{p}$ with $dμ=ω\,dA$. The purpose of the paper is to characterize bounded (and compact) embeddings $A_{ω,Ψ}^{p}\subset L_{μ, Φ}^{q}$, when $0<p\le q<\infty$, the functions $Ψ$ and $Φ$ are essential monotonic, and $Ψ,Φ,ω$ satisfy certain doubling properties. The tools developed on the way to the main results are applied to characterize bounded and compact integral operators acting from $A^p_{ω,Ψ}$ to $A^q_{ν,Φ}$, provided $ν$ admits the same doubling property as $ω$. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Finite flocking time of the nonlinear Cucker--Smale model with Rayleigh friction type using the discrete $p$-Laplacian

Authors: Jong-Ho Kim, Young Ju Lee, Jea-Hyun Park

Abstract: The study of collective behavior in multi-agent systems has attracted the attention of many researchers due to its wide range of applications. Among them, the Cucker-Smale model was developed to study the phenomenon of flocking, and various types of extended models have been actively proposed and studied in recent decades. In this study, we address open questions of the Cucker--Smale model with… ▽ More The study of collective behavior in multi-agent systems has attracted the attention of many researchers due to its wide range of applications. Among them, the Cucker-Smale model was developed to study the phenomenon of flocking, and various types of extended models have been actively proposed and studied in recent decades. In this study, we address open questions of the Cucker--Smale model with norm-type Rayleigh friction: {\bf (i)} The positivity of the communication weight, {\bf (ii)} The convergence of the norm of the velocities of agents, {\bf (iii)} The direction of the velocities of agents. For problems (i) and (ii), we present the nonlinear Cucker--Smale model with norm-type Rayleigh friction, where the nonlinear Cucker--Smale model is generalized to a nonlinear model by applying a discrete $p$-Laplacian operator. For this model, we present conditions that guarantee that the norm for velocities of agents converges to 0 or a positive value, and we also show that the regular communication weight satisfies the conditions given in this study. In particular, we present a condition for the initial configuration to obtain that the norm of agent velocities converges to only some positive value. By contrast, problem (iii) is not solved by the norm-type nonlinear model. Thus, we propose a nonlinear Cucker--Smale model with a vector-type Rayleigh friction for problem (iii). In parallel to the first model, we show that the direction of the agents' velocities can be controlled by parameters in the nonlinear Cucker--Smale model with the vector-type Rayleigh friction. △ Less

Submitted 29 August, 2023; v1 submitted 12 May, 2023; originally announced May 2023.

Comments: 26 pages

Companion-Based Multi-Level Finite Element Method for Computing Multiple Solutions of Nonlinear Differential Equations

Authors: Wenrui Hao, Sun Lee, Young Ju Lee

Abstract: The use of nonlinear PDEs has led to significant advancements in various fields, such as physics, biology, ecology, and quantum mechanics. However, finding multiple solutions for nonlinear PDEs can be a challenging task, especially when suitable initial guesses are difficult to obtain. In this paper, we introduce a novel approach called the Companion-Based Multilevel finite element method (CBMFEM)… ▽ More The use of nonlinear PDEs has led to significant advancements in various fields, such as physics, biology, ecology, and quantum mechanics. However, finding multiple solutions for nonlinear PDEs can be a challenging task, especially when suitable initial guesses are difficult to obtain. In this paper, we introduce a novel approach called the Companion-Based Multilevel finite element method (CBMFEM), which can efficiently and accurately generate multiple initial guesses for solving nonlinear elliptic semi-linear equations with polynomial nonlinear terms using finite element methods with conforming elements. We provide a theoretical analysis of the error estimate of finite element methods using an appropriate notion of isolated solutions, for the nonlinear elliptic equation with multiple solutions and present numerical results obtained using CBMFEM which are consistent with the theoretical analysis. △ Less

Submitted 6 May, 2023; originally announced May 2023.

MSC Class: 49M37; 65N30; 90C99

Helicity-conservative Physics-informed Neural Network Model for Navier-Stokes Equations

Authors: Jiwei Jia, Young Ju Lee, Ziqian Li, Zheng Lu, Ran Zhang

Abstract: We design the helicity-conservative physics-informed neural network model for the Navier-Stokes equation in the ideal case. The key is to provide an appropriate PDE model as loss function so that its neural network solutions produce helicity conservation. Physics-informed neural network model is based on the strong form of PDE. We compare the proposed Physics-informed neural network model and a re… ▽ More We design the helicity-conservative physics-informed neural network model for the Navier-Stokes equation in the ideal case. The key is to provide an appropriate PDE model as loss function so that its neural network solutions produce helicity conservation. Physics-informed neural network model is based on the strong form of PDE. We compare the proposed Physics-informed neural network model and a relevant helicity-conservative finite element method. We arrive at the conclusion that the strong form PDE is better suited for conservation issues. We also present theoretical justifications for helicity conservation as well as supporting numerical calculations. △ Less

Submitted 3 April, 2024; v1 submitted 15 April, 2022; originally announced April 2022.

Comments: 17 pages, 9 figures, 3 tables

Existence and Stability of Global Solutions to a regularized Oldroyd-B Model in its Vorticity Formulation

Authors: Jaroslaw S. Jaracz, Young Ju Lee

Abstract: We present a new regularized Oldroyd-B model in three dimensions which satisfies an energy estimate analogous to that of the standard model, and maintains the positive semi-definiteness of the conformation tensor. This results in the unique existence and stability of global solutions in a periodic domain. To be precise, given an initial velocity $u_0$ and initial conformation tensor $σ_0$, both wi… ▽ More We present a new regularized Oldroyd-B model in three dimensions which satisfies an energy estimate analogous to that of the standard model, and maintains the positive semi-definiteness of the conformation tensor. This results in the unique existence and stability of global solutions in a periodic domain. To be precise, given an initial velocity $u_0$ and initial conformation tensor $σ_0$, both with components in $H^2$, we obtain a velocity $u$ and conformation tensor $σ$ both with components in $C([0, T]; H^2)$ for all $T>0$. Assuming better regularity for the initial data allows us to obtain better regularity for the solutions. We treat both the diffusive and non-diffusive cases of the model. Notably, the regularization in the equation for the conformation tensor in our new model has been applied only to the velocity, rather than to the conformation tensor, unlike other available regularization techniques \cite{barrett;suli2009}. This is desired since the stress, and thus the conformation tensor, is typically less regular than the velocity for the creeping flow of non-Newtonian fluids. In \cite{constantinnote} the existence and regularity of solutions to the non-regularized two dimensional diffusive Oldroyd-B model was established. However, the proof cannot be generalized to three dimensions nor to the non-diffusive case. The proposed regularization overcomes these obstacles. Moreover, we show that the solutions in the diffusive case are stable in the $H^2$ norm. In the non-diffusive case, we are able to establish that the solutions are stable in the $L^2$ norm. Furthermore, we show that as the diffusivity parameter goes to zero, our solutions converge in the $L^2$ norm to the non-diffusive solution. △ Less

Submitted 23 November, 2021; originally announced November 2021.

Journal ref: Journal of Differential Equations, Volume 327, 5 August 2022, Pages 259-321

Complex symmetry of Toeplitz operators

Authors: Yong Chen, Young Joo Lee, Yile Zhao

Abstract: We introduce a new class of conjugations and characterize complex symmetric Toeplitz operators on the Hardy space with respect to those conjugations. Also, we prove that complex symmetricity and \uet~ property are the same for a certain class of Toeplitz operators. We also discuss the analytic symmetricity for Toeplitz operators. Our results extend several known results by providing unified ways o… ▽ More We introduce a new class of conjugations and characterize complex symmetric Toeplitz operators on the Hardy space with respect to those conjugations. Also, we prove that complex symmetricity and \uet~ property are the same for a certain class of Toeplitz operators. We also discuss the analytic symmetricity for Toeplitz operators. Our results extend several known results by providing unified ways of treating them. △ Less

Submitted 14 July, 2021; originally announced July 2021.

Comments: 24 pages

MSC Class: Primary 47B35; Secondary 46E22; 47B99

Locally conservative immersed finite element method for elliptic interface problems

Authors: Gwanghyun Jo, Do Young Kwak, Young Ju Lee

Abstract: In this paper, we introduce the locally conservative enriched immersed finite element method (EIFEM) to tackle the elliptic problem with interface. The immersed finite element is useful for handling interface with mesh unfit with the interface. However, all the currently available method under IFEM framework may not be designed to consider the flux conservation. We provide an efficient and effecti… ▽ More In this paper, we introduce the locally conservative enriched immersed finite element method (EIFEM) to tackle the elliptic problem with interface. The immersed finite element is useful for handling interface with mesh unfit with the interface. However, all the currently available method under IFEM framework may not be designed to consider the flux conservation. We provide an efficient and effective remedy for this issue by introducing a local piecewise constant enrichment, which provides the locally conservative flux. We have also constructed and analyzed an auxiliary space preconditioner for the resulting system based on the application of algebraic multigrid method. The new observation in this work is that by imposing strong Dirichlet boundary condition for the standard IFEM part of EIFEM, we are able to remove the zero eigen-mode of the EIFEM system while still imposing the Dirichlet boundary condition weakly assigned to the piecewise constant enrichment part of EIFEM. A couple of issues relevant to the piecewise constant enrichment given for the mesh unfit to the interface has been discussed and clarified as well. Numerical tests are provided to confirm the theoretical development. △ Less

Submitted 1 January, 2021; originally announced January 2021.

Local Polynomial Estimation of Time-Varying Parameters in Nonlinear Models

Authors: Dennis Kristensen, Young Jun Lee

Abstract: We develop a novel asymptotic theory for local polynomial (quasi-) maximum-likelihood estimators of time-varying parameters in a broad class of nonlinear time series models. Under weak regularity conditions, we show the proposed estimators are consistent and follow normal distributions in large samples. Our conditions impose weaker smoothness and moment conditions on the data-generating process an… ▽ More We develop a novel asymptotic theory for local polynomial (quasi-) maximum-likelihood estimators of time-varying parameters in a broad class of nonlinear time series models. Under weak regularity conditions, we show the proposed estimators are consistent and follow normal distributions in large samples. Our conditions impose weaker smoothness and moment conditions on the data-generating process and its likelihood compared to existing theories. Furthermore, the bias terms of the estimators take a simpler form. We demonstrate the usefulness of our general results by applying our theory to local (quasi-)maximum-likelihood estimators of a time-varying VAR's, ARCH and GARCH, and Poisson autogressions. For the first three models, we are able to substantially weaken the conditions found in the existing literature. For the Poisson autogression, existing theories cannot be be applied while our novel approach allows us to analyze it. △ Less

Submitted 24 August, 2023; v1 submitted 10 April, 2019; originally announced April 2019.

Axisymmetric Stokes equations in polygonal domains: regularity and finite element approximations

Authors: Young Ju Lee, Hengguang Li

Abstract: We study the regularity and finite element approximation of the axisymmetric Stokes problem on a polygonal domain $Ω$. In particular, taking into account the singular coefficients in the equation and non-smoothness of the domain, we establish the well-posedness and full regularity of the solution in new weighted Sobolev spaces $\maK^m_{μ, 1}(Ω)$. Using our a priori results, we give a specific cons… ▽ More We study the regularity and finite element approximation of the axisymmetric Stokes problem on a polygonal domain $Ω$. In particular, taking into account the singular coefficients in the equation and non-smoothness of the domain, we establish the well-posedness and full regularity of the solution in new weighted Sobolev spaces $\maK^m_{μ, 1}(Ω)$. Using our a priori results, we give a specific construction of graded meshes on which the Taylor-Hood mixed method approximates singular solutions at the optimal convergence rate. Numerical tests are presented to confirm the theoretical results in the paper. △ Less

Submitted 19 June, 2012; originally announced June 2012.

Multidimensional Divide-and-Conquer and Weighted Digital Sums

Authors: Y. K. Cheung, Philippe Flajolet, Mordecai Golin, C. Y. James Lee

Abstract: This paper studies three types of functions arising separately in the analysis of algorithms that we analyze exactly using similar Mellin transform techniques. The first is the solution to a Multidimensional Divide-and-Conquer (MDC) recurrence that arises when solving problems on points in $d$-dimensional space. The second involves weighted digital sums. Write $n$ in its binary representation… ▽ More This paper studies three types of functions arising separately in the analysis of algorithms that we analyze exactly using similar Mellin transform techniques. The first is the solution to a Multidimensional Divide-and-Conquer (MDC) recurrence that arises when solving problems on points in $d$-dimensional space. The second involves weighted digital sums. Write $n$ in its binary representation $n=(b_i b_{i-1}... b_1 b_0)_2$ and set $S_M(n) = \sum_{t=0}^i t^{\bar{M}} b_t 2^t$. We analyze the average $TS_M(n) = \frac{1}{n}\sum_{j<n} S_M(j)$. The third is a different variant of weighted digital sums. Write $n$ as $n=2^{i_1} + 2^{i_2} + ... + 2^{i_k}$ with $i_1 > i_2 > ... > i_k\geq 0$ and set $W_M(n) = \sum_{t=1}^k t^M 2^{i_t}$. We analyze the average $TW_M(n) = \frac{1}{n}\sum_{j<n} W_M(j)$. We show that both the MDC functions and $TS_M(n)$ (with $d=M+1$) have solutions of the form $λ_d n \lg^{d-1}n + \sum_{m=0}^{d-2}(n\lg^m n)A_{d,m}(\lg n) + c_d,$ where $λ_d,c_d$ are constants and $A_{d,m}(u)$'s are periodic functions with period one (given by absolutely convergent Fourier series). We also show that $TW_M(n)$ has a solution of the form $n G_M(\lg n) + d_M \lg^M n + \sum_{d=0}^{M-1}(\lg^d n)G_{M,d}(\lg n),$ where $d_M$ is a constant, $G_M(u)$ and $G_{M,d}(u)$'s are again periodic functions with period one (given by absolutely convergent Fourier series). △ Less

Submitted 28 February, 2010; originally announced March 2010.

Comments: 44 pages, 8 figures