-
Monotone Peridynamic Neural Operator for Nonlinear Material Modeling with Conditionally Unique Solutions
Authors:
Jihong Wang,
Xiaochuan Tian,
Zhongqiang Zhang,
Stewart Silling,
Siavash Jafarzadeh,
Yue Yu
Abstract:
Data-driven methods have emerged as powerful tools for modeling the responses of complex nonlinear materials directly from experimental measurements. Among these methods, the data-driven constitutive models present advantages in physical interpretability and generalizability across different boundary conditions/domain settings. However, the well-posedness of these learned models is generally not g…
▽ More
Data-driven methods have emerged as powerful tools for modeling the responses of complex nonlinear materials directly from experimental measurements. Among these methods, the data-driven constitutive models present advantages in physical interpretability and generalizability across different boundary conditions/domain settings. However, the well-posedness of these learned models is generally not guaranteed a priori, which makes the models prone to non-physical solutions in downstream simulation tasks. In this study, we introduce monotone peridynamic neural operator (MPNO), a novel data-driven nonlocal constitutive model learning approach based on neural operators. Our approach learns a nonlocal kernel together with a nonlinear constitutive relation, while ensuring solution uniqueness through a monotone gradient network. This architectural constraint on gradient induces convexity of the learnt energy density function, thereby guaranteeing solution uniqueness of MPNO in small deformation regimes. To validate our approach, we evaluate MPNO's performance on both synthetic and real-world datasets. On synthetic datasets with manufactured kernel and constitutive relation, we show that the learnt model converges to the ground-truth as the measurement grid size decreases both theoretically and numerically. Additionally, our MPNO exhibits superior generalization capabilities than the conventional neural networks: it yields smaller displacement solution errors in down-stream tasks with new and unseen loadings. Finally, we showcase the practical utility of our approach through applications in learning a homogenized model from molecular dynamics data, highlighting its expressivity and robustness in real-world scenarios.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
Nonlocal Attention Operator: Materializing Hidden Knowledge Towards Interpretable Physics Discovery
Authors:
Yue Yu,
Ning Liu,
Fei Lu,
Tian Gao,
Siavash Jafarzadeh,
Stewart Silling
Abstract:
Despite the recent popularity of attention-based neural architectures in core AI fields like natural language processing (NLP) and computer vision (CV), their potential in modeling complex physical systems remains under-explored. Learning problems in physical systems are often characterized as discovering operators that map between function spaces based on a few instances of function pairs. This t…
▽ More
Despite the recent popularity of attention-based neural architectures in core AI fields like natural language processing (NLP) and computer vision (CV), their potential in modeling complex physical systems remains under-explored. Learning problems in physical systems are often characterized as discovering operators that map between function spaces based on a few instances of function pairs. This task frequently presents a severely ill-posed PDE inverse problem. In this work, we propose a novel neural operator architecture based on the attention mechanism, which we coin Nonlocal Attention Operator (NAO), and explore its capability towards developing a foundation physical model. In particular, we show that the attention mechanism is equivalent to a double integral operator that enables nonlocal interactions among spatial tokens, with a data-dependent kernel characterizing the inverse mapping from data to the hidden parameter field of the underlying operator. As such, the attention mechanism extracts global prior information from training data generated by multiple systems, and suggests the exploratory space in the form of a nonlinear kernel map. Consequently, NAO can address ill-posedness and rank deficiency in inverse PDE problems by encoding regularization and achieving generalizability. We empirically demonstrate the advantages of NAO over baseline neural models in terms of generalizability to unseen data resolutions and system states. Our work not only suggests a novel neural operator architecture for learning interpretable foundation models of physical systems, but also offers a new perspective towards understanding the attention mechanism.
△ Less
Submitted 14 August, 2024;
originally announced August 2024.
-
An Ultra-high-speed Reproducing Kernel Particle Method
Authors:
Siavash Jafarzadeh,
Michael Hillman
Abstract:
In this work, the fast-convolving reproducing kernel particle method (FC-RKPM) is introduced. This method is hundreds to millions of times faster than the traditional RKPM for 3D meshfree simulations. In this approach, the meshfree discretizations with RK approximation are expressed in terms of convolution sums. Fast Fourier transform (FFT) is then used to efficiently compute the convolutions. Cer…
▽ More
In this work, the fast-convolving reproducing kernel particle method (FC-RKPM) is introduced. This method is hundreds to millions of times faster than the traditional RKPM for 3D meshfree simulations. In this approach, the meshfree discretizations with RK approximation are expressed in terms of convolution sums. Fast Fourier transform (FFT) is then used to efficiently compute the convolutions. Certain modifications to the domain and shape functions are considered to maintain generality for complex geometries and arbitrary boundary conditions. The new method does not need to identify, store, and loop over the neighbors which is one of the bottleneck of the traditional meshfree methods. As a result, the run-times and memory allocations are independent of the number of neighbors and the shape function support size. As a model problem, the method is laid out for a Galerkin weak form of the Poisson problem with the RK approximation, and is verified in 1D, 2D, and 3D. Tables with run-times and allocated memory are presented to compare the performance of FC-RKPM with the traditional method in 3D. The performance is studied for various node numbers, support size, and approximation degree. All the implementation details and the roadmap for software development are also provided. Application of the new method to nonlinear and explicit problems are briefly discussed as well.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
A general and fast convolution-based method for peridynamics: applications to elasticity and brittle fracture
Authors:
Siavash Jafarzadeh,
Farzaneh Mousavi,
Adam Larios,
Florin Bobaru
Abstract:
We introduce a general and fast convolution-based method (FCBM) for peridynamics (PD). Expressing the PD integrals in terms of convolutions and computing them by fast Fourier transform (FFT), we reduce the computational complexity of PD models from O(N^2) to O(Nlog_2 N), with N being the total number of discretization nodes. Initial neighbor identification and storing neighbor information is not r…
▽ More
We introduce a general and fast convolution-based method (FCBM) for peridynamics (PD). Expressing the PD integrals in terms of convolutions and computing them by fast Fourier transform (FFT), we reduce the computational complexity of PD models from O(N^2) to O(Nlog_2 N), with N being the total number of discretization nodes. Initial neighbor identification and storing neighbor information is not required, and, as a consequence, memory allocation scales with O(N) instead of O(N^2), common for existing methods. The method is applicable to bounded domains with arbitrary shapes and boundary conditions via an embedded constraint (EC) approach. We explain the FCBM-EC formulation for certain bond-based and state-based, linear and nonlinear PD models of elasticity and dynamic brittle fracture, as applications. We solve a 3D elastostatic problem and show that the FCBM reduces the computational time from days to hours and from years to days, compared with the original meshfree discretization for PD models. Large-scale computations of PD models are feasible with the new method, and we demonstrate its versatility by simulating, with ease, the difficult problem of multiple crack branching in a brittle plate.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Efficient solutions for nonlocal diffusion problems via boundary-adapted spectral methods
Authors:
Siavash Jafarzadeh,
Adam Larios,
Florin Bobaru
Abstract:
We introduce an efficient boundary-adapted spectral method for peridynamic diffusion problems with arbitrary boundary conditions. The spectral approach transforms the convolution integral in the peridynamic formulation into a multiplication in the Fourier space, resulting in computations that scale as O(NlogN). The limitation of regular spectral methods to periodic problems is eliminated using the…
▽ More
We introduce an efficient boundary-adapted spectral method for peridynamic diffusion problems with arbitrary boundary conditions. The spectral approach transforms the convolution integral in the peridynamic formulation into a multiplication in the Fourier space, resulting in computations that scale as O(NlogN). The limitation of regular spectral methods to periodic problems is eliminated using the volume penalization method. We show that arbitrary boundary conditions or volume constraints can be enforced in this way to achieve high levels of accuracy. To test the performance of our approach we compare the computational results with analytical solutions of the nonlocal problem. The performance is tested with convergence studies in terms of nodal discretization and the size of the penalization parameter in problems with Dirichlet and Neumann boundary conditions.
△ Less
Submitted 9 May, 2019;
originally announced May 2019.
