-
Explainable and Class-Revealing Signal Feature Extraction via Scattering Transform and Constrained Zeroth-Order Optimization
Authors:
Naoki Saito,
David Weber
Abstract:
We propose a new method to extract discriminant and explainable features from a particular machine learning model, i.e., a combination of the scattering transform and the multiclass logistic regression. Although this model is well-known for its ability to learn various signal classes with high classification rate, it remains elusive to understand why it can generate such successful classification,…
▽ More
We propose a new method to extract discriminant and explainable features from a particular machine learning model, i.e., a combination of the scattering transform and the multiclass logistic regression. Although this model is well-known for its ability to learn various signal classes with high classification rate, it remains elusive to understand why it can generate such successful classification, mainly due to the nonlinearity of the scattering transform. In order to uncover the meaning of the scattering transform coefficients selected by the multiclass logistic regression (with the Lasso penalty), we adopt zeroth-order optimization algorithms to search an input pattern that maximizes the class probability of a class of interest given the learned model. In order to do so, it turns out that imposing sparsity and smoothness of input patterns is important. We demonstrate the effectiveness of our proposed method using a couple of synthetic time-series classification problems.
△ Less
Submitted 14 April, 2025; v1 submitted 8 February, 2025;
originally announced February 2025.
-
An Uncertainty-aware, Mesh-free Numerical Method for Kolmogorov PDEs
Authors:
Daisuke Inoue,
Yuji Ito,
Takahito Kashiwabara,
Norikazu Saito,
Hiroaki Yoshida
Abstract:
This study introduces an uncertainty-aware, mesh-free numerical method for solving Kolmogorov PDEs. In the proposed method, we use Gaussian process regression (GPR) to smoothly interpolate pointwise solutions that are obtained by Monte Carlo methods based on the Feynman-Kac formula. The proposed method has two main advantages: 1. uncertainty assessment, which is facilitated by the probabilistic na…
▽ More
This study introduces an uncertainty-aware, mesh-free numerical method for solving Kolmogorov PDEs. In the proposed method, we use Gaussian process regression (GPR) to smoothly interpolate pointwise solutions that are obtained by Monte Carlo methods based on the Feynman-Kac formula. The proposed method has two main advantages: 1. uncertainty assessment, which is facilitated by the probabilistic nature of GPR, and 2. mesh-free computation, which allows efficient handling of high-dimensional PDEs. The quality of the solution is improved by adjusting the kernel function and incorporating noise information from the Monte Carlo samples into the GPR noise model. The performance of the method is rigorously analyzed based on a theoretical lower bound on the posterior variance, which serves as a measure of the error between the numerical and true solutions. Extensive tests on three representative PDEs demonstrate the high accuracy and robustness of the method compared to existing methods.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
Multiscale Hodge Scattering Networks for Data Analysis
Authors:
Naoki Saito,
Stefan C. Schonsheck,
Eugene Shvarts
Abstract:
We propose new scattering networks for signals measured on simplicial complexes, which we call \emph{Multiscale Hodge Scattering Networks} (MHSNs). Our construction is based on multiscale basis dictionaries on simplicial complexes, i.e., the $κ$-GHWT and $κ$-HGLET, which we recently developed for simplices of dimension $κ\in \mathbb{N}$ in a given simplicial complex by generalizing the node-based…
▽ More
We propose new scattering networks for signals measured on simplicial complexes, which we call \emph{Multiscale Hodge Scattering Networks} (MHSNs). Our construction is based on multiscale basis dictionaries on simplicial complexes, i.e., the $κ$-GHWT and $κ$-HGLET, which we recently developed for simplices of dimension $κ\in \mathbb{N}$ in a given simplicial complex by generalizing the node-based Generalized Haar-Walsh Transform (GHWT) and Hierarchical Graph Laplacian Eigen Transform (HGLET). The $κ$-GHWT and the $κ$-HGLET both form redundant sets (i.e., dictionaries) of multiscale basis vectors and the corresponding expansion coefficients of a given signal. Our MHSNs use a layered structure analogous to a convolutional neural network (CNN) to cascade the moments of the modulus of the dictionary coefficients. The resulting features are invariant to reordering of the simplices (i.e., node permutation of the underlying graphs). Importantly, the use of multiscale basis dictionaries in our MHSNs admits a natural pooling operation that is akin to local pooling in CNNs, and which may be performed either locally or per-scale. These pooling operations are harder to define in both traditional scattering networks based on Morlet wavelets, and geometric scattering networks based on Diffusion Wavelets. As a result, we are able to extract a rich set of descriptive yet robust features that can be used along with very simple machine learning methods (i.e., logistic regression or support vector machines) to achieve high-accuracy classification systems with far fewer parameters to train than most modern graph neural networks. Finally, we demonstrate the usefulness of our MHSNs in three distinct types of problems: signal classification, domain (i.e., graph/simplex) classification, and molecular dynamics prediction.
△ Less
Submitted 27 November, 2024; v1 submitted 16 November, 2023;
originally announced November 2023.
-
Convergence Analysis of the Upwind Difference Methods for Hamilton-Jacobi-Bellman Equations
Authors:
Daisuke Inoue,
Yuji Ito,
Takahito Kashiwabara,
Norikazu Saito,
Hiroaki Yoshida
Abstract:
The convergence properties of the upwind difference scheme for the Hamilton-Jacobi-Bellman (HJB) equation, which is a fundamental equation for optimal control theory, are investigated. We first perform a convergence analysis for the solution of the scheme, which eliminates ambiguities in the proofs of existing studies. We then prove the convergence of the spatial difference of the solution in the…
▽ More
The convergence properties of the upwind difference scheme for the Hamilton-Jacobi-Bellman (HJB) equation, which is a fundamental equation for optimal control theory, are investigated. We first perform a convergence analysis for the solution of the scheme, which eliminates ambiguities in the proofs of existing studies. We then prove the convergence of the spatial difference of the solution in the scheme by the correspondence between the HJB equations and the conservation laws. This result leads to a property of the objective function called epi-convergence, by which the convergence property of the input function is shown. The latter two results have not been addressed in existing studies. Numerical calculations support the obtained results.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
Multiscale Transforms for Signals on Simplicial Complexes
Authors:
Naoki Saito,
Stefan C. Schonsheck,
Eugene Shvarts
Abstract:
Our previous multiscale graph basis dictionaries/graph signal transforms -- Generalized Haar-Walsh Transform (GHWT); Hierarchical Graph Laplacian Eigen Transform (HGLET); Natural Graph Wavelet Packets (NGWPs); and their relatives -- were developed for analyzing data recorded on nodes of a given graph. In this article, we propose their generalization for analyzing data recorded on edges, faces (i.e…
▽ More
Our previous multiscale graph basis dictionaries/graph signal transforms -- Generalized Haar-Walsh Transform (GHWT); Hierarchical Graph Laplacian Eigen Transform (HGLET); Natural Graph Wavelet Packets (NGWPs); and their relatives -- were developed for analyzing data recorded on nodes of a given graph. In this article, we propose their generalization for analyzing data recorded on edges, faces (i.e., triangles), or more generally $κ$-dimensional simplices of a simplicial complex (e.g., a triangle mesh of a manifold). The key idea is to use the Hodge Laplacians and their variants for hierarchical partitioning of a set of $κ$-dimensional simplices in a given simplicial complex, and then build localized basis functions on these partitioned subsets. We demonstrate their usefulness for data representation on both illustrative synthetic examples and real-world simplicial complexes generated from a co-authorship/citation dataset and an ocean current/flow dataset.
△ Less
Submitted 17 October, 2023; v1 submitted 28 December, 2022;
originally announced January 2023.
-
On a Nonlocal Integral Operator Commuting with the Laplacian and the Sturm-Liouville Problem I: Low Rank Perturbations of the Operator
Authors:
Lotfi Hermi,
Naoki Saito
Abstract:
We reformulate all general real coupled self-adjoint boundary value problems as integral operators and show that they are all finite rank perturbations of the free space Green's function on the real line. This free space Green's function corresponds to the nonlocal boundary value problem proposed earlier by Saito [N. Saito, Appl. Comput. Harmonic Anal., 25, 68--97 (2008)]. We prove these perturbat…
▽ More
We reformulate all general real coupled self-adjoint boundary value problems as integral operators and show that they are all finite rank perturbations of the free space Green's function on the real line. This free space Green's function corresponds to the nonlocal boundary value problem proposed earlier by Saito [N. Saito, Appl. Comput. Harmonic Anal., 25, 68--97 (2008)]. We prove these perturbations to be polynomials of rank up to 4. They encapsulate in a fundamental way the corresponding boundary conditions.
△ Less
Submitted 14 March, 2024; v1 submitted 14 November, 2022;
originally announced November 2022.
-
A fictitious-play finite-difference method for linearly solvable mean field games
Authors:
Daisuke Inoue,
Yuji Ito,
Takahito Kashiwabara,
Norikazu Saito,
Hiroaki Yoshida
Abstract:
An iterative finite difference scheme for mean field games (MFGs) is proposed. The target MFGs are derived from control problems for multidimensional systems with advection terms. For such MFGs, linearization using the Cole-Hopf transformation and iterative computation using fictitious play are introduced. This leads to an implementation-friendly algorithm that iteratively solves explicit schemes.…
▽ More
An iterative finite difference scheme for mean field games (MFGs) is proposed. The target MFGs are derived from control problems for multidimensional systems with advection terms. For such MFGs, linearization using the Cole-Hopf transformation and iterative computation using fictitious play are introduced. This leads to an implementation-friendly algorithm that iteratively solves explicit schemes. The convergence properties of the proposed scheme are mathematically proved by tracking the error of the variable through iterations. Numerical calculations show that the proposed method works stably for both one- and two-dimensional control problems.
△ Less
Submitted 25 April, 2023; v1 submitted 14 April, 2022;
originally announced April 2022.
-
Monogenic Wavelet Scattering Network for Texture Image Classification
Authors:
Wai Ho Chak,
Naoki Saito
Abstract:
The scattering transform network (STN), which has a similar structure as that of a popular convolutional neural network except its use of predefined convolution filters and a small number of layers, can generates a robust representation of an input signal relative to small deformations. We propose a novel Monogenic Wavelet Scattering Network (MWSN) for 2D texture image classification through a cas…
▽ More
The scattering transform network (STN), which has a similar structure as that of a popular convolutional neural network except its use of predefined convolution filters and a small number of layers, can generates a robust representation of an input signal relative to small deformations. We propose a novel Monogenic Wavelet Scattering Network (MWSN) for 2D texture image classification through a cascade of monogenic wavelet filtering with nonlinear modulus and averaging operators by replacing the 2D Morlet wavelet filtering in the standard STN. Our MWSN can extract useful hierarchical and directional features with interpretable coefficients, which can be further compressed by PCA and fed into a classifier. Using the CUReT texture image database, we demonstrate the superior performance of our MWSN over the standard STN. This performance improvement can be explained by the natural extension of 1D analyticity to 2D monogenicity.
△ Less
Submitted 24 February, 2022;
originally announced February 2022.
-
A finite element method to a periodic steady-state problem for an electromagnetic field system using the space-time finite element exterior calculus
Authors:
Masaru Miyashita,
Norikazu Saito
Abstract:
This paper proposes a finite element method for solving the periodic steady-state problem for the scalar-valued and vector-valued Poisson equations, a simple reduction model of the Maxwell equations under the Coulomb gauge. Introducing a new potential variable, we reformulate two systems composed of the scalar-valued and vector-valued Poisson problems to a single Hodge-Laplace problem for the 1-fo…
▽ More
This paper proposes a finite element method for solving the periodic steady-state problem for the scalar-valued and vector-valued Poisson equations, a simple reduction model of the Maxwell equations under the Coulomb gauge. Introducing a new potential variable, we reformulate two systems composed of the scalar-valued and vector-valued Poisson problems to a single Hodge-Laplace problem for the 1-form in $\mathbb{R}^4$ using the standard de Rham complex. Consequently, we can directly apply the Finite Element Exterior Calculus (FEEC) theory in $\mathbb{R}^4$ to deduce the well-posedness, stability, and convergence. Numerical examples using the cubical element are reported to validate the theoretical results.
△ Less
Submitted 12 January, 2022;
originally announced January 2022.
-
eGHWT: The Extended Generalized Haar-Walsh Transform
Authors:
Naoki Saito,
Yiqun Shao
Abstract:
Extending computational harmonic analysis tools from the classical setting of regular lattices to the more general setting of graphs and networks is very important and much research has been done recently. The Generalized Haar-Walsh Transform (GHWT) developed by Irion and Saito (2014) is a multiscale transform for signals on graphs, which is a generalization of the classical Haar and Walsh-Hadamar…
▽ More
Extending computational harmonic analysis tools from the classical setting of regular lattices to the more general setting of graphs and networks is very important and much research has been done recently. The Generalized Haar-Walsh Transform (GHWT) developed by Irion and Saito (2014) is a multiscale transform for signals on graphs, which is a generalization of the classical Haar and Walsh-Hadamard Transforms. We propose the extended Generalized Haar-Walsh Transform (eGHWT), which is a generalization of the adapted time-frequency tilings of Thiele and Villemoes (1996). The eGHWT examines not only the efficiency of graph-domain partitions but also that of "sequency-domain" partitions simultaneously. Consequently, the eGHWT and its associated best-basis selection algorithm for graph signals significantly improve the performance of the previous GHWT with the similar computational cost, $O(N \log N)$, where $N$ is the number of nodes of an input graph. While the GHWT best-basis algorithm seeks the most suitable orthonormal basis for a given task among more than $(1.5)^N$ possible orthonormal bases in $\mathbb{R}^N$, the eGHWT best-basis algorithm can find a better one by searching through more than $0.618\cdot(1.84)^N$ possible orthonormal bases in $\mathbb{R}^N$. This article describes the details of the eGHWT best-basis algorithm and demonstrates its superiority using several examples including genuine graph signals as well as conventional digital images viewed as graph signals. Furthermore, we also show how the eGHWT can be extended to 2D signals and matrix-form data by viewing them as a tensor product of graphs generated from their columns and rows and demonstrate its effectiveness on applications such as image approximation.
△ Less
Submitted 26 December, 2021; v1 submitted 11 July, 2021;
originally announced July 2021.
-
A mass-lumping finite element method for radially symmetric solution of a multidimensional semilinear heat equation with blow-up
Authors:
Toru Nakanishi,
Norikazu Saito
Abstract:
This study presents a new mass-lumping finite element method for computing the radially symmetric solution of a semilinear heat equation in an $N$ dimensional ball ($N\ge 2$). We provide two schemes, (ML-1) and (ML-2), and derive their error estimates through the discrete maximum principle. In the weighted $L^{2}$ norm, the convergence of (ML-1) was at the optimal order but that of (ML-2) was only…
▽ More
This study presents a new mass-lumping finite element method for computing the radially symmetric solution of a semilinear heat equation in an $N$ dimensional ball ($N\ge 2$). We provide two schemes, (ML-1) and (ML-2), and derive their error estimates through the discrete maximum principle. In the weighted $L^{2}$ norm, the convergence of (ML-1) was at the optimal order but that of (ML-2) was only at sub-optimal order. Nevertheless, scheme (ML-2) reproduces a blow-up of the solution of the original equation. In fact, in scheme (ML-2), we could accurately approximate the blow-up time. Our theoretical results were validated in numerical experiments.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Natural Graph Wavelet Packet Dictionaries
Authors:
Alexander Cloninger,
Haotian Li,
Naoki Saito
Abstract:
We introduce a set of novel multiscale basis transforms for signals on graphs that utilize their "dual" domains by incorporating the "natural" distances between graph Laplacian eigenvectors, rather than simply using the eigenvalue ordering. These basis dictionaries can be seen as generalizations of the classical Shannon wavelet packet dictionary to arbitrary graphs, and do not rely on the frequenc…
▽ More
We introduce a set of novel multiscale basis transforms for signals on graphs that utilize their "dual" domains by incorporating the "natural" distances between graph Laplacian eigenvectors, rather than simply using the eigenvalue ordering. These basis dictionaries can be seen as generalizations of the classical Shannon wavelet packet dictionary to arbitrary graphs, and do not rely on the frequency interpretation of Laplacian eigenvalues. We describe the algorithms (involving either vector rotations or orthogonalizations) to construct these basis dictionaries, use them to efficiently approximate graph signals through the best basis search, and demonstrate the strengths of these basis dictionaries for graph signals measured on sunflower graphs and street networks.
△ Less
Submitted 20 April, 2021; v1 submitted 18 September, 2020;
originally announced September 2020.
-
On the multicanonical systems of quasi-elliptic surfaces
Authors:
Toshiyuki Katsura,
Natsuo Saito
Abstract:
We consider the multicanonical systems $\vert mK_{S}\vert$ of quasi-elliptic surfaces with Kodaira dimension $1$ in characteristic 2. We show that for any $m \geq 6$ $\vert mK_{S}\vert$ gives the structure of quasi-elliptic fiber space, and 6 is the best possible number to give the structure for any such surfaces.
We consider the multicanonical systems $\vert mK_{S}\vert$ of quasi-elliptic surfaces with Kodaira dimension $1$ in characteristic 2. We show that for any $m \geq 6$ $\vert mK_{S}\vert$ gives the structure of quasi-elliptic fiber space, and 6 is the best possible number to give the structure for any such surfaces.
△ Less
Submitted 21 June, 2020;
originally announced June 2020.
-
Model Predictive Mean Field Games for Controlling Multi-Agent Systems
Authors:
Daisuke Inoue,
Yuji Ito,
Takahito Kashiwabara,
Norikazu Saito,
Hiroaki Yoshida
Abstract:
When controlling multi-agent systems, the trade-off between performance and scalability is a major challenge. Here, we address this difficulty by using mean field games (MFGs), which is a framework that deduces the macroscopic dynamics describing the density profile of agents from their microscopic dynamics. To effectively use the MFG, we propose a model predictive MFG (MP-MFG), which estimates th…
▽ More
When controlling multi-agent systems, the trade-off between performance and scalability is a major challenge. Here, we address this difficulty by using mean field games (MFGs), which is a framework that deduces the macroscopic dynamics describing the density profile of agents from their microscopic dynamics. To effectively use the MFG, we propose a model predictive MFG (MP-MFG), which estimates the agent population density profile with using kernel density estimation and manages the input generation with model predictive control. The proposed MP-MFG generates control inputs by monitoring the agent population at each time step, and thus achieves higher robustness than the conventional MFG. Numerical results show that the MP-MFG outperforms the MFG when the agent model has modeling errors or the number of agents in the system is small.
△ Less
Submitted 5 August, 2021; v1 submitted 16 April, 2020;
originally announced April 2020.
-
Nitsche's method for a Robin boundary value problem in a smooth domain
Authors:
Yuki Chiba,
Norikazu Saito
Abstract:
We prove several optimal-order error estimates for a finite-element method applied to an inhomogeneous Robin boundary value problem (BVP) for the Poisson equation defined in a smooth bounded domain in $\mathbb{R}^n$, $n=2,3$. The boundary condition is weakly imposed using Nitsche's method. The Robin BVP is interpreted as the classical penalty method with the penalty parameter $\varepsilon$. The op…
▽ More
We prove several optimal-order error estimates for a finite-element method applied to an inhomogeneous Robin boundary value problem (BVP) for the Poisson equation defined in a smooth bounded domain in $\mathbb{R}^n$, $n=2,3$. The boundary condition is weakly imposed using Nitsche's method. The Robin BVP is interpreted as the classical penalty method with the penalty parameter $\varepsilon$. The optimal choice of the mesh size $h$ relative to $\varepsilon$ is a non-trivial issue. This paper carefully examines the dependence of $\varepsilon$ on error estimates. Our error estimates require no unessential regularity assumptions on the solution. Numerical examples are also reported to confirm our results.
△ Less
Submitted 17 May, 2022; v1 submitted 5 May, 2019;
originally announced May 2019.
-
Finite element method for radially symmetric solution of a multidimensional semilinear heat equation
Authors:
Toru Nakanishi,
Norikazu Saito
Abstract:
This study aims to present the error and numerical blow up analyses of a finite element method for computing the radially symmetric solutions of semilinear heat equations. In particular, this study establishes optimal order error estimates in $L^\infty$ and weighted $L^2$ norms for the symmetric and nonsymmetric formulation, respectively. Some numerical examples are presented to validate the obtai…
▽ More
This study aims to present the error and numerical blow up analyses of a finite element method for computing the radially symmetric solutions of semilinear heat equations. In particular, this study establishes optimal order error estimates in $L^\infty$ and weighted $L^2$ norms for the symmetric and nonsymmetric formulation, respectively. Some numerical examples are presented to validate the obtained theoretical results.
△ Less
Submitted 27 August, 2019; v1 submitted 21 February, 2019;
originally announced February 2019.
-
Weak discrete maximum principle and $L^\infty$ analysis of the DG method for the Poisson equation on a polygonal domain
Authors:
Yuki Chiba,
Norikazu Saito
Abstract:
We derive several $L^\infty$ error estimates for the symmetric interior penalty (SIP) discontinuous Galerkin (DG) method applied to the Poisson equation in a two-dimensional polygonal domain. Both local and global estimates are examined. The weak maximum principle (WMP) for the discrete harmonic function is also established. We prove our $L^\infty$ estimates using this WMP and several $W^{2,p}$ an…
▽ More
We derive several $L^\infty$ error estimates for the symmetric interior penalty (SIP) discontinuous Galerkin (DG) method applied to the Poisson equation in a two-dimensional polygonal domain. Both local and global estimates are examined. The weak maximum principle (WMP) for the discrete harmonic function is also established. We prove our $L^\infty$ estimates using this WMP and several $W^{2,p}$ and $W^{1,1}$ estimates for the Poisson equation. Numerical examples to validate our results are also presented.
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
The inf-sup condition and error estimates of the Nitsche method for evolutionary diffusion-advection-reaction equations
Authors:
Yuki Ueda,
Norikazu Saito
Abstract:
The Nitsche method is a method of "weak imposition" of the inhomogeneous Dirichlet boundary conditions for partial differential equations. This paper explains stability and convergence study of the Nitsche method applied to evolutionary diffusion-advection-reaction equations. We mainly discuss a general space semidiscrete scheme including not only the standard finite element method but also Isogeo…
▽ More
The Nitsche method is a method of "weak imposition" of the inhomogeneous Dirichlet boundary conditions for partial differential equations. This paper explains stability and convergence study of the Nitsche method applied to evolutionary diffusion-advection-reaction equations. We mainly discuss a general space semidiscrete scheme including not only the standard finite element method but also Isogeometric Analysis. Our method of analysis is a variational one that is a popular method for studying elliptic problems. The variational method enables us to obtain the best approximation property directly. Actually, results show that the scheme satisfies the inf-sup condition and Galerkin orthogonality. Consequently, the optimal order error estimates in some appropriate norms are proven under some regularity assumptions on the exact solution. We also consider a fully discretized scheme using the backward Euler method. Numerical example demonstrate the validity of those theoretical results.
△ Less
Submitted 24 March, 2018;
originally announced March 2018.
-
How can we naturally order and organize graph Laplacian eigenvectors?
Authors:
Naoki Saito
Abstract:
When attempting to develop wavelet transforms for graphs and networks, some researchers have used graph Laplacian eigenvalues and eigenvectors in place of the frequencies and complex exponentials in the Fourier theory for regular lattices in the Euclidean domains. This viewpoint, however, has a fundamental flaw: on a general graph, the Laplacian eigenvalues cannot be interpreted as the frequencies…
▽ More
When attempting to develop wavelet transforms for graphs and networks, some researchers have used graph Laplacian eigenvalues and eigenvectors in place of the frequencies and complex exponentials in the Fourier theory for regular lattices in the Euclidean domains. This viewpoint, however, has a fundamental flaw: on a general graph, the Laplacian eigenvalues cannot be interpreted as the frequencies of the corresponding eigenvectors. In this paper, we discuss this important problem further and propose a new method to organize those eigenvectors by defining and measuring "natural" distances between eigenvectors using the Ramified Optimal Transport Theory followed by embedding them into a low-dimensional Euclidean domain. We demonstrate its effectiveness using a synthetic graph as well as a dendritic tree of a retinal ganglion cell of a mouse.
△ Less
Submitted 19 April, 2018; v1 submitted 21 January, 2018;
originally announced January 2018.
-
Notes on the Banach-Necas-Babuska theorem and Kato's minimum modulus of operators
Authors:
Norikazu Saito
Abstract:
This note was prepared for a lecture given at Kyoto University (RIMS Workshop: "The State of the Art in Numerical Analysis: Theory, Methods, and Applications", November 8-10, 2017). That lecture described the variational analysis of the discontinuous Galerkin time-stepping method for parabolic equations based on an earlier paper by the author (arXiv:1710.10543). I also presented the Banach-Necas-B…
▽ More
This note was prepared for a lecture given at Kyoto University (RIMS Workshop: "The State of the Art in Numerical Analysis: Theory, Methods, and Applications", November 8-10, 2017). That lecture described the variational analysis of the discontinuous Galerkin time-stepping method for parabolic equations based on an earlier paper by the author (arXiv:1710.10543). I also presented the Banach-Necas-Babuska (BNB) Theorem or the Babuska-Lax-Milgram (BLM) Theorem as the key theorem of our analysis. For proof of the BNB theorem, it is useful to introduce the minimum modulus of operators by T. Kato. This note presents a review of the proofs of Closed Range Theorem and BNB Theorem following the idea of Kato. Moreover, I present an application to BNB theorem to parabolic equations. The well-posedness is proved by BNB theorem. This note is not an original research paper. It includes no new results. This is a revised manuscript and several incorrect descriptions in the original version are fixed.
△ Less
Submitted 13 July, 2018; v1 submitted 5 November, 2017;
originally announced November 2017.
-
Variational analysis of the discontinuous Galerkin time-stepping method for parabolic equations
Authors:
Norikazu Saito
Abstract:
The discontinuous Galerkin (DG) time-stepping method applied to abstract evolution equation of parabolic type is studied using a variational approach. We establish the inf-sup condition or Babuška--Brezzi condition for the DG bilinear form. Then, a nearly best approximation property and a nearly symmetric error estimate are obtained as corollaries. Moreover, the optimal order error estimates under…
▽ More
The discontinuous Galerkin (DG) time-stepping method applied to abstract evolution equation of parabolic type is studied using a variational approach. We establish the inf-sup condition or Babuška--Brezzi condition for the DG bilinear form. Then, a nearly best approximation property and a nearly symmetric error estimate are obtained as corollaries. Moreover, the optimal order error estimates under appropriate regularity assumption on the solution are derived as direct applications of the standard interpolation error estimates. Our method of analysis is new for the DG time-stepping method; it differs from previous works by which the method is formulated as the one-step method. We apply our abstract results to the finite element approximation of a second order parabolic equation with space-time variable coefficient functions in a polyhedral domain, and derive the optimal order error estimates in several norms.
△ Less
Submitted 23 January, 2020; v1 submitted 28 October, 2017;
originally announced October 2017.
-
Adaptive synchrosqueezing based on a quilted short-time Fourier transform
Authors:
Alexander Berrian,
Naoki Saito
Abstract:
In recent years, the synchrosqueezing transform (SST) has gained popularity as a method for the analysis of signals that can be broken down into multiple components determined by instantaneous amplitudes and phases. One such version of SST, based on the short-time Fourier transform (STFT), enables the sharpening of instantaneous frequency (IF) information derived from the STFT, as well as the sepa…
▽ More
In recent years, the synchrosqueezing transform (SST) has gained popularity as a method for the analysis of signals that can be broken down into multiple components determined by instantaneous amplitudes and phases. One such version of SST, based on the short-time Fourier transform (STFT), enables the sharpening of instantaneous frequency (IF) information derived from the STFT, as well as the separation of amplitude-phase components corresponding to distinct IF curves. However, this SST is limited by the time-frequency resolution of the underlying window function, and may not resolve signals exhibiting diverse time-frequency behaviors with sufficient accuracy. In this work, we develop a framework for an SST based on a "quilted" short-time Fourier transform (SST-QSTFT), which allows adaptation to signal behavior in separate time-frequency regions through the use of multiple windows. This motivates us to introduce a discrete reassignment frequency formula based on a finite difference of the phase spectrum, ensuring computational accuracy for a wider variety of windows. We develop a theoretical framework for the SST-QSTFT in both the continuous and the discrete settings, and describe an algorithm for the automatic selection of optimal windows depending on the region of interest. Using synthetic data, we demonstrate the superior numerical performance of SST-QSTFT relative to other SST methods in a noisy context. Finally, we apply SST-QSTFT to audio recordings of animal calls to demonstrate the potential of our method for the analysis of real bioacoustic signals.
△ Less
Submitted 18 September, 2017; v1 submitted 11 July, 2017;
originally announced July 2017.
-
Hybridized discontinuous Galerkin method for elliptic interface problems
Authors:
Masasru Miyashita,
Norikazu Saito
Abstract:
New hybridized discontinuous Galerkin (HDG) methods for the interface problem for elliptic equations are proposed. Unknown functions of our schemes are $u_h$ in elements and $\hat{u}_h$ on inter-element edges. That is, we formulate our schemes without introducing the flux variable. Our schemes naturally satisfy the Galerkin orthogonality. The solution $u$ of the interface problem under considerati…
▽ More
New hybridized discontinuous Galerkin (HDG) methods for the interface problem for elliptic equations are proposed. Unknown functions of our schemes are $u_h$ in elements and $\hat{u}_h$ on inter-element edges. That is, we formulate our schemes without introducing the flux variable. Our schemes naturally satisfy the Galerkin orthogonality. The solution $u$ of the interface problem under consideration may not have a sufficient regularity, say $u|_{Ω_1}\in H^2(Ω_1)$ and $u|_{Ω_2}\in H^2(Ω_2)$, where $Ω_1$ and $Ω_2$ are subdomains of the whole domain $Ω$ and $Γ=\partialΩ_1\cap\partialΩ_2$ implies the interface. We study the convergence, assuming $u|_{Ω_1}\in H^{1+s}(Ω_1)$ and $u|_{Ω_2}\in H^{1+s}(Ω_2)$ for some $s\in (1/2,1]$, where $H^{1+s}$ denotes the fractional order Sobolev space. Consequently, we succeed in deriving optimal order error estimates in an HDG norm and the $L^2$ norm. Numerical examples to validate our results are also presented.
△ Less
Submitted 4 January, 2017;
originally announced January 2017.
-
Convergence of the immersed-boundary finite-element method for the Stokes problem
Authors:
Norikazu Saito,
Yoshiki Sugitani
Abstract:
Convergence results for the immersed boundary method applied to a model Stokes problem with the homogeneous Dirichlet boundary condition are presented. As a discretization method, we deal with the finite element method. First, the immersed force field is approximated using a regularized delta function and its error in the $W^{-1,p}$ norm is examined for $1\le p<n/(n-1)$, $n$ being the space dimens…
▽ More
Convergence results for the immersed boundary method applied to a model Stokes problem with the homogeneous Dirichlet boundary condition are presented. As a discretization method, we deal with the finite element method. First, the immersed force field is approximated using a regularized delta function and its error in the $W^{-1,p}$ norm is examined for $1\le p<n/(n-1)$, $n$ being the space dimension. Then, we consider the immersed boundary discretization of the Stokes problem and study the regularization and discretization errors separately. Consequently, error estimate of order $h^{1-α}$ in the $W^{1,1}\times L^1$ norm for the velocity and pressure is derived, where $α$ is an arbitrarily small positive number. Error estimate of order $h^{1-α}$ in the $L^r$ norm for the velocity is also derived with $r=n/(n-1-α)$. The validity of those theoretical results are confirmed by numerical examples.
△ Less
Submitted 22 November, 2016;
originally announced November 2016.
-
Discrete maximal regularity and the finite element method for parabolic equations
Authors:
Tomoya Kemmochi,
Norikazu Saito
Abstract:
Maximal regularity is a fundamental concept in the theory of partial differential equations. In this paper, we establish a fully discrete version of maximal regularity for a parabolic equation. We derive various stability results in $L^p(0,T;L^q(Ω))$ norm, $p,q\in (1,\infty)$ for the finite element approximation with the mass-lumping to the linear heat equation. Our method of analysis is an operat…
▽ More
Maximal regularity is a fundamental concept in the theory of partial differential equations. In this paper, we establish a fully discrete version of maximal regularity for a parabolic equation. We derive various stability results in $L^p(0,T;L^q(Ω))$ norm, $p,q\in (1,\infty)$ for the finite element approximation with the mass-lumping to the linear heat equation. Our method of analysis is an operator theoretical one using pure imaginary powers of operators and might be a discrete version of G.~Dore and A.~Venni (On the closedness of the sum of two closed operators. \emph{Math.\ Z.}, 196(2):189--201, 1987). As an application, optimal order error estimates in that norm are proved. Furthermore, we study the finite element approximation for semilinear heat equations with locally Lipschitz continuous nonlinearity and offer a new method for deriving optimal order error estimates. Some interesting auxiliary results including discrete Gagliardo-Nirenberg and Sobolev inequalities are also presented.
△ Less
Submitted 22 February, 2016;
originally announced February 2016.
-
Mysteries around the graph Laplacian eigenvalue 4
Authors:
Yuji Nakatsukasa,
Naoki Saito,
Ernest Woei
Abstract:
We describe our current understanding on the phase transition phenomenon of the graph Laplacian eigenvectors constructed on a certain type of unweighted trees, which we previously observed through our numerical experiments. The eigenvalue distribution for such a tree is a smooth bell-shaped curve starting from the eigenvalue 0 up to 4. Then, at the eigenvalue 4, there is a sudden jump. Interesting…
▽ More
We describe our current understanding on the phase transition phenomenon of the graph Laplacian eigenvectors constructed on a certain type of unweighted trees, which we previously observed through our numerical experiments. The eigenvalue distribution for such a tree is a smooth bell-shaped curve starting from the eigenvalue 0 up to 4. Then, at the eigenvalue 4, there is a sudden jump. Interestingly, the eigenvectors corresponding to the eigenvalues below 4 are semi-global oscillations (like Fourier modes) over the entire tree or one of the branches; on the other hand, those corresponding to the eigenvalues above 4 are much more localized and concentrated (like wavelets) around junctions/branching vertices. For a special class of trees called starlike trees, we obtain a complete understanding of such phase transition phenomenon. For a general graph, we prove the number of the eigenvalues larger than 4 is bounded from above by the number of vertices whose degrees is strictly higher than 2. Moreover, we also prove that if a graph contains a branching path, then the magnitudes of the components of any eigenvector corresponding to the eigenvalue greater than 4 decay exponentially from the branching vertex toward the leaf of that branch.
△ Less
Submitted 21 August, 2012; v1 submitted 19 December, 2011;
originally announced December 2011.
-
On Rayleigh-Type Formulas for a Non-local Boundary Value Problem Associated with an Integral Operator Commuting with the Laplacian
Authors:
Lotfi Hermi,
Naoki Saito
Abstract:
In this article we prove the existence, uniqueness, and simplicity of a negative eigenvalue for a class of integral operators whose kernel is of the form $|x-y|^ρ$, $0 < ρ\leq 1$, $x, y \in [-a, a]$. We also provide two different ways of producing recursive formulas for the Rayleigh functions (i.e., recursion formulas for power sums) of the eigenvalues of this integral operator when $ρ=1$, providi…
▽ More
In this article we prove the existence, uniqueness, and simplicity of a negative eigenvalue for a class of integral operators whose kernel is of the form $|x-y|^ρ$, $0 < ρ\leq 1$, $x, y \in [-a, a]$. We also provide two different ways of producing recursive formulas for the Rayleigh functions (i.e., recursion formulas for power sums) of the eigenvalues of this integral operator when $ρ=1$, providing means of approximating this negative eigenvalue. These methods offer recursive procedures for dealing with the eigenvalues of a one-dimensional Laplacian with non-local boundary conditions which commutes with an integral operator having a harmonic kernel. The problem emerged in recent work by one of the authors [45]. We also discuss extensions in higher dimensions and links with distance matrices.
△ Less
Submitted 26 September, 2013; v1 submitted 21 September, 2010;
originally announced September 2010.
-
The Generalized Spike Process, Sparsity, and Statistical Independence
Authors:
Naoki Saito
Abstract:
A basis under which a given set of realizations of a stochastic process can be represented most sparsely (the so-called best sparsifying basis (BSB)) and the one under which such a set becomes as less statistically dependent as possible (the so-called least statistically-dependent basis (LSDB)) are important for data compression and have generated interests among computational neuroscientists as…
▽ More
A basis under which a given set of realizations of a stochastic process can be represented most sparsely (the so-called best sparsifying basis (BSB)) and the one under which such a set becomes as less statistically dependent as possible (the so-called least statistically-dependent basis (LSDB)) are important for data compression and have generated interests among computational neuroscientists as well as applied mathematicians. Here we consider these bases for a particularly simple stochastic process called ``generalized spike process'', which puts a single spike--whose amplitude is sampled from the standard normal distribution--at a random location in the zero vector of length $\ndim$ for each realization.
Unlike the ``simple spike process'' which we dealt with in our previous paper and whose amplitude is constant, we need to consider the kurtosis-maximizing basis (KMB) instead of the LSDB due to the difficulty of evaluating differential entropy and mutual information of the generalized spike process. By computing the marginal densities and moments, we prove that: 1) the BSB and the KMB selects the standard basis if we restrict our basis search within all possible orthonormal bases in ${\mathbb R}^n$; 2) if we extend our basis search to all possible volume-preserving invertible linear transformations, then the BSB exists and is again the standard basis whereas the KMB does not exist. Thus, the KMB is rather sensitive to the orthonormality of the transformations under consideration whereas the BSB is insensitive to that. Our results once again support the preference of the BSB over the LSDB/KMB for data compression applications as our previous work did.
△ Less
Submitted 9 October, 2001;
originally announced October 2001.
-
Sparsity vs. Statistical Independence in Adaptive Signal Representations: A Case Study of the Spike Process
Authors:
Bertrand Benichou,
Naoki Saito
Abstract:
Finding a basis/coordinate system that can efficiently represent an input data stream by viewing them as realizations of a stochastic process is of tremendous importance in many fields including data compression and computational neuroscience. Two popular measures of such efficiency of a basis are sparsity (measured by the expected $\ell^p$ norm, $0 < p \leq 1$) and statistical independence (mea…
▽ More
Finding a basis/coordinate system that can efficiently represent an input data stream by viewing them as realizations of a stochastic process is of tremendous importance in many fields including data compression and computational neuroscience. Two popular measures of such efficiency of a basis are sparsity (measured by the expected $\ell^p$ norm, $0 < p \leq 1$) and statistical independence (measured by the mutual information). Gaining deeper understanding of their intricate relationship, however, remains elusive. Therefore, we chose to study a simple synthetic stochastic process called the spike process, which puts a unit impulse at a random location in an $n$-dimensional vector for each realization. For this process, we obtained the following results: 1) The standard basis is the best both in terms of sparsity and statistical independence if $n \geq 5$ and the search of basis is restricted within all possible orthonormal bases in $R^n$; 2) If we extend our basis search in all possible invertible linear transformations in $R^n$, then the best basis in statistical independence differs from the one in sparsity; 3) In either of the above, the best basis in statistical independence is not unique, and there even exist those which make the inputs completely dense; 4) There is no linear invertible transformation that achieves the true statistical independence for $n > 2$.
△ Less
Submitted 6 April, 2001;
originally announced April 2001.
