-
Analysis of nonquadratic energy-conservative schemes for KdV type-equations
Authors:
Shuto Kawai,
Shun Sato,
Takayasu Matsuo
Abstract:
Numerical schemes that conserve invariants have demonstrated superior performance in various contexts, and several unified methods have been developed for constructing such schemes. However, the mathematical properties of these schemes remain poorly understood, except in norm-preserving cases.
This study introduces a novel analytical framework applicable to general energy-preserving schemes. The…
▽ More
Numerical schemes that conserve invariants have demonstrated superior performance in various contexts, and several unified methods have been developed for constructing such schemes. However, the mathematical properties of these schemes remain poorly understood, except in norm-preserving cases.
This study introduces a novel analytical framework applicable to general energy-preserving schemes. The proposed framework is applied to Korteweg-de Vries (KdV)-type equations, establishing global existence and convergence estimates for the numerical solutions.
△ Less
Submitted 19 December, 2024;
originally announced December 2024.
-
A novel interpretation of Nesterov's acceleration via variable step-size linear multistep methods
Authors:
Ryota Nozawa,
Shun Sato,
Takayasu Matsuo
Abstract:
Nesterov's acceleration in continuous optimization can be understood in a novel way when Nesterov's accelerated gradient (NAG) method is considered as a linear multistep (LM) method for gradient flow. Although the NAG method for strongly convex functions (NAG-sc) has been fully discussed, the NAG method for $L$-smooth convex functions (NAG-c) has not. To fill this gap, we show that the existing NA…
▽ More
Nesterov's acceleration in continuous optimization can be understood in a novel way when Nesterov's accelerated gradient (NAG) method is considered as a linear multistep (LM) method for gradient flow. Although the NAG method for strongly convex functions (NAG-sc) has been fully discussed, the NAG method for $L$-smooth convex functions (NAG-c) has not. To fill this gap, we show that the existing NAG-c method can be interpreted as a variable step size LM (VLM) for the gradient flow. Surprisingly, the VLM allows linearly increasing step sizes, which explains the acceleration in the convex case. Here, we introduce a novel technique for analyzing the absolute stability of VLMs. Subsequently, we prove that NAG-c is optimal in a certain natural class of VLMs. Finally, we construct a new broader class of VLMs by optimizing the parameters in the VLM for ill-conditioned problems. According to numerical experiments, the proposed method outperforms the NAG-c method in ill-conditioned cases. These results imply that the numerical analysis perspective of the NAG is a promising working environment, and considering a broader class of VLMs could further reveal novel methods.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Mathematical analysis and numerical comparison of energy-conservative schemes for the Zakharov equations
Authors:
Shuto Kawai,
Shun Sato,
Takayasu Matsuo
Abstract:
Furihata and Matsuo proposed in 2010 an energy-conserving scheme for the Zakharov equations, as an application of the discrete variational derivative method (DVDM).
This scheme is distinguished from conventional methods (in particular the one devised by Glassey in 1992) in that the invariants are consistent with respect to time, but it has not been sufficiently studied both theoretically and num…
▽ More
Furihata and Matsuo proposed in 2010 an energy-conserving scheme for the Zakharov equations, as an application of the discrete variational derivative method (DVDM).
This scheme is distinguished from conventional methods (in particular the one devised by Glassey in 1992) in that the invariants are consistent with respect to time, but it has not been sufficiently studied both theoretically and numerically.
In this study, we theoretically prove the solvability under the loosest possible assumptions.
We also prove the convergence of this DVDM scheme by improving the argument by Glassey.
Furthermore, we perform intensive numerical experiments for comparing the above two schemes.
It is found that the DVDM scheme is superior in terms of accuracy, but since it is fully-implicit, the linearly-implicit Glassey scheme is better for practical efficiency.
In addition, we proposed a way to choose a solution for the first step that would allow Glassey's scheme to work more efficiently.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
A new unified framework for designing convex optimization methods with prescribed theoretical convergence estimates: A numerical analysis approach
Authors:
Kansei Ushiyama,
Shun Sato,
Takayasu Matsuo
Abstract:
We propose a new unified framework for describing and designing gradient-based convex optimization methods from a numerical analysis perspective. There the key is the new concept of weak discrete gradients (weak DGs), which is a generalization of DGs standard in numerical analysis. Via weak DG, we consider abstract optimization methods, and prove unified convergence rate estimates that hold indepe…
▽ More
We propose a new unified framework for describing and designing gradient-based convex optimization methods from a numerical analysis perspective. There the key is the new concept of weak discrete gradients (weak DGs), which is a generalization of DGs standard in numerical analysis. Via weak DG, we consider abstract optimization methods, and prove unified convergence rate estimates that hold independent of the choice of weak DGs except for some constants in the final estimate. With some choices of weak DGs, we can reproduce many popular existing methods, such as the steepest descent and Nesterov's accelerated gradient method, and also some recent variants from numerical analysis community. By considering new weak DGs, we can easily explore new theoretically-guaranteed optimization methods; we show some examples. We believe this work is the first attempt to fully integrate research branches in optimization and numerical analysis areas, so far independently developed.
△ Less
Submitted 14 February, 2023;
originally announced February 2023.
-
Double-Exponential transformation: A quick review of a Japanese tradition
Authors:
Kazuo Murota,
Takayasu Matsuo
Abstract:
This paper is a short introduction to numerical methods using the double exponential (DE) transformation, such as tanh-sinh quadrature and DE-Sinc approximation. The DE-based methods for numerical computation have been developed intensively in Japan and the objective of this paper is to describe their history in addition to the underlying mathematical ideas.
This paper is a short introduction to numerical methods using the double exponential (DE) transformation, such as tanh-sinh quadrature and DE-Sinc approximation. The DE-based methods for numerical computation have been developed intensively in Japan and the objective of this paper is to describe their history in addition to the underlying mathematical ideas.
△ Less
Submitted 21 May, 2025; v1 submitted 5 January, 2023;
originally announced January 2023.
-
Essential convergence rate of ordinary differential equations appearing in optimization
Authors:
Kansei Ushiyama,
Shun Sato,
Takayasu Matsuo
Abstract:
Some continuous optimization methods can be connected to ordinary differential equations (ODEs) by taking continuous limits, and their convergence rates can be explained by the ODEs. However, since such ODEs can achieve any convergence rate by time scaling, the correspondence is not as straightforward as usually expected, and deriving new methods through ODEs is not quite direct. In this letter, w…
▽ More
Some continuous optimization methods can be connected to ordinary differential equations (ODEs) by taking continuous limits, and their convergence rates can be explained by the ODEs. However, since such ODEs can achieve any convergence rate by time scaling, the correspondence is not as straightforward as usually expected, and deriving new methods through ODEs is not quite direct. In this letter, we pay attention to stability restriction in discretizing ODEs and show that acceleration by time scaling basically implies deceleration in discretization; they balance out so that we can define an attainable unique convergence rate which we call an "essential convergence rate".
△ Less
Submitted 14 July, 2022; v1 submitted 6 June, 2022;
originally announced June 2022.
-
Continuum covariance propagation for understanding variance loss in advective systems
Authors:
Shay Gilpin,
Tomoko Matsuo,
Stephen E. Cohn
Abstract:
Motivated by the spurious variance loss encountered during covariance propagation in atmospheric and other large-scale data assimilation systems, we consider the problem for state dynamics governed by the continuity and related hyperbolic partial differential equations. This loss of variance is often attributed to reduced-rank representations of the covariance matrix, as in ensemble methods for ex…
▽ More
Motivated by the spurious variance loss encountered during covariance propagation in atmospheric and other large-scale data assimilation systems, we consider the problem for state dynamics governed by the continuity and related hyperbolic partial differential equations. This loss of variance is often attributed to reduced-rank representations of the covariance matrix, as in ensemble methods for example, or else to the use of dissipative numerical methods. Through a combination of analytical work and numerical experiments, we demonstrate that significant variance loss, as well as gain, typically occurs during covariance propagation, even at full rank. The cause of this unusual behavior is a discontinuous change in the continuum covariance dynamics as correlation lengths become small, for instance in the vicinity of sharp gradients in the velocity field. This discontinuity in the covariance dynamics arises from hyperbolicity: the diagonal of the kernel of the covariance operator is a characteristic surface for advective dynamics. Our numerical experiments demonstrate that standard numerical methods for evolving the state are not adequate for propagating the covariance, because they do not capture the discontinuity in the continuum covariance dynamics as correlations lengths tend to zero. Our analytical and numerical results demonstrate in the context of mass conservation that this leads to significant, spurious variance loss in regions of mass convergence and gain in regions of mass divergence. The results suggest that developing local covariance propagation methods designed specifically to capture covariance evolution near the diagonal may prove a useful alternative to current methods of covariance propagation.
△ Less
Submitted 6 September, 2021;
originally announced September 2021.
-
On Spatial Discretization of Evolutionary Differential Equations on the Periodic Domain with a Mixed Derivative
Authors:
Shun Sato,
Takayasu Matsuo
Abstract:
Recently, various evolutionary partial differential equations (PDEs) with a mixed derivative have been emerged and drawn much attention. Nonetheless, their PDE-theoretical and numerical studies are still in their early stage. In this paper, we aim at the unified framework of numerical methods for such PDEs. However, due to the presence of the mixed derivative, we cannot discuss numerical methods w…
▽ More
Recently, various evolutionary partial differential equations (PDEs) with a mixed derivative have been emerged and drawn much attention. Nonetheless, their PDE-theoretical and numerical studies are still in their early stage. In this paper, we aim at the unified framework of numerical methods for such PDEs. However, due to the presence of the mixed derivative, we cannot discuss numerical methods without some appropriate reformulation, which is mathematically challenging itself. Therefore, we first propose a novel procedure for the reformulation of target PDEs into a standard form of evolutionary equations. This contribution may become an important basis not only of numerical analysis, but also of PDE-theory. In order to illustrate this point, we establish the global well-posedness of the sine-Gordon equation. After that, we classify and discuss the spatial discretizations based on the proposed reformulation technique. As a result, we show the average-difference method is suitable for the discretization of the mixed derivative.
△ Less
Submitted 11 December, 2017; v1 submitted 12 April, 2017;
originally announced April 2017.
-
Geometric numerical integrators for Hunter-Saxton-like equations
Authors:
Yuto Miyatake,
David Cohen,
Daisuke Furihata,
Takayasu Matsuo
Abstract:
We present novel geometric numerical integrators for Hunter--Saxton-like equations by means of new multi-symplectic formulations and known Hamiltonian structures of the problems. We consider the Hunter--Saxton equation, the modified Hunter--Saxton equation, and the two-component Hunter--Saxton equation. Multi-symplectic discretisations based on these new formulations of the problems are exemplifie…
▽ More
We present novel geometric numerical integrators for Hunter--Saxton-like equations by means of new multi-symplectic formulations and known Hamiltonian structures of the problems. We consider the Hunter--Saxton equation, the modified Hunter--Saxton equation, and the two-component Hunter--Saxton equation. Multi-symplectic discretisations based on these new formulations of the problems are exemplified by means of the explicit Euler box scheme, and Hamiltonian-preserving discretisations are exemplified by means of the discrete variational derivative method. We explain and justify the correct treatment of boundary conditions in a unified manner. This is necessary for a proper numerical implementation of these equations and was never explicitly clarified in the literature before, to the best of our knowledge. Finally, numerical experiments demonstrate the favourable behaviour of the proposed numerical integrators.
△ Less
Submitted 22 April, 2017; v1 submitted 16 August, 2016;
originally announced August 2016.
-
A self-adaptive moving mesh method for the short pulse equation via its hodograph link to the sine-Gordon equation
Authors:
S. Sato,
K. Oguma,
T. Matsuo,
B. -F. Feng
Abstract:
The short pulse equation was introduced by Schaefer--Wayne (2004) for modeling the propagation of ultrashort optical pulses. While it can describe a wide range of solutions, its ultrashort pulse solutions with a few cycles, which the conventional nonlinear Schroedinger equation does not possess, have drawn much attention. In such a region, existing numerical methods turn out to require very fine n…
▽ More
The short pulse equation was introduced by Schaefer--Wayne (2004) for modeling the propagation of ultrashort optical pulses. While it can describe a wide range of solutions, its ultrashort pulse solutions with a few cycles, which the conventional nonlinear Schroedinger equation does not possess, have drawn much attention. In such a region, existing numerical methods turn out to require very fine numerical mesh, and accordingly are computationally expensive. In this paper, we establish a new efficient numerical method by combining the idea of the hodograph transformation and the structure-preserving numerical methods. The resulting scheme is a self-adaptive moving mesh scheme that can successfully capture not only the ultrashort pulses but also exotic solutions such as loop soliton solutions.
△ Less
Submitted 19 July, 2016;
originally announced July 2016.
-
A novel discrete variational derivative method using "average-difference methods"
Authors:
Daisuke Furihata,
Shun Sato,
Takayasu Matsuo
Abstract:
We consider structure-preserving methods for conservative systems, which rigorously replicate the conservation property yielding better numerical solutions. There, corresponding to the skew-symmetry of the differential operator, that of difference operators is essential to the discrete conservation law. Unfortunately, however, when we employ the standard central difference operator, the simplest o…
▽ More
We consider structure-preserving methods for conservative systems, which rigorously replicate the conservation property yielding better numerical solutions. There, corresponding to the skew-symmetry of the differential operator, that of difference operators is essential to the discrete conservation law. Unfortunately, however, when we employ the standard central difference operator, the simplest one, the numerical solutions often suffer from undesirable spatial oscillations. In this letter, we propose a novel "average-difference method," which is tougher against such oscillations, and combine it with an existing conservative method. Theoretical and numerical analysis in the linear case show the superiority of the proposed method.
△ Less
Submitted 16 July, 2016; v1 submitted 16 May, 2016;
originally announced May 2016.
-
Discrete Variational Derivative Methods for the EPDiff equation
Authors:
Stig Larsson,
Takayasu Matsuo,
Klas Modin,
Matteo Molteni
Abstract:
The aim of this paper is the derivation of structure preserving schemes for the solution of the EPDiff equation, with particular emphasis on the two dimensional case. We develop three different schemes based on the Discrete Variational Derivative Method (DVDM) on a rectangular domain discretized with a regular, structured, orthogonal grid.
We present numerical experiments to support our claims:…
▽ More
The aim of this paper is the derivation of structure preserving schemes for the solution of the EPDiff equation, with particular emphasis on the two dimensional case. We develop three different schemes based on the Discrete Variational Derivative Method (DVDM) on a rectangular domain discretized with a regular, structured, orthogonal grid.
We present numerical experiments to support our claims: we investigate the preservation of energy and linear momenta, the reversibility, and the empirical convergence of the schemes. The quality of our schemes is finally tested by simulating the interaction of singular wave fronts.
△ Less
Submitted 21 April, 2016;
originally announced April 2016.
-
Structure-preserving integrators for the Benjamin-type equations
Authors:
Kimiaki Kinugasa,
Yuto Miyatake,
Takayasu Matsuo
Abstract:
The numerical integration of the Benjamin and Benjamin--Ono equations are considered. They are non-local partial differential equations involving the Hilbert transform, and due to this, so far quite few structure-preserving integrators have been proposed. In this paper, a new reformulation of the equations is stated, and new structure-preserving discretizations are proposed based on it. Numerical…
▽ More
The numerical integration of the Benjamin and Benjamin--Ono equations are considered. They are non-local partial differential equations involving the Hilbert transform, and due to this, so far quite few structure-preserving integrators have been proposed. In this paper, a new reformulation of the equations is stated, and new structure-preserving discretizations are proposed based on it. Numerical experiments confirm the effectiveness of the proposed integrators.
△ Less
Submitted 29 July, 2015;
originally announced July 2015.
