-
Physical significance of artificial numerical noise in direct numerical simulation of turbulence
Authors:
Shijun Liao,
Shijie Qin
Abstract:
Using clean numerical simulation (CNS) in which artificial numerical noise is negligible over a finite, sufficiently long interval of time, we provide evidence, for the first time, that artificial numerical noise in direct numerical simulation (DNS) of turbulence is approximately equivalent to thermal fluctuation and/or stochastic environmental noise. This confers physical significance on the arti…
▽ More
Using clean numerical simulation (CNS) in which artificial numerical noise is negligible over a finite, sufficiently long interval of time, we provide evidence, for the first time, that artificial numerical noise in direct numerical simulation (DNS) of turbulence is approximately equivalent to thermal fluctuation and/or stochastic environmental noise. This confers physical significance on the artificial numerical noise of DNS of the Navier-Stokes equations. As a result, DNS on a fine mesh should correspond to turbulence under small internal/external physical disturbance, whereas DNS on a sparse mesh corresponds to turbulent flow under large physical disturbance, respectively. The key point is that: all of them have physical meanings and so are correct in terms of their deterministic physics, even if their statistics are quite different. This is illustrated herein. Our paper provides a positive viewpoint regarding the presence of artificial numerical noise in DNS.
△ Less
Submitted 4 April, 2025;
originally announced April 2025.
-
A Self-Adaptive Algorithm of the Clean Numerical Simulation (CNS) for Chaos
Authors:
Shijie Qin,
Shijun Liao
Abstract:
The background numerical noise $\varepsilon_{0} $ is determined by the maximum of truncation error and round-off error. For a chaotic system, the numerical error $\varepsilon(t)$ grows exponentially, say, $\varepsilon(t) = \varepsilon_{0} \exp(κ\,t)$, where $κ>0$ is the so-called noise-growing exponent. This is the reason why one can not gain a convergent simulation of chaotic systems in a long en…
▽ More
The background numerical noise $\varepsilon_{0} $ is determined by the maximum of truncation error and round-off error. For a chaotic system, the numerical error $\varepsilon(t)$ grows exponentially, say, $\varepsilon(t) = \varepsilon_{0} \exp(κ\,t)$, where $κ>0$ is the so-called noise-growing exponent. This is the reason why one can not gain a convergent simulation of chaotic systems in a long enough interval of time by means of traditional algorithms in double precision, since the background numerical noise $\varepsilon_{0}$ might stop decreasing because of the use of double precision. This restriction can be overcome by means of the clean numerical simulation (CNS), which can decrease the background numerical noise $\varepsilon_{0}$ to any required tiny level. A lot of successful applications show the novelty and validity of the CNS. In this paper, we further propose some strategies to greatly increase the computational efficiency of the CNS algorithms for chaotic dynamical systems. It is highly suggested to keep a balance between truncation error and round-off error and besides to progressively enlarge the background numerical noise $\varepsilon_{0}$, since the exponentially increasing numerical noise $\varepsilon(t)$ is much larger than it. Some examples are given to illustrate the validity of our strategies for the CNS.
△ Less
Submitted 31 January, 2023;
originally announced February 2023.
-
A physical perturbation based study on the prediction of free-fall disks with chaotic modes in the water
Authors:
Tianzhuang Xu,
Bo Zhang,
Jing Li,
Zhihui Li,
Shijuan Liao
Abstract:
We report a phenomenon that physical perturbations sometimes can benefit the certainty of a free-fall motion with chaotic modes, albeit, as commonly believed, they can ruin it. We statistically compare those factors that may lead to uncertainty, by which we find that the growth of the standard deviation of the landing locations is directly determined by the physical perturbations. A significant ya…
▽ More
We report a phenomenon that physical perturbations sometimes can benefit the certainty of a free-fall motion with chaotic modes, albeit, as commonly believed, they can ruin it. We statistically compare those factors that may lead to uncertainty, by which we find that the growth of the standard deviation of the landing locations is directly determined by the physical perturbations. A significant yardstick is defined in the meantime. This temporal criterion is of big relevance to the replicability of such problems experimentally, although they are inherently chaotic. Our hypothesis is verified by experiments from other literature. This outcome also provides a practical strategy to evaluate the credible prediction time by estimating the disturbances from physical parameters as a priori.
△ Less
Submitted 23 June, 2022;
originally announced June 2022.
-
A kind of Lagrangian chaotic property of the Arnold-Beltrami-Childress flow
Authors:
Shijie Qin,
Shijun Liao
Abstract:
Three-dimensional steady-state Arnold-Beltrami-Childress (ABC) flow has a chaotic Lagrangian structure, and also satisfies the Navier-Stokes (NS) equations with an external force per unit mass. It is well-known that, although trajectories of a chaotic system have sensitive dependence on initial conditions, i.e. the famous ``butterfly-effect'', their statistical properties are often insensitive to…
▽ More
Three-dimensional steady-state Arnold-Beltrami-Childress (ABC) flow has a chaotic Lagrangian structure, and also satisfies the Navier-Stokes (NS) equations with an external force per unit mass. It is well-known that, although trajectories of a chaotic system have sensitive dependence on initial conditions, i.e. the famous ``butterfly-effect'', their statistical properties are often insensitive to small disturbances. This kind of chaos (such as governed by the Lorenz equations) is called normal-chaos. However, a new concept, i.e. ultra-chaos, has been reported recently, whose statistics are unstable to tiny disturbances. Thus, ultra-chaos represents higher disorder than normal chaos. In this paper, we illustrate that ultra-chaos widely exists in Lagrangian trajectories of fluid particles in steady-state ABC flow. Moreover, solving the NS equation when $Re=50$ with the ABC flow plus a very small disturbance as the initial condition, it is found that trajectories of nearly all fluid particles become ultra-chaotic when the transition from laminar to turbulence occurs. These numerical experiments and facts highly suggest that ultra-chaos should have a relationship with turbulence. This paper identifies differences between ultra-chaos and sensitivity of statistics to parameters. Possible relationships between ultra-chaos and the Poincaré section, ultra-chaos and ergodicity/non-ergodicity, etc., are discussed. The concept of ultra-chaos opens a new perspective of chaos, the Poincaré section, ergodicity/non-ergodicity, turbulence and their inter-relationships.
△ Less
Submitted 13 May, 2023; v1 submitted 28 April, 2022;
originally announced April 2022.
-
Influence of database noises to machine learning for spatiotemporal chaos
Authors:
Yu Yang,
Shijie Qin,
Shijun Liao
Abstract:
A new strategy, namely the "clean numerical simulation" (CNS), was proposed (J. Computational Physics, 418:109629, 2020) to gain reliable/convergent simulations (with negligible numerical noises) of spatiotemporal chaotic systems in a long enough interval of time, which provide us benchmark solution for comparison. Here we illustrate that machine learning (ML) can always give good enough fitting p…
▽ More
A new strategy, namely the "clean numerical simulation" (CNS), was proposed (J. Computational Physics, 418:109629, 2020) to gain reliable/convergent simulations (with negligible numerical noises) of spatiotemporal chaotic systems in a long enough interval of time, which provide us benchmark solution for comparison. Here we illustrate that machine learning (ML) can always give good enough fitting predictions of a spatiotemporal chaos by using, separately, two quite different training sets: one is the "clean database" given by the CNS with negligible numerical noises, the other is the "polluted database" given by the traditional algorithms in single/double precision with considerably large numerical noises. However, even in statistics, the ML predictions based on the "polluted database" are quite different from those based on the "clean database". It illustrates that the database noises have huge influences on ML predictions of some spatiotemporal chaos, even in statistics. Thus, we must use a "clean" database for machine learning of some spatiotemporal chaos. This surprising result might open a new door and possibility to study machine learning.
△ Less
Submitted 13 September, 2021; v1 submitted 8 September, 2021;
originally announced September 2021.
-
Three-body problem -- from Newton to supercomputer plus machine learning
Authors:
Shijun Liao,
Xiaoming Li,
Yu Yang
Abstract:
The famous three-body problem can be traced back to Newton in 1687, but quite few families of periodic orbits were found in 300 years thereafter. In this paper, we propose an effective approach and roadmap to numerically gain planar periodic orbits of three-body systems with arbitrary masses by means of machine learning based on an artificial neural network (ANN) model. Given any a known periodic…
▽ More
The famous three-body problem can be traced back to Newton in 1687, but quite few families of periodic orbits were found in 300 years thereafter. In this paper, we propose an effective approach and roadmap to numerically gain planar periodic orbits of three-body systems with arbitrary masses by means of machine learning based on an artificial neural network (ANN) model. Given any a known periodic orbit as a starting point, this approach can provide more and more periodic orbits (of the same family name) with variable masses, while the mass domain having periodic orbits becomes larger and larger, and the ANN model becomes wiser and wiser. Finally we have an ANN model trained by means of all obtained periodic orbits of the same family, which provides a convenient way to give accurate enough predictions of periodic orbits with arbitrary masses for physicists and astronomers. It suggests that the high-performance computer and artificial intelligence (including machine learning) should be the key to gain periodic orbits of the famous three-body problem.
△ Less
Submitted 5 May, 2022; v1 submitted 20 May, 2021;
originally announced June 2021.
-
Accurate predictions of chaotic motion of a free fall disk
Authors:
Tianzhuang Xu,
Jing Li,
Zhihui Li,
Shijun Liao
Abstract:
It is important to know the accurate trajectory of a free fall object in fluid (such as a spacecraft), whose motion might be chaotic in many cases. However, it is impossible to accurately predict its chaotic trajectory in a long enough duration by traditional numerical algorithms in double precision. In this paper, we give the accurate predictions of the same problem by a new strategy, namely the…
▽ More
It is important to know the accurate trajectory of a free fall object in fluid (such as a spacecraft), whose motion might be chaotic in many cases. However, it is impossible to accurately predict its chaotic trajectory in a long enough duration by traditional numerical algorithms in double precision. In this paper, we give the accurate predictions of the same problem by a new strategy, namely the Clean Numerical Simulation (CNS). Without loss of generality, a free fall disk in water is considered, whose motion is governed by the Andersen-Pesavento-Wang model. We illustrate that convergent and reliable trajectories of a chaotic free fall disk in a long enough interval of time can be obtained by means of the CNS, but different traditional algorithms in double precision give disparate trajectories. Besides, unlike the traditional algorithms in double precision, the CNS can predict the accurate posture of the free fall disk near the vicinity of the bifurcation point of some physical parameters in a long duration. Therefore, the CNS can provide reliable prediction of chaotic systems in a long enough interval of time.
△ Less
Submitted 20 February, 2021;
originally announced February 2021.
-
Satellites of the Broucke-Hadjidemetriou-Hénon family of periodic unequal-mass three-body orbits
Authors:
Xiaoming Li,
Shijun Liao
Abstract:
The Broucke-Hadjidemetriou-Hénon's (BHH) orbits are a family of periodic orbits of the three-body system with the simplest topological free group word $a$, while the BHH satellites have free group words $a^k$ ($k>1$), where $k$ is the topological exponent. Janković and Dmitrašinović [Phy. Rev. Lett. 116, 064301 (2016)] reported 57 new BHH satellites with equal mass and found that at a fixed energy…
▽ More
The Broucke-Hadjidemetriou-Hénon's (BHH) orbits are a family of periodic orbits of the three-body system with the simplest topological free group word $a$, while the BHH satellites have free group words $a^k$ ($k>1$), where $k$ is the topological exponent. Janković and Dmitrašinović [Phy. Rev. Lett. 116, 064301 (2016)] reported 57 new BHH satellites with equal mass and found that at a fixed energy the relationship between the angular momentum ($L$) and the topologically rescaled period ($T/k$) is the same for both of the BHH orbits ($k=1$) and the BHH satellites ($k>1$). In this letter, we report 419,743 new BHH orbits ($k=1$) and 179,253 new BHH satellites ($k>1$) of the three-body system with unequal mass, which have never been reported, to the best of our knowledge. Among these newly-found 598,996 BBH orbits and satellites, about 33.5 % (i.e., 200,686) are linearly stable and thus many among them might be observed in practice. Besides, we discover that, for the three-body system with unequal mass at a fixed energy, relationship between the angular momentum ($L$) and topologically rescaled period ($T/k$) of the BHH satellites ($k>1$) is different from that of the BHH orbits ($k=1$).
△ Less
Submitted 19 July, 2020;
originally announced August 2020.
-
One family of 13315 stable periodic orbits of the non-hierarchical unequal-mass triple system
Authors:
Xiaoming Li,
Xiaochen Li,
Shijun Liao
Abstract:
The three-body problem has been studied for more than three centuries [1,2], and has received much attention in recent years [3-5]. It shows complex dynamical phenomena due to the mutual gravitational interaction of the three bodies. Triple systems are common in astronomy, but all observed periodic triple systems are hierarchical up till now [6-8]. It is traditionally believed that bound non-hiera…
▽ More
The three-body problem has been studied for more than three centuries [1,2], and has received much attention in recent years [3-5]. It shows complex dynamical phenomena due to the mutual gravitational interaction of the three bodies. Triple systems are common in astronomy, but all observed periodic triple systems are hierarchical up till now [6-8]. It is traditionally believed that bound non-hierarchical triple systems are almost unstable and disintegrate into a stable binary system and a single star [5], and thus stable periodic orbits of non-hierarchical triple systems are rather scarce. Here we report one family of 13315 stable periodic orbits of the non-hierarchical triple system with unequal mass. Compared with the narrow mass region (only 10E-5) of the stable figure-eight solution [9], our newly-found stable periodic orbits can have fairly large mass region. It is found that many of these newly-found stable periodic orbits have the mass ratios close to those of the hierarchical triple systems that have been measured by the astronomical observation. It implies that these stable periodic orbits of the non-hierarchical triple system with distinctly unequal masses can be quite possibly observed in practice. Our investigation also suggests that there should exist an infinite number of stable periodic orbits of non-hierarchical triple systems with distinctly unequal masses. Obviously, these stable periodic orbits of the non-hierarchical unequal-mass triple system have broad impact for the astrophysical scenario: they could inspire the theoretical and observational study of the non-hierarchical triple system, the formation of triple stars [6], the gravitational waves pattern [10] and the gravitational waves observation [11] of the non-hierarchical triple system.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
On the risks of using double precision in numerical simulations of spatio-temporal chaos
Authors:
Tianli Hu,
Shijun Liao
Abstract:
Due to the butterfly-effect, computer-generated chaotic simulations often deviate exponentially from the true solution, so that it is very hard to obtain a reliable simulation of chaos in a long-duration time. In this paper, a new strategy of the so-called Clean Numerical Simulation (CNS) in physical space is proposed for spatio-temporal chaos, which is computationally much more efficient than its…
▽ More
Due to the butterfly-effect, computer-generated chaotic simulations often deviate exponentially from the true solution, so that it is very hard to obtain a reliable simulation of chaos in a long-duration time. In this paper, a new strategy of the so-called Clean Numerical Simulation (CNS) in physical space is proposed for spatio-temporal chaos, which is computationally much more efficient than its predecessor (in spectral space). The strategy of the CNS is to reduce both of the truncation and round-off errors to a specified level by implementing high-order algorithms in multiple-precision arithmetic (with sufficient significant digits for all variables and parameters) so as to guarantee that numerical noise is below such a critical level in a temporal interval $t\in[0,T_c]$ that corresponding numerical simulation remains reliable over the whole interval. Without loss of generality, the complex Ginzburg-Landau equation (CGLE) is used to illustrate its validity. As a result, a reliable long-duration numerical simulation of the CGLE is achieved in the whole spatial domain over a long interval of time $t\in[0,3000]$, which is used as a reliable benchmark solution to investigate the influence of numerical noise by comparing it with the corresponding ones given by the 4th-order Runge-Kutta method in double precision (RKwD). Our results demonstrate that the use of double precision in simulations of chaos might lead to huge errors in the prediction of spatio-temporal trajectories and in statistics, not only quantitatively but also qualitatively, particularly in a long interval of time.
△ Less
Submitted 3 June, 2020; v1 submitted 25 October, 2019;
originally announced October 2019.
-
Collisionless periodic orbits in the free-fall three-body problem
Authors:
Xiaoming Li,
Shijun Liao
Abstract:
Although the free-fall three-body problem have been investigated for more than one century, however, only four collisionless periodic orbits have been found. In this paper, we report 234 collisionless periodic orbits of the free-fall three-body system with some mass ratios, including three known collisionless periodic orbits. Thus, 231 collisionless free-fall periodic orbits among them are entirel…
▽ More
Although the free-fall three-body problem have been investigated for more than one century, however, only four collisionless periodic orbits have been found. In this paper, we report 234 collisionless periodic orbits of the free-fall three-body system with some mass ratios, including three known collisionless periodic orbits. Thus, 231 collisionless free-fall periodic orbits among them are entirely new. In theory, we can gain periodic orbits of the free-fall three-body system in arbitrary ratio of mass. Besides, it is found that, for a given ratio of masses of two bodies, there exists a generalized Kepler's third law for the periodic three-body system. All of these would enrich our knowledge and deepen our understanding about the famous three-body problem as a whole.
△ Less
Submitted 21 May, 2018;
originally announced May 2018.
-
The 1223 new periodic orbits of planar three-body problem with unequal mass and zero angular momentum
Authors:
Xiaoming Li,
Yipeng Jing,
Shijun Liao
Abstract:
We present 1349 families of Newtonian periodic planar three-body orbits with unequal mass and zero angular momentum and the initial conditions in case of isosceles collinear configurations. These 1349 families of the periodic collisionless orbits can be divided into seven classes according to their geometric and algebraic symmetries. Among these 1349 families, 1223 families are entirely new, to th…
▽ More
We present 1349 families of Newtonian periodic planar three-body orbits with unequal mass and zero angular momentum and the initial conditions in case of isosceles collinear configurations. These 1349 families of the periodic collisionless orbits can be divided into seven classes according to their geometric and algebraic symmetries. Among these 1349 families, 1223 families are entirely new, to the best of our knowledge. Furthermore, some periodic orbits have the same free group element for different mass. We find that the scale-invariant average period linearly increases with the mass of one body when the masses of the other two are constant. It is suggested that the masses of bodies may play an important role in periodic three-body systems. The movies of these periodic orbits are given on the website \url{http://numericaltank.sjtu.edu.cn/three-body/three-body-unequal-mass.htm} .
△ Less
Submitted 13 September, 2017;
originally announced September 2017.
-
Influence of round-off errors on the reliability of numerical simulations of chaotic dynamic systems
Authors:
Shijie Qin,
Shijun Liao
Abstract:
We illustrate that, like the truncation error, the round-off error has a significant influence on the reliability of numerical simulations of chaotic dynamic systems. Due to the butterfly-effect, all numerical approaches in double precision cannot give a reliable long-term simulation of chaotic dynamic systems. So, in order to avoid man-made uncertainty of numerical simulations of chaos, we had to…
▽ More
We illustrate that, like the truncation error, the round-off error has a significant influence on the reliability of numerical simulations of chaotic dynamic systems. Due to the butterfly-effect, all numerical approaches in double precision cannot give a reliable long-term simulation of chaotic dynamic systems. So, in order to avoid man-made uncertainty of numerical simulations of chaos, we had to greatly decrease both of the truncation and round-off error to a small enough level, plus a verification of solution reliability by means of an additional computation using even smaller truncation and round-off errors.
△ Less
Submitted 15 July, 2017;
originally announced July 2017.
-
More than six hundreds new families of Newtonian periodic planar collisionless three-body orbits
Authors:
Xiaoming Li,
Shijun Liao
Abstract:
The famous three-body problem can be traced back to Isaac Newton in 1680s. In the 300 years since this "three-body problem" was first recognized, only three families of periodic solutions had been found, until 2013 when Šuvakov and Dmitrašinović [Phys. Rev. Lett. 110, 114301 (2013)] made a breakthrough to numerically find 13 new distinct periodic orbits, which belong to 11 new families of Newtonia…
▽ More
The famous three-body problem can be traced back to Isaac Newton in 1680s. In the 300 years since this "three-body problem" was first recognized, only three families of periodic solutions had been found, until 2013 when Šuvakov and Dmitrašinović [Phys. Rev. Lett. 110, 114301 (2013)] made a breakthrough to numerically find 13 new distinct periodic orbits, which belong to 11 new families of Newtonian planar three-body problem with equal mass and zero angular momentum. In this paper, we numerically obtain 695 families of Newtonian periodic planar collisionless orbits of three-body system with equal mass and zero angular momentum in case of initial conditions with isosceles collinear configuration, including the well-known Figure-eight family found by Moore in 1993, the 11 families found by Šuvakov and Dmitrašinović in 2013, and more than 600 new families that have been never reported, to the best of our knowledge. With the definition of the average period $\bar{T} = T/L_f$, where $L_f$ is the length of the so-called "free group element", these 695 families suggest that there should exist the quasi Kepler's third law $ \bar{T}^* \approx 2.433 \pm 0.075$ for the considered case, where $\bar{T}^*= \bar{T} |E|^{3/2}$ is the scale-invariant average period and $E$ is its total kinetic and potential energy, respectively. The movies of these 695 periodic orbits in the real space and the corresponding close curves on the "shape sphere" can be found via the website: http://numericaltank.sjtu.edu.cn/three-body/three-body.htm
△ Less
Submitted 11 July, 2017; v1 submitted 26 April, 2017;
originally announced May 2017.
-
The influence of numerical noises on statistics computation of chaotic dynamic systems
Authors:
Xiaoming Li,
Shijun Liao
Abstract:
It is well known that chaotic dynamic systems (such as three-body system, turbulent flow and so on) have the sensitive dependance on initial conditions (SDIC). Unfortunately, numerical noises (such as truncation error and round-off error) always exist in practice. Thus, due to the SDIC, long-term accurate prediction of chaotic dynamic systems is practically impossible, and therefore numerical simu…
▽ More
It is well known that chaotic dynamic systems (such as three-body system, turbulent flow and so on) have the sensitive dependance on initial conditions (SDIC). Unfortunately, numerical noises (such as truncation error and round-off error) always exist in practice. Thus, due to the SDIC, long-term accurate prediction of chaotic dynamic systems is practically impossible, and therefore numerical simulations of chaos are only mixtures of "true" solution with physical meanings and numerical noises without physical meanings. However, it is traditionally believed that statistic computations based on such kind of "mixtures" of numerical simulations of chaotic dynamic systems are acceptable. In this paper, using the so-called "clean numerical simulation" (CNS) whose numerical noises might be much smaller even than micro-level physical uncertainty and thus are negligible, we gain accurate prediction of a chaotic dynamic system in a long enough interval of time. Then, based on these reliable simulations, the influence of numerical noises on statistic computations is investigated. It is found that the influence of numerical noises is negligible when statistic results are time-independent. Unfortunately, when a chaotic dynamic system is far from equilibrium state so that its statistics are time-dependent, numerical noises have a great influence even on statistic computations. It suggests that even the direct numerical simulations (DNS) might not give reliable statistic computations for non-equilibrium dynamic systems with the SDIC.
△ Less
Submitted 29 September, 2016;
originally announced September 2016.
-
Clean Numerical Simulation: A New Strategy to Obtain Reliable Solutions of Chaotic Dynamic Systems
Authors:
Xiaoming Li,
Shijun Liao
Abstract:
It is well known that chaotic dynamic systems (such as three-body system, turbulent flow and so on) have the sensitive dependence on initial conditions (SDIC). Unfortunately, numerical noises (such as truncation error and round-off error) always exist in practice. Thus, due to the SDIC, long-term accurate prediction of chaotic dynamic systems is practically impossible. In this paper, a new strateg…
▽ More
It is well known that chaotic dynamic systems (such as three-body system, turbulent flow and so on) have the sensitive dependence on initial conditions (SDIC). Unfortunately, numerical noises (such as truncation error and round-off error) always exist in practice. Thus, due to the SDIC, long-term accurate prediction of chaotic dynamic systems is practically impossible. In this paper, a new strategy for chaotic dynamic systems, i.e. the Clean Numerical Simulation (CNS), is briefly described, together with its applications to a few Hamiltonian chaotic systems. With negligible numerical noises, the CNS can provide convergent (reliable) chaotic trajectories in a long enough interval of time. This is very important for Hamiltonian systems such as three-body problem, and thus should have many applications in various fields. We find that the traditional numerical methods in double precision cannot give not only reliable trajectories but also reliable Fourier power spectra and autocorrelation functions. In addition, it is found that even statistic properties of chaotic systems can not be correctly obtained by means of traditional numerical algorithms in double precision, as long as these statistics are time-dependent. Thus, our CNS results strongly suggest that one had better to be very careful on DNS results of statistically unsteady turbulent flows, although DNS results often agree well with experimental data when turbulent flows are in a statistical stationary state.
△ Less
Submitted 20 May, 2018; v1 submitted 29 September, 2016;
originally announced September 2016.
-
On the method of directly defining inverse mapping for nonlinear differential equations
Authors:
Shijun Liao,
Yinlong Zhao
Abstract:
In scientific computing, it is time-consuming to calculate an inverse operator ${\mathscr A}^{-1}$ of a differential equation ${\mathscr A}\varphi = f$, especially when ${\mathscr A}$ is a highly nonlinear operator. In this paper, based on the homotopy analysis method (HAM), a new approach, namely the method of directly defining inverse mapping (MDDiM), is proposed to gain analytic approximations…
▽ More
In scientific computing, it is time-consuming to calculate an inverse operator ${\mathscr A}^{-1}$ of a differential equation ${\mathscr A}\varphi = f$, especially when ${\mathscr A}$ is a highly nonlinear operator. In this paper, based on the homotopy analysis method (HAM), a new approach, namely the method of directly defining inverse mapping (MDDiM), is proposed to gain analytic approximations of nonlinear differential equations. In other words, one can solve a nonlinear differential equation ${\mathscr A}\varphi = f$ by means of directly defining an inverse mapping $\mathscr J$, i.e. without calculating any inverse operators. Here, the inverse mapping $\mathscr J$ is even unnecessary to be explicitly expressed in a differential form, since "mapping" is a more general concept than "differential operator". To guide how to directly define an inverse mapping $\mathscr J$, some rules are provided. Besides, a convergence theorem is proved, which guarantees that a convergent series solution given by the MDDiM must be a solution of problems under consideration. In addition, three nonlinear differential equations are used to illustrate the validity and potential of the MDDiM, and especially the great freedom and large flexibility of directly defining inverse mappings for various types of nonlinear problems. The method of directly defining inverse mapping (MDDiM) might open a completely new, more general way to solve nonlinear problems in science and engineering, which is fundamentally different from traditional methods.
△ Less
Submitted 10 November, 2015; v1 submitted 14 July, 2015;
originally announced July 2015.
-
On the inherent self-excited macroscopic randomness of chaotic three-body system
Authors:
Shijun Liao,
Xiaoming Li
Abstract:
What is the origin of macroscopic randomness (uncertainty)? This is one of the most fundamental open questions for human being. In this paper, 10000 samples of reliable (convergent), multiple-scale (from 1.0E-60 to 100) numerical simulations of a chaotic three-body system indicate that, without any external disturbance, the microscopic inherent uncertainty (in the level of 1.0E-60) due to physical…
▽ More
What is the origin of macroscopic randomness (uncertainty)? This is one of the most fundamental open questions for human being. In this paper, 10000 samples of reliable (convergent), multiple-scale (from 1.0E-60 to 100) numerical simulations of a chaotic three-body system indicate that, without any external disturbance, the microscopic inherent uncertainty (in the level of 1.0E-60) due to physical fluctuation of initial positions of the three-body system enlarges exponentially into macroscopic randomness (at the level O(1)) until t=T*, the so-called physical limit time of prediction, but propagates algebraically thereafter when accurate prediction of orbit is impossible. Note that these 10000 samples use micro-level, inherent physical fluctuations of initial position, which have nothing to do with human being. Especially, the differences of these 10000 fluctuations are mathematically so small (in the level of 1.0E-60) that they are physically the SAME since a distance shorter than a Planck length does not make physical senses according to the spring theory. It indicates that the macroscopic randomness of the chaotic three-body system is self-excited, say, without any external force or disturbances, from the inherent micro-level uncertainty. This provides us the new concept "self-excited macroscopic randomness (uncertainty)". In addition, it is found that, without any external disturbance, the chaotic three-body system might randomly disrupt with the symmetry-breaking at t=1000 in about 25% probability, which provides us the new concepts "self-excited random disruption", "self-excited random escape" and "self-excited symmetry breaking" of the chaotic three-body system. It suggests that a chaotic three-body system might randomly evolve by itself, without any external forces or disturbance.
△ Less
Submitted 29 March, 2015; v1 submitted 15 July, 2014;
originally announced July 2014.
-
A comment on the arguments about the reliability and convergence of chaotic simulations
Authors:
Shijun Liao
Abstract:
Yao and Hughes commented (Tellus-A, 60: 803 - 805, 2008) that "all chaotic responses are simply numerical noise and have nothing to do with the solutions of differential equations". However, using 1200 CPUs of the National Supercomputer TH-A1 and a parallel integral algorithm of the so-called "Clean Numerical Simulation" (CNS) based on the 3500th-order Taylor expansion and data in 4180-digit multi…
▽ More
Yao and Hughes commented (Tellus-A, 60: 803 - 805, 2008) that "all chaotic responses are simply numerical noise and have nothing to do with the solutions of differential equations". However, using 1200 CPUs of the National Supercomputer TH-A1 and a parallel integral algorithm of the so-called "Clean Numerical Simulation" (CNS) based on the 3500th-order Taylor expansion and data in 4180-digit multiple precision, one can gain reliable, convergent chaotic solution of Lorenz equation in a rather long interval [0,10000]. This supports Lorenz's optimistic viewpoint (Tellus-A, 60: 806 - 807, 2008): "numerical approximations can converge to a chaotic true solution throughout any finite range of time".
△ Less
Submitted 1 January, 2014;
originally announced January 2014.
-
Physical limit of prediction for chaotic motion of three-body problem
Authors:
Shijun Liao
Abstract:
A half century ago, Lorenz found the "butterfly effect" of chaotic dynamic systems and made his famous claim that long-term prediction of chaos is impossible. However, the meaning of the "long-term" in his claim is not very clear. In this article, a new concept, i.e. the physical limit of prediction time, denoted by $T_p^{max}$, is put forwarded to provide us a time-scale for at most how long math…
▽ More
A half century ago, Lorenz found the "butterfly effect" of chaotic dynamic systems and made his famous claim that long-term prediction of chaos is impossible. However, the meaning of the "long-term" in his claim is not very clear. In this article, a new concept, i.e. the physical limit of prediction time, denoted by $T_p^{max}$, is put forwarded to provide us a time-scale for at most how long mathematically reliable (numerical) simulations of trajectories of a chaotic dynamic system are physically correct. A special case of three-body problem is used as an example to illustrate that, due to the inherent, physical uncertainty of initial positions in the (dimensionless) micro-level of $10^{-60}$, the chaotic trajectories are essentially uncertain in physics after $t > T_p^{max}$, where $T_p^{max}\approx 810$ for this special case of the three body problem. Thus, physically, it has no sense to talk about the "accurate, deterministic prediction" of chaotic trajectories of the three body problem after $t > T_p^{max}$. In addition, our mathematically reliable simulations of the chaotic trajectories of the three bodies suggest that, due to the butterfly effect of chaotic dynamic systems, the micro-level physical uncertainty of initial conditions might transfer into macroscopic uncertainty. This suggests that micro-level uncertainty might be an origin of some macroscopic uncertainty. Besides, it might provide us a theoretical explanation about the origin of uncertainty (or randomness) of many macroscopic phenomena such as turbulent flows, the random distribution of stars in the universe, and so on.
△ Less
Submitted 17 July, 2013; v1 submitted 26 May, 2013;
originally announced May 2013.
-
On the mathematically reliable long-term simulation of chaos of Lorenz equation in the interval [0,10000]
Authors:
Shijun Liao,
Pengfei Wang
Abstract:
Using 1200 CPUs of the National Supercomputer TH-A1 and a parallel integral algorithm based on the 3500th-order Taylor expansion and the 4180-digit multiple precision data, we have done a reliable simulation of chaotic solution of Lorenz equation in a rather long interval [0,10000] (Lorenz time unit). Such a kind of mathematically reliable chaotic simulation has never been reported. It provides us…
▽ More
Using 1200 CPUs of the National Supercomputer TH-A1 and a parallel integral algorithm based on the 3500th-order Taylor expansion and the 4180-digit multiple precision data, we have done a reliable simulation of chaotic solution of Lorenz equation in a rather long interval [0,10000] (Lorenz time unit). Such a kind of mathematically reliable chaotic simulation has never been reported. It provides us a numerical benchmark for mathematically reliable long-term prediction of chaos. Besides, it also proposes a safe method for mathematically reliable simulations of chaos in a finite but long enough interval. In addition, our very fine simulations suggest that such a kind of mathematically reliable long-term prediction of chaotic solution might have no physical meanings, because the inherent physical micro-level uncertainty due to thermal fluctuation might quickly transfer into macroscopic uncertainty so that trajectories for a long enough time would be essentially uncertain in physics.
△ Less
Submitted 12 January, 2014; v1 submitted 17 May, 2013;
originally announced May 2013.
-
Chaotic motion of three-body problem : an origin of macroscopic randomness of the universe
Authors:
Shijun Liao
Abstract:
The famous three-body problem is investigated by means of a numerical approach with negligible numerical noises in a long enough time interval, namely the Clean Numerical Simulation (CNS). From physical viewpoints, position of any bodies contains inherent micro-level uncertainty. The evaluations of such kind of inherent micro-level uncertainty are accurately simulated by means of the CNS. Our reli…
▽ More
The famous three-body problem is investigated by means of a numerical approach with negligible numerical noises in a long enough time interval, namely the Clean Numerical Simulation (CNS). From physical viewpoints, position of any bodies contains inherent micro-level uncertainty. The evaluations of such kind of inherent micro-level uncertainty are accurately simulated by means of the CNS. Our reliable, very accurate CNS results indicate that the inherent micro-level uncertainty of position of a star/planet might transfer into macroscopic randomness. Thus, the inherent micro-level uncertainty of a body might be an origin of macroscopic randomness of the universe. In addition, from physical viewpoints, orbits of some three-body systems at large time are inherently random, and thus it has no physical meanings to talk about the accurate long-term prediction of the chaotic orbits. Note that such kind of uncertainty and randomness has nothing to do with the ability of human being. All of these might enrich our knowledge and deepen our understandings about not only the three-body problem but also chaos.
△ Less
Submitted 7 April, 2013;
originally announced April 2013.
-
On peaked solitary waves of Degasperis - Procesi equation
Authors:
Shijun Liao
Abstract:
The Degasperis - Procesi (DP) equation describing the propagation of shallow water waves contains a physical parameter $ω$, and it is well-known that the DP equation admits solitary waves with a peaked crest when $ω= 0$. In this article, we illustrate, for the first time, that the DP equation admits peaked solitary waves even when $ω\neq 0$. This is helpful to enrich our knowledge and deepen our u…
▽ More
The Degasperis - Procesi (DP) equation describing the propagation of shallow water waves contains a physical parameter $ω$, and it is well-known that the DP equation admits solitary waves with a peaked crest when $ω= 0$. In this article, we illustrate, for the first time, that the DP equation admits peaked solitary waves even when $ω\neq 0$. This is helpful to enrich our knowledge and deepen our understandings about peaked solitary waves of the DP equation.
△ Less
Submitted 26 September, 2012; v1 submitted 24 May, 2012;
originally announced May 2012.
-
On peaked solitary waves of Camassa-Holm equation
Authors:
Shijun Liao
Abstract:
Unlike the Boussinesq, KdV and BBM equations, the celebrated Casamma-Holm (CH) equation can model both phenomena of soliton interaction and wave breaking. Especially, it has peaked solitary waves in case of omega=0. Besides, in case of omega > 0, its solitary wave "becomes $C^\infty$ and there is no derivative discontinuity at its peak", as mentioned by Camassa and Holm in 1993 (PRL). However, it…
▽ More
Unlike the Boussinesq, KdV and BBM equations, the celebrated Casamma-Holm (CH) equation can model both phenomena of soliton interaction and wave breaking. Especially, it has peaked solitary waves in case of omega=0. Besides, in case of omega > 0, its solitary wave "becomes $C^\infty$ and there is no derivative discontinuity at its peak", as mentioned by Camassa and Holm in 1993 (PRL). However, it is found in this article that the CH equation has peaked solitary waves even in case of omega > 0. Especially, all of these peaked solitary waves have an unusual property: their phase speeds have nothing to do with the height of peakons or anti-peakons. Therefore, in contrast to the traditional view-points, the peaked solitary waves are a common property of the CH equation: in fact, all mainstream models of shallow water waves admit such kind of peaked solitary waves
△ Less
Submitted 19 April, 2012;
originally announced April 2012.
-
Two kinds of peaked solitary waves of the KdV, BBM and Boussinesq equations
Authors:
Shijun Liao
Abstract:
It is well-known that the celebrated Camassa-Holm equation has the peaked solitary waves, which have been not reported for other mainstream models of shallow water waves. In this letter, the closed-form solutions of peaked solitary waves of the KdV equation, the BBM equation and the Boussinesq equation are given for the first time. All of them have either a peakon or an anti-peakon. Each of them e…
▽ More
It is well-known that the celebrated Camassa-Holm equation has the peaked solitary waves, which have been not reported for other mainstream models of shallow water waves. In this letter, the closed-form solutions of peaked solitary waves of the KdV equation, the BBM equation and the Boussinesq equation are given for the first time. All of them have either a peakon or an anti-peakon. Each of them exactly satisfies the corresponding Rankine-Hogoniot jump condition and should be understood as weak solution. Therefore, the peaked solitary waves might be common for most of shallow water wave models, no matter whether or not they are integrable and/or admit breaking-wave solutions.
△ Less
Submitted 26 September, 2012; v1 submitted 18 March, 2012;
originally announced March 2012.
-
On the numerical simulation of propagation of micro-level inherent uncertainty for chaotic dynamic systems
Authors:
S. J. Liao
Abstract:
In this paper, an extremely accurate numerical algorithm, namely the "clean numerical simulation" (CNS), is proposed to accurately simulate the propagation of micro-level inherent physical uncertainty of chaotic dynamic systems. The chaotic Hamiltonian Hénon-Heiles system for motion of stars orbiting in a plane about the galactic center is used as an example to show its basic ideas and validity. B…
▽ More
In this paper, an extremely accurate numerical algorithm, namely the "clean numerical simulation" (CNS), is proposed to accurately simulate the propagation of micro-level inherent physical uncertainty of chaotic dynamic systems. The chaotic Hamiltonian Hénon-Heiles system for motion of stars orbiting in a plane about the galactic center is used as an example to show its basic ideas and validity. Based on Taylor expansion at rather high-order and MP (multiple precision) data in very high accuracy, the CNS approach can provide reliable trajectories of the chaotic system in a finite interval $t\in[0,T_c]$, together with an explicit estimation of the critical time $T_c$. Besides, the residual and round-off errors are verified and estimated carefully by means of different time-step $Δt$, different precision of data, and different order $M$ of Taylor expansion. In this way, the numerical noises of the CNS can be reduced to a required level, i.e. the CNS is a rigorous algorithm. It is illustrated that, for the considered problem, the truncation and round-off errors of the CNS can be reduced even to the level of $10^{-1244}$ and $10^{-1000}$, respectively, so that the micro-level inherent physical uncertainty of the initial condition (in the level of $10^{-60}$) of the Hénon-Heiles system can be investigated accurately. It is found that, due to the sensitive dependence on initial condition (SDIC) of chaos, the micro-level inherent physical uncertainty of the position and velocity of a star transfers into the macroscopic randomness of motion. Thus, chaos might be a bridge from the micro-level inherent physical uncertainty to the macroscopic randomness in nature. This might provide us a new explanation to the SDIC of chaos from the physical viewpoint.
△ Less
Submitted 24 December, 2012; v1 submitted 1 September, 2011;
originally announced September 2011.
-
Chaos: a bridge from microscopic uncertainty to macroscopic randomness
Authors:
S. J. Liao
Abstract:
It is traditionally believed that the macroscopic randomness has nothing to do with the micro-level uncertainty. Besides, the sensitive dependence on initial condition (SDIC) of Lorenz chaos has never been considered together with the so-called continuum-assumption of fluid (on which Lorenz equations are based), from physical and statistic viewpoints. A very fine numerical technique (Liao, 2009) w…
▽ More
It is traditionally believed that the macroscopic randomness has nothing to do with the micro-level uncertainty. Besides, the sensitive dependence on initial condition (SDIC) of Lorenz chaos has never been considered together with the so-called continuum-assumption of fluid (on which Lorenz equations are based), from physical and statistic viewpoints. A very fine numerical technique (Liao, 2009) with negligible truncation and round-off errors, called here the "clean numerical simulation" (CNS), is applied to investigate the propagation of the micro-level unavoidable uncertain fluctuation (caused by the continuum-assumption of fluid) of initial conditions for Lorenz equation with chaotic solutions. Our statistic analysis based on CNS computation of 10,000 samples shows that, due to the SDIC, the uncertainty of the micro-level statistic fluctuation of initial conditions transfers into the macroscopic randomness of chaos. This suggests that chaos might be a bridge from micro-level uncertainty to macroscopic randomness, and thus would be an origin of macroscopic randomness. We reveal in this article that, due to the SDIC of chaos and the inherent uncertainty of initial data, accurate long-term prediction of chaotic solution is not only impossible in mathematics but also has no physical meanings. This might provide us a new, different viewpoint to deepen and enrich our understandings about the SDIC of chaos.
△ Less
Submitted 8 January, 2012; v1 submitted 22 August, 2011;
originally announced August 2011.
-
On the homotopy multiple-variable method and its applications in the interactions of nonlinear gravity waves
Authors:
Shijun Liao
Abstract:
The basic ideas of a homotopy-based multiple-variable method is proposed and applied to investigate the nonlinear interactions of periodic traveling waves. Mathematically, this method does not depend upon any small physical parameters at all and thus is more general than the traditional multiple-scale perturbation techniques. Physically, it is found that, for a fully developed wave system, the amp…
▽ More
The basic ideas of a homotopy-based multiple-variable method is proposed and applied to investigate the nonlinear interactions of periodic traveling waves. Mathematically, this method does not depend upon any small physical parameters at all and thus is more general than the traditional multiple-scale perturbation techniques. Physically, it is found that, for a fully developed wave system, the amplitudes of all wave components are finite even if the wave resonance condition given by Phillips (1960) is exactly satisfied. Besides, it is revealed that there exist multiple resonant waves, and that the amplitudes of resonant wave may be much smaller than those of primary waves so that the resonant waves sometimes contain rather small part of wave energy. Furthermore, a wave resonance condition for arbitrary numbers of traveling waves with large wave amplitudes is given, which logically contains Phillips' four-wave resonance condition but opens a way to investigate the strongly nonlinear interaction of more than four traveling waves with large amplitudes. This work also illustrates that the homotopy multiple-variable method is helpful to gain solutions with important physical meanings of nonlinear problems, if the multiple variables are properly defined with clear physical meanings.
△ Less
Submitted 19 June, 2010; v1 submitted 30 May, 2010;
originally announced May 2010.
-
On the reliability of computed chaotic solutions of nonlinear differential equations
Authors:
Shijun Liao
Abstract:
In this paper a new concept, namely the critical predictable time $T_c$, is introduced to give a more precise description of computed chaotic solutions of nonlinear differential equations: it is suggested that computed chaotic solutions are unreliable and doubtable when $ t > T_c$. This provides us a strategy to detect reliable solution from a given computed result. In this way, the computationa…
▽ More
In this paper a new concept, namely the critical predictable time $T_c$, is introduced to give a more precise description of computed chaotic solutions of nonlinear differential equations: it is suggested that computed chaotic solutions are unreliable and doubtable when $ t > T_c$. This provides us a strategy to detect reliable solution from a given computed result. In this way, the computational phenomena, such as computational chaos (CC), computational periodicity (CP) and computational prediction uncertainty, which are mainly based on long-term properties of computed time series, can be completely avoided. So, this concept also provides us a time-scale to determine whether or not a particular time is long enough for a given nonlinear dynamic system. Besides, the influence of data inaccuracy and various numerical schemes on the critical predictable time is investigated in details by using symbolic computation software as a tool. A reliable chaotic solution of Lorenz equation in a rather large interval $0 \leq t < 1200$ non-dimensional Lorenz time units is obtained for the first time. It is found that the precision of initial condition and computed data at each time-step, which is mathematically necessary to get such a reliable chaotic solution in such a long time, is so high that it is physically impossible due to the Heisenberg uncertainty principle in quantum physics. This however provides us a so-called "precision paradox of chaos", which suggests that the prediction uncertainty of chaos is physically unavoidable, and that even the macroscopical phenomena might be essentially stochastic and thus could be described by probability more economically.
△ Less
Submitted 20 January, 2009;
originally announced January 2009.
