-
SVD-based Causal Emergence for Gaussian Iterative Systems
Authors:
Kaiwei Liu,
Linli Pan,
Zhipeng Wang,
Bing Yuan,
Jiang Zhang
Abstract:
Causal emergence (CE) based on effective information (EI) shows that macro-states can exhibit stronger causal effects than micro-states in dynamics. However, the identification of CE and the maximization of EI both rely on coarse-graining strategies, which is a key challenge. A recently proposed CE framework based on approximate dynamical reversibility utilizing singular value decomposition (SVD)…
▽ More
Causal emergence (CE) based on effective information (EI) shows that macro-states can exhibit stronger causal effects than micro-states in dynamics. However, the identification of CE and the maximization of EI both rely on coarse-graining strategies, which is a key challenge. A recently proposed CE framework based on approximate dynamical reversibility utilizing singular value decomposition (SVD) is independent of coarse-graining but is limited to transition probability matrices (TPM) in discrete states. To address this problem, this article proposes a pioneering CE quantification framework for Gaussian iterative systems (GIS), based on approximate dynamical reversibility derived from SVD of covariance matrices in forward and backward dynamics. The positive correlation between SVD-based and EI-based CE, along with the equivalence condition, are given analytically. After that, we can provide precise coarse-graining strategies directly from singular value spectrums and orthogonal matrices. This new framework can be applied to any dynamical system with continuous states and Gaussian noise, such as auto-regressive growth models, Markov Gaussian systems, and even SIR modeling by neural networks (NN). Numerical simulations on typical cases validate our theory and offer a new approach to studying the CE phenomenon, emphasizing noise and covariance over dynamical functions in both known models and machine learning.
△ Less
Submitted 12 February, 2025;
originally announced February 2025.
-
Emergence and Causality in Complex Systems: A Survey on Causal Emergence and Related Quantitative Studies
Authors:
Bing Yuan,
Zhang Jiang,
Aobo Lyu,
Jiayun Wu,
Zhipeng Wang,
Mingzhe Yang,
Kaiwei Liu,
Muyun Mou,
Peng Cui
Abstract:
Emergence and causality are two fundamental concepts for understanding complex systems. They are interconnected. On one hand, emergence refers to the phenomenon where macroscopic properties cannot be solely attributed to the cause of individual properties. On the other hand, causality can exhibit emergence, meaning that new causal laws may arise as we increase the level of abstraction. Causal emer…
▽ More
Emergence and causality are two fundamental concepts for understanding complex systems. They are interconnected. On one hand, emergence refers to the phenomenon where macroscopic properties cannot be solely attributed to the cause of individual properties. On the other hand, causality can exhibit emergence, meaning that new causal laws may arise as we increase the level of abstraction. Causal emergence theory aims to bridge these two concepts and even employs measures of causality to quantify emergence. This paper provides a comprehensive review of recent advancements in quantitative theories and applications of causal emergence. Two key problems are addressed: quantifying causal emergence and identifying it in data. Addressing the latter requires the use of machine learning techniques, thus establishing a connection between causal emergence and artificial intelligence. We highlighted that the architectures used for identifying causal emergence are shared by causal representation learning, causal model abstraction, and world model-based reinforcement learning. Consequently, progress in any of these areas can benefit the others. Potential applications and future perspectives are also discussed in the final section of the review.
△ Less
Submitted 25 February, 2024; v1 submitted 27 December, 2023;
originally announced December 2023.
-
Multivariate Spatiotemporal Hawkes Processes and Network Reconstruction
Authors:
Baichuan Yuan,
Hao Li,
Andrea L. Bertozzi,
P. Jeffrey Brantingham,
Mason A. Porter
Abstract:
There is often latent network structure in spatial and temporal data and the tools of network analysis can yield fascinating insights into such data. In this paper, we develop a nonparametric method for network reconstruction from spatiotemporal data sets using multivariate Hawkes processes. In contrast to prior work on network reconstruction with point-process models, which has often focused on e…
▽ More
There is often latent network structure in spatial and temporal data and the tools of network analysis can yield fascinating insights into such data. In this paper, we develop a nonparametric method for network reconstruction from spatiotemporal data sets using multivariate Hawkes processes. In contrast to prior work on network reconstruction with point-process models, which has often focused on exclusively temporal information, our approach uses both temporal and spatial information and does not assume a specific parametric form of network dynamics. This leads to an effective way of recovering an underlying network. We illustrate our approach using both synthetic networks and networks constructed from real-world data sets (a location-based social media network, a narrative of crime events, and violent gang crimes). Our results demonstrate that, in comparison to using only temporal data, our spatiotemporal approach yields improved network reconstruction, providing a basis for meaningful subsequent analysis --- such as community structure and motif analysis --- of the reconstructed networks.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Lyapunov Functions in Piecewise Linear Systems: From Fixed Point to Limit Cycle
Authors:
Yian Ma,
Ruoshi Yuan,
Yang Li,
Ping Ao,
Bo Yuan
Abstract:
This paper provides a first example of constructing Lyapunov functions in a class of piecewise linear systems with limit cycles. The method of construction helps analyze and control complex oscillating systems through novel geometric means. Special attention is stressed upon a problem not formerly solved: to impose consistent boundary conditions on the Lyapunov function in each linear region. By s…
▽ More
This paper provides a first example of constructing Lyapunov functions in a class of piecewise linear systems with limit cycles. The method of construction helps analyze and control complex oscillating systems through novel geometric means. Special attention is stressed upon a problem not formerly solved: to impose consistent boundary conditions on the Lyapunov function in each linear region. By successfully solving the problem, the authors construct continuous Lyapunov functions in the whole state space. It is further demonstrated that the Lyapunov functions constructed explain for the different bifurcations leading to the emergence of limit cycle oscillation.
△ Less
Submitted 28 June, 2013;
originally announced June 2013.
-
Potential Function in a Continuous Dissipative Chaotic System: Decomposition Scheme and Role of Strange Attractor
Authors:
Yian Ma,
Qijun Tan,
Ruoshi Yuan,
Bo Yuan,
Ping Ao
Abstract:
In this paper, we demonstrate, first in literature known to us, that potential functions can be constructed in continuous dissipative chaotic systems and can be used to reveal their dynamical properties. To attain this aim, a Lorenz-like system is proposed and rigorously proved chaotic for exemplified analysis. We explicitly construct a potential function monotonically decreasing along the system'…
▽ More
In this paper, we demonstrate, first in literature known to us, that potential functions can be constructed in continuous dissipative chaotic systems and can be used to reveal their dynamical properties. To attain this aim, a Lorenz-like system is proposed and rigorously proved chaotic for exemplified analysis. We explicitly construct a potential function monotonically decreasing along the system's dynamics, revealing the structure of the chaotic strange attractor. The potential function can have different forms of construction. We also decompose the dynamical system to explain for the different origins of chaotic attractor and strange attractor. Consequently, reasons for the existence of both chaotic nonstrange attractors and nonchaotic strange attractors are clearly discussed within current decomposition framework.
△ Less
Submitted 8 August, 2012;
originally announced August 2012.
-
Constructive Proof of Global Lyapunov Function as Potential Function
Authors:
Ruoshi Yuan,
Yian Ma,
Bo Yuan,
Ping Ao
Abstract:
We provide a constructive proof on the equivalence of two fundamental concepts: the global Lyapunov function in engineering and the potential function in physics, establishing a bridge between these distinct fields. This result suggests new approaches on the significant unsolved problem namely to construct Lyapunov functions for general nonlinear systems through the analogy with existing methods o…
▽ More
We provide a constructive proof on the equivalence of two fundamental concepts: the global Lyapunov function in engineering and the potential function in physics, establishing a bridge between these distinct fields. This result suggests new approaches on the significant unsolved problem namely to construct Lyapunov functions for general nonlinear systems through the analogy with existing methods on potential functions. In addition, we show another connection that the Lyapunov equation is a reduced form of the generalized Einstein relation for linear systems.
△ Less
Submitted 13 December, 2010;
originally announced December 2010.
