-
Efficient Information Aggregation: Optimal Structure of Signal Networks
Authors:
Bernd Heidergott,
Frank den Hollander,
Ines Lindner,
Azadeh Parvaneh
Abstract:
This paper develops a mathematical framework to study signal networks, in which nodes can be active or inactive, and their activation or deactivation is driven by external signals and the states of the nodes to which they are connected via links. The focus is on determining the optimal number of key nodes (= highly connected and structurally important nodes) required to represent the global activa…
▽ More
This paper develops a mathematical framework to study signal networks, in which nodes can be active or inactive, and their activation or deactivation is driven by external signals and the states of the nodes to which they are connected via links. The focus is on determining the optimal number of key nodes (= highly connected and structurally important nodes) required to represent the global activation state of the network accurately. Motivated by neuroscience, medical science, and social science examples, we describe the node dynamics as a continuous-time inhomogeneous Markov process. Under mean-field and homogeneity assumptions, appropriate for large scale-free and disassortative signal networks, we derive differential equations characterising the global activation behaviour and compute the expected hitting time to network triggering. Analytical and numerical results show that two or three key nodes are typically sufficient to approximate the overall network state well, balancing sensitivity and robustness. Our findings provide insight into how natural systems can efficiently aggregate information by exploiting minimal structural components.
△ Less
Submitted 27 May, 2025;
originally announced May 2025.
-
A Pseudo-Gradient Approach for Model-free Markov Chain Optimization
Authors:
Nanne A. Dieleman,
Joost Berkhout,
Bernd Heidergott
Abstract:
We develop a first-order (pseudo-)gradient approach for optimizing functions over the stationary distribution of discrete-time Markov chains (DTMC). We give insights into why solving this optimization problem is challenging and show how transformations can be used to circumvent the hard constraints inherent in the optimization problem. The optimization framework is model-free since no explicit mod…
▽ More
We develop a first-order (pseudo-)gradient approach for optimizing functions over the stationary distribution of discrete-time Markov chains (DTMC). We give insights into why solving this optimization problem is challenging and show how transformations can be used to circumvent the hard constraints inherent in the optimization problem. The optimization framework is model-free since no explicit model of the interdependence of the row elements of the Markov chain transition matrix is required. Upon the transformation we build an extension of Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm, called stochastic matrix SPSA (SM-SPSA) to solve the optimization problem. The performance of the SM-SPSA gradient search is compared with a benchmark commercial solver. Numerical examples show that SM-SPSA scales better which makes it the preferred solution method for large problem instances. We also apply the algorithm to the maximization of web-page rankings in web-graphs based on a real-life data set. As we explain in the paper, when applying a first-order gradient search one typically encounters a phenomenon which we call ``infliction points," that is, jumps in the optimization trajectories between periods of almost stationary behavior that slow down the optimization. We propose a heuristic for avoiding such infliction points and present a metastudy on a wide range of networks showing the positive effect of our heuristic on the convergence properties of SM-SPSA gradient search.
△ Less
Submitted 20 July, 2024;
originally announced July 2024.
-
A First-Order Gradient Approach for the Connectivity Optimization of Markov Chains
Authors:
Christian P. C. Franssen,
Alessandro Zocca,
Bernd F. Heidergott
Abstract:
Graphs are commonly used to model various complex systems, including social networks, power grids, transportation networks, and biological systems. In many applications, the connectivity of these networks can be expressed through the Mean First Passage Times (MFPTs) of a Markov chain modeling a random walker on the graph. In this paper, we generalize the network metrics based on Markov chains' MFP…
▽ More
Graphs are commonly used to model various complex systems, including social networks, power grids, transportation networks, and biological systems. In many applications, the connectivity of these networks can be expressed through the Mean First Passage Times (MFPTs) of a Markov chain modeling a random walker on the graph. In this paper, we generalize the network metrics based on Markov chains' MFPTs and extend them to networks affected by uncertainty, in which edges may fail and hence not be present according to a pre-determined stochastic model. To find optimally connected Markov chains, we present a parameterization-free method for optimizing the MFPTs of the Markov chain. More specifically, we present an efficient Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm in the context of Markov chain optimization. The proposed algorithm is suitable for both fixed and random networks. Using various numerical experiments, we demonstrate scalability compared to established benchmarks. Importantly, our algorithm finds an optimal solution without requiring prior knowledge of edge failure probabilities, allowing for an online optimization approach.
△ Less
Submitted 9 May, 2025; v1 submitted 18 March, 2024;
originally announced March 2024.
-
A Critical Account of Perturbation Analysis of Markov Chains
Authors:
Karim Abbas,
Joost Berkhout,
Bernd Heidergott
Abstract:
Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite and denumerable Markov chains and introduces new bounds based on series expansions. We discuss a series of examples to illustrate the applicability and numerical…
▽ More
Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite and denumerable Markov chains and introduces new bounds based on series expansions. We discuss a series of examples to illustrate the applicability and numerical efficiency of the various bounds. Specifically, we address the question on how the bounds developed for finite Markov chains behave as the size of the system grows. In addition, we provide for the first time an analysis of the relative error of these bounds. For the case of a scaled perturbation we show that perturbation bounds can be used to analyze stability of a stable Markov chain with respect to perturbation with an unstable chain.
△ Less
Submitted 14 September, 2016;
originally announced September 2016.
-
Differentiation via Logarithmic Expansions
Authors:
Michael C. Fu,
Bernd Heidergott,
Haralambie Leahu,
Felisa Vazquez-Abad
Abstract:
In this note, we introduce a new finite difference approximation called the Black-Box Logarithmic Expansion Numerical Derivative (BLEND) algorithm, which is based on a formal logarithmic expansion of the differentiation operator. BLEND capitalizes on parallelization and provides derivative approximations of arbitrarily precision, i.e., our analysis can be used to determine the number of terms in t…
▽ More
In this note, we introduce a new finite difference approximation called the Black-Box Logarithmic Expansion Numerical Derivative (BLEND) algorithm, which is based on a formal logarithmic expansion of the differentiation operator. BLEND capitalizes on parallelization and provides derivative approximations of arbitrarily precision, i.e., our analysis can be used to determine the number of terms in the series expansion to guarantee a specified number of decimal places of accuracy. Furthermore, in the vector setting, the complexity of the resulting directional derivative is independent of the dimension of the parameter.
△ Less
Submitted 28 August, 2016;
originally announced August 2016.
