-
Optimal and Scalable Augmented Lagrangian preconditioners for Fictitious Domain problems
Authors:
Michele Benzi,
Marco Feder,
Luca Heltai,
Federica Mugnaioni
Abstract:
We present optimal and scalable preconditioning techniques to solve linear systems of equations with a block two-by-two and three-by-three structure arising from fictitious domain problems and from finite element discretizations of immersed boundary methods. In particular, we propose two augmented Lagrangian-based preconditioners to accelerate the convergence of iterative solvers for these two cla…
▽ More
We present optimal and scalable preconditioning techniques to solve linear systems of equations with a block two-by-two and three-by-three structure arising from fictitious domain problems and from finite element discretizations of immersed boundary methods. In particular, we propose two augmented Lagrangian-based preconditioners to accelerate the convergence of iterative solvers for these two classes of linear. We consider two relevant examples to illustrate the performance of these preconditioners when used in conjunction with flexible GMRES: the Poisson and the Stokes fictitious domain problems. A spectral analysis is established for both exact and inexact versions of these preconditioners. We show the effectiveness of the proposed approach and the robustness of our preconditioning strategy through extensive numerical tests in both two and three dimensions.
△ Less
Submitted 15 April, 2025;
originally announced April 2025.
-
A Lie algebra view of matrix splittings
Authors:
Michele Benzi,
Milo Viviani
Abstract:
In this paper we use some basic facts from the theory of (matrix) Lie groups and algebras to show that many of the classical matrix splittings used to construct stationary iterative methods and preconditioniers for Krylov subspace methods can be interpreted as linearizations of matrix factorizations. Moreover, we show that new matrix splittings are obtained when we specialize these splittings to s…
▽ More
In this paper we use some basic facts from the theory of (matrix) Lie groups and algebras to show that many of the classical matrix splittings used to construct stationary iterative methods and preconditioniers for Krylov subspace methods can be interpreted as linearizations of matrix factorizations. Moreover, we show that new matrix splittings are obtained when we specialize these splittings to some of the classical matrix groups and their Lie and Jordan algebras. As an example, we derive structured generalizations of the HSS (Hermitian/skew-Hermitian) iteration, and provide sufficient conditions for their convergence.
△ Less
Submitted 19 March, 2025;
originally announced March 2025.
-
Changing the ranking in eigenvector centrality of a weighted graph by small perturbations
Authors:
Michele Benzi,
Nicola Guglielmi
Abstract:
In this article, we consider eigenvector centrality for the nodes of a graph and study the robustness (and stability) of this popular centrality measure. For a given weighted graph $\G$ (both directed and undirected), we consider the associated weighted adiacency matrix $A$, which by definition is a non-negative matrix. Eigenvector centrality consists of ranking the elements of the graph according…
▽ More
In this article, we consider eigenvector centrality for the nodes of a graph and study the robustness (and stability) of this popular centrality measure. For a given weighted graph $\G$ (both directed and undirected), we consider the associated weighted adiacency matrix $A$, which by definition is a non-negative matrix. Eigenvector centrality consists of ranking the elements of the graph according to the corresponding entries of the Perron eigenvector of $A$, which is associated with the positive eigenvalue with largest modulus.
An indicator of the robustness of eigenvector centrality consists in looking for a nearby perturbed graph $\widetilde{\G}$, with the same structure as $\G$ (i.e., with the same vertices and edges), but with a weighted adiacency matrix $\widetilde A$ such that the highest $m$ entries ($m \ge 2$) of the Perron eigenvector of $\widetilde A$ coalesce, making the ranking at the highest level ambiguous. To compute a solution to this matrix nearness problem, a nested iterative algorithm is proposed that makes use of a constrained gradient system of matrix differential equations (possibly on a low-rank manifold) in the inner iteration and a one-dimensional optimization of the perturbation size in the outer iteration.
The proposed algorithm produces the {\em optimal} perturbation (i.e., the one with smallest Frobenius norm) of the graph, which causes the looked-for coalescence, which is a measure of the sensitivity of the graph. The methodology is formulated in terms of graphs but applies to any nonnegative matrix, with potential applications in fields like population models, consensus dynamics, economics, etc.
△ Less
Submitted 18 January, 2025;
originally announced January 2025.
-
Spectra and pseudospectra in the evaluation of material stability in phase field schemes
Authors:
Michele Benzi,
Daniele La Pegna,
Paolo Maria Mariano
Abstract:
We consider the dynamics of bodies with "active" microstructure described by vector-valued phase fields. For waves with time-varying amplitude, the associated evolution equation involves a matrix that can be non-normal, depending on the constitutive choices adopted for the microstructural actions associated with the considered phase field. The occurrence of non-normality requires to look at the ps…
▽ More
We consider the dynamics of bodies with "active" microstructure described by vector-valued phase fields. For waves with time-varying amplitude, the associated evolution equation involves a matrix that can be non-normal, depending on the constitutive choices adopted for the microstructural actions associated with the considered phase field. The occurrence of non-normality requires to look at the pseudospectrum of the considered matrix, namely the set of all possible eigenvalues of matrices in a $\varepsilon$-neighborhood of the matrix itself, because the eigenvalues of non-normal matrices can be very sensitive to small perturbations and therefore the spectral analysis alone would not be sufficient to distinguish with certainty between table and unstable behavior. We develop the relevant analyses in the case of quasicrystals for which the values of some constitutive parameters are not known or are uncertain from an experimental point of view, a circumstance suggesting parametric analyses. We find circumstances in which the pseudospectra obtained by means of the so-called structured perturbations predict instability when, instead, the spectral analysis indicates stability.
△ Less
Submitted 16 February, 2025; v1 submitted 27 October, 2024;
originally announced October 2024.
-
Estimation of spectral gaps for sparse symmetric matrices
Authors:
Michele Benzi,
Michele Rinelli,
Igor Simunec
Abstract:
In this paper we propose and analyze an algorithm for identifying spectral gaps of a real symmetric matrix $A$ by simultaneously approximating the traces of spectral projectors associated with multiple different spectral slices. Our method utilizes Hutchinson's stochastic trace estimator together with the Lanczos algorithm to approximate quadratic forms involving spectral projectors. Instead of fo…
▽ More
In this paper we propose and analyze an algorithm for identifying spectral gaps of a real symmetric matrix $A$ by simultaneously approximating the traces of spectral projectors associated with multiple different spectral slices. Our method utilizes Hutchinson's stochastic trace estimator together with the Lanczos algorithm to approximate quadratic forms involving spectral projectors. Instead of focusing on determining the gap between two particular consecutive eigenvalues of $A$, we aim to find all gaps that are wider than a specified threshold. By examining the problem from this perspective, and thoroughly analyzing both the Hutchinson and the Lanczos components of the algorithm, we obtain error bounds that allow us to determine the numbers of Hutchinson's sample vectors and Lanczos iterations needed to ensure the detection of all gaps above the target width with high probability. In particular, we conclude that the most efficient strategy is to always use a single random sample vector for Hutchinson's estimator and concentrate all computational effort in the Lanczos algorithm. Our numerical experiments demonstrate the efficiency and reliability of this approach.
△ Less
Submitted 20 October, 2024;
originally announced October 2024.
-
Modeling advection on distance-weighted directed networks
Authors:
Michele Benzi,
Fabio Durastante,
Francesco Zigliotto
Abstract:
In this paper we propose a model for describing advection dynamics on distance-weighted directed graphs. To this end we establish a set of key properties, or axioms, that a discrete advection operator should satisfy, and prove that there exists an essentially unique operator satisfying all such properties. Both infinite and finite networks are considered, as well as possible variants and extension…
▽ More
In this paper we propose a model for describing advection dynamics on distance-weighted directed graphs. To this end we establish a set of key properties, or axioms, that a discrete advection operator should satisfy, and prove that there exists an essentially unique operator satisfying all such properties. Both infinite and finite networks are considered, as well as possible variants and extensions. We illustrate the proposed model through examples, both analytical and numerical, and we describe an application to the simulation of a traffic network.
△ Less
Submitted 11 March, 2025; v1 submitted 15 October, 2024;
originally announced October 2024.
-
An augmented Lagrangian preconditioner for the control of the Navier--Stokes equations
Authors:
Santolo Leveque,
Michele Benzi,
Patrick E. Farrell
Abstract:
We address the solution of the distributed control problem for the steady, incompressible Navier--Stokes equations. We propose an inexact Newton linearization of the optimality conditions. Upon discretization by a finite element scheme, we obtain a sequence of large symmetric linear systems of saddle-point type. We use an augmented Lagrangian-based block triangular preconditioner in combination wi…
▽ More
We address the solution of the distributed control problem for the steady, incompressible Navier--Stokes equations. We propose an inexact Newton linearization of the optimality conditions. Upon discretization by a finite element scheme, we obtain a sequence of large symmetric linear systems of saddle-point type. We use an augmented Lagrangian-based block triangular preconditioner in combination with the flexible GMRES method at each Newton step. The preconditioner is applied inexactly via a suitable multigrid solver. Numerical experiments indicate that the resulting method appears to be fairly robust with respect to viscosity, mesh size, and the choice of regularization parameter when applied to 2D problems.
△ Less
Submitted 15 April, 2025; v1 submitted 9 August, 2024;
originally announced August 2024.
-
An augmented Lagrangian-based preconditioning technique for a class of block three-by-three linear systems
Authors:
Fatemeh P. A. Beik,
Michele Benzi
Abstract:
We propose an augmented Lagrangian-based preconditioner to accelerate the convergence of Krylov subspace methods applied to linear systems of equations with a block three-by-three structure such as those arising from mixed finite element discretizations of the coupled Stokes-Darcy flow problem. We analyze the spectrum of the preconditioned matrix and we show how the new preconditioner can be effic…
▽ More
We propose an augmented Lagrangian-based preconditioner to accelerate the convergence of Krylov subspace methods applied to linear systems of equations with a block three-by-three structure such as those arising from mixed finite element discretizations of the coupled Stokes-Darcy flow problem. We analyze the spectrum of the preconditioned matrix and we show how the new preconditioner can be efficiently applied. Numerical experiments are reported to illustrate the effectiveness of the preconditioner in conjunction with flexible GMRES for solving linear systems of equations arising from a 3D test problem.
△ Less
Submitted 24 October, 2023;
originally announced October 2023.
-
Accelerating iterative solvers via a two-dimensional minimum residual technique
Authors:
Fatemeh P. A. Beik,
Michele Benzi,
Mehdi Najafi-Kalyani
Abstract:
This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each sub-iterate is minimized over a certain two-dimensional subspace. Convergence properties of the proposed method are studied in detail. The approach is further d…
▽ More
This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each sub-iterate is minimized over a certain two-dimensional subspace. Convergence properties of the proposed method are studied in detail. The approach is further developed to solve (regularized) normal equations arising from the discretization of ill-posed problems. The results of numerical experiments are reported to illustrate the performance of exact and inexact variants of the method on several test problems from different application areas.
△ Less
Submitted 22 April, 2024; v1 submitted 22 March, 2023;
originally announced March 2023.
-
Computation of the von Neumann entropy of large matrices via trace estimators and rational Krylov methods
Authors:
Michele Benzi,
Michele Rinelli,
Igor Simunec
Abstract:
We consider the problem of approximating the von Neumann entropy of a large, sparse, symmetric positive semidefinite matrix $A$, defined as $\operatorname{tr}(f(A))$ where $f(x)=-x\log x$. After establishing some useful properties of this matrix function, we consider the use of both polynomial and rational Krylov subspace algorithms within two types of approximations methods, namely, randomized tr…
▽ More
We consider the problem of approximating the von Neumann entropy of a large, sparse, symmetric positive semidefinite matrix $A$, defined as $\operatorname{tr}(f(A))$ where $f(x)=-x\log x$. After establishing some useful properties of this matrix function, we consider the use of both polynomial and rational Krylov subspace algorithms within two types of approximations methods, namely, randomized trace estimators and probing techniques based on graph colorings. We develop error bounds and heuristics which are employed in the implementation of the algorithms. Numerical experiments on density matrices of different types of networks illustrate the performance of the methods.
△ Less
Submitted 22 June, 2023; v1 submitted 19 December, 2022;
originally announced December 2022.
-
Structural analysis of water networks
Authors:
Michele Benzi,
Isabella Daidone,
Chiara Faccio,
Laura Zanetti-Polzi
Abstract:
Liquid water, besides being fundamental for life on Earth, has long fascinated scientists due to several anomalies. Different hypotheses have been put forward to explain these peculiarities. The most accredited one foresees the presence in the supercooled region of two phases at different densities: the low-density liquid phase and the high-density liquid phase. In our previous work [Faccio et al.…
▽ More
Liquid water, besides being fundamental for life on Earth, has long fascinated scientists due to several anomalies. Different hypotheses have been put forward to explain these peculiarities. The most accredited one foresees the presence in the supercooled region of two phases at different densities: the low-density liquid phase and the high-density liquid phase. In our previous work [Faccio et al., J. Mol. Liq. 355 (2022): 118922], we showed that it is possible to identify these two forms in water networks through a computational approach based on molecular dynamics simulation and on the calculation of the total communicability of the associated graph, in which the nodes correspond to water molecules and the edges represent the connections (interactions) between molecules. In this paper, we present a more in-depth investigation of the application of graph-theory based approaches to the analysis of the structure of water networks. In particular, we investigate different connectivity and centrality measures and we report on the use of a variety of global metrics aimed at giving a topological and geometrical characterization of liquid water.
△ Less
Submitted 25 October, 2022;
originally announced October 2022.
-
Efficient preconditioners for solving dynamical optimal transport via interior point methods
Authors:
Enrico Facca,
Gabriele Todeschi,
Andrea Natale,
Michele Benzi
Abstract:
In this paper we address the numerical solution of the quadratic optimal transport problem in its dynamical form, the so-called Benamou-Brenier formulation. When solved using interior point methods, the main computational bottleneck is the solution of large saddle point linear systems arising from the associated Newton-Raphson scheme. The main purpose of this paper is to design efficient precondit…
▽ More
In this paper we address the numerical solution of the quadratic optimal transport problem in its dynamical form, the so-called Benamou-Brenier formulation. When solved using interior point methods, the main computational bottleneck is the solution of large saddle point linear systems arising from the associated Newton-Raphson scheme. The main purpose of this paper is to design efficient preconditioners to solve these linear systems via iterative methods. Among the proposed preconditioners, we introduce one based on the partial commutation of the operators that compose the dual Schur complement of these saddle point linear systems, which we refer as $\boldsymbol{B}\boldsymbol{B}$-preconditioner. A series of numerical tests show that the $\boldsymbol{B}\boldsymbol{B}$-preconditioner is the most efficient among those presented, despite a performance deterioration in the last steps of the interior point method. It is in fact the only one having a CPU-time that scales only slightly worse than linearly with respect to the number of unknowns used to discretize the problem.
△ Less
Submitted 19 January, 2024; v1 submitted 1 September, 2022;
originally announced September 2022.
-
Solving linear systems of the form $(A + γUU^T)\, {\bf x} = {\bf b}$ by preconditioned iterative methods
Authors:
Michele Benzi,
Chiara Faccio
Abstract:
We consider the iterative solution of large linear systems of equations in which the coefficient matrix is the sum of two terms, a sparse matrix $A$ and a possibly dense, rank deficient matrix of the form $γUU^T$, where $γ> 0$ is a parameter which in some applications may be taken to be 1. The matrix $A$ itself can be singular, but we assume that the symmetric part of $A$ is positive semidefinite…
▽ More
We consider the iterative solution of large linear systems of equations in which the coefficient matrix is the sum of two terms, a sparse matrix $A$ and a possibly dense, rank deficient matrix of the form $γUU^T$, where $γ> 0$ is a parameter which in some applications may be taken to be 1. The matrix $A$ itself can be singular, but we assume that the symmetric part of $A$ is positive semidefinite and that $A+γUU^T$ is nonsingular. Linear systems of this form arise frequently in fields like optimization, fluid mechanics, computational statistics, and others. We investigate preconditioning strategies based on an alternating splitting approach combined with the use of the Sherman-Morrison-Woodbury matrix identity. The potential of the proposed approach is demonstrated by means of numerical experiments on linear systems from different application areas.
△ Less
Submitted 7 November, 2022; v1 submitted 21 June, 2022;
originally announced June 2022.
-
Solving cubic matrix equations arising in conservative dynamics
Authors:
Michele Benzi,
Milo Viviani
Abstract:
In this paper we consider the spatial semi-discretization of conservative PDEs. Such finite dimensional approximations of infinite dimensional dynamical systems can be described as flows in suitable matrix spaces, which in turn leads to the need to solve polynomial matrix equations, a classical and important topic both in theoretical and in applied mathematics. Solving numerically these equations…
▽ More
In this paper we consider the spatial semi-discretization of conservative PDEs. Such finite dimensional approximations of infinite dimensional dynamical systems can be described as flows in suitable matrix spaces, which in turn leads to the need to solve polynomial matrix equations, a classical and important topic both in theoretical and in applied mathematics. Solving numerically these equations is challenging due to the presence of several conservation laws which our finite models incorporate and which must be retained while integrating the equations of motion. In the last thirty years, the theory of geometric integration has provided a variety of techniques to tackle this problem. These numerical methods require solving both direct and inverse problems in matrix spaces. We present three algorithms to solve a cubic matrix equation arising in the geometric integration of isospectral flows. This type of ODEs includes finite models of ideal hydrodynamics, plasma dynamics, and spin particles, which we use as test problems for our algorithms.
△ Less
Submitted 27 February, 2022; v1 submitted 24 November, 2021;
originally announced November 2021.
-
New results and open problems on subgraph centrality
Authors:
Nikita Deniskin,
Michele Benzi
Abstract:
Subgraph centrality, introduced by Estrada and Rodríguez-Velázquez in [12], has become a widely used centrality measure in the analysis of networks, with applications in biology, neuroscience, economics and many other fields. It is also worthy of study from a strictly mathematical point of view, in view of its connections to topics in spectral graph theory, number theory, analytic matrix functions…
▽ More
Subgraph centrality, introduced by Estrada and Rodríguez-Velázquez in [12], has become a widely used centrality measure in the analysis of networks, with applications in biology, neuroscience, economics and many other fields. It is also worthy of study from a strictly mathematical point of view, in view of its connections to topics in spectral graph theory, number theory, analytic matrix functions, and combinatorics. In this paper we present some new results and a list of open questions about subgraph centrality and other node centrality measures based on graph walks.
△ Less
Submitted 19 October, 2022; v1 submitted 12 November, 2021;
originally announced November 2021.
-
Refined decay bounds on the entries of spectral projectors associated with sparse Hermitian matrices
Authors:
Michele Benzi,
Michele Rinelli
Abstract:
Spectral projectors of Hermitian matrices play a key role in many applications, and especially in electronic structure computations. Linear scaling methods for gapped systems are based on the fact that these special matrix functions are localized, which means that the entries decay exponentially away from the main diagonal or with respect to more general sparsity patterns. The relation with the si…
▽ More
Spectral projectors of Hermitian matrices play a key role in many applications, and especially in electronic structure computations. Linear scaling methods for gapped systems are based on the fact that these special matrix functions are localized, which means that the entries decay exponentially away from the main diagonal or with respect to more general sparsity patterns. The relation with the sign function together with an integral representation is used to obtain new decay bounds, which turn out to be optimal in an asymptotic sense. The influence of isolated eigenvalues in the spectrum on the decay properties is also investigated and a superexponential behaviour is predicted.
△ Less
Submitted 22 October, 2021;
originally announced October 2021.
-
Rational Krylov methods for fractional diffusion problems on graphs
Authors:
Michele Benzi,
Igor Simunec
Abstract:
In this paper we propose a method to compute the solution to the fractional diffusion equation on directed networks, which can be expressed in terms of the graph Laplacian $L$ as a product $f(L^T) \boldsymbol{b}$, where $f$ is a non-analytic function involving fractional powers and $\boldsymbol{b}$ is a given vector. The graph Laplacian is a singular matrix, causing Krylov methods for…
▽ More
In this paper we propose a method to compute the solution to the fractional diffusion equation on directed networks, which can be expressed in terms of the graph Laplacian $L$ as a product $f(L^T) \boldsymbol{b}$, where $f$ is a non-analytic function involving fractional powers and $\boldsymbol{b}$ is a given vector. The graph Laplacian is a singular matrix, causing Krylov methods for $f(L^T) \boldsymbol{b}$ to converge more slowly. In order to overcome this difficulty and achieve faster convergence, we use rational Krylov methods applied to a desingularized version of the graph Laplacian, obtained with either a rank-one shift or a projection on a subspace.
△ Less
Submitted 15 December, 2020;
originally announced December 2020.
-
Fast Iterative Solution of the Optimal Transport Problem on Graphs
Authors:
Enrico Facca,
Michele Benzi
Abstract:
In this paper, we address the numerical solution of the Optimal Transport Problem on undirected weighted graphs, taking the shortest path distance as transport cost. The optimal solution is obtained from the long-time limit of the gradient descent dynamics. Among different time stepping procedures for the discretization of this dynamics, a backward Euler time stepping scheme combined with the inex…
▽ More
In this paper, we address the numerical solution of the Optimal Transport Problem on undirected weighted graphs, taking the shortest path distance as transport cost. The optimal solution is obtained from the long-time limit of the gradient descent dynamics. Among different time stepping procedures for the discretization of this dynamics, a backward Euler time stepping scheme combined with the inexact Newton-Raphson method results in a robust and accurate approach for the solution of the Optimal Transport Problem on graphs. It is found experimentally that the algorithm requires solving between $\mathcal{O}(1)$ and $\mathcal{O}(M^{0.36})$ linear systems involving weighted Laplacian matrices, where $M$ is the number of edges. These linear systems are solved via algebraic multigrid methods, resulting in an efficient solver for the Optimal Transport Problem on graphs.
△ Less
Submitted 28 September, 2020;
originally announced September 2020.
-
Nonlocal network dynamics via fractional graph Laplacians
Authors:
Michele Benzi,
Daniele Bertaccini,
Fabio Durastante,
Igor Simunec
Abstract:
We introduce nonlocal dynamics on directed networks through the construction of a fractional version of a nonsymmetric Laplacian for weighted directed graphs. Furthermore, we provide an analytic treatment of fractional dynamics for both directed and undirected graphs, showing the possibility of exploring the network employing random walks with jumps of arbitrary length. We also provide some exampl…
▽ More
We introduce nonlocal dynamics on directed networks through the construction of a fractional version of a nonsymmetric Laplacian for weighted directed graphs. Furthermore, we provide an analytic treatment of fractional dynamics for both directed and undirected graphs, showing the possibility of exploring the network employing random walks with jumps of arbitrary length. We also provide some examples of the applicability of the proposed dynamics, including consensus over multi-agent systems described by directed networks.
△ Less
Submitted 4 May, 2020; v1 submitted 16 December, 2019;
originally announced December 2019.
-
What is the meaning of the graph energy after all?
Authors:
Ernesto Estrada,
Michele Benzi
Abstract:
For a simple graph $G=(V,E)$ with eigenvalues of the adjacency matrix $λ_{1}\geqλ_{2}\geq\cdots\geqλ_{n}$, the energy of the graph is defined by $E(G)=\sum_{j=1}^{n}|λ_{j}|$. Myriads of papers have been published in the mathematical and chemistry literature about properties of this graph invariant due to its connection with the energy of (bipartite) conjugated molecules. However, a structural inte…
▽ More
For a simple graph $G=(V,E)$ with eigenvalues of the adjacency matrix $λ_{1}\geqλ_{2}\geq\cdots\geqλ_{n}$, the energy of the graph is defined by $E(G)=\sum_{j=1}^{n}|λ_{j}|$. Myriads of papers have been published in the mathematical and chemistry literature about properties of this graph invariant due to its connection with the energy of (bipartite) conjugated molecules. However, a structural interpretation of this concept in terms of the contributions of even and odd walks, and consequently on the contribution of subgraphs, is not yet known. Here, we find such interpretation and prove that the (adjacency) energy of any graph (bipartite or not) is a weighted sum of the traces of even powers of the adjacency matrix. We then use such result to find bounds for the energy in terms of subgraphs contributing to it. The new bounds are studied for some specific simple graphs, such as cycles and fullerenes. We observe that including contributions from subgraphs of sizes not bigger than 6 improves some of the best known bounds for the energy, and more importantly gives insights about the contributions of specific subgraphs to the energy of these graphs.
△ Less
Submitted 3 April, 2017;
originally announced April 2017.
-
Computation of generalized matrix functions
Authors:
Francesca Arrigo,
Michele Benzi,
Caterina Fenu
Abstract:
We develop numerical algorithms for the efficient evaluation of quantities associated with generalized matrix functions [J. B. Hawkins and A. Ben-Israel, Linear and Multilinear Algebra 1(2), 1973, pp. 163-171]. Our algorithms are based on Gaussian quadrature and Golub--Kahan bidiagonalization. Block variants are also investigated. Numerical experiments are performed to illustrate the effectiveness…
▽ More
We develop numerical algorithms for the efficient evaluation of quantities associated with generalized matrix functions [J. B. Hawkins and A. Ben-Israel, Linear and Multilinear Algebra 1(2), 1973, pp. 163-171]. Our algorithms are based on Gaussian quadrature and Golub--Kahan bidiagonalization. Block variants are also investigated. Numerical experiments are performed to illustrate the effectiveness and efficiency of our techniques in computing generalized matrix functions arising in the analysis of networks.
△ Less
Submitted 9 December, 2015; v1 submitted 4 December, 2015;
originally announced December 2015.
-
Core-satellite Graphs. Clustering, Assortativity and Spectral Properties
Authors:
Ernesto Estrada,
Michele Benzi
Abstract:
Core-satellite graphs (sometimes referred to as generalized friendship graphs) are an interesting class of graphs that generalize many well known types of graphs. In this paper we show that two popular clustering measures, the average Watts-Strogatz clustering coefficient and the transitivity index, diverge when the graph size increases. We also show that these graphs are disassortative. In additi…
▽ More
Core-satellite graphs (sometimes referred to as generalized friendship graphs) are an interesting class of graphs that generalize many well known types of graphs. In this paper we show that two popular clustering measures, the average Watts-Strogatz clustering coefficient and the transitivity index, diverge when the graph size increases. We also show that these graphs are disassortative. In addition, we completely describe the spectrum of the adjacency and Laplacian matrices associated with core-satellite graphs. Finally, we introduce the class of generalized core-satellite graphs, and we analyze the spectral properties of such graphs.
△ Less
Submitted 8 October, 2015;
originally announced October 2015.
-
Edge modification criteria for enhancing the communicability of digraphs
Authors:
Francesca Arrigo,
Michele Benzi
Abstract:
We introduce new broadcast and receive communicability indices that can be used as global measures of how effectively information is spread in a directed network. Furthermore, we describe fast and effective criteria for the selection of edges to be added to (or deleted from) a given directed network so as to enhance these network communicability measures. Numerical experiments illustrate the effec…
▽ More
We introduce new broadcast and receive communicability indices that can be used as global measures of how effectively information is spread in a directed network. Furthermore, we describe fast and effective criteria for the selection of edges to be added to (or deleted from) a given directed network so as to enhance these network communicability measures. Numerical experiments illustrate the effectiveness of the proposed techniques.
△ Less
Submitted 17 November, 2015; v1 submitted 5 August, 2015;
originally announced August 2015.
-
Approximation of functions of large matrices with Kronecker structure
Authors:
Michele Benzi,
Valeria Simoncini
Abstract:
We consider the numerical approximation of $f({\cal A})b$ where $b\in{\mathbb R}^{N}$ and $\cal A$ is the sum of Kronecker products, that is ${\cal A}=M_2 \otimes I + I \otimes M_1\in{\mathbb R}^{N\times N}$. Here $f$ is a regular function such that $f({\cal A})$ is well defined. We derive a computational strategy that significantly lowers the memory requirements and computational efforts of the s…
▽ More
We consider the numerical approximation of $f({\cal A})b$ where $b\in{\mathbb R}^{N}$ and $\cal A$ is the sum of Kronecker products, that is ${\cal A}=M_2 \otimes I + I \otimes M_1\in{\mathbb R}^{N\times N}$. Here $f$ is a regular function such that $f({\cal A})$ is well defined. We derive a computational strategy that significantly lowers the memory requirements and computational efforts of the standard approximations, with special emphasis on the exponential function, for which the new procedure becomes particularly advantageous. Our findings are illustrated by numerical experiments with typical functions used in applications.
△ Less
Submitted 9 March, 2015;
originally announced March 2015.
-
Decay bounds for functions of matrices with banded or Kronecker structure
Authors:
Michele Benzi,
Valeria Simoncini
Abstract:
We present decay bounds for a broad class of Hermitian matrix functions where the matrix argument is banded or a Kronecker sum of banded matrices. Besides being significantly tighter than previous estimates, the new bounds closely capture the actual (non-monotonic) decay behavior of the entries of functions of matrices with Kronecker sum structure. We also discuss extensions to more general sparse…
▽ More
We present decay bounds for a broad class of Hermitian matrix functions where the matrix argument is banded or a Kronecker sum of banded matrices. Besides being significantly tighter than previous estimates, the new bounds closely capture the actual (non-monotonic) decay behavior of the entries of functions of matrices with Kronecker sum structure. We also discuss extensions to more general sparse matrices.
△ Less
Submitted 29 January, 2015;
originally announced January 2015.
-
Updating and downdating techniques for optimizing network communicability
Authors:
Francesca Arrigo,
Michele Benzi
Abstract:
The total communicability of a network (or graph) is defined as the sum of the entries in the exponential of the adjacency matrix of the network, possibly normalized by the number of nodes. This quantity offers a good measure of how easily information spreads across the network, and can be useful in the design of networks having certain desirable properties. The total communicability can be comput…
▽ More
The total communicability of a network (or graph) is defined as the sum of the entries in the exponential of the adjacency matrix of the network, possibly normalized by the number of nodes. This quantity offers a good measure of how easily information spreads across the network, and can be useful in the design of networks having certain desirable properties. The total communicability can be computed quickly even for large networks using techniques based on the Lanczos algorithm.
In this work we introduce some heuristics that can be used to add, delete, or rewire a limited number of edges in a given sparse network so that the modified network has a large total communicability. To this end, we introduce new edge centrality measures which can be used to guide in the selection of edges to be added or removed.
Moreover, we show experimentally that the total communicability provides an effective and easily computable measure of how "well-connected" a sparse network is.
△ Less
Submitted 20 August, 2015; v1 submitted 20 October, 2014;
originally announced October 2014.
-
On the limiting behavior of parameter-dependent network centrality measures
Authors:
Michele Benzi,
Christine Klymko
Abstract:
We consider a broad class of walk-based, parameterized node centrality measures for network analysis. These measures are expressed in terms of functions of the adjacency matrix and generalize various well-known centrality indices, including Katz and subgraph centrality. We show that the parameter can be "tuned" to interpolate between degree and eigenvector centrality, which appear as limiting case…
▽ More
We consider a broad class of walk-based, parameterized node centrality measures for network analysis. These measures are expressed in terms of functions of the adjacency matrix and generalize various well-known centrality indices, including Katz and subgraph centrality. We show that the parameter can be "tuned" to interpolate between degree and eigenvector centrality, which appear as limiting cases. Our analysis helps explain certain correlations often observed between the rankings obtained using different centrality measures, and provides some guidance for the tuning of parameters. We also highlight the roles played by the spectral gap of the adjacency matrix and by the number of triangles in the network. Our analysis covers both undirected and directed networks, including weighted ones. A brief discussion of PageRank is also given.
△ Less
Submitted 30 April, 2015; v1 submitted 23 December, 2013;
originally announced December 2013.
-
Decay properties for functions of matrices over $C^*$-algebras
Authors:
Michele Benzi,
Paola Boito
Abstract:
We extend previous results on the exponential off-diagonal decay of the entries of analytic functions of banded and sparse matrices to the case where the matrix entries are elements of a $C^*$-algebra.
We extend previous results on the exponential off-diagonal decay of the entries of analytic functions of banded and sparse matrices to the case where the matrix entries are elements of a $C^*$-algebra.
△ Less
Submitted 26 July, 2013;
originally announced July 2013.
-
Total communicability as a centrality measure
Authors:
Michele Benzi,
Christine Klymko
Abstract:
We examine a node centrality measure based on the notion of total communicability, defined in terms of the row sums of the exponential of the adjacency matrix of the network. We argue that this is a natural metric for ranking nodes in a network, and we point out that it can be computed very rapidly even in the case of large networks. Furthermore, we propose the total sum of node communicabilities…
▽ More
We examine a node centrality measure based on the notion of total communicability, defined in terms of the row sums of the exponential of the adjacency matrix of the network. We argue that this is a natural metric for ranking nodes in a network, and we point out that it can be computed very rapidly even in the case of large networks. Furthermore, we propose the total sum of node communicabilities as a useful measure of network connectivity. Extensive numerical studies are conducted in order to compare this centrality measure with the closely related ones of subgraph centrality [E. Estrada and J. A. Rodriguez-Velazquez, Phys. Rev. E, 71 (2005), 056103] and Katz centrality [L. Katz, Psychometrica, 18 (1953), pp. 39-43]. Both synthetic and real-world networks are used in the computations.
△ Less
Submitted 4 April, 2013; v1 submitted 27 February, 2013;
originally announced February 2013.
-
Decay properties of spectral projectors with applications to electronic structure
Authors:
Michele Benzi,
Paola Boito,
Nader Razouk
Abstract:
Motivated by applications in quantum chemistry and solid state physics, we apply general results from approximation theory and matrix analysis to the study of the decay properties of spectral projectors associated with large and sparse Hermitian matrices. Our theory leads to a rigorous proof of the exponential off-diagonal decay ("nearsightedness") for the density matrix of gapped systems at zero…
▽ More
Motivated by applications in quantum chemistry and solid state physics, we apply general results from approximation theory and matrix analysis to the study of the decay properties of spectral projectors associated with large and sparse Hermitian matrices. Our theory leads to a rigorous proof of the exponential off-diagonal decay ("nearsightedness") for the density matrix of gapped systems at zero electronic temperature in both orthogonal and non-orthogonal representations, thus providing a firm theoretical basis for the possibility of linear scaling methods in electronic structure calculations for non-metallic systems. We further discuss the case of density matrices for metallic systems at positive electronic temperature. A few other possible applications are also discussed.
△ Less
Submitted 18 March, 2012;
originally announced March 2012.
-
Ranking hubs and authorities using matrix functions
Authors:
Michele Benzi,
Ernesto Estrada,
Christine Klymko
Abstract:
The notions of subgraph centrality and communicability, based on the exponential of the adjacency matrix of the underlying graph, have been effectively used in the analysis of undirected networks. In this paper we propose an extension of these measures to directed networks, and we apply them to the problem of ranking hubs and authorities. The extension is achieved by bipartization, i.e., the direc…
▽ More
The notions of subgraph centrality and communicability, based on the exponential of the adjacency matrix of the underlying graph, have been effectively used in the analysis of undirected networks. In this paper we propose an extension of these measures to directed networks, and we apply them to the problem of ranking hubs and authorities. The extension is achieved by bipartization, i.e., the directed network is mapped onto a bipartite undirected network with twice as many nodes in order to obtain a network with a symmetric adjacency matrix. We explicitly determine the exponential of this adjacency matrix in terms of the adjacency matrix of the original, directed network, and we give an interpretation of centrality and communicability in this new context, leading to a technique for ranking hubs and authorities. The matrix exponential method for computing hubs and authorities is compared to the well known HITS algorithm, both on small artificial examples and on more realistic real-world networks. A few other ranking algorithms are also discussed and compared with our technique. The use of Gaussian quadrature rules for calculating hub and authority scores is discussed.
△ Less
Submitted 1 October, 2012; v1 submitted 15 January, 2012;
originally announced January 2012.
