Showing 1–10 of 10 results for author: Singer, S

Nearly optimal scaling in the SR decomposition

Authors: Heike Fassbender, Miroslav Rozloznik, Sanja Singer

Abstract: In this paper we analyze the nearly optimal block diagonal scalings of the rows of one factor and the columns of the other factor in the triangular form of the SR decomposition. The result is a block generalization of the result of the van der Sluis about the almost optimal diagonal scalings of the general rectangular matrices. In this paper we analyze the nearly optimal block diagonal scalings of the rows of one factor and the columns of the other factor in the triangular form of the SR decomposition. The result is a block generalization of the result of the van der Sluis about the almost optimal diagonal scalings of the general rectangular matrices. △ Less

Submitted 7 April, 2020; originally announced April 2020.

MSC Class: 65F25 65F35 65F05

A Kogbetliantz-type algorithm for the hyperbolic SVD

Authors: Vedran Novaković, Sanja Singer

Abstract: In this paper a two-sided, parallel Kogbetliantz-type algorithm for the hyperbolic singular value decomposition (HSVD) of real and complex square matrices is developed, with a single assumption that the input matrix, of order $n$, admits such a decomposition into the product of a unitary, a non-negative diagonal, and a $J$-unitary matrix, where $J$ is a given diagonal matrix of positive and negati… ▽ More In this paper a two-sided, parallel Kogbetliantz-type algorithm for the hyperbolic singular value decomposition (HSVD) of real and complex square matrices is developed, with a single assumption that the input matrix, of order $n$, admits such a decomposition into the product of a unitary, a non-negative diagonal, and a $J$-unitary matrix, where $J$ is a given diagonal matrix of positive and negative signs. When $J=\pm I$, the proposed algorithm computes the ordinary SVD. The paper's most important contribution -- a derivation of formulas for the HSVD of $2\times 2$ matrices -- is presented first, followed by the details of their implementation in floating-point arithmetic. Next, the effects of the hyperbolic transformations on the columns of the iteration matrix are discussed. These effects then guide a redesign of the dynamic pivot ordering, being already a well-established pivot strategy for the ordinary Kogbetliantz algorithm, for the general, $n\times n$ HSVD. A heuristic but sound convergence criterion is then proposed, which contributes to high accuracy demonstrated in the numerical testing results. Such a $J$-Kogbetliantz algorithm as presented here is intrinsically slow, but is nevertheless usable for matrices of small orders. △ Less

Submitted 6 October, 2021; v1 submitted 14 March, 2020; originally announced March 2020.

Comments: Accepted for publication in Numerical Algorithms. This version slightly differs from the accepted one, with several small corrections and an alternative (hopefully more stable) data server listed

MSC Class: 65F15 (Primary) 65Y05; 15A18 (Secondary)

Journal ref: Numer. Algoritms 90 (2022), 2; 523-561

Implicit Hari--Zimmermann algorithm for the generalized SVD on the GPUs

Authors: Vedran Novaković, Sanja Singer

Abstract: A parallel, blocked, one-sided Hari--Zimmermann algorithm for the generalized singular value decomposition (GSVD) of a real or a complex matrix pair $(F,G)$ is here proposed, where $F$ and $G$ have the same number of columns, and are both of the full column rank. The algorithm targets either a single graphics processing unit (GPU), or a cluster of those, performs all non-trivial computation exclus… ▽ More A parallel, blocked, one-sided Hari--Zimmermann algorithm for the generalized singular value decomposition (GSVD) of a real or a complex matrix pair $(F,G)$ is here proposed, where $F$ and $G$ have the same number of columns, and are both of the full column rank. The algorithm targets either a single graphics processing unit (GPU), or a cluster of those, performs all non-trivial computation exclusively on the GPUs, requires the minimal amount of memory to be reasonably expected, scales acceptably with the increase of the number of GPUs available, and guarantees the reproducible, bitwise identical output of the runs repeated over the same input and with the same number of GPUs. △ Less

Submitted 13 October, 2020; v1 submitted 30 August, 2019; originally announced September 2019.

Comments: A minor revision of the revised submission, with the supplementary material attached

MSC Class: 65F15; 65F25; 65Y05; 65Y10

Journal ref: Int. J. High Perform. Comput. Appl. 35 (2021), 2; 170-205

The antitriangular factorization of skew-symmetric matrices

Authors: Sanja Singer

Abstract: In this paper we develop algorithms for orthogonal similarity transformations of skew-symmetric matrices to simpler forms. The first algorithm is similar to the algorithm for the block antitriangular factorization of symmetric matrices, but in the case of skew-symmetric matrices, an antitriangular form is always obtained. Moreover, a simple two-sided permutation of the antitriangular form transfor… ▽ More In this paper we develop algorithms for orthogonal similarity transformations of skew-symmetric matrices to simpler forms. The first algorithm is similar to the algorithm for the block antitriangular factorization of symmetric matrices, but in the case of skew-symmetric matrices, an antitriangular form is always obtained. Moreover, a simple two-sided permutation of the antitriangular form transforms the matrix into a multi-arrowhead matrix. In addition, we show that the block antitriangular form of the skew-Hermitian matrices has the same structure as the block antitriangular form of the symmetric matrices. △ Less

Submitted 2 May, 2020; v1 submitted 30 August, 2019; originally announced September 2019.

Comments: Corrected Author's Accepted Manuscript. For the supplementary material see https://github.com/venovako/ATFact repository

MSC Class: 15A23 (Primary) 15B57; 65F30 (Secondary)

Journal ref: Appl. Math. Comput. 381 (2020), 125263

The LAPW method with eigendecomposition based on the Hari--Zimmermann generalized hyperbolic SVD

Authors: Sanja Singer, Edoardo Di Napoli, Vedran Novaković, Gayatri Čaklović

Abstract: In this paper we propose an accurate, highly parallel algorithm for the generalized eigendecomposition of a matrix pair $(H, S)$, given in a factored form $(F^{\ast} J F, G^{\ast} G)$. Matrices $H$ and $S$ are generally complex and Hermitian, and $S$ is positive definite. This type of matrices emerges from the representation of the Hamiltonian of a quantum mechanical system in terms of an overcomp… ▽ More In this paper we propose an accurate, highly parallel algorithm for the generalized eigendecomposition of a matrix pair $(H, S)$, given in a factored form $(F^{\ast} J F, G^{\ast} G)$. Matrices $H$ and $S$ are generally complex and Hermitian, and $S$ is positive definite. This type of matrices emerges from the representation of the Hamiltonian of a quantum mechanical system in terms of an overcomplete set of basis functions. This expansion is part of a class of models within the broad field of Density Functional Theory, which is considered the golden standard in condensed matter physics. The overall algorithm consists of four phases, the second and the fourth being optional, where the two last phases are computation of the generalized hyperbolic SVD of a complex matrix pair $(F,G)$, according to a given matrix $J$ defining the hyperbolic scalar product. If $J = I$, then these two phases compute the GSVD in parallel very accurately and efficiently. △ Less

Submitted 22 June, 2020; v1 submitted 19 July, 2019; originally announced July 2019.

Comments: The supplementary material is available at https://web.math.pmf.unizg.hr/mfbda/papers/sm-SISC.pdf due to its size. This revised manuscript is currently being considered for publication

MSC Class: 65F15; 65F25; 65Y05; 65Z05

Journal ref: SIAM J. Sci. Comput. 42 (2020), C265-C293

Sensitivity of the Heat Transfer Coefficient Calculation

Authors: Sasa Singer

Abstract: The purpose of the Liscic/Petrofer probe is to determine the cooling intensity during liquid quenching in laboratory and workshop environments. The surface heat transfer coefficient is calculated by the one-dimensional finite volume method from the smoothed temperature curve, measured at a near-surface point in the probe. Smoothed reference temperature curves for oil and water, based on measuremen… ▽ More The purpose of the Liscic/Petrofer probe is to determine the cooling intensity during liquid quenching in laboratory and workshop environments. The surface heat transfer coefficient is calculated by the one-dimensional finite volume method from the smoothed temperature curve, measured at a near-surface point in the probe. Smoothed reference temperature curves for oil and water, based on measurements made by the probe, are used in a series of numerical experiments to investigate the sensitivity of the calculation with respect to various input parameters of the problem, such as: thermal properties of the material, the near-surface thermocouple position, and the diameter of the probe. These results are relevant for other liquid quenchants, at least qualitatively, if not quantitatively. A similar type of analysis is conducted with respect to the variation of numerical simulation parameters in the finite volume method---the choice of space and time steps for problem discretization. When the input curves are sufficiently smooth, the method itself is very reliable. △ Less

Submitted 12 January, 2014; originally announced January 2014.

Comments: 40 pages, 46 figures, submitted to Materials Performance and Characterization

MSC Class: 80A20; 80A23 (Primary) 65M32 (Secondary)

Three-Level Parallel J-Jacobi Algorithms for Hermitian Matrices

Authors: Sanja Singer, Sasa Singer, Vedran Novakovic, Davor Davidovic, Kresimir Bokulic, Aleksandar Uscumlic

Abstract: The paper describes several efficient parallel implementations of the one-sided hyperbolic Jacobi-type algorithm for computing eigenvalues and eigenvectors of Hermitian matrices. By appropriate blocking of the algorithms an almost ideal load balancing between all available processors/cores is obtained. A similar blocking technique can be used to exploit local cache memory of each processor to furt… ▽ More The paper describes several efficient parallel implementations of the one-sided hyperbolic Jacobi-type algorithm for computing eigenvalues and eigenvectors of Hermitian matrices. By appropriate blocking of the algorithms an almost ideal load balancing between all available processors/cores is obtained. A similar blocking technique can be used to exploit local cache memory of each processor to further speed up the process. Due to diversity of modern computer architectures, each of the algorithms described here may be the method of choice for a particular hardware and a given matrix size. All proposed block algorithms compute the eigenvalues with relative accuracy similar to the original non-blocked Jacobi algorithm. △ Less

Submitted 24 August, 2010; originally announced August 2010.

Comments: Submitted for publication

MSC Class: 65F15 (Primary) 65Y05; 65Y20; 46C20; 68W10 (Secondary) ACM Class: G.1.3; G.4

Journal ref: Appl. Math. Comput. 218 (2012) 5704-5725

A GPU-based hyperbolic SVD algorithm

Authors: Vedran Novakovic, Sanja Singer

Abstract: A one-sided Jacobi hyperbolic singular value decomposition (HSVD) algorithm, using a massively parallel graphics processing unit (GPU), is developed. The algorithm also serves as the final stage of solving a symmetric indefinite eigenvalue problem. Numerical testing demonstrates the gains in speed and accuracy over sequential and MPI-parallelized variants of similar Jacobi-type HSVD algorithms. Fi… ▽ More A one-sided Jacobi hyperbolic singular value decomposition (HSVD) algorithm, using a massively parallel graphics processing unit (GPU), is developed. The algorithm also serves as the final stage of solving a symmetric indefinite eigenvalue problem. Numerical testing demonstrates the gains in speed and accuracy over sequential and MPI-parallelized variants of similar Jacobi-type HSVD algorithms. Finally, possibilities of hybrid CPU--GPU parallelism are discussed. △ Less

Submitted 25 April, 2011; v1 submitted 7 August, 2010; originally announced August 2010.

Comments: Accepted for publication in BIT Numerical Mathematics

MSC Class: 65F15 (Primary) 65Y05; 65Y10 (Secondary) ACM Class: G.1.3; G.4

Journal ref: BIT 51 (2011) 1009-1030

Novel Modifications of Parallel Jacobi Algorithms

Authors: Sanja Singer, Sasa Singer, Vedran Novakovic, Aleksandar Uscumlic, Vedran Dunjko

Abstract: We describe two main classes of one-sided trigonometric and hyperbolic Jacobi-type algorithms for computing eigenvalues and eigenvectors of Hermitian matrices. These types of algorithms exhibit significant advantages over many other eigenvalue algorithms. If the matrices permit, both types of algorithms compute the eigenvalues and eigenvectors with high relative accuracy. We present novel parall… ▽ More We describe two main classes of one-sided trigonometric and hyperbolic Jacobi-type algorithms for computing eigenvalues and eigenvectors of Hermitian matrices. These types of algorithms exhibit significant advantages over many other eigenvalue algorithms. If the matrices permit, both types of algorithms compute the eigenvalues and eigenvectors with high relative accuracy. We present novel parallelization techniques for both trigonometric and hyperbolic classes of algorithms, as well as some new ideas on how pivoting in each cycle of the algorithm can improve the speed of the parallel one-sided algorithms. These parallelization approaches are applicable to both distributed-memory and shared-memory machines. The numerical testing performed indicates that the hyperbolic algorithms may be superior to the trigonometric ones, although, in theory, the latter seem more natural. △ Less

Submitted 17 May, 2011; v1 submitted 1 August, 2010; originally announced August 2010.

Comments: Accepted for publication in Numerical Algorithms

MSC Class: 68W10 (Primary) 65F15; 65Y05; 65Y20 (Secondary) ACM Class: G.1.3; G.4

Journal ref: Numer. Algorithms 59 (2012) 1-27

Estimates for the Spectral Condition Number of Cardinal B-Spline Collocation Matrices (Long version)

Authors: Vedran Novakovic, Sanja Singer, Sasa Singer

Abstract: The famous de Boor conjecture states that the condition of the polynomial B-spline collocation matrix at the knot averages is bounded independently of the knot sequence, i.e., depends only on the spline degree. For highly nonuniform knot meshes, like geometric meshes, the conjecture is known to be false. As an effort towards finding an answer for uniform meshes, we investigate the spectral conditi… ▽ More The famous de Boor conjecture states that the condition of the polynomial B-spline collocation matrix at the knot averages is bounded independently of the knot sequence, i.e., depends only on the spline degree. For highly nonuniform knot meshes, like geometric meshes, the conjecture is known to be false. As an effort towards finding an answer for uniform meshes, we investigate the spectral condition number of cardinal B-spline collocation matrices. Numerical testing strongly suggests that the conjecture is true for cardinal B-splines. △ Less

Submitted 22 April, 2010; originally announced April 2010.

Comments: Short version submitted for publication in Mathematical Communications.

MSC Class: 65D07 (Primary) 65D05; 65F35; 15A12 (Secondary)

Journal ref: Math. Commun. 15 (2010) 503-519