-
Probabilistic Position-Aided Beam Selection for mmWave MIMO Systems
Authors:
Joseph K. Chege,
Arie Yeredor,
Martin Haardt
Abstract:
Millimeter-wave (mmWave) MIMO systems rely on highly directional beamforming to overcome severe path loss and ensure robust communication links. However, selecting the optimal beam pair efficiently remains a challenge due to the large search space and the overhead of conventional methods. This paper proposes a probabilistic position-aided beam selection approach that exploits the statistical depen…
▽ More
Millimeter-wave (mmWave) MIMO systems rely on highly directional beamforming to overcome severe path loss and ensure robust communication links. However, selecting the optimal beam pair efficiently remains a challenge due to the large search space and the overhead of conventional methods. This paper proposes a probabilistic position-aided beam selection approach that exploits the statistical dependence between user equipment (UE) positions and optimal beam indices. We model the underlying joint probability mass function (PMF) of the positions and the beam indices as a low-rank tensor and estimate its parameters from training data using Bayesian inference. The estimated model is then used to predict the best (or a list of the top) beam pair indices for new UE positions. The proposed method is evaluated using data generated from a state-of-the-art ray tracing simulator and compared with neural network-based and fingerprinting approaches. The results show that our approach achieves a high data rate with fewer training samples and a significantly reduced beam search space. These advantages render it a promising solution for practical mmWave MIMO deployments, reducing the beam search overhead while maintaining a reliable connectivity.
△ Less
Submitted 12 April, 2025; v1 submitted 7 April, 2025;
originally announced April 2025.
-
Bayesian Estimation and Tuning-Free Rank Detection for Probability Mass Function Tensors
Authors:
Joseph K. Chege,
Arie Yeredor,
Martin Haardt
Abstract:
Obtaining a reliable estimate of the joint probability mass function (PMF) of a set of random variables from observed data is a significant objective in statistical signal processing and machine learning. Modelling the joint PMF as a tensor that admits a low-rank canonical polyadic decomposition (CPD) has enabled the development of efficient PMF estimation algorithms. However, these algorithms req…
▽ More
Obtaining a reliable estimate of the joint probability mass function (PMF) of a set of random variables from observed data is a significant objective in statistical signal processing and machine learning. Modelling the joint PMF as a tensor that admits a low-rank canonical polyadic decomposition (CPD) has enabled the development of efficient PMF estimation algorithms. However, these algorithms require the rank (model order) of the tensor to be specified beforehand. In real-world applications, the true rank is unknown. Therefore, an appropriate rank is usually selected from a candidate set either by observing validation errors or by computing various likelihood-based information criteria, a procedure which is computationally expensive for large datasets. This paper presents a novel Bayesian framework for estimating the joint PMF and automatically inferring its rank from observed data. We specify a Bayesian PMF estimation model and employ appropriate prior distributions for the model parameters, allowing for tuning-free rank inference via a single training run. We then derive a deterministic solution based on variational inference (VI) to approximate the posterior distributions of various model parameters. Additionally, we develop a scalable version of the VI-based approach by leveraging stochastic variational inference (SVI) to arrive at an efficient algorithm whose complexity scales sublinearly with the size of the dataset. Numerical experiments involving both synthetic data and real movie recommendation data illustrate the advantages of our VI and SVI-based methods in terms of estimation accuracy, automatic rank detection, and computational efficiency.
△ Less
Submitted 8 October, 2024;
originally announced October 2024.
-
Time-Domain Based Embeddings for Spoofed Audio Representation
Authors:
Matan Karo,
Arie Yeredor,
Itshak Lapidot
Abstract:
Anti-spoofing is the task of speech authentication. That is, identifying genuine human speech compared to spoofed speech. The main focus of this paper is to suggest new representations for genuine and spoofed speech, based on the probability mass function (PMF) estimation of the audio waveforms' amplitude.
We introduce a new feature extraction method for speech audio signals: unlike traditional…
▽ More
Anti-spoofing is the task of speech authentication. That is, identifying genuine human speech compared to spoofed speech. The main focus of this paper is to suggest new representations for genuine and spoofed speech, based on the probability mass function (PMF) estimation of the audio waveforms' amplitude.
We introduce a new feature extraction method for speech audio signals: unlike traditional methods, our method is based on direct processing of time-domain audio samples. The PMF is utilized by designing a feature extractor based on different PMF distances and similarity measures. As an additional step, we used filter-bank preprocessing, which significantly affects the discriminative characteristics of the features and facilitates convenient visualization of possible clustering of spoofing attacks. Furthermore, we use diffusion maps to reveal the underlying manifold on which the data lies.
The suggested embeddings allow the use of simple linear separators to achieve decent performance. In addition, we present a convenient way to visualize the data, which helps to assess the efficiency of different spoofing techniques.
The experimental results show the potential of using multi-channel PMF based features for the anti-spoofing task, in addition to the benefits of using diffusion maps both as an analysis tool and as an embedding tool.
△ Less
Submitted 27 October, 2022;
originally announced October 2022.
-
Monotonicity of the Trace-Inverse of Covariance Submatrices and Two-Sided Prediction
Authors:
Anatoly Khina,
Arie Yeredor,
Ram Zamir
Abstract:
It is common to assess the "memory strength" of a stationary process looking at how fast the normalized log-determinant of its covariance submatrices (i.e., entropy rate) decreases. In this work, we propose an alternative characterization in terms of the normalized trace-inverse of the covariance submatrices. We show that this sequence is monotonically non-decreasing and is constant if and only if…
▽ More
It is common to assess the "memory strength" of a stationary process looking at how fast the normalized log-determinant of its covariance submatrices (i.e., entropy rate) decreases. In this work, we propose an alternative characterization in terms of the normalized trace-inverse of the covariance submatrices. We show that this sequence is monotonically non-decreasing and is constant if and only if the process is white. Furthermore, while the entropy rate is associated with one-sided prediction errors (present from past), the new measure is associated with two-sided prediction errors (present from past and future). This measure can be used as an alternative to Burg's maximum-entropy principle for spectral estimation. We also propose a counterpart for non-stationary processes, by looking at the average trace-inverse of subsets.
△ Less
Submitted 21 November, 2020;
originally announced November 2020.
-
Enhanced Blind Calibration of Uniform Linear Arrays with One-Bit Quantization by Kullback-Leibler Divergence Covariance Fitting
Authors:
Amir Weiss,
Arie Yeredor
Abstract:
One-bit quantization has recently become an attractive option for data acquisition in cutting edge applications, due to the increasing demand for low power and higher sampling rates. Subsequently, the rejuvenated one-bit array processing field is now receiving more attention, as "classical" array processing techniques are adapted / modified accordingly. However, array calibration, often an instrum…
▽ More
One-bit quantization has recently become an attractive option for data acquisition in cutting edge applications, due to the increasing demand for low power and higher sampling rates. Subsequently, the rejuvenated one-bit array processing field is now receiving more attention, as "classical" array processing techniques are adapted / modified accordingly. However, array calibration, often an instrumental preliminary stage in array processing, has so far received little attention in its one-bit form. In this paper, we present a novel solution approach for the blind calibration problem, namely, without using known calibration signals. In order to extract information within the second-order statistics of the quantized measurements, we propose to estimate the unknown sensors' gains and phases offsets according to a Kullback-Leibler Divergence (KLD) covariance fitting criterion. We then provide a quasi-Newton solution algorithm, with a consistent initial estimate, and demonstrate the improved accuracy of our KLD-based estimates in simulations.
△ Less
Submitted 28 October, 2020;
originally announced October 2020.
-
Non-Iterative Blind Calibration of Nested Arrays with Asymptotically Optimal Weighting
Authors:
Amir Weiss,
Arie Yeredor
Abstract:
Blind calibration of sensors arrays (without using calibration signals) is an important, yet challenging problem in array processing. While many methods have been proposed for "classical" array structures, such as uniform linear arrays, not as many are found in the context of the more "modern" sparse arrays. In this paper, we present a novel blind calibration method for $2$-level nested arrays. Sp…
▽ More
Blind calibration of sensors arrays (without using calibration signals) is an important, yet challenging problem in array processing. While many methods have been proposed for "classical" array structures, such as uniform linear arrays, not as many are found in the context of the more "modern" sparse arrays. In this paper, we present a novel blind calibration method for $2$-level nested arrays. Specifically, and despite recent contradicting claims in the literature, we show that the Least-Squares (LS) approach can in fact be used for this purpose with such arrays. Moreover, the LS approach gives rise to optimally-weighted LS joint estimation of the sensors' gains and phases offsets, which leads to more accurate calibration, and in turn, to higher accuracy in subsequent estimation tasks (e.g., direction-of-arrival). Our method, which can be extended to $K$-level arrays ($K>2$), is superior to the current state of the art both in terms of accuracy and computational efficiency, as we demonstrate in simulation.
△ Less
Submitted 28 October, 2020;
originally announced October 2020.
-
Iterative Symbol Recovery For Power Efficient DC Biased Optical OFDM Systems
Authors:
Amir Weiss,
Arie Yeredor,
Mark Shtaif
Abstract:
Orthogonal frequency division multiplexing (OFDM) has proven itself as an effective multi-carrier digital communication technique. In recent years the interest in optical OFDM has grown significantly, due to its spectral efficiency and inherent resilience to frequency-selective channels and to narrowband interference. For these reasons it is currently considered to be one of the leading candidates…
▽ More
Orthogonal frequency division multiplexing (OFDM) has proven itself as an effective multi-carrier digital communication technique. In recent years the interest in optical OFDM has grown significantly, due to its spectral efficiency and inherent resilience to frequency-selective channels and to narrowband interference. For these reasons it is currently considered to be one of the leading candidates for deployment in short fiber links such as the ones intended for inter-data-center communications. In this paper we present a new power-efficient symbol recovery scheme for dc-biased optical OFDM (DCO-OFDM) in an intensity-modulation direct-detection (IM/DD) system. We introduce an alternative method for clipping in order to maintain a non-negative real-valued signal and still preserve information, which is lost when using clipping, and propose an iterative detection algorithm for this method. A reduction of $50\%$ in the transmitted optical power along with an increase of signal-independent noise immunity (gaining $3$[dB] in SNR), compared to traditional DCO-OFDM with a DC bias of $2$ standard deviations of the OFDM signal, is attained by our new scheme for a symbol error rate (SER) of $10^{-3}$ in a QPSK constellation additive white gaussian noise (AWGN) flat channel model.
△ Less
Submitted 31 August, 2020;
originally announced August 2020.
-
The Extended "Sequentially Drilled" Joint Congruence Transformation and its Application in Gaussian Independent Vector Analysis
Authors:
Amir Weiss,
Arie Yeredor,
Sher Ali Cheema,
Martin Haardt
Abstract:
Independent Vector Analysis (IVA) has emerged in recent years as an extension of Independent Component Analysis (ICA) into multiple sets of mixtures, where the source signals in each set are independent, but may depend on source signals in the other sets. In a semi-blind IVA (or ICA) framework, information regarding the probability distributions of the sources may be available, giving rise to Maxi…
▽ More
Independent Vector Analysis (IVA) has emerged in recent years as an extension of Independent Component Analysis (ICA) into multiple sets of mixtures, where the source signals in each set are independent, but may depend on source signals in the other sets. In a semi-blind IVA (or ICA) framework, information regarding the probability distributions of the sources may be available, giving rise to Maximum Likelihood (ML) separation. In recent work we have shown that under the multivariate Gaussian model, with arbitrary temporal covariance matrices (stationary or non-stationary) of the source signals, ML separation requires the solution of a "Sequentially Drilled" Joint Congruence (SeDJoCo) transformation of a set of matrices, which is reminiscent of (but different from) classical joint diagonalization. In this paper we extend our results to the IVA problem, showing how the ML solution for the Gaussian model (with arbitrary covariance and cross-covariance matrices) takes the form of an extended SeDJoCo problem. We formulate the extended problem, derive a condition for the existence of a solution, and propose two iterative solution algorithms. In addition, we derive the induced Cramér-Rao Lower Bound (iCRLB) on the resulting Interference-to-Source Ratios (ISR) matrices, and demonstrate by simulation how the ML separation obtained by solving the extended SeDJoCo problem indeed attains the iCRLB (asymptotically), as opposed to other separation approaches, which cannot exploit prior knowledge regarding the sources' distributions.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.
-
Performance Analysis of the Gaussian Quasi-Maximum Likelihood Approach for Independent Vector Analysis
Authors:
Amir Weiss,
Sher Ali Cheema,
Martin Haardt,
Arie Yeredor
Abstract:
Maximum Likelihood (ML) estimation requires precise knowledge of the underlying statistical model. In Quasi ML (QML), a presumed model is used as a substitute to the (unknown) true model. In the context of Independent Vector Analysis (IVA), we consider the Gaussian QML Estimate (QMLE) of the demixing matrices set and present an (approximate) analysis of its asymptotic separation performance. In Ga…
▽ More
Maximum Likelihood (ML) estimation requires precise knowledge of the underlying statistical model. In Quasi ML (QML), a presumed model is used as a substitute to the (unknown) true model. In the context of Independent Vector Analysis (IVA), we consider the Gaussian QML Estimate (QMLE) of the demixing matrices set and present an (approximate) analysis of its asymptotic separation performance. In Gaussian QML the sources are presumed to be Gaussian, with covariance matrices specified by some "educated guess". The resulting quasi-likelihood equations of the demixing matrices take a special form, recently termed an extended "Sequentially Drilled" Joint Congruence (SeDJoCo) transformation, which is reminiscent of (though essentially different from) classical joint diagonalization. We show that asymptotically this QMLE, i.e., the solution of the resulting extended SeDJoCo transformation, attains perfect separation (under some mild conditions) regardless of the sources' true distributions and/or covariance matrices. In addition, based on the "small-errors" assumption, we present a first-order perturbation analysis of the extended SeDJoCo solution. Using the resulting closed-form expressions for the errors in the solution matrices, we provide closed-form expressions for the resulting Interference-to-Source Ratios (ISRs) for IVA. Moreover, we prove that asymptotically the ISRs depend only on the sources' covariances, and not on their specific distributions. As an immediate consequence of this result, we provide an asymptotically attainable lower bound on the resulting ISRs. We also present empirical results, corroborating our analytical derivations, of three simulation experiments concerning two possible model errors - inaccurate covariance matrices and sources' distribution mismodeling.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.
-
Blind Determination of the Number of Sources Using Distance Correlation
Authors:
Amir Weiss,
Arie Yeredor
Abstract:
A novel blind estimate of the number of sources from noisy, linear mixtures is proposed. Based on Székely et al.'s distance correlation measure, we define the Sources' Dependency Criterion (SDC), from which our estimate arises. Unlike most previously proposed estimates, the SDC estimate exploits the full independence of the sources and noise, as well as the non-Gaussianity of the sources (as oppos…
▽ More
A novel blind estimate of the number of sources from noisy, linear mixtures is proposed. Based on Székely et al.'s distance correlation measure, we define the Sources' Dependency Criterion (SDC), from which our estimate arises. Unlike most previously proposed estimates, the SDC estimate exploits the full independence of the sources and noise, as well as the non-Gaussianity of the sources (as opposed to the Gaussianity of the noise), via implicit use of high-order statistics. This leads to a more robust, resilient and stable estimate w.r.t. the mixing matrix and the noise covariance structure. Empirical simulation results demonstrate these virtues, on top of superior performance in comparison with current state of the art estimates.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.
-
Asymptotically Optimal Blind Calibration of Uniform Linear Sensor Arrays for Narrowband Gaussian Signals
Authors:
Amir Weiss,
Arie Yeredor
Abstract:
An asymptotically optimal blind calibration scheme of uniform linear arrays for narrowband Gaussian signals is proposed. Rather than taking the direct Maximum Likelihood (ML) approach for joint estimation of all the unknown model parameters, which leads to a multi-dimensional optimization problem with no closed-form solution, we revisit Paulraj and Kailath's (P-K's) classical approach in exploitin…
▽ More
An asymptotically optimal blind calibration scheme of uniform linear arrays for narrowband Gaussian signals is proposed. Rather than taking the direct Maximum Likelihood (ML) approach for joint estimation of all the unknown model parameters, which leads to a multi-dimensional optimization problem with no closed-form solution, we revisit Paulraj and Kailath's (P-K's) classical approach in exploiting the special (Toeplitz) structure of the observations' covariance. However, we offer a substantial improvement over P-K's ordinary Least Squares (LS) estimates by using asymptotic approximations in order to obtain simple, non-iterative, (quasi-)linear Optimally-Weighted LS (OWLS) estimates of the sensors gains and phases offsets with asymptotically optimal weighting, based only on the empirical covariance matrix of the measurements. Moreover, we prove that our resulting estimates are also asymptotically optimal w.r.t. the raw data, and can therefore be deemed equivalent to the ML Estimates (MLE), which are otherwise obtained by joint ML estimation of all the unknown model parameters. After deriving computationally convenient expressions of the respective Cramér-Rao lower bounds, we also show that our estimates offer improved performance when applied to non-Gaussian signals (and/or noise) as quasi-MLE in a similar setting. The optimal performance of our estimates is demonstrated in simulation experiments, with a considerable improvement (reaching an order of magnitude and more) in the resulting mean squared errors w.r.t. P-K's ordinary LS estimates. We also demonstrate the improved accuracy in a multiple-sources directions-of-arrivals estimation task.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.
