Showing 1–27 of 27 results for author: Babu, P

Ship Detection in Remote Sensing Imagery for Arbitrarily Oriented Object Detection

Authors: Bibi Erum Ayesha, T. Satyanarayana Murthy, Palamakula Ramesh Babu, Ramu Kuchipudi

Abstract: This research paper presents an innovative ship detection system tailored for applications like maritime surveillance and ecological monitoring. The study employs YOLOv8 and repurposed U-Net, two advanced deep learning models, to significantly enhance ship detection accuracy. Evaluation metrics include Mean Average Precision (mAP), processing speed, and overall accuracy. The research utilizes the… ▽ More This research paper presents an innovative ship detection system tailored for applications like maritime surveillance and ecological monitoring. The study employs YOLOv8 and repurposed U-Net, two advanced deep learning models, to significantly enhance ship detection accuracy. Evaluation metrics include Mean Average Precision (mAP), processing speed, and overall accuracy. The research utilizes the "Airbus Ship Detection" dataset, featuring diverse remote sensing images, to assess the models' versatility in detecting ships with varying orientations and environmental contexts. Conventional ship detection faces challenges with arbitrary orientations, complex backgrounds, and obscured perspectives. Our approach incorporates YOLOv8 for real-time processing and U-Net for ship instance segmentation. Evaluation focuses on mAP, processing speed, and overall accuracy. The dataset is chosen for its diverse images, making it an ideal benchmark. Results demonstrate significant progress in ship detection. YOLOv8 achieves an 88% mAP, excelling in accurate and rapid ship detection. U Net, adapted for ship instance segmentation, attains an 89% mAP, improving boundary delineation and handling occlusions. This research enhances maritime surveillance, disaster response, and ecological monitoring, exemplifying the potential of deep learning models in ship detection. △ Less

Submitted 17 March, 2025; originally announced March 2025.

Dual-Function Beamforming Design For Multi-Target Localization and Reliable Communications

Authors: Bo Tang, Da Li, Wenjun Wu, Astha Saini, Prabhu Babu, Petre Stoica

Abstract: This paper investigates the transmit beamforming design for multiple-input multiple-output systems to support both multi-target localization and multi-user communications. To enhance the target localization performance, we derive the asymptotic Cramér-Rao bound (CRB) for target angle estimation by assuming that the receive array is linear and uniform. Then we formulate a beamforming design problem… ▽ More This paper investigates the transmit beamforming design for multiple-input multiple-output systems to support both multi-target localization and multi-user communications. To enhance the target localization performance, we derive the asymptotic Cramér-Rao bound (CRB) for target angle estimation by assuming that the receive array is linear and uniform. Then we formulate a beamforming design problem based on minimizing an upper bound on the asymptotic CRB (which is shown to be equivalent to {maximizing} the harmonic mean of the weighted beampattern responses at the target directions). Moreover, we impose a constraint on the SINR of each received communication signal to guarantee reliable communication performance. Two iterative algorithms are derived to tackle the non-convex design problem: one is based on the alternating direction method of multipliers, and the other uses the majorization-minimization technique to solve an equivalent minimax problem. Numerical results show that, through elaborate dual-function beamforming matrix design, the proposed algorithms can simultaneously achieve superior angle estimation performance as well as high-quality multi-user communications. △ Less

Submitted 13 January, 2025; originally announced January 2025.

Comments: 31 pages, 14 figures

Min-Max Framework for Majorization-Minimization Algorithms in Signal Processing Applications: An Overview

Authors: Astha Saini, Petre Stoica, Prabhu Babu, Aakash Arora

Abstract: This monograph presents a theoretical background and a broad introduction to the Min-Max Framework for Majorization-Minimization (MM4MM), an algorithmic methodology for solving minimization problems by formulating them as min-max problems and then employing majorization-minimization. The monograph lays out the mathematical basis of the approach used to reformulate a minimization problem as a min-m… ▽ More This monograph presents a theoretical background and a broad introduction to the Min-Max Framework for Majorization-Minimization (MM4MM), an algorithmic methodology for solving minimization problems by formulating them as min-max problems and then employing majorization-minimization. The monograph lays out the mathematical basis of the approach used to reformulate a minimization problem as a min-max problem. With the prerequisites covered, including multiple illustrations of the formulations for convex and non-convex functions, this work serves as a guide for developing MM4MM-based algorithms for solving non-convex optimization problems in various areas of signal processing. As special cases, we discuss using the majorization-minimization technique to solve min-max problems encountered in signal processing applications and min-max problems formulated using the Lagrangian. Lastly, we present detailed examples of using MM4MM in ten signal processing applications such as phase retrieval, source localization, independent vector analysis, beamforming and optimal sensor placement in wireless sensor networks. The devised MM4MM algorithms are free of hyper-parameters and enjoy the advantages inherited from the use of the majorization-minimization technique such as monotonicity. △ Less

Submitted 12 November, 2024; originally announced November 2024.

Comments: 84 pages, no figures, published in Foundations and Trends in Signal Processing: Vol. 18: No. 4, pp 310-389. http://dx.doi.org/10.1561/2000000129

Journal ref: Foundations and Trends in Signal Processing 2024: Vol. 18: No. 4, pp 310-389

New Methods for MLE of Toeplitz Structured Covariance Matrices with Applications to RADAR Problems

Authors: Augusto Aubry, Prabhu Babu, Antonio De Maio, Massimo Rosamilia

Abstract: This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent statistical learning framework. Both the strategies are based on the Majorization Minimization (MM) paradigm and hence enjoy nice properties s… ▽ More This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent statistical learning framework. Both the strategies are based on the Majorization Minimization (MM) paradigm and hence enjoy nice properties such as monotonicity and ensured convergence to a stationary point of the equivalent MLE problem. The proposed framework is also extended to deal with MLE of other practically relevant covariance structures, namely, the banded Toeplitz, block Toeplitz, and Toeplitz-block-Toeplitz. Through numerical simulations, it is shown that the new methods provide excellent performance levels in terms of both mean square estimation error (which is very close to the benchmark Cramér-Rao Bound (CRB)) and signal-to-interference-plus-noise ratio, especially in comparison with state of the art strategies. △ Less

Submitted 8 July, 2023; originally announced July 2023.

Comments: submitted to IEEE Transactions on Signal Processing. arXiv admin note: substantial text overlap with arXiv:2110.12176

Journal ref: IEEE Transactions on Information Theory, vol. 70, no. 12, pp. 9277-9292, Dec. 2024

Two new algorithms for maximum likelihood estimation of sparse covariance matrices with applications to graphical modeling

Authors: Ghania Fatima, Prabhu Babu, Petre Stoica

Abstract: In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the likelihood to impose sparsity, we solve the MLE problem based on an estimated covariance graph. More specifically, we propose a two-stage procedure: in the first s… ▽ More In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the likelihood to impose sparsity, we solve the MLE problem based on an estimated covariance graph. More specifically, we propose a two-stage procedure: in the first stage, we determine the sparsity pattern of the target covariance matrix (in other words the marginal independence in the covariance graph under a Gaussian graphical model) using the multiple hypothesis testing method of false discovery rate (FDR), and in the second stage we use either a block coordinate descent approach to estimate the non-zero values or a proximal distance approach that penalizes the distance between the estimated covariance graph and the target covariance matrix. Doing so gives rise to two different methods, each with its own advantage: the coordinate descent approach does not require tuning of any hyper-parameters, whereas the proximal distance approach is computationally fast but requires a careful tuning of the penalty parameter. Both methods are effective even in cases where the number of observed samples is less than the dimension of the data. For performance evaluation, we test the proposed methods on both simulated and real-world data and show that they provide more accurate estimates of the sparse covariance matrix than two state-of-the-art methods. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Pearson-Matthews correlation coefficients for binary and multinary classification and hypothesis testing

Authors: Petre Stoica, Prabhu Babu

Abstract: The Pearson-Matthews correlation coefficient (usually abbreviated MCC) is considered to be one of the most useful metrics for the performance of a binary classification or hypothesis testing method (for the sake of conciseness we will use the classification terminology throughout, but the concepts and methods discussed in the paper apply verbatim to hypothesis testing as well). For multinary class… ▽ More The Pearson-Matthews correlation coefficient (usually abbreviated MCC) is considered to be one of the most useful metrics for the performance of a binary classification or hypothesis testing method (for the sake of conciseness we will use the classification terminology throughout, but the concepts and methods discussed in the paper apply verbatim to hypothesis testing as well). For multinary classification tasks (with more than two classes) the existing extension of MCC, commonly called the $\text{R}_{\text{K}}$ metric, has also been successfully used in many applications. The present paper begins with an introductory discussion on certain aspects of MCC. Then we go on to discuss the topic of multinary classification that is the main focus of this paper and which, despite its practical and theoretical importance, appears to be less developed than the topic of binary classification. Our discussion of the $\text{R}_{\text{K}}$ is followed by the introduction of two other metrics for multinary classification derived from the multivariate Pearson correlation (MPC) coefficients. We show that both $\text{R}_{\text{K}}$ and the MPC metrics suffer from the problem of not decisively indicating poor classification results when they should, and introduce three new enhanced metrics that do not suffer from this problem. We also present an additional new metric for multinary classification which can be viewed as a direct extension of MCC. △ Less

Submitted 10 May, 2023; originally announced May 2023.

Fair principal component analysis (PCA): minorization-maximization algorithms for Fair PCA, Fair Robust PCA and Fair Sparse PCA

Authors: Prabhu Babu, Petre Stoica

Abstract: In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the minorization-maximization (MM) approach. The proposed algorithm relies on the relaxation of a semi-orthogonality constraint which is proved to be tight at every… ▽ More In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the minorization-maximization (MM) approach. The proposed algorithm relies on the relaxation of a semi-orthogonality constraint which is proved to be tight at every iteration of the algorithm. The vanilla version of the proposed algorithm requires solving a semi-definite program (SDP) at every iteration, which can be further simplified to a quadratic program by formulating the dual of the surrogate maximization problem. We also propose two important reformulations of the fair PCA problem: a) fair robust PCA -- which can handle outliers in the data, and b) fair sparse PCA -- which can enforce sparsity on the estimated fair principal components. The proposed algorithms are computationally efficient and monotonically increase their respective design objectives at every iteration. An added feature of the proposed algorithms is that they do not require the selection of any hyperparameter (except for the fair sparse PCA case where a penalty parameter that controls the sparsity has to be chosen by the user). We numerically compare the performance of the proposed methods with two of the state-of-the-art approaches on synthetic data sets and a real-life data set. △ Less

Submitted 10 May, 2023; originally announced May 2023.

Low-rank covariance matrix estimation for factor analysis in anisotropic noise: application to array processing and portfolio selection

Authors: Petre Stoica, Prabhu Babu

Abstract: Factor analysis (FA) or principal component analysis (PCA) models the covariance matrix of the observed data as R = SS' + Σ, where SS' is the low-rank covariance matrix of the factors (aka latent variables) and Σ is the diagonal matrix of the noise. When the noise is anisotropic (aka nonuniform in the signal processing literature and heteroscedastic in the statistical literature), the diagonal ele… ▽ More Factor analysis (FA) or principal component analysis (PCA) models the covariance matrix of the observed data as R = SS' + Σ, where SS' is the low-rank covariance matrix of the factors (aka latent variables) and Σ is the diagonal matrix of the noise. When the noise is anisotropic (aka nonuniform in the signal processing literature and heteroscedastic in the statistical literature), the diagonal elements of Σ cannot be assumed to be identical and they must be estimated jointly with the elements of SS'. The problem of estimating SS' and Σ in the above covariance model is the central theme of the present paper. After stating this problem in a more formal way, we review the main existing algorithms for solving it. We then go on to show that these algorithms have reliability issues (such as lack of convergence or convergence to infeasible solutions) and therefore they may not be the best possible choice for practical applications. Next we explain how to modify one of these algorithms to improve its convergence properties and we also introduce a new method that we call FAAN (Factor Analysis for Anisotropic Noise). FAAN is a coordinate descent algorithm that iteratively maximizes the normal likelihood function, which is easy to implement in a numerically efficient manner and has excellent convergence properties as illustrated by the numerical examples presented in the paper. Out of the many possible applications of FAAN we focus on the following two: direction-of-arrival (DOA) estimation using array signal processing techniques and portfolio selection for financial asset management. △ Less

Submitted 18 April, 2023; originally announced April 2023.

Comments on "Iteratively Re-weighted Algorithm for Fuzzy c-Means"

Authors: Astha Saini, Prabhu Babu

Abstract: In this comment, we present a simple alternate derivation to the IRW-FCM algorithm presented in "Iteratively Re-weighted Algorithm for Fuzzy c-Means" for Fuzzy c-Means problem. We show that the iterative steps derived for IRW-FCM algorithm are nothing but steps of the popular Majorization Minimization (MM) algorithm. The derivation presented in this note is much simpler and straightforward and, un… ▽ More In this comment, we present a simple alternate derivation to the IRW-FCM algorithm presented in "Iteratively Re-weighted Algorithm for Fuzzy c-Means" for Fuzzy c-Means problem. We show that the iterative steps derived for IRW-FCM algorithm are nothing but steps of the popular Majorization Minimization (MM) algorithm. The derivation presented in this note is much simpler and straightforward and, unlike the derivation of IRW-FCM, the derivation here does not involve introduction of any auxiliary variable. Moreover, by showing the steps of IRW-FCM as the MM algorithm, the inner loop of the IRW-FCM algorithm can be eliminated and the algorithm can be effectively run as a "single loop" algorithm. More precisely, the new MM-based derivation deduces that a single inner loop of IRW-FCM is sufficient to decrease the Fuzzy c-means objective function, which speeds up the IRW-FCM algorithm. △ Less

Submitted 16 September, 2022; originally announced September 2022.

Majorization-Minimization based Hybrid Localization Method for High Precision Localization in Wireless Sensor Networks

Authors: Kuntal Panwar, Prabhu Babu

Abstract: This paper investigates the hybrid source localization problem using the four radio measurements - time of arrival (TOA), time difference of arrival (TDOA), received signal strength (RSS), and angle of arrival (AOA). First, after invoking tractable approximations in the RSS and AOA models, the maximum likelihood estimation (MLE) problem for the hybrid TOA-TDOA-RSS-AOA data model is derived. Then a… ▽ More This paper investigates the hybrid source localization problem using the four radio measurements - time of arrival (TOA), time difference of arrival (TDOA), received signal strength (RSS), and angle of arrival (AOA). First, after invoking tractable approximations in the RSS and AOA models, the maximum likelihood estimation (MLE) problem for the hybrid TOA-TDOA-RSS-AOA data model is derived. Then a weighted least-squares problem is formulated from the MLE, which is solved using the principle of the majorization-minimization (MM), resulting in an iterative algorithm with guaranteed convergence. The key feature of the proposed method is that it provides a unified framework where localization using any possible merger out of these four measurements can be implemented as per the requirement/application. Extensive numerical simulations are conducted to study the performance of the proposed method. The obtained results indicate that the hybrid localization model improves the localization accuracy compared to the heterogeneous measurements under different network scenarios, which also includes the presence of non-line of sight (NLOS) errors. △ Less

Submitted 28 November, 2023; v1 submitted 8 May, 2022; originally announced May 2022.

Optimal Sensor Placement for Hybrid Source Localization Using Fused TOA-RSS-AOA Measurements

Authors: Kuntal Panwar, Ghania Fatima, Prabhu Babu

Abstract: Source localization techniques incorporating hybrid measurements improve the reliability and accuracy of the location estimate. Given a set of hybrid sensors that can collect combined time of arrival (TOA), received signal strength (RSS) and angle of arrival (AOA) measurements, the localization accuracy can be enhanced further by optimally designing the placements of the hybrid sensors. In this pa… ▽ More Source localization techniques incorporating hybrid measurements improve the reliability and accuracy of the location estimate. Given a set of hybrid sensors that can collect combined time of arrival (TOA), received signal strength (RSS) and angle of arrival (AOA) measurements, the localization accuracy can be enhanced further by optimally designing the placements of the hybrid sensors. In this paper, we present an optimal sensor placement methodology, which is based on the principle of majorization-minimization (MM), for hybrid localization technique. We first derive the Cramer-Rao lower bound (CRLB) of the hybrid measurement model, and formulate the design problem using the A-optimal criterion. Next, we introduce an auxiliary variable to reformulate the design problem into an equivalent saddle-point problem, and then construct simple surrogate functions (having closed form solutions) over both primal and dual variables. The application of MM in this paper is distinct from the conventional MM (that is usually developed only over the primal variable), and we believe that the MM framework developed in this paper can be employed to solve many optimization problems. The main advantage of our method over most of the existing state-of-the-art algorithms (which are mostly analytical in nature) is its ability to work for both uncorrelated and correlated noise in the measurements. We also discuss the extension of the proposed algorithm for the optimal placement designs based on D and E optimal criteria. Finally, the performance of the proposed method is studied under different noise conditions and different design parameters. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Designing Interference-Immune Doppler-TolerantWaveforms for Automotive Radar Applications

Authors: Robin Amar, Mohammad Alaee-Kerahroodi, Prabhu Babu, Bhavani Shankar M. R

Abstract: Dynamic target detection using FMCW waveform is challenging in the presence of interference for different radar applications. Degradation in SNR is irreparable and interference is difficult to mitigate in time and frequency domain. In this paper, a waveform design problem is addressed using the Majorization-Minimization (MM) framework by considering PSL/ISL cost functions, resulting in a code sequ… ▽ More Dynamic target detection using FMCW waveform is challenging in the presence of interference for different radar applications. Degradation in SNR is irreparable and interference is difficult to mitigate in time and frequency domain. In this paper, a waveform design problem is addressed using the Majorization-Minimization (MM) framework by considering PSL/ISL cost functions, resulting in a code sequence with Doppler-tolerance characteristics of an FMCW waveform and interference immune characteristics of a tailored PMCW waveform (unique phase code + minimal ISL/PSL). The optimal design sequences possess polynomial phase behavior of degree Q amongst its sub-sequences and obtain optimal ISL and PSL solutions with guaranteed convergence. By tuning the optimization parameters such as degree Q of the polynomial phase behavior, sub-sequence length M and the total number of sub-sequences L, the optimized sequences can be as Doppler tolerant as FMCW waveform in one end, and they can possess small cross-correlation values similar to random-phase sequences in PMCW waveform on the other end. If required in the event of acute interference, new codes can be generated in the runtime which have low cross-correlation with the interferers. The performance analysis indicates that the proposed method outperforms the state-of-the-art counterparts. △ Less

Submitted 5 April, 2022; originally announced April 2022.

Learning Sparse Graphs via Majorization-Minimization for Smooth Node Signals

Authors: Ghania Fatima, Aakash Arora, Prabhu Babu, Petre Stoica

Abstract: In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the principle of majorization-minimization (MM), wherein we first obtain a tight surrogate function for the graph learning objective and then solve the resultant s… ▽ More In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the principle of majorization-minimization (MM), wherein we first obtain a tight surrogate function for the graph learning objective and then solve the resultant surrogate problem which has a simple closed form solution. The proposed algorithm does not require tuning of any hyperparameter and it has the desirable feature of eliminating the inactive variables in the course of the iterations - which can help speeding up the algorithm. The numerical simulations conducted using both synthetic and real world (brain-network) data show that the proposed algorithm converges faster, in terms of the average number of iterations, than several existing methods in the literature. △ Less

Submitted 6 February, 2022; originally announced February 2022.

PROMPT: Parallel Iterative Algorithm for $\ell_{p}$ norm linear regression via Majorization Minimization with an application to semi-supervised graph learning

Authors: R. Jyothi, P. Babu

Abstract: In this paper, we consider the problem of $\ell_{p}$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning. The problem, even though convex, does not enjoy a closed-form solution. The state-of-the-art algorithms are iterative but suffer from convergence issues, i.e., they either diverge for p>3 or the convergence to the opt… ▽ More In this paper, we consider the problem of $\ell_{p}$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning. The problem, even though convex, does not enjoy a closed-form solution. The state-of-the-art algorithms are iterative but suffer from convergence issues, i.e., they either diverge for p>3 or the convergence to the optimal solution is sensitive to the initialization of the algorithm. Also, these algorithms are not generalizable to every possible value of $p$. In this paper, we propose an iterative algorithm : Parallel IteRative AlgOrithM for $\ell_{P}$ norm regression via MajorizaTion Minimization (PROMPT) based on the principle of Majorization Minimization and prove that the proposed algorithm is monotonic and converges to the optimal solution of the problem for any value of $p$. The proposed algorithm can also parallelly update each element of the regression variable, which helps to handle large scale data efficiently, a common scenario in this era of data explosion. Subsequently, we show that the proposed algorithm can also be applied for the graph based semi-supervised learning problem. We show through numerical simulations that the proposed algorithm converges to the optimal solution for any random initialization and also performs better than the state-of-the-art algorithms in terms of speed of convergence. We also evaluate the performance of the proposed algorithm using simulated and real data for the graph based semi-supervised learning problem. △ Less

Submitted 23 October, 2021; originally announced October 2021.

TELET: A Monotonic Algorithm to Design Large Dimensional Equiangular Tight Frames for Applications in Compressed Sensing

Authors: R. Jyothi, P. Babu

Abstract: An Equiangular tight frame (ETF) - also known as the Welch-bound-equality sequences - consists of a sequence of unit norm vectors whose absolute inner product is identical and minimal. Due to this unique property, these frames are preferred in different applications such as in constructing sensing matrices for compressed sensing systems, robust transmission, and quantum computing. Construction of… ▽ More An Equiangular tight frame (ETF) - also known as the Welch-bound-equality sequences - consists of a sequence of unit norm vectors whose absolute inner product is identical and minimal. Due to this unique property, these frames are preferred in different applications such as in constructing sensing matrices for compressed sensing systems, robust transmission, and quantum computing. Construction of ETFs involves solving a challenging non-convex minimax optimization problem, and only a few methods were successful in constructing them, albeit only for smaller dimensions. In this paper, we propose an iterative algorithm named TEchnique to devise Large dimensional Equiangular Tight-frames (TELET-frames) based on the majorization minimization (MM) procedure - in which we design and minimize a tight upper bound for the ETF cost function at every iteration. Since TELET is designed using the MM approach, it inherits useful properties of MM such as monotonicity and guaranteed convergence to a stationary point. Subsequently, we use the derived frames to construct optimized sensing matrix for compressed sensing systems. In the numerical simulations, we show that the proposed algorithm can generate complex and real frames (in the order of hundreds) with very low mutual coherence value when compared to the state-of-the-art algorithm, with a slight increase in computational cost. Experiments using synthetic data and real images reveal that the optimized sensing matrix obtained through the frames constructed by TELET performs better, in terms of image reconstruction accuracy, than the sensing matrix constructed using state-of-the-art methods. △ Less

Submitted 23 October, 2021; originally announced October 2021.

New Methods for MLE of Toeplitz Structured Covariance Matrices with Applications to RADAR Problems

Authors: Augusto Aubry, Prabhu Babu, Antonio De Maio, Rikhabchand Jyothi

Abstract: This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent problem. Both the strategies are based on the Majorization Minimization (MM) framework and hence enjoy nice properties such as monotonicity an… ▽ More This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent problem. Both the strategies are based on the Majorization Minimization (MM) framework and hence enjoy nice properties such as monotonicity and ensured convergence to a stationary point of the equivalent MLE problem. The proposed algorithms are also extended to deal with MLE of other related covariance structures, namely, the banded Toeplitz, Toeplitz-block-Toeplitz, low rank Toeplitz structure plus a scalar matrix (accounting for white noise), and finally Toeplitz matrices satisfying a condition number constraint. Through numerical simulations, it is shown that new methods provide satisfactory performance levels in terms of both mean square estimation error and signal-to-interference-plus-noise ratio. △ Less

Submitted 23 October, 2021; originally announced October 2021.

PDMM: A novel Primal-Dual Majorization-Minimization algorithm for Poisson Phase-Retrieval problem

Authors: Ghania Fatima, Zongyu Li, Aakash Arora, Prabhu Babu

Abstract: In this paper, we introduce a novel iterative algorithm for the problem of phase-retrieval where the measurements consist of only the magnitude of linear function of the unknown signal, and the noise in the measurements follow Poisson distribution. The proposed algorithm is based on the principle of majorization-minimization (MM); however, the application of MM here is very novel and distinct from… ▽ More In this paper, we introduce a novel iterative algorithm for the problem of phase-retrieval where the measurements consist of only the magnitude of linear function of the unknown signal, and the noise in the measurements follow Poisson distribution. The proposed algorithm is based on the principle of majorization-minimization (MM); however, the application of MM here is very novel and distinct from the way MM has been usually used to solve optimization problems in the literature. More precisely, we reformulate the original minimization problem into a saddle point problem by invoking Fenchel dual representation of the log (.) term in the Poisson likelihood function. We then propose tighter surrogate functions over both primal and dual variables resulting in a double-loop MM algorithm, which we have named as Primal-Dual Majorization-Minimization (PDMM) algorithm. The iterative steps of the resulting algorithm are simple to implement and involve only computing matrix vector products. We also extend our algorithm to handle various L1 regularized Poisson phase-retrieval problems (which exploit sparsity). The proposed algorithm is compared with previously proposed algorithms such as wirtinger flow (WF), MM (conventional), and alternating direction methods of multipliers (ADMM) for the Poisson data model. The simulation results under different experimental settings show that PDMM is faster than the competing methods, and its performance in recovering the original signal is at par with the state-of-the-art algorithms. △ Less

Submitted 16 October, 2021; originally announced October 2021.

Optimal Sensor Placement for Source Localization: A Unified ADMM Approach

Authors: Nitesh Sahu, Linlong Wu, Prabhu Babu, Bhavani Shankar M. R., Björn Ottersten

Abstract: Source localization plays a key role in many applications including radar, wireless and underwater communications. Among various localization methods, the most popular ones are Time-Of-Arrival (TOA), Time-Difference-Of-Arrival (TDOA), and Received Signal Strength (RSS) based. Since the Cramér-Rao lower bounds (CRLB) of these methods depend on the sensor geometry explicitly, sensor placement become… ▽ More Source localization plays a key role in many applications including radar, wireless and underwater communications. Among various localization methods, the most popular ones are Time-Of-Arrival (TOA), Time-Difference-Of-Arrival (TDOA), and Received Signal Strength (RSS) based. Since the Cramér-Rao lower bounds (CRLB) of these methods depend on the sensor geometry explicitly, sensor placement becomes a crucial issue in source localization applications. In this paper, we consider finding the optimal sensor placements for the TOA, TDOA and RSS based localization scenarios. We first unify the three localization models by a generalized problem formulation based on the CRLB-related metric. Then a unified optimization framework for optimal sensor placement (UTMOST) is developed through the combination of the alternating direction method of multipliers (ADMM) and majorization-minimization (MM) techniques. Unlike the majority of the state-of-the-art works, the proposed UTMOST neither approximates the design criterion nor considers only uncorrelated noise in the measurements. It can readily adapt to to different design criteria (i.e. A, D and E-optimality) with slight modifications within the framework and yield the optimal sensor placements correspondingly. Extensive numerical experiments are performed to exhibit the efficacy and flexibility of the proposed framework. △ Less

Submitted 4 March, 2022; v1 submitted 8 September, 2021; originally announced September 2021.

UNIPOL: Unimodular sequence design via a separable iterative quartic polynomial optimization for active sensing systems

Authors: Surya Prakash Sankuru, Prabhu Babu, Mohammad Alaee-Kerahroodi

Abstract: Sequences having better autocorrelation properties play a crucial role in enhancing the performance of active sensing systems. Hence, sequences with good autocorrelation properties are very much in demand. In this paper, we addressed the problem of designing a unimodular sequence having better side-lobe levels. We formulated it as a constrained optimization problem comprising the Integrated Side-l… ▽ More Sequences having better autocorrelation properties play a crucial role in enhancing the performance of active sensing systems. Hence, sequences with good autocorrelation properties are very much in demand. In this paper, we addressed the problem of designing a unimodular sequence having better side-lobe levels. We formulated it as a constrained optimization problem comprising the Integrated Side-lobe Level (ISL) metric and then proposed an effective algorithm (named UNIPOL - UNImodular sequence design via a separable iterative POLynomial optimization) where we perform the polynomial optimization at every iteration. The novelty of the paper comes from deriving a quartic majorization function that is separable in the sequence variables and that can be minimized parallelly. To evaluate the performance of our proposed algorithm we perform the numerical experiments for different sequence lengths and confirm that our proposed algorithm is the fastest algorithm to attain an actual optimum minimizer of the ISL metric. Our proposed algorithm is also computationally efficient due to its ease of implementation using the FFT, IFFT operations in a parallel fashion. △ Less

Submitted 9 July, 2021; originally announced July 2021.

Comments: 9 pages 7 figures

Design of MIMO Radar Waveforms based on lp-Norm Criteria

Authors: Ehsan Raei, Mohammad Alaee-Kerahroodi, Prabhu Babu, M. R. Bhavani Shankar

Abstract: Multiple-input multiple-output (MIMO) radars transmit a set of sequences that exhibit small cross-correlation sidelobes, to enhance sensing performance by separating them at the matched filter outputs. The waveforms also require small auto-correlation sidelobes to avoid masking of weak targets by the range sidelobes of strong targets and to mitigate deleterious effects of distributed clutter. In l… ▽ More Multiple-input multiple-output (MIMO) radars transmit a set of sequences that exhibit small cross-correlation sidelobes, to enhance sensing performance by separating them at the matched filter outputs. The waveforms also require small auto-correlation sidelobes to avoid masking of weak targets by the range sidelobes of strong targets and to mitigate deleterious effects of distributed clutter. In light of these requirements, in this paper, we design a set of phase-only (constant modulus) sequences that exhibit near-optimal properties in terms of Peak Sidelobe Level (PSL) and Integrated Sidelobe Level (ISL). At the design stage, we adopt weighted lp-norm of auto- and cross-correlation sidelobes as the objective function and minimize it for a general p value, using block successive upper bound minimization (BSUM). Considering the limitation of radar amplifiers, we design unimodular sequences which make the design problem non-convex and NP-hard. To tackle the problem, in every iteration of the BSUM algorithm, we introduce different local approximation functions and optimize them concerning a block, containing a code entry or a code vector. The numerical results show that the performance of the optimized set of sequences outperforms the state-of-the-art counterparts, in both terms of PSL values and computational time. △ Less

Submitted 7 April, 2021; originally announced April 2021.

Designing sequence set with minimal peak side-lobe level for applications in high resolution RADAR imaging

Authors: Surya Prakash Sankuru, R Jyothi, Prabhu Babu, Mohammad Alaee-Kerahroodi

Abstract: Constant modulus sequence set with low peak side-lobe level is a necessity for enhancing the performance of modern active sensing systems like Multiple Input Multiple Output (MIMO) RADARs. In this paper, we consider the problem of designing a constant modulus sequence set by minimizing the peak side-lobe level, which can be cast as a non-convex minimax problem, and propose a Majorization-Minimizat… ▽ More Constant modulus sequence set with low peak side-lobe level is a necessity for enhancing the performance of modern active sensing systems like Multiple Input Multiple Output (MIMO) RADARs. In this paper, we consider the problem of designing a constant modulus sequence set by minimizing the peak side-lobe level, which can be cast as a non-convex minimax problem, and propose a Majorization-Minimization technique based iterative monotonic algorithm. The iterative steps of our algorithm are computationally not very demanding and they can be efficiently implemented via Fast Fourier Transform (FFT) operations. We also establish the convergence of our proposed algorithm and discuss the computational and space complexities of the algorithm. Finally, through numerical simulations, we illustrate the performance of our method with the state-of-the-art methods. To highlight the potential of our approach, we evaluate the performance of the sequence set designed via our approach in the context of probing sequence set design for MIMO RADAR angle-range imaging application and show results exhibiting good performance of our method when compared with other commonly used sequence set design approaches. △ Less

Submitted 7 September, 2020; originally announced September 2020.

A Fast Iterative Algorithm to design phase only sequences by minimizing the ISL metric

Authors: Surya Prakash Sankuru, Prabhu Babu

Abstract: Unimodular/Phase only sequence having impulse like aperiodic auto-correlation function plays a central role in the applications of RADAR, SONAR, Cryptography, and Wireless (CDMA) Communication Systems. In this paper, we propose a fast iterative algorithm to design phase only sequences of arbitrary lengths by minimizing the Integrated Side-lobe Level (ISL) metric, which is very closely related to t… ▽ More Unimodular/Phase only sequence having impulse like aperiodic auto-correlation function plays a central role in the applications of RADAR, SONAR, Cryptography, and Wireless (CDMA) Communication Systems. In this paper, we propose a fast iterative algorithm to design phase only sequences of arbitrary lengths by minimizing the Integrated Side-lobe Level (ISL) metric, which is very closely related to the auto-correlation property of a sequence. The ISL minimization problem is solved iteratively by using the Majorization-Minimization (MM) technique, which ensures a monotonic convergence to the stationary minimum point. To highlight the performance of a proposed algorithm, we conduct the numerical experiments for different sequence lengths using different initializations and also compare them with the existing algorithms. Numerical simulations show that irrespective of the sequence length and initialization, the proposed algorithm is performing better than the state-of-the-art algorithms in terms of speed of convergence. We also show a computationally efficient way to implement our proposed algorithm by using the FFT and IFFT operations. △ Less

Submitted 15 July, 2020; originally announced July 2020.

Comments: 24 pages, 6 figures

Designing unimodular sequence with good auto-correlation properties via Block Majorization-Minimization method

Authors: Surya Prakash Sankuru, Prabhu Babu

Abstract: Constant modulus sequence having lower side-lobe levels in its auto-correlation function plays an important role in the applications like SONAR, RADAR and digital communication systems. In this paper, we consider the problem of minimizing the Integrated Sidelobe Level (ISL) metric, to design a complex unimodular sequence of any length. The underlying optimization problem is solved iteratively usin… ▽ More Constant modulus sequence having lower side-lobe levels in its auto-correlation function plays an important role in the applications like SONAR, RADAR and digital communication systems. In this paper, we consider the problem of minimizing the Integrated Sidelobe Level (ISL) metric, to design a complex unimodular sequence of any length. The underlying optimization problem is solved iteratively using the Block Majorization-Minimization(MM) technique, which ensures that the resultant algorithm to be monotonic. We also show a computationally efficient way to implement the algorithm using Fast Fourier Transform (FFT) and Inverse Fast Fourier Transform (IFFT) operations. Numerical experiments were conducted to compare the proposed algorithm with the state-of-the art algorithms and was found that the proposed algorithm performs better in terms of computational complexity and speed of convergence. △ Less

Submitted 17 January, 2020; originally announced January 2020.

New Derivation for Gaussian Mixture Model Parameter Estimation: MM Based Approach

Authors: Nitesh Sahu, Prabhu Babu

Abstract: In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the technique of expectation-maximization (EM), is straightforward and doesn't invoke any hidden or latent variables and calculation of the conditional density function.… ▽ More In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the technique of expectation-maximization (EM), is straightforward and doesn't invoke any hidden or latent variables and calculation of the conditional density function. The new derivation is based on the approach of minorization-maximization and involves finding a tighter lower bound of the log-likelihood criterion. The update steps of the parameters, obtained via the new derivation, are same as the update steps obtained via the classical EM algorithm. △ Less

Submitted 9 January, 2020; originally announced January 2020.

A novel Algorithm for Optimal Placement of Multiple Inertial Sensors to Improve the Sensing Accuracy

Authors: Nitesh Sahu, Prabhu Babu, Arun Kumar, Rajendar Bahl

Abstract: This paper proposes a novel algorithm to determine the optimal placement of redundant inertial sensors such as accelerometers and gyroscopes (gyros) for increasing the sensing accuracy. In this paper, we have proposed a novel iterative algorithm to find the optimal sensor configuration. The proposed algorithm utilizes the majorization-minimization (MM) algorithm and the duality principle to find t… ▽ More This paper proposes a novel algorithm to determine the optimal placement of redundant inertial sensors such as accelerometers and gyroscopes (gyros) for increasing the sensing accuracy. In this paper, we have proposed a novel iterative algorithm to find the optimal sensor configuration. The proposed algorithm utilizes the majorization-minimization (MM) algorithm and the duality principle to find the optimal configuration. Unlike the state-of-the-art which are mainly geometrical in nature and restricted to certain noise statistics, the proposed algorithm gives the exact positions of the sensors, and moreover, the proposed algorithm is independent of the nature of the noise at different sensors. The proposed alogrithm has been implemented and tested via numerical simulation in the MATLAB. The simulation results show that the algorithm converges to the optimal configurations and show the effectiveness of the proposed algorithm. △ Less

Submitted 20 May, 2019; originally announced May 2019.

Novel Algorithms based on Majorization Minimization for Nonnegative Matrix Factorization

Authors: R. Jyothi, P. Babu, R. Bahl

Abstract: Matrix decomposition is ubiquitous and has applications in various fields like speech processing, data mining and image processing to name a few. Under matrix decomposition, nonnegative matrix factorization is used to decompose a nonnegative matrix into a product of two nonnegative matrices which gives some meaningful interpretation of the data. Thus, nonnegative matrix factorization has an edge o… ▽ More Matrix decomposition is ubiquitous and has applications in various fields like speech processing, data mining and image processing to name a few. Under matrix decomposition, nonnegative matrix factorization is used to decompose a nonnegative matrix into a product of two nonnegative matrices which gives some meaningful interpretation of the data. Thus, nonnegative matrix factorization has an edge over the other decomposition techniques. In this paper, we propose two novel iterative algorithms based on Majorization Minimization (MM)-in which we formulate a novel upper bound and minimize it to get a closed form solution at every iteration. Since the algorithms are based on MM, it is ensured that the proposed methods will be monotonic. The proposed algorithms differ in the updating approach of the two nonnegative matrices. The first algorithm-Iterative Nonnegative Matrix Factorization (INOM) sequentially updates the two nonnegative matrices while the second algorithm-Parallel Iterative Nonnegative Matrix Factorization (PARINOM) parallely updates them. We also prove that the proposed algorithms converge to the stationary point of the problem. Simulations were conducted to compare the proposed methods with the existing ones and was found that the proposed algorithms performs better than the existing ones in terms of computational speed and convergence. KeyWords: Nonnegative matrix factorization, Majorization Minimization, Big Data, Parallel, Multiplicative Update △ Less

Submitted 11 May, 2019; originally announced May 2019.

SOLVIT:A Reference-Free Source Localization Technique using Majorization Minimization

Authors: R. Jyothi, P. Babu

Abstract: We consider the problem of localizing the source using range and range-difference measurements. Both the problems are non-convex and non-smooth and are challenging to solve. In this paper, we develop an iterative algorithm - Source Localization Via an Iterative technique (SOLVIT) to localize the source using all the distinct range-difference measurements, i.e., without choosing a reference sensor.… ▽ More We consider the problem of localizing the source using range and range-difference measurements. Both the problems are non-convex and non-smooth and are challenging to solve. In this paper, we develop an iterative algorithm - Source Localization Via an Iterative technique (SOLVIT) to localize the source using all the distinct range-difference measurements, i.e., without choosing a reference sensor. SOLVIT is based on the Majorization Minimization approach - in which a novel upper bound is formulated and minimized to get a closed-form solution at every iteration. We also solve the source localization problem based on range measurements and rederive the Standard Fixed Point algorithm using the Majorization Minimization approach. By doing so, we show a less intricate way to prove the convergence of the Standard Fixed Point algorithm. Numerical simulations and experiments in an anechoic chamber confirm that SOLVIT performs better than existing reference-based and reference-free methods in terms of source positioning accuracy. △ Less

Submitted 7 February, 2020; v1 submitted 11 May, 2019; originally announced May 2019.