-
Ship Detection in Remote Sensing Imagery for Arbitrarily Oriented Object Detection
Authors:
Bibi Erum Ayesha,
T. Satyanarayana Murthy,
Palamakula Ramesh Babu,
Ramu Kuchipudi
Abstract:
This research paper presents an innovative ship detection system tailored for applications like maritime surveillance and ecological monitoring. The study employs YOLOv8 and repurposed U-Net, two advanced deep learning models, to significantly enhance ship detection accuracy. Evaluation metrics include Mean Average Precision (mAP), processing speed, and overall accuracy. The research utilizes the…
▽ More
This research paper presents an innovative ship detection system tailored for applications like maritime surveillance and ecological monitoring. The study employs YOLOv8 and repurposed U-Net, two advanced deep learning models, to significantly enhance ship detection accuracy. Evaluation metrics include Mean Average Precision (mAP), processing speed, and overall accuracy. The research utilizes the "Airbus Ship Detection" dataset, featuring diverse remote sensing images, to assess the models' versatility in detecting ships with varying orientations and environmental contexts. Conventional ship detection faces challenges with arbitrary orientations, complex backgrounds, and obscured perspectives. Our approach incorporates YOLOv8 for real-time processing and U-Net for ship instance segmentation. Evaluation focuses on mAP, processing speed, and overall accuracy. The dataset is chosen for its diverse images, making it an ideal benchmark. Results demonstrate significant progress in ship detection. YOLOv8 achieves an 88% mAP, excelling in accurate and rapid ship detection. U Net, adapted for ship instance segmentation, attains an 89% mAP, improving boundary delineation and handling occlusions. This research enhances maritime surveillance, disaster response, and ecological monitoring, exemplifying the potential of deep learning models in ship detection.
△ Less
Submitted 17 March, 2025;
originally announced March 2025.
-
Dual-Function Beamforming Design For Multi-Target Localization and Reliable Communications
Authors:
Bo Tang,
Da Li,
Wenjun Wu,
Astha Saini,
Prabhu Babu,
Petre Stoica
Abstract:
This paper investigates the transmit beamforming design for multiple-input multiple-output systems to support both multi-target localization and multi-user communications. To enhance the target localization performance, we derive the asymptotic Cramér-Rao bound (CRB) for target angle estimation by assuming that the receive array is linear and uniform. Then we formulate a beamforming design problem…
▽ More
This paper investigates the transmit beamforming design for multiple-input multiple-output systems to support both multi-target localization and multi-user communications. To enhance the target localization performance, we derive the asymptotic Cramér-Rao bound (CRB) for target angle estimation by assuming that the receive array is linear and uniform. Then we formulate a beamforming design problem based on minimizing an upper bound on the asymptotic CRB (which is shown to be equivalent to {maximizing} the harmonic mean of the weighted beampattern responses at the target directions). Moreover, we impose a constraint on the SINR of each received communication signal to guarantee reliable communication performance. Two iterative algorithms are derived to tackle the non-convex design problem: one is based on the alternating direction method of multipliers, and the other uses the majorization-minimization technique to solve an equivalent minimax problem. Numerical results show that, through elaborate dual-function beamforming matrix design, the proposed algorithms can simultaneously achieve superior angle estimation performance as well as high-quality multi-user communications.
△ Less
Submitted 13 January, 2025;
originally announced January 2025.
-
Min-Max Framework for Majorization-Minimization Algorithms in Signal Processing Applications: An Overview
Authors:
Astha Saini,
Petre Stoica,
Prabhu Babu,
Aakash Arora
Abstract:
This monograph presents a theoretical background and a broad introduction to the Min-Max Framework for Majorization-Minimization (MM4MM), an algorithmic methodology for solving minimization problems by formulating them as min-max problems and then employing majorization-minimization. The monograph lays out the mathematical basis of the approach used to reformulate a minimization problem as a min-m…
▽ More
This monograph presents a theoretical background and a broad introduction to the Min-Max Framework for Majorization-Minimization (MM4MM), an algorithmic methodology for solving minimization problems by formulating them as min-max problems and then employing majorization-minimization. The monograph lays out the mathematical basis of the approach used to reformulate a minimization problem as a min-max problem. With the prerequisites covered, including multiple illustrations of the formulations for convex and non-convex functions, this work serves as a guide for developing MM4MM-based algorithms for solving non-convex optimization problems in various areas of signal processing. As special cases, we discuss using the majorization-minimization technique to solve min-max problems encountered in signal processing applications and min-max problems formulated using the Lagrangian. Lastly, we present detailed examples of using MM4MM in ten signal processing applications such as phase retrieval, source localization, independent vector analysis, beamforming and optimal sensor placement in wireless sensor networks. The devised MM4MM algorithms are free of hyper-parameters and enjoy the advantages inherited from the use of the majorization-minimization technique such as monotonicity.
△ Less
Submitted 12 November, 2024;
originally announced November 2024.
-
New Methods for MLE of Toeplitz Structured Covariance Matrices with Applications to RADAR Problems
Authors:
Augusto Aubry,
Prabhu Babu,
Antonio De Maio,
Massimo Rosamilia
Abstract:
This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent statistical learning framework. Both the strategies are based on the Majorization Minimization (MM) paradigm and hence enjoy nice properties s…
▽ More
This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent statistical learning framework. Both the strategies are based on the Majorization Minimization (MM) paradigm and hence enjoy nice properties such as monotonicity and ensured convergence to a stationary point of the equivalent MLE problem. The proposed framework is also extended to deal with MLE of other practically relevant covariance structures, namely, the banded Toeplitz, block Toeplitz, and Toeplitz-block-Toeplitz. Through numerical simulations, it is shown that the new methods provide excellent performance levels in terms of both mean square estimation error (which is very close to the benchmark Cramér-Rao Bound (CRB)) and signal-to-interference-plus-noise ratio, especially in comparison with state of the art strategies.
△ Less
Submitted 8 July, 2023;
originally announced July 2023.
-
Two new algorithms for maximum likelihood estimation of sparse covariance matrices with applications to graphical modeling
Authors:
Ghania Fatima,
Prabhu Babu,
Petre Stoica
Abstract:
In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the likelihood to impose sparsity, we solve the MLE problem based on an estimated covariance graph. More specifically, we propose a two-stage procedure: in the first s…
▽ More
In this paper, we propose two new algorithms for maximum-likelihood estimation (MLE) of high dimensional sparse covariance matrices. Unlike most of the state of-the-art methods, which either use regularization techniques or penalize the likelihood to impose sparsity, we solve the MLE problem based on an estimated covariance graph. More specifically, we propose a two-stage procedure: in the first stage, we determine the sparsity pattern of the target covariance matrix (in other words the marginal independence in the covariance graph under a Gaussian graphical model) using the multiple hypothesis testing method of false discovery rate (FDR), and in the second stage we use either a block coordinate descent approach to estimate the non-zero values or a proximal distance approach that penalizes the distance between the estimated covariance graph and the target covariance matrix. Doing so gives rise to two different methods, each with its own advantage: the coordinate descent approach does not require tuning of any hyper-parameters, whereas the proximal distance approach is computationally fast but requires a careful tuning of the penalty parameter. Both methods are effective even in cases where the number of observed samples is less than the dimension of the data. For performance evaluation, we test the proposed methods on both simulated and real-world data and show that they provide more accurate estimates of the sparse covariance matrix than two state-of-the-art methods.
△ Less
Submitted 11 May, 2023;
originally announced May 2023.
-
Pearson-Matthews correlation coefficients for binary and multinary classification and hypothesis testing
Authors:
Petre Stoica,
Prabhu Babu
Abstract:
The Pearson-Matthews correlation coefficient (usually abbreviated MCC) is considered to be one of the most useful metrics for the performance of a binary classification or hypothesis testing method (for the sake of conciseness we will use the classification terminology throughout, but the concepts and methods discussed in the paper apply verbatim to hypothesis testing as well). For multinary class…
▽ More
The Pearson-Matthews correlation coefficient (usually abbreviated MCC) is considered to be one of the most useful metrics for the performance of a binary classification or hypothesis testing method (for the sake of conciseness we will use the classification terminology throughout, but the concepts and methods discussed in the paper apply verbatim to hypothesis testing as well). For multinary classification tasks (with more than two classes) the existing extension of MCC, commonly called the $\text{R}_{\text{K}}$ metric, has also been successfully used in many applications. The present paper begins with an introductory discussion on certain aspects of MCC. Then we go on to discuss the topic of multinary classification that is the main focus of this paper and which, despite its practical and theoretical importance, appears to be less developed than the topic of binary classification. Our discussion of the $\text{R}_{\text{K}}$ is followed by the introduction of two other metrics for multinary classification derived from the multivariate Pearson correlation (MPC) coefficients. We show that both $\text{R}_{\text{K}}$ and the MPC metrics suffer from the problem of not decisively indicating poor classification results when they should, and introduce three new enhanced metrics that do not suffer from this problem. We also present an additional new metric for multinary classification which can be viewed as a direct extension of MCC.
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
Fair principal component analysis (PCA): minorization-maximization algorithms for Fair PCA, Fair Robust PCA and Fair Sparse PCA
Authors:
Prabhu Babu,
Petre Stoica
Abstract:
In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the minorization-maximization (MM) approach. The proposed algorithm relies on the relaxation of a semi-orthogonality constraint which is proved to be tight at every…
▽ More
In this paper we propose a new iterative algorithm to solve the fair PCA (FPCA) problem. We start with the max-min fair PCA formulation originally proposed in [1] and derive a simple and efficient iterative algorithm which is based on the minorization-maximization (MM) approach. The proposed algorithm relies on the relaxation of a semi-orthogonality constraint which is proved to be tight at every iteration of the algorithm. The vanilla version of the proposed algorithm requires solving a semi-definite program (SDP) at every iteration, which can be further simplified to a quadratic program by formulating the dual of the surrogate maximization problem. We also propose two important reformulations of the fair PCA problem: a) fair robust PCA -- which can handle outliers in the data, and b) fair sparse PCA -- which can enforce sparsity on the estimated fair principal components. The proposed algorithms are computationally efficient and monotonically increase their respective design objectives at every iteration. An added feature of the proposed algorithms is that they do not require the selection of any hyperparameter (except for the fair sparse PCA case where a penalty parameter that controls the sparsity has to be chosen by the user). We numerically compare the performance of the proposed methods with two of the state-of-the-art approaches on synthetic data sets and a real-life data set.
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
Low-rank covariance matrix estimation for factor analysis in anisotropic noise: application to array processing and portfolio selection
Authors:
Petre Stoica,
Prabhu Babu
Abstract:
Factor analysis (FA) or principal component analysis (PCA) models the covariance matrix of the observed data as R = SS' + Σ, where SS' is the low-rank covariance matrix of the factors (aka latent variables) and Σ is the diagonal matrix of the noise. When the noise is anisotropic (aka nonuniform in the signal processing literature and heteroscedastic in the statistical literature), the diagonal ele…
▽ More
Factor analysis (FA) or principal component analysis (PCA) models the covariance matrix of the observed data as R = SS' + Σ, where SS' is the low-rank covariance matrix of the factors (aka latent variables) and Σ is the diagonal matrix of the noise. When the noise is anisotropic (aka nonuniform in the signal processing literature and heteroscedastic in the statistical literature), the diagonal elements of Σ cannot be assumed to be identical and they must be estimated jointly with the elements of SS'. The problem of estimating SS' and Σ in the above covariance model is the central theme of the present paper. After stating this problem in a more formal way, we review the main existing algorithms for solving it. We then go on to show that these algorithms have reliability issues (such as lack of convergence or convergence to infeasible solutions) and therefore they may not be the best possible choice for practical applications. Next we explain how to modify one of these algorithms to improve its convergence properties and we also introduce a new method that we call FAAN (Factor Analysis for Anisotropic Noise). FAAN is a coordinate descent algorithm that iteratively maximizes the normal likelihood function, which is easy to implement in a numerically efficient manner and has excellent convergence properties as illustrated by the numerical examples presented in the paper. Out of the many possible applications of FAAN we focus on the following two: direction-of-arrival (DOA) estimation using array signal processing techniques and portfolio selection for financial asset management.
△ Less
Submitted 18 April, 2023;
originally announced April 2023.
-
Comments on "Iteratively Re-weighted Algorithm for Fuzzy c-Means"
Authors:
Astha Saini,
Prabhu Babu
Abstract:
In this comment, we present a simple alternate derivation to the IRW-FCM algorithm presented in "Iteratively Re-weighted Algorithm for Fuzzy c-Means" for Fuzzy c-Means problem. We show that the iterative steps derived for IRW-FCM algorithm are nothing but steps of the popular Majorization Minimization (MM) algorithm. The derivation presented in this note is much simpler and straightforward and, un…
▽ More
In this comment, we present a simple alternate derivation to the IRW-FCM algorithm presented in "Iteratively Re-weighted Algorithm for Fuzzy c-Means" for Fuzzy c-Means problem. We show that the iterative steps derived for IRW-FCM algorithm are nothing but steps of the popular Majorization Minimization (MM) algorithm. The derivation presented in this note is much simpler and straightforward and, unlike the derivation of IRW-FCM, the derivation here does not involve introduction of any auxiliary variable. Moreover, by showing the steps of IRW-FCM as the MM algorithm, the inner loop of the IRW-FCM algorithm can be eliminated and the algorithm can be effectively run as a "single loop" algorithm. More precisely, the new MM-based derivation deduces that a single inner loop of IRW-FCM is sufficient to decrease the Fuzzy c-means objective function, which speeds up the IRW-FCM algorithm.
△ Less
Submitted 16 September, 2022;
originally announced September 2022.
-
Majorization-Minimization based Hybrid Localization Method for High Precision Localization in Wireless Sensor Networks
Authors:
Kuntal Panwar,
Prabhu Babu
Abstract:
This paper investigates the hybrid source localization problem using the four radio measurements - time of arrival (TOA), time difference of arrival (TDOA), received signal strength (RSS), and angle of arrival (AOA). First, after invoking tractable approximations in the RSS and AOA models, the maximum likelihood estimation (MLE) problem for the hybrid TOA-TDOA-RSS-AOA data model is derived. Then a…
▽ More
This paper investigates the hybrid source localization problem using the four radio measurements - time of arrival (TOA), time difference of arrival (TDOA), received signal strength (RSS), and angle of arrival (AOA). First, after invoking tractable approximations in the RSS and AOA models, the maximum likelihood estimation (MLE) problem for the hybrid TOA-TDOA-RSS-AOA data model is derived. Then a weighted least-squares problem is formulated from the MLE, which is solved using the principle of the majorization-minimization (MM), resulting in an iterative algorithm with guaranteed convergence. The key feature of the proposed method is that it provides a unified framework where localization using any possible merger out of these four measurements can be implemented as per the requirement/application. Extensive numerical simulations are conducted to study the performance of the proposed method. The obtained results indicate that the hybrid localization model improves the localization accuracy compared to the heterogeneous measurements under different network scenarios, which also includes the presence of non-line of sight (NLOS) errors.
△ Less
Submitted 28 November, 2023; v1 submitted 8 May, 2022;
originally announced May 2022.
-
Optimal Sensor Placement for Hybrid Source Localization Using Fused TOA-RSS-AOA Measurements
Authors:
Kuntal Panwar,
Ghania Fatima,
Prabhu Babu
Abstract:
Source localization techniques incorporating hybrid measurements improve the reliability and accuracy of the location estimate. Given a set of hybrid sensors that can collect combined time of arrival (TOA), received signal strength (RSS) and angle of arrival (AOA) measurements, the localization accuracy can be enhanced further by optimally designing the placements of the hybrid sensors. In this pa…
▽ More
Source localization techniques incorporating hybrid measurements improve the reliability and accuracy of the location estimate. Given a set of hybrid sensors that can collect combined time of arrival (TOA), received signal strength (RSS) and angle of arrival (AOA) measurements, the localization accuracy can be enhanced further by optimally designing the placements of the hybrid sensors. In this paper, we present an optimal sensor placement methodology, which is based on the principle of majorization-minimization (MM), for hybrid localization technique. We first derive the Cramer-Rao lower bound (CRLB) of the hybrid measurement model, and formulate the design problem using the A-optimal criterion. Next, we introduce an auxiliary variable to reformulate the design problem into an equivalent saddle-point problem, and then construct simple surrogate functions (having closed form solutions) over both primal and dual variables. The application of MM in this paper is distinct from the conventional MM (that is usually developed only over the primal variable), and we believe that the MM framework developed in this paper can be employed to solve many optimization problems. The main advantage of our method over most of the existing state-of-the-art algorithms (which are mostly analytical in nature) is its ability to work for both uncorrelated and correlated noise in the measurements. We also discuss the extension of the proposed algorithm for the optimal placement designs based on D and E optimal criteria. Finally, the performance of the proposed method is studied under different noise conditions and different design parameters.
△ Less
Submitted 13 April, 2022;
originally announced April 2022.
-
Designing Interference-Immune Doppler-TolerantWaveforms for Automotive Radar Applications
Authors:
Robin Amar,
Mohammad Alaee-Kerahroodi,
Prabhu Babu,
Bhavani Shankar M. R
Abstract:
Dynamic target detection using FMCW waveform is challenging in the presence of interference for different radar applications. Degradation in SNR is irreparable and interference is difficult to mitigate in time and frequency domain. In this paper, a waveform design problem is addressed using the Majorization-Minimization (MM) framework by considering PSL/ISL cost functions, resulting in a code sequ…
▽ More
Dynamic target detection using FMCW waveform is challenging in the presence of interference for different radar applications. Degradation in SNR is irreparable and interference is difficult to mitigate in time and frequency domain. In this paper, a waveform design problem is addressed using the Majorization-Minimization (MM) framework by considering PSL/ISL cost functions, resulting in a code sequence with Doppler-tolerance characteristics of an FMCW waveform and interference immune characteristics of a tailored PMCW waveform (unique phase code + minimal ISL/PSL). The optimal design sequences possess polynomial phase behavior of degree Q amongst its sub-sequences and obtain optimal ISL and PSL solutions with guaranteed convergence. By tuning the optimization parameters such as degree Q of the polynomial phase behavior, sub-sequence length M and the total number of sub-sequences L, the optimized sequences can be as Doppler tolerant as FMCW waveform in one end, and they can possess small cross-correlation values similar to random-phase sequences in PMCW waveform on the other end. If required in the event of acute interference, new codes can be generated in the runtime which have low cross-correlation with the interferers. The performance analysis indicates that the proposed method outperforms the state-of-the-art counterparts.
△ Less
Submitted 5 April, 2022;
originally announced April 2022.
-
Learning Sparse Graphs via Majorization-Minimization for Smooth Node Signals
Authors:
Ghania Fatima,
Aakash Arora,
Prabhu Babu,
Petre Stoica
Abstract:
In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the principle of majorization-minimization (MM), wherein we first obtain a tight surrogate function for the graph learning objective and then solve the resultant s…
▽ More
In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the principle of majorization-minimization (MM), wherein we first obtain a tight surrogate function for the graph learning objective and then solve the resultant surrogate problem which has a simple closed form solution. The proposed algorithm does not require tuning of any hyperparameter and it has the desirable feature of eliminating the inactive variables in the course of the iterations - which can help speeding up the algorithm. The numerical simulations conducted using both synthetic and real world (brain-network) data show that the proposed algorithm converges faster, in terms of the average number of iterations, than several existing methods in the literature.
△ Less
Submitted 6 February, 2022;
originally announced February 2022.
-
PROMPT: Parallel Iterative Algorithm for $\ell_{p}$ norm linear regression via Majorization Minimization with an application to semi-supervised graph learning
Authors:
R. Jyothi,
P. Babu
Abstract:
In this paper, we consider the problem of $\ell_{p}$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning. The problem, even though convex, does not enjoy a closed-form solution. The state-of-the-art algorithms are iterative but suffer from convergence issues, i.e., they either diverge for p>3 or the convergence to the opt…
▽ More
In this paper, we consider the problem of $\ell_{p}$ norm linear regression, which has several applications such as in sparse recovery, data clustering, and semi-supervised learning. The problem, even though convex, does not enjoy a closed-form solution. The state-of-the-art algorithms are iterative but suffer from convergence issues, i.e., they either diverge for p>3 or the convergence to the optimal solution is sensitive to the initialization of the algorithm. Also, these algorithms are not generalizable to every possible value of $p$. In this paper, we propose an iterative algorithm : Parallel IteRative AlgOrithM for $\ell_{P}$ norm regression via MajorizaTion Minimization (PROMPT) based on the principle of Majorization Minimization and prove that the proposed algorithm is monotonic and converges to the optimal solution of the problem for any value of $p$. The proposed algorithm can also parallelly update each element of the regression variable, which helps to handle large scale data efficiently, a common scenario in this era of data explosion. Subsequently, we show that the proposed algorithm can also be applied for the graph based semi-supervised learning problem. We show through numerical simulations that the proposed algorithm converges to the optimal solution for any random initialization and also performs better than the state-of-the-art algorithms in terms of speed of convergence. We also evaluate the performance of the proposed algorithm using simulated and real data for the graph based semi-supervised learning problem.
△ Less
Submitted 23 October, 2021;
originally announced October 2021.
-
TELET: A Monotonic Algorithm to Design Large Dimensional Equiangular Tight Frames for Applications in Compressed Sensing
Authors:
R. Jyothi,
P. Babu
Abstract:
An Equiangular tight frame (ETF) - also known as the Welch-bound-equality sequences - consists of a sequence of unit norm vectors whose absolute inner product is identical and minimal. Due to this unique property, these frames are preferred in different applications such as in constructing sensing matrices for compressed sensing systems, robust transmission, and quantum computing. Construction of…
▽ More
An Equiangular tight frame (ETF) - also known as the Welch-bound-equality sequences - consists of a sequence of unit norm vectors whose absolute inner product is identical and minimal. Due to this unique property, these frames are preferred in different applications such as in constructing sensing matrices for compressed sensing systems, robust transmission, and quantum computing. Construction of ETFs involves solving a challenging non-convex minimax optimization problem, and only a few methods were successful in constructing them, albeit only for smaller dimensions. In this paper, we propose an iterative algorithm named TEchnique to devise Large dimensional Equiangular Tight-frames (TELET-frames) based on the majorization minimization (MM) procedure - in which we design and minimize a tight upper bound for the ETF cost function at every iteration. Since TELET is designed using the MM approach, it inherits useful properties of MM such as monotonicity and guaranteed convergence to a stationary point. Subsequently, we use the derived frames to construct optimized sensing matrix for compressed sensing systems. In the numerical simulations, we show that the proposed algorithm can generate complex and real frames (in the order of hundreds) with very low mutual coherence value when compared to the state-of-the-art algorithm, with a slight increase in computational cost. Experiments using synthetic data and real images reveal that the optimized sensing matrix obtained through the frames constructed by TELET performs better, in terms of image reconstruction accuracy, than the sensing matrix constructed using state-of-the-art methods.
△ Less
Submitted 23 October, 2021;
originally announced October 2021.
-
New Methods for MLE of Toeplitz Structured Covariance Matrices with Applications to RADAR Problems
Authors:
Augusto Aubry,
Prabhu Babu,
Antonio De Maio,
Rikhabchand Jyothi
Abstract:
This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent problem. Both the strategies are based on the Majorization Minimization (MM) framework and hence enjoy nice properties such as monotonicity an…
▽ More
This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization of the equivalent problem. Both the strategies are based on the Majorization Minimization (MM) framework and hence enjoy nice properties such as monotonicity and ensured convergence to a stationary point of the equivalent MLE problem. The proposed algorithms are also extended to deal with MLE of other related covariance structures, namely, the banded Toeplitz, Toeplitz-block-Toeplitz, low rank Toeplitz structure plus a scalar matrix (accounting for white noise), and finally Toeplitz matrices satisfying a condition number constraint. Through numerical simulations, it is shown that new methods provide satisfactory performance levels in terms of both mean square estimation error and signal-to-interference-plus-noise ratio.
△ Less
Submitted 23 October, 2021;
originally announced October 2021.
-
PDMM: A novel Primal-Dual Majorization-Minimization algorithm for Poisson Phase-Retrieval problem
Authors:
Ghania Fatima,
Zongyu Li,
Aakash Arora,
Prabhu Babu
Abstract:
In this paper, we introduce a novel iterative algorithm for the problem of phase-retrieval where the measurements consist of only the magnitude of linear function of the unknown signal, and the noise in the measurements follow Poisson distribution. The proposed algorithm is based on the principle of majorization-minimization (MM); however, the application of MM here is very novel and distinct from…
▽ More
In this paper, we introduce a novel iterative algorithm for the problem of phase-retrieval where the measurements consist of only the magnitude of linear function of the unknown signal, and the noise in the measurements follow Poisson distribution. The proposed algorithm is based on the principle of majorization-minimization (MM); however, the application of MM here is very novel and distinct from the way MM has been usually used to solve optimization problems in the literature. More precisely, we reformulate the original minimization problem into a saddle point problem by invoking Fenchel dual representation of the log (.) term in the Poisson likelihood function. We then propose tighter surrogate functions over both primal and dual variables resulting in a double-loop MM algorithm, which we have named as Primal-Dual Majorization-Minimization (PDMM) algorithm. The iterative steps of the resulting algorithm are simple to implement and involve only computing matrix vector products. We also extend our algorithm to handle various L1 regularized Poisson phase-retrieval problems (which exploit sparsity). The proposed algorithm is compared with previously proposed algorithms such as wirtinger flow (WF), MM (conventional), and alternating direction methods of multipliers (ADMM) for the Poisson data model. The simulation results under different experimental settings show that PDMM is faster than the competing methods, and its performance in recovering the original signal is at par with the state-of-the-art algorithms.
△ Less
Submitted 16 October, 2021;
originally announced October 2021.
-
Optimal Sensor Placement for Source Localization: A Unified ADMM Approach
Authors:
Nitesh Sahu,
Linlong Wu,
Prabhu Babu,
Bhavani Shankar M. R.,
Björn Ottersten
Abstract:
Source localization plays a key role in many applications including radar, wireless and underwater communications. Among various localization methods, the most popular ones are Time-Of-Arrival (TOA), Time-Difference-Of-Arrival (TDOA), and Received Signal Strength (RSS) based. Since the Cramér-Rao lower bounds (CRLB) of these methods depend on the sensor geometry explicitly, sensor placement become…
▽ More
Source localization plays a key role in many applications including radar, wireless and underwater communications. Among various localization methods, the most popular ones are Time-Of-Arrival (TOA), Time-Difference-Of-Arrival (TDOA), and Received Signal Strength (RSS) based. Since the Cramér-Rao lower bounds (CRLB) of these methods depend on the sensor geometry explicitly, sensor placement becomes a crucial issue in source localization applications. In this paper, we consider finding the optimal sensor placements for the TOA, TDOA and RSS based localization scenarios. We first unify the three localization models by a generalized problem formulation based on the CRLB-related metric. Then a unified optimization framework for optimal sensor placement (UTMOST) is developed through the combination of the alternating direction method of multipliers (ADMM) and majorization-minimization (MM) techniques. Unlike the majority of the state-of-the-art works, the proposed UTMOST neither approximates the design criterion nor considers only uncorrelated noise in the measurements. It can readily adapt to to different design criteria (i.e. A, D and E-optimality) with slight modifications within the framework and yield the optimal sensor placements correspondingly. Extensive numerical experiments are performed to exhibit the efficacy and flexibility of the proposed framework.
△ Less
Submitted 4 March, 2022; v1 submitted 8 September, 2021;
originally announced September 2021.
-
UNIPOL: Unimodular sequence design via a separable iterative quartic polynomial optimization for active sensing systems
Authors:
Surya Prakash Sankuru,
Prabhu Babu,
Mohammad Alaee-Kerahroodi
Abstract:
Sequences having better autocorrelation properties play a crucial role in enhancing the performance of active sensing systems. Hence, sequences with good autocorrelation properties are very much in demand. In this paper, we addressed the problem of designing a unimodular sequence having better side-lobe levels. We formulated it as a constrained optimization problem comprising the Integrated Side-l…
▽ More
Sequences having better autocorrelation properties play a crucial role in enhancing the performance of active sensing systems. Hence, sequences with good autocorrelation properties are very much in demand. In this paper, we addressed the problem of designing a unimodular sequence having better side-lobe levels. We formulated it as a constrained optimization problem comprising the Integrated Side-lobe Level (ISL) metric and then proposed an effective algorithm (named UNIPOL - UNImodular sequence design via a separable iterative POLynomial optimization) where we perform the polynomial optimization at every iteration. The novelty of the paper comes from deriving a quartic majorization function that is separable in the sequence variables and that can be minimized parallelly. To evaluate the performance of our proposed algorithm we perform the numerical experiments for different sequence lengths and confirm that our proposed algorithm is the fastest algorithm to attain an actual optimum minimizer of the ISL metric. Our proposed algorithm is also computationally efficient due to its ease of implementation using the FFT, IFFT operations in a parallel fashion.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Design of MIMO Radar Waveforms based on lp-Norm Criteria
Authors:
Ehsan Raei,
Mohammad Alaee-Kerahroodi,
Prabhu Babu,
M. R. Bhavani Shankar
Abstract:
Multiple-input multiple-output (MIMO) radars transmit a set of sequences that exhibit small cross-correlation sidelobes, to enhance sensing performance by separating them at the matched filter outputs. The waveforms also require small auto-correlation sidelobes to avoid masking of weak targets by the range sidelobes of strong targets and to mitigate deleterious effects of distributed clutter. In l…
▽ More
Multiple-input multiple-output (MIMO) radars transmit a set of sequences that exhibit small cross-correlation sidelobes, to enhance sensing performance by separating them at the matched filter outputs. The waveforms also require small auto-correlation sidelobes to avoid masking of weak targets by the range sidelobes of strong targets and to mitigate deleterious effects of distributed clutter. In light of these requirements, in this paper, we design a set of phase-only (constant modulus) sequences that exhibit near-optimal properties in terms of Peak Sidelobe Level (PSL) and Integrated Sidelobe Level (ISL). At the design stage, we adopt weighted lp-norm of auto- and cross-correlation sidelobes as the objective function and minimize it for a general p value, using block successive upper bound minimization (BSUM). Considering the limitation of radar amplifiers, we design unimodular sequences which make the design problem non-convex and NP-hard. To tackle the problem, in every iteration of the BSUM algorithm, we introduce different local approximation functions and optimize them concerning a block, containing a code entry or a code vector. The numerical results show that the performance of the optimized set of sequences outperforms the state-of-the-art counterparts, in both terms of PSL values and computational time.
△ Less
Submitted 7 April, 2021;
originally announced April 2021.
-
Designing sequence set with minimal peak side-lobe level for applications in high resolution RADAR imaging
Authors:
Surya Prakash Sankuru,
R Jyothi,
Prabhu Babu,
Mohammad Alaee-Kerahroodi
Abstract:
Constant modulus sequence set with low peak side-lobe level is a necessity for enhancing the performance of modern active sensing systems like Multiple Input Multiple Output (MIMO) RADARs. In this paper, we consider the problem of designing a constant modulus sequence set by minimizing the peak side-lobe level, which can be cast as a non-convex minimax problem, and propose a Majorization-Minimizat…
▽ More
Constant modulus sequence set with low peak side-lobe level is a necessity for enhancing the performance of modern active sensing systems like Multiple Input Multiple Output (MIMO) RADARs. In this paper, we consider the problem of designing a constant modulus sequence set by minimizing the peak side-lobe level, which can be cast as a non-convex minimax problem, and propose a Majorization-Minimization technique based iterative monotonic algorithm. The iterative steps of our algorithm are computationally not very demanding and they can be efficiently implemented via Fast Fourier Transform (FFT) operations. We also establish the convergence of our proposed algorithm and discuss the computational and space complexities of the algorithm. Finally, through numerical simulations, we illustrate the performance of our method with the state-of-the-art methods. To highlight the potential of our approach, we evaluate the performance of the sequence set designed via our approach in the context of probing sequence set design for MIMO RADAR angle-range imaging application and show results exhibiting good performance of our method when compared with other commonly used sequence set design approaches.
△ Less
Submitted 7 September, 2020;
originally announced September 2020.
-
A Fast Iterative Algorithm to design phase only sequences by minimizing the ISL metric
Authors:
Surya Prakash Sankuru,
Prabhu Babu
Abstract:
Unimodular/Phase only sequence having impulse like aperiodic auto-correlation function plays a central role in the applications of RADAR, SONAR, Cryptography, and Wireless (CDMA) Communication Systems. In this paper, we propose a fast iterative algorithm to design phase only sequences of arbitrary lengths by minimizing the Integrated Side-lobe Level (ISL) metric, which is very closely related to t…
▽ More
Unimodular/Phase only sequence having impulse like aperiodic auto-correlation function plays a central role in the applications of RADAR, SONAR, Cryptography, and Wireless (CDMA) Communication Systems. In this paper, we propose a fast iterative algorithm to design phase only sequences of arbitrary lengths by minimizing the Integrated Side-lobe Level (ISL) metric, which is very closely related to the auto-correlation property of a sequence. The ISL minimization problem is solved iteratively by using the Majorization-Minimization (MM) technique, which ensures a monotonic convergence to the stationary minimum point. To highlight the performance of a proposed algorithm, we conduct the numerical experiments for different sequence lengths using different initializations and also compare them with the existing algorithms. Numerical simulations show that irrespective of the sequence length and initialization, the proposed algorithm is performing better than the state-of-the-art algorithms in terms of speed of convergence. We also show a computationally efficient way to implement our proposed algorithm by using the FFT and IFFT operations.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
Designing unimodular sequence with good auto-correlation properties via Block Majorization-Minimization method
Authors:
Surya Prakash Sankuru,
Prabhu Babu
Abstract:
Constant modulus sequence having lower side-lobe levels in its auto-correlation function plays an important role in the applications like SONAR, RADAR and digital communication systems. In this paper, we consider the problem of minimizing the Integrated Sidelobe Level (ISL) metric, to design a complex unimodular sequence of any length. The underlying optimization problem is solved iteratively usin…
▽ More
Constant modulus sequence having lower side-lobe levels in its auto-correlation function plays an important role in the applications like SONAR, RADAR and digital communication systems. In this paper, we consider the problem of minimizing the Integrated Sidelobe Level (ISL) metric, to design a complex unimodular sequence of any length. The underlying optimization problem is solved iteratively using the Block Majorization-Minimization(MM) technique, which ensures that the resultant algorithm to be monotonic. We also show a computationally efficient way to implement the algorithm using Fast Fourier Transform (FFT) and Inverse Fast Fourier Transform (IFFT) operations. Numerical experiments were conducted to compare the proposed algorithm with the state-of-the art algorithms and was found that the proposed algorithm performs better in terms of computational complexity and speed of convergence.
△ Less
Submitted 17 January, 2020;
originally announced January 2020.
-
New Derivation for Gaussian Mixture Model Parameter Estimation: MM Based Approach
Authors:
Nitesh Sahu,
Prabhu Babu
Abstract:
In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the technique of expectation-maximization (EM), is straightforward and doesn't invoke any hidden or latent variables and calculation of the conditional density function.…
▽ More
In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the technique of expectation-maximization (EM), is straightforward and doesn't invoke any hidden or latent variables and calculation of the conditional density function. The new derivation is based on the approach of minorization-maximization and involves finding a tighter lower bound of the log-likelihood criterion. The update steps of the parameters, obtained via the new derivation, are same as the update steps obtained via the classical EM algorithm.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
A novel Algorithm for Optimal Placement of Multiple Inertial Sensors to Improve the Sensing Accuracy
Authors:
Nitesh Sahu,
Prabhu Babu,
Arun Kumar,
Rajendar Bahl
Abstract:
This paper proposes a novel algorithm to determine the optimal placement of redundant inertial sensors such as accelerometers and gyroscopes (gyros) for increasing the sensing accuracy. In this paper, we have proposed a novel iterative algorithm to find the optimal sensor configuration. The proposed algorithm utilizes the majorization-minimization (MM) algorithm and the duality principle to find t…
▽ More
This paper proposes a novel algorithm to determine the optimal placement of redundant inertial sensors such as accelerometers and gyroscopes (gyros) for increasing the sensing accuracy. In this paper, we have proposed a novel iterative algorithm to find the optimal sensor configuration. The proposed algorithm utilizes the majorization-minimization (MM) algorithm and the duality principle to find the optimal configuration. Unlike the state-of-the-art which are mainly geometrical in nature and restricted to certain noise statistics, the proposed algorithm gives the exact positions of the sensors, and moreover, the proposed algorithm is independent of the nature of the noise at different sensors. The proposed alogrithm has been implemented and tested via numerical simulation in the MATLAB. The simulation results show that the algorithm converges to the optimal configurations and show the effectiveness of the proposed algorithm.
△ Less
Submitted 20 May, 2019;
originally announced May 2019.
-
Novel Algorithms based on Majorization Minimization for Nonnegative Matrix Factorization
Authors:
R. Jyothi,
P. Babu,
R. Bahl
Abstract:
Matrix decomposition is ubiquitous and has applications in various fields like speech processing, data mining and image processing to name a few. Under matrix decomposition, nonnegative matrix factorization is used to decompose a nonnegative matrix into a product of two nonnegative matrices which gives some meaningful interpretation of the data. Thus, nonnegative matrix factorization has an edge o…
▽ More
Matrix decomposition is ubiquitous and has applications in various fields like speech processing, data mining and image processing to name a few. Under matrix decomposition, nonnegative matrix factorization is used to decompose a nonnegative matrix into a product of two nonnegative matrices which gives some meaningful interpretation of the data. Thus, nonnegative matrix factorization has an edge over the other decomposition techniques. In this paper, we propose two novel iterative algorithms based on Majorization Minimization (MM)-in which we formulate a novel upper bound and minimize it to get a closed form solution at every iteration. Since the algorithms are based on MM, it is ensured that the proposed methods will be monotonic. The proposed algorithms differ in the updating approach of the two nonnegative matrices. The first algorithm-Iterative Nonnegative Matrix Factorization (INOM) sequentially updates the two nonnegative matrices while the second algorithm-Parallel Iterative Nonnegative Matrix Factorization (PARINOM) parallely updates them. We also prove that the proposed algorithms converge to the stationary point of the problem. Simulations were conducted to compare the proposed methods with the existing ones and was found that the proposed algorithms performs better than the existing ones in terms of computational speed and convergence.
KeyWords: Nonnegative matrix factorization, Majorization Minimization, Big Data, Parallel, Multiplicative Update
△ Less
Submitted 11 May, 2019;
originally announced May 2019.
-
SOLVIT:A Reference-Free Source Localization Technique using Majorization Minimization
Authors:
R. Jyothi,
P. Babu
Abstract:
We consider the problem of localizing the source using range and range-difference measurements. Both the problems are non-convex and non-smooth and are challenging to solve. In this paper, we develop an iterative algorithm - Source Localization Via an Iterative technique (SOLVIT) to localize the source using all the distinct range-difference measurements, i.e., without choosing a reference sensor.…
▽ More
We consider the problem of localizing the source using range and range-difference measurements. Both the problems are non-convex and non-smooth and are challenging to solve. In this paper, we develop an iterative algorithm - Source Localization Via an Iterative technique (SOLVIT) to localize the source using all the distinct range-difference measurements, i.e., without choosing a reference sensor. SOLVIT is based on the Majorization Minimization approach - in which a novel upper bound is formulated and minimized to get a closed-form solution at every iteration. We also solve the source localization problem based on range measurements and rederive the Standard Fixed Point algorithm using the Majorization Minimization approach. By doing so, we show a less intricate way to prove the convergence of the Standard Fixed Point algorithm. Numerical simulations and experiments in an anechoic chamber confirm that SOLVIT performs better than existing reference-based and reference-free methods in terms of source positioning accuracy.
△ Less
Submitted 7 February, 2020; v1 submitted 11 May, 2019;
originally announced May 2019.