Showing 1–50 of 59 results for author: Yilmaz, O

Denoising guarantees for optimized sampling schemes in compressed sensing

Authors: Yaniv Plan, Matthew S. Scott, Xia Sheng, Ozgur Yilmaz

Abstract: Compressed sensing with subsampled unitary matrices benefits from \emph{optimized} sampling schemes, which feature improved theoretical guarantees and empirical performance relative to uniform subsampling. We provide, in a first of its kind in compressed sensing, theoretical guarantees showing that the error caused by the measurement noise vanishes with an increasing number of measurements for opt… ▽ More Compressed sensing with subsampled unitary matrices benefits from \emph{optimized} sampling schemes, which feature improved theoretical guarantees and empirical performance relative to uniform subsampling. We provide, in a first of its kind in compressed sensing, theoretical guarantees showing that the error caused by the measurement noise vanishes with an increasing number of measurements for optimized sampling schemes, assuming that the noise is Gaussian. We moreover provide similar guarantees for measurements sampled with-replacement with arbitrary probability weights. All our results hold on prior sets contained in a union of low-dimensional subspaces. Finally, we demonstrate that this denoising behavior appears in empirical experiments with a rate that closely matches our theoretical guarantees when the prior set is the range of a generative ReLU neural network and when it is the set of sparse vectors. △ Less

Submitted 31 March, 2025; originally announced April 2025.

Comments: 29 pages, 4 figures. Submitted for review to the SIAM Journal on Mathematics of Data Science (SIMODS). Author roles: Authors listed in alphabetic order. MS was primarily responsible for developing the theory, the sparsity-based numerics, and writing the paper. XS was primarily responsible for training the generative model and creating and presenting the related numerics

MSC Class: 94A20; 94A12; 68T07

Downlink Channel Covariance Matrix Estimation via Representation Learning with Graph Regularization

Authors: Melih Can Zerin, Elif Vural, Ali Özgür Yılmaz

Abstract: In this paper, we propose an algorithm for downlink (DL) channel covariance matrix (CCM) estimation for frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) communication systems with base station (BS) possessing a uniform linear array (ULA) antenna structure. We consider a setting where the UL CCM is mapped to DL CCM by a mapping function. We first present a theoretica… ▽ More In this paper, we propose an algorithm for downlink (DL) channel covariance matrix (CCM) estimation for frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO) communication systems with base station (BS) possessing a uniform linear array (ULA) antenna structure. We consider a setting where the UL CCM is mapped to DL CCM by a mapping function. We first present a theoretical error analysis of learning a nonlinear embedding by constructing a mapping function, which points to the importance of the Lipschitz regularity of the mapping function for achieving high estimation performance. Then, based on the theoretical ground, we propose a representation learning algorithm as a solution for the estimation problem, where Gaussian RBF kernel interpolators are chosen to map UL CCMs to their DL counterparts. The proposed algorithm is based on the optimization of an objective function that fits a regression model between the DL CCM and UL CCM samples in the training dataset and preserves the local geometric structure of the data in the UL CCM space, while explicitly regulating the Lipschitz continuity of the mapping function in light of our theoretical findings. The proposed algorithm surpasses benchmark methods in terms of three error metrics as shown by simulations. △ Less

Submitted 18 March, 2025; v1 submitted 26 July, 2024; originally announced July 2024.

Model-adapted Fourier sampling for generative compressed sensing

Authors: Aaron Berk, Simone Brugiapaglia, Yaniv Plan, Matthew Scott, Xia Sheng, Ozgur Yilmaz

Abstract: We study generative compressed sensing when the measurement matrix is randomly subsampled from a unitary matrix (with the DFT as an important special case). It was recently shown that $\textit{O}(kdn\| \boldsymbolα\|_{\infty}^{2})$ uniformly random Fourier measurements are sufficient to recover signals in the range of a neural network $G:\mathbb{R}^k \to \mathbb{R}^n$ of depth $d$, where each comp… ▽ More We study generative compressed sensing when the measurement matrix is randomly subsampled from a unitary matrix (with the DFT as an important special case). It was recently shown that $\textit{O}(kdn\| \boldsymbolα\|_{\infty}^{2})$ uniformly random Fourier measurements are sufficient to recover signals in the range of a neural network $G:\mathbb{R}^k \to \mathbb{R}^n$ of depth $d$, where each component of the so-called local coherence vector $\boldsymbolα$ quantifies the alignment of a corresponding Fourier vector with the range of $G$. We construct a model-adapted sampling strategy with an improved sample complexity of $\textit{O}(kd\| \boldsymbolα\|_{2}^{2})$ measurements. This is enabled by: (1) new theoretical recovery guarantees that we develop for nonuniformly random sampling distributions and then (2) optimizing the sampling distribution to minimize the number of measurements needed for these guarantees. This development offers a sample complexity applicable to natural signal classes, which are often almost maximally coherent with low Fourier frequencies. Finally, we consider a surrogate sampling scheme, and validate its performance in recovery experiments using the CelebA dataset. △ Less

Submitted 17 November, 2023; v1 submitted 7 October, 2023; originally announced October 2023.

Comments: 12 pages, 4 figures. Submitted to the NeurIPS 2023 Workshop on Deep Learning and Inverse Problems. This revision features additional attribution of work, aknowledgmenents, and a correction in definition 1.1

Quasi-Newton FDE in One-Bit Pseudo-Randomly Quantized Massive MIMO-OFDM Systems

Authors: Gökhan Yılmaz, Ali Özgür Yılmaz

Abstract: This letter offers a new frequency domain equalization (FDE) scheme that can work with a pseudo-random quantization (PRQ) scheme utilizing non-zero threshold quantization in one-bit uplink multi-user massive multiple-input multiple-output (MIMO) systems to mitigate quantization distortion and support high-order modulation schemes. The equalizer is based on Newton's method (NM) and applicable for o… ▽ More This letter offers a new frequency domain equalization (FDE) scheme that can work with a pseudo-random quantization (PRQ) scheme utilizing non-zero threshold quantization in one-bit uplink multi-user massive multiple-input multiple-output (MIMO) systems to mitigate quantization distortion and support high-order modulation schemes. The equalizer is based on Newton's method (NM) and applicable for orthogonal frequency division multiplexing (OFDM) transmission under frequency-selective fading by exploiting the properties of massive MIMO. We develop a low-complexity FDE scheme to obtain a quasi-Newton method. The proposed detector outperforms the benchmark detector with comparable complexity. △ Less

Submitted 23 December, 2023; v1 submitted 7 June, 2023; originally announced June 2023.

Pseudo-Random Quantization Based Two-Stage Detection in One-Bit Massive MIMO Systems

Authors: Gökhan Yılmaz, Ali Özgür Yılmaz

Abstract: Utilizing low-resolution analog-to-digital converters (ADCs) in uplink massive multiple-input multiple-output (MIMO) systems is a practical solution to decrease power consumption. The performance gap between the low and high-resolution systems is small at low signal-to-noise ratio (SNR) regimes. However, at high SNR and with high modulation orders, the achievable rate saturates after a finite SNR… ▽ More Utilizing low-resolution analog-to-digital converters (ADCs) in uplink massive multiple-input multiple-output (MIMO) systems is a practical solution to decrease power consumption. The performance gap between the low and high-resolution systems is small at low signal-to-noise ratio (SNR) regimes. However, at high SNR and with high modulation orders, the achievable rate saturates after a finite SNR value due to the stochastic resonance (SR) phenomenon. This paper proposes a novel pseudo-random quantization (PRQ) scheme by modifying the quantization thresholds that can help compensate for the effects of SR and makes communication with high-order modulation schemes such as $1024$-QAM in one-bit quantized uplink massive MIMO systems possible. Moreover, modified linear detectors for non-zero threshold quantization are derived, and a two-stage uplink detector for single-carrier (SC) multi-user systems is proposed. The first stage is an iterative method called Boxed Newton Detector (BND) that utilizes Newton's Method to maximize the log-likelihood with box constraints. The second stage, Nearest Codeword Detector (NCD), exploits the first stage solution and creates a small set of most likely candidates based on sign constraints to increase detection performance. The proposed two-stage method with PRQ outperforms the state-of-the-art detectors from the literature with comparable complexity while supporting high-order modulation schemes. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Hierarchical Graph Neural Network with Cross-Attention for Cross-Device User Matching

Authors: Ali Taghibakhshi, Mingyuan Ma, Ashwath Aithal, Onur Yilmaz, Haggai Maron, Matthew West

Abstract: Cross-device user matching is a critical problem in numerous domains, including advertising, recommender systems, and cybersecurity. It involves identifying and linking different devices belonging to the same person, utilizing sequence logs. Previous data mining techniques have struggled to address the long-range dependencies and higher-order connections between the logs. Recently, researchers hav… ▽ More Cross-device user matching is a critical problem in numerous domains, including advertising, recommender systems, and cybersecurity. It involves identifying and linking different devices belonging to the same person, utilizing sequence logs. Previous data mining techniques have struggled to address the long-range dependencies and higher-order connections between the logs. Recently, researchers have modeled this problem as a graph problem and proposed a two-tier graph contextual embedding (TGCE) neural network architecture, which outperforms previous methods. In this paper, we propose a novel hierarchical graph neural network architecture (HGNN), which has a more computationally efficient second level design than TGCE. Furthermore, we introduce a cross-attention (Cross-Att) mechanism in our model, which improves performance by 5% compared to the state-of-the-art TGCE method. △ Less

Submitted 19 October, 2023; v1 submitted 6 April, 2023; originally announced April 2023.

Artificial intelligence as a gateway to scientific discovery: Uncovering features in retinal fundus images

Authors: Parsa Delavari, Gulcenur Ozturan, Ozgur Yilmaz, Ipek Oruc

Abstract: Purpose: Convolutional neural networks can be trained to detect various conditions or patient traits based on retinal fundus photographs, some of which, such as the patient sex, are invisible to the expert human eye. Here we propose a methodology for explainable classification of fundus images to uncover the mechanism(s) by which CNNs successfully predict the labels. We used patient sex as a case… ▽ More Purpose: Convolutional neural networks can be trained to detect various conditions or patient traits based on retinal fundus photographs, some of which, such as the patient sex, are invisible to the expert human eye. Here we propose a methodology for explainable classification of fundus images to uncover the mechanism(s) by which CNNs successfully predict the labels. We used patient sex as a case study to validate our proposed methodology. Approach: First, we used a set of 4746 fundus images, including training, validation and test partitions, to fine-tune a pre-trained CNN on the sex classification task. Next, we utilized deep learning explainability tools to hypothesize possible ways sex differences in the retina manifest. We measured numerous retinal properties relevant to our hypotheses through image segmentation to identify those significantly different between males and females. To tackle the multiple comparisons problem, we shortlisted the parameters by testing them on a set of 100 fundus images distinct from the images used for fine-tuning. Finally, we used an additional 400 images, not included in any previous set, to reveal significant sex differences in the retina. Results: We observed that the peripapillary area is darker in males compared to females ($p=.023, d=.243$). We also observed that males have richer retinal vasculature networks by showing a higher number of branches ($p=.016, d=.272$) and nodes ($p=.014, d=.299$) and a larger total length of branches ($p=.045, d=.206$) in the vessel graph. Also, vessels cover a greater area in the superior temporal quadrant of the retina in males compared to females ($p=0.048, d=.194$). Conclusions: Our methodology reveals retinal features in fundus photographs that allow CNNs to predict traits currently unknown, but meaningful to experts. △ Less

Submitted 16 January, 2023; originally announced January 2023.

Embracing Off-the-Grid Samples

Authors: Oscar López, Özgür Yılmaz

Abstract: Many empirical studies suggest that samples of continuous-time signals taken at locations randomly deviated from an equispaced grid (i.e., off-the-grid) can benefit signal acquisition, e.g., undersampling and anti-aliasing. However, explicit statements of such advantages and their respective conditions are scarce in the literature. This paper provides some insight on this topic when the sampling p… ▽ More Many empirical studies suggest that samples of continuous-time signals taken at locations randomly deviated from an equispaced grid (i.e., off-the-grid) can benefit signal acquisition, e.g., undersampling and anti-aliasing. However, explicit statements of such advantages and their respective conditions are scarce in the literature. This paper provides some insight on this topic when the sampling positions are known, with grid deviations generated i.i.d. from a variety of distributions. By solving a square-root LASSO decoder with an interpolation kernel we demonstrate the capabilities of nonuniform samples for compressive sampling, an effective paradigm for undersampling and anti-aliasing. For functions in the Wiener algebra that admit a discrete $s$-sparse representation in some transform domain, we show that $\mathcal{O}(s\log N)$ random off-the-grid samples are sufficient to recover an accurate $\frac{N}{2}$-bandlimited approximation of the signal. For sparse signals (i.e., $s \ll N$), this sampling complexity is a great reduction in comparison to equispaced sampling where $\mathcal{O}(N)$ measurements are needed for the same quality of reconstruction (Nyquist-Shannon sampling theorem). We further consider noise attenuation via oversampling (relative to a desired bandwidth), a standard technique with limited theoretical understanding when the sampling positions are non-equispaced. By solving a least squares problem, we show that $\mathcal{O}(N\log N)$ i.i.d. randomly deviated samples provide an accurate $\frac{N}{2}$-bandlimited approximation of the signal with suppression of the noise energy by a factor $\sim\frac{1}{\sqrt{\log N}}$. △ Less

Submitted 20 February, 2023; v1 submitted 4 November, 2022; originally announced November 2022.

Learning from few examples: Classifying sex from retinal images via deep learning

Authors: Aaron Berk, Gulcenur Ozturan, Parsa Delavari, David Maberley, Özgür Yılmaz, Ipek Oruc

Abstract: Deep learning has seen tremendous interest in medical imaging, particularly in the use of convolutional neural networks (CNNs) for developing automated diagnostic tools. The facility of its non-invasive acquisition makes retinal fundus imaging amenable to such automated approaches. Recent work in analyzing fundus images using CNNs relies on access to massive data for training and validation - hund… ▽ More Deep learning has seen tremendous interest in medical imaging, particularly in the use of convolutional neural networks (CNNs) for developing automated diagnostic tools. The facility of its non-invasive acquisition makes retinal fundus imaging amenable to such automated approaches. Recent work in analyzing fundus images using CNNs relies on access to massive data for training and validation - hundreds of thousands of images. However, data residency and data privacy restrictions stymie the applicability of this approach in medical settings where patient confidentiality is a mandate. Here, we showcase results for the performance of DL on small datasets to classify patient sex from fundus images - a trait thought not to be present or quantifiable in fundus images until recently. We fine-tune a Resnet-152 model whose last layer has been modified for binary classification. In several experiments, we assess performance in the small dataset context using one private (DOVS) and one public (ODIR) data source. Our models, developed using approximately 2500 fundus images, achieved test AUC scores of up to 0.72 (95% CI: [0.67, 0.77]). This corresponds to a mere 25% decrease in performance despite a nearly 1000-fold decrease in the dataset size compared to prior work in the literature. Even with a hard task like sex categorization from retinal images, we find that classification is possible with very small datasets. Additionally, we perform domain adaptation experiments between DOVS and ODIR; explore the effect of data curation on training and generalizability; and investigate model ensembling to maximize CNN classifier performance in the context of small development datasets. △ Less

Submitted 19 July, 2022; originally announced July 2022.

MSC Class: 68T07; 62P10; 92C50; 92C55; 94A08; 94A12 ACM Class: I.2.1; I.4.7; I.4.9; I.4.10; I.5.1; I.5.2; I.5.4; J.3

A coherence parameter characterizing generative compressed sensing with Fourier measurements

Authors: Aaron Berk, Simone Brugiapaglia, Babhru Joshi, Yaniv Plan, Matthew Scott, Özgür Yilmaz

Abstract: In Bora et al. (2017), a mathematical framework was developed for compressed sensing guarantees in the setting where the measurement matrix is Gaussian and the signal structure is the range of a generative neural network (GNN). The problem of compressed sensing with GNNs has since been extensively analyzed when the measurement matrix and/or network weights follow a subgaussian distribution. We mov… ▽ More In Bora et al. (2017), a mathematical framework was developed for compressed sensing guarantees in the setting where the measurement matrix is Gaussian and the signal structure is the range of a generative neural network (GNN). The problem of compressed sensing with GNNs has since been extensively analyzed when the measurement matrix and/or network weights follow a subgaussian distribution. We move beyond the subgaussian assumption, to measurement matrices that are derived by sampling uniformly at random rows of a unitary matrix (including subsampled Fourier measurements as a special case). Specifically, we prove the first known restricted isometry guarantee for generative compressed sensing with subsampled isometries and provide recovery bounds, addressing an open problem of Scarlett et al. (2022, p. 10). Recovery efficacy is characterized by the coherence, a new parameter, which measures the interplay between the range of the network and the measurement matrix. Our approach relies on subspace counting arguments and ideas central to high-dimensional probability. Furthermore, we propose a regularization strategy for training GNNs to have favourable coherence with the measurement operator. We provide compelling numerical simulations that support this regularized training strategy: our strategy yields low coherence networks that require fewer measurements for signal recovery. This, together with our theoretical results, supports coherence as a natural quantity for characterizing generative compressed sensing with subsampled isometries. △ Less

Submitted 9 November, 2022; v1 submitted 19 July, 2022; originally announced July 2022.

MSC Class: 68T07; 60F10; 68P30; 94A08; 94A16

A Theoretical Performance Bound for Joint Beamformer Design of Wireless Fronthaul and Access Links in Downlink C-RAN

Authors: Fehmi Emre Kadan, Ali Özgür Yılmaz

Abstract: It is known that data rates in standard cellular networks are limited due to inter-cell interference. An effective solution of this problem is to use the multi-cell cooperation idea. In Cloud Radio Access Network (C-RAN), which is a candidate solution in 5G and future communication networks, cooperation is applied by means of central processors (CPs) connected to simple remote radio heads with fin… ▽ More It is known that data rates in standard cellular networks are limited due to inter-cell interference. An effective solution of this problem is to use the multi-cell cooperation idea. In Cloud Radio Access Network (C-RAN), which is a candidate solution in 5G and future communication networks, cooperation is applied by means of central processors (CPs) connected to simple remote radio heads with finite capacity fronthaul links. In this study, we consider a downlink C-RAN with a wireless fronthaul and aim to minimize total power spent by jointly designing beamformers for fronthaul and access links. We consider the case where perfect channel state information is not available in the CP. We first derive a novel theoretical performance bound for the problem defined. Then we propose four algorithms with different complexities to show the tightness of the bound. The first two algorithms apply successive convex optimizations with semi-definite relaxation idea where other two are adapted from well-known beamforming design methods. The detailed simulations under realistic channel conditions show that as the complexity of the algorithm increases, the corresponding performance becomes closer to the bound. △ Less

Submitted 13 February, 2021; originally announced February 2021.

Comments: 30 pages, single column, 11 figures, submitted to Transactions on Wireless Communications in Oct. 20, 2020. Major Revision decision was made in Jan. 16, 2021. After the revision, it will be resubmitted to the same journal until the end of February, 2021

Beamformer Design with Smooth Constraint-Free Approximation in Downlink Cloud Radio Access Networks

Authors: Fehmi Emre Kadan, Ali Özgür Yılmaz

Abstract: It is known that data rates in standard cellular networks are limited due to inter-cell interference. An effective solution of this problem is to use the multi-cell cooperation idea. In Cloud Radio Access Network, which is a candidate solution in 5G and beyond, cooperation is applied by means of central processors (CPs) connected to simple remote radio heads with finite capacity fronthaul links. I… ▽ More It is known that data rates in standard cellular networks are limited due to inter-cell interference. An effective solution of this problem is to use the multi-cell cooperation idea. In Cloud Radio Access Network, which is a candidate solution in 5G and beyond, cooperation is applied by means of central processors (CPs) connected to simple remote radio heads with finite capacity fronthaul links. In this study, we consider a downlink scenario and aim to minimize total power spent by designing beamformers. We consider the case where perfect channel state information is not available in the CP. The original problem includes discontinuous terms with many constraints. We propose a novel method which transforms the problem into a smooth constraint-free form and a solution is found by the gradient descent approach. As a comparison, we consider the optimal method solving an extensive number of convex sub-problems, a known heuristic search algorithm and some sparse solution techniques. Heuristic search methods find a solution by solving a subset of all possible convex sub-problems. Sparse techniques apply some norm approximation ($\ell_0/\ell_1, \ell_0/\ell_2$) or convex approximation to make the objective function more tractable. We also derive a theoretical performance bound in order to observe how far the proposed method performs off the optimal method when running the optimal method is prohibitive due to computational complexity. Detailed simulations show that the performance of the proposed method is close to the optimal one, and it outperforms other methods analyzed. △ Less

Submitted 13 February, 2021; originally announced February 2021.

Comments: 18 pages, 12 figures, submitted to IEEE Access in Feb. 03, 2021. It is a revised version of the paper submitted to IEEE Access in Nov. 23, 2020. Revisions were made according to the reviewer comments

NBIHT: An Efficient Algorithm for 1-bit Compressed Sensing with Optimal Error Decay Rate

Authors: Michael P. Friedlander, Halyun Jeong, Yaniv Plan, Ozgur Yilmaz

Abstract: The Binary Iterative Hard Thresholding (BIHT) algorithm is a popular reconstruction method for one-bit compressed sensing due to its simplicity and fast empirical convergence. There have been several works about BIHT but a theoretical understanding of the corresponding approximation error and convergence rate still remains open. This paper shows that the normalized version of BIHT (NBHIT) achiev… ▽ More The Binary Iterative Hard Thresholding (BIHT) algorithm is a popular reconstruction method for one-bit compressed sensing due to its simplicity and fast empirical convergence. There have been several works about BIHT but a theoretical understanding of the corresponding approximation error and convergence rate still remains open. This paper shows that the normalized version of BIHT (NBHIT) achieves an approximation error rate optimal up to logarithmic factors. More precisely, using $m$ one-bit measurements of an $s$-sparse vector $x$, we prove that the approximation error of NBIHT is of order $O \left(1 \over m \right)$ up to logarithmic factors, which matches the information-theoretic lower bound $Ω\left(1 \over m \right)$ proved by Jacques, Laska, Boufounos, and Baraniuk in 2013. To our knowledge, this is the first theoretical analysis of a BIHT-type algorithm that explains the optimal rate of error decay empirically observed in the literature. This also makes NBIHT the first provable computationally-efficient one-bit compressed sensing algorithm that breaks the inverse square root error decay rate $O \left(1 \over m^{1/2} \right)$. △ Less

Submitted 23 December, 2020; originally announced December 2020.

Comments: Submitted to a journal

MSC Class: 94-XX

On the best choice of Lasso program given data parameters

Authors: Aaron Berk, Yaniv Plan, Özgür Yilmaz

Abstract: Generalized compressed sensing (GCS) is a paradigm in which a structured high-dimensional signal may be recovered from random, under-determined, and corrupted linear measurements. Generalized Lasso (GL) programs are effective for solving GCS problems due to their proven ability to leverage underlying signal structure. Three popular GL programs are equivalent in a sense and sometimes used interchan… ▽ More Generalized compressed sensing (GCS) is a paradigm in which a structured high-dimensional signal may be recovered from random, under-determined, and corrupted linear measurements. Generalized Lasso (GL) programs are effective for solving GCS problems due to their proven ability to leverage underlying signal structure. Three popular GL programs are equivalent in a sense and sometimes used interchangeably. Tuned by a governing parameter, each admit an optimal parameter choice. For sparse or low-rank signal structures, this choice yields minimax order-optimal error. While GCS is well-studied, existing theory for GL programs typically concerns this optimally tuned setting. However, the optimal parameter value for a GL program depends on properties of the data, and is typically unknown in practical settings. Performance in empirical problems thus hinges on a program's parameter sensitivity: it is desirable that small variation about the optimal parameter choice begets small variation about the optimal risk. We examine the risk for these three programs and demonstrate that their parameter sensitivity can differ for the same data. We prove a gauge-constrained GL program admits asymptotic cusp-like behaviour of its risk in the limiting low-noise regime. We prove that a residual-constrained Lasso program has asymptotically suboptimal risk for very sparse vectors. These results contrast observations about an unconstrained Lasso program, which is relatively less sensitive to its parameter choice. We support the asymptotic theory with numerical simulations, demonstrating that parameter sensitivity of GL programs is readily observed for even modest dimensional parameters. Importantly, these simulations demonstrate regimes in which a GL program exhibits sensitivity to its parameter choice, though the other two do not. We hope this work aids practitioners in selecting a GL program for their problem. △ Less

Submitted 17 October, 2020; originally announced October 2020.

MSC Class: 90C47; 90C25; 94B75; 46N10; 47L07; ACM Class: E.4; H.1.1; G.1.6

A Reduced Complexity Ungerboeck Receiver for Quantized Wideband Massive SC-MIMO

Authors: Ali Bulut Üçüncü, Gökhan Muzaffer Güvensen, Ali Özgür Yılmaz

Abstract: Employing low resolution analog-to-digital converters in massive multiple-input multiple-output (MIMO) has many advantages in terms of total power consumption, cost and feasibility of such systems. However, such advantages come together with significant challenges in channel estimation and data detection due to the severe quantization noise present. In this study, we propose a novel iterative rece… ▽ More Employing low resolution analog-to-digital converters in massive multiple-input multiple-output (MIMO) has many advantages in terms of total power consumption, cost and feasibility of such systems. However, such advantages come together with significant challenges in channel estimation and data detection due to the severe quantization noise present. In this study, we propose a novel iterative receiver for quantized uplink single carrier MIMO (SC-MIMO) utilizing an efficient message passing algorithm based on the Bussgang decomposition and Ungerboeck factorization, which avoids the use of a complex whitening filter. A reduced state sequence estimator with bidirectional decision feedback is also derived, achieving remarkable complexity reduction compared to the existing receivers for quantized SC-MIMO in the literature, without any requirement on the sparsity of the transmission channel. Moreover, the linear minimum mean-square-error (LMMSE) channel estimator for SC-MIMO under frequency-selective channel, which do not require any cyclic-prefix overhead, is also derived. We observe that the proposed receiver has significant performance gains with respect to the existing receivers in the literature under imperfect channel state information. △ Less

Submitted 18 August, 2020; v1 submitted 16 July, 2020; originally announced July 2020.

Comments: This work has been submitted to the IEEE for possible publication

Performance Analysis of Quantized Uplink Massive MIMO-OFDM With Oversampling Under Adjacent Channel Interference

Authors: Ali Bulut Üçüncü, Emil Björnson, Håkan Johansson, Erik G. Larsson, Ali Özgür Yılmaz

Abstract: Massive multiple-input multiple-output (MIMO) systems have attracted much attention lately due to the many advantages they provide over single-antenna systems. Owing to the many antennas, low-cost implementation and low power consumption per antenna are desired. To that end, massive MIMO structures with low-resolution analog-to-digital converters (ADC) have been investigated in many studies. Howev… ▽ More Massive multiple-input multiple-output (MIMO) systems have attracted much attention lately due to the many advantages they provide over single-antenna systems. Owing to the many antennas, low-cost implementation and low power consumption per antenna are desired. To that end, massive MIMO structures with low-resolution analog-to-digital converters (ADC) have been investigated in many studies. However, the effect of a strong interferer in the adjacent band on quantized massive MIMO systems have not been examined yet. In this study, we analyze the performance of uplink massive MIMO with low-resolution ADCs under frequency selective fading with orthogonal frequency division multiplexing in the perfect and imperfect receiver channel state information cases. We derive analytical expressions for the bit error rate and ergodic capacity. We show that the interfering band can be suppressed by increasing the number of antennas or the oversampling rate when a zero-forcing receiver is employed. △ Less

Submitted 18 February, 2020; originally announced February 2020.

Sub-Gaussian Matrices on Sets: Optimal Tail Dependence and Applications

Authors: Halyun Jeong, Xiaowei Li, Yaniv Plan, Özgür Yılmaz

Abstract: Random linear mappings are widely used in modern signal processing, compressed sensing and machine learning. These mappings may be used to embed the data into a significantly lower dimension while at the same time preserving useful information. This is done by approximately preserving the distances between data points, which are assumed to belong to $\mathbb{R}^n$. Thus, the performance of these m… ▽ More Random linear mappings are widely used in modern signal processing, compressed sensing and machine learning. These mappings may be used to embed the data into a significantly lower dimension while at the same time preserving useful information. This is done by approximately preserving the distances between data points, which are assumed to belong to $\mathbb{R}^n$. Thus, the performance of these mappings is usually captured by how close they are to an isometry on the data. Gaussian linear mappings have been the object of much study, while the sub-Gaussian settings is not yet fully understood. In the latter case, the performance depends on the sub-Gaussian norm of the rows. In many applications, e.g., compressed sensing, this norm may be large, or even growing with dimension, and thus it is important to characterize this dependence. We study when a sub-Gaussian matrix can become a near isometry on a set, show that previous best known dependence on the sub-Gaussian norm was sub-optimal, and present the optimal dependence. Our result not only answers a remaining question posed by Liaw, Mehrabian, Plan and Vershynin in 2017, but also generalizes their work. We also develop a new Bernstein type inequality for sub-exponential random variables, and a new Hanson-Wright inequality for quadratic forms of sub-Gaussian random variables, in both cases improving the bounds in the sub-Gaussian regime under moment constraints. Finally, we illustrate popular applications such as Johnson-Lindenstrauss embeddings, null space property for 0-1 matrices, randomized sketches and blind demodulation, whose theoretical guarantees can be improved by our results (in the sub-Gaussian case). △ Less

Submitted 20 January, 2021; v1 submitted 28 January, 2020; originally announced January 2020.

On one-stage recovery for $ΣΔ$-quantized compressed sensing

Authors: Arman Arian, Ozgur Yilmaz

Abstract: Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representations. When such a signal is acquired according to the principles of CS, the measurements still take on values in the continuum. In today's "digital" world, a subsequent quantization step, where these measurements are replaced with elements from a finite se… ▽ More Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representations. When such a signal is acquired according to the principles of CS, the measurements still take on values in the continuum. In today's "digital" world, a subsequent quantization step, where these measurements are replaced with elements from a finite set is crucial. We focus on one of the approaches that yield efficient quantizers for CS: $ΣΔ$ quantization, followed by a one-stage tractable reconstruction method, which was developed by Saab et al. with theoretical error guarantees in the case of sub-Gaussian matrices. We propose two alternative approaches that extend this result to a wider class of measurement matrices including (certain unitary transforms of) partial bounded orthonormal systems and deterministic constructions based on chirp sensing matrices. △ Less

Submitted 18 November, 2019; originally announced November 2019.

Deterministic partial binary circulant compressed sensing matrices

Authors: Arman Arian, Ozgur Yilmaz

Abstract: Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representation. This is achieved by collecting linear, non-adaptive measurements of a signal, which can be formalized as multiplying the signal with a "measurement matrix". Most of matrices used in CS are random matrices as they satisfy the restricted isometry proper… ▽ More Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representation. This is achieved by collecting linear, non-adaptive measurements of a signal, which can be formalized as multiplying the signal with a "measurement matrix". Most of matrices used in CS are random matrices as they satisfy the restricted isometry property (RIP) in an optimal regime of number of measurements with high probability. However, these matrices have their own caveats and for this reason, deterministic measurement matrices have been proposed. While there is a wide classes of deterministic matrices in the literature, we propose a novel class of deterministic matrices using the Legendre symbol. This construction has a simple structure, it enjoys being a binary matrix, and having a partial circulant structure which provides a fast matrix-vector multiplication and a fast reconstruction algorithm. We will derive a bound on the sparsity level of signals that can be measured (and be reconstructed) with this class of matrices. We perform quantization using these matrices, and we verify the performance of these matrices (and compare with other existing constructions) numerically. △ Less

Submitted 18 November, 2019; originally announced November 2019.

RIP constants for deterministic compressed sensing matrices-beyond Gershgorin

Authors: Arman Arian, Ozgur Yilmaz

Abstract: Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representations. This is achieved by collecting linear, non-adaptive measurements of a signal, which can be formalized as multiplying the signal with a "measurement matrix". If the measurement satisfies the so-called restricted isometry property (RIP), then it will b… ▽ More Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representations. This is achieved by collecting linear, non-adaptive measurements of a signal, which can be formalized as multiplying the signal with a "measurement matrix". If the measurement satisfies the so-called restricted isometry property (RIP), then it will be appropriate to be used in compressed sensing. While a wide class of random matrices provably satisfy the RIP with high probability, explicit and deterministic constructions have been shown (so far) to satisfy the RIP only in a significantly suboptimal regime. In this paper, we propose two novel approaches for improving the RIP constant estimates based on Gershgorin circle theorem for a specific deterministic construction based on Paley tight frames, obtaining an improvement over the Gershgorin bound by a multiplicative constant. In one approach we use a recent result on the spectra of the skew-adjacency matrices of oriented graphs. In the other approach, we use the so-called Dembo bounds on the extreme eigenvalues of a positive semidefinite Hermitian matrix. We also generalize these bounds and we combine the new bounds with a conjecture we make regarding the distribution of quadratic residues in a finite field to provide a potential path to break the so-called "square-root barrier"-we provide a proof based on the assumption that the conjecture holds. △ Less

Submitted 17 November, 2019; originally announced November 2019.

Sensitivity of $\ell_{1}$ minimization to parameter choice

Authors: Aaron Berk, Yaniv Plan, Özgür Yilmaz

Abstract: The use of generalized LASSO is a common technique for recovery of structured high-dimensional signals. Each generalized LASSO program has a governing parameter whose optimal value depends on properties of the data. At this optimal value, compressed sensing theory explains why LASSO programs recover structured high-dimensional signals with minimax order-optimal error. Unfortunately in practice, th… ▽ More The use of generalized LASSO is a common technique for recovery of structured high-dimensional signals. Each generalized LASSO program has a governing parameter whose optimal value depends on properties of the data. At this optimal value, compressed sensing theory explains why LASSO programs recover structured high-dimensional signals with minimax order-optimal error. Unfortunately in practice, the optimal choice is generally unknown and must be estimated. Thus, we investigate stability of each LASSO program with respect to its governing parameter. Our goal is to aid the practitioner in answering the following question: given real data, which LASSO program should be used? We take a step towards answering this by analyzing the case where the measurement matrix is identity (the so-called proximal denoising setup) and we use $\ell_{1}$ regularization. For each LASSO program, we specify settings in which that program is provably unstable with respect to its governing parameter. We support our analysis with detailed numerical simulations. For example, there are settings where a 0.1% underestimate of a LASSO parameter can increase the error significantly; and a 50% underestimate can cause the error to increase by a factor of $10^{9}$. △ Less

Submitted 1 April, 2019; v1 submitted 29 October, 2018; originally announced October 2018.

MSC Class: 90C31; 90C47; 94A15; 60D05

Learning tensors from partial binary measurements

Authors: Navid Ghadermarzy, Yaniv Plan, Ozgur Yilmaz

Abstract: In this paper we generalize the 1-bit matrix completion problem to higher order tensors. We prove that when $r=O(1)$ a bounded rank-$r$, order-$d$ tensor $T$ in $\mathbb{R}^{N} \times \mathbb{R}^{N} \times \cdots \times \mathbb{R}^{N}$ can be estimated efficiently by only $m=O(Nd)$ binary measurements by regularizing its max-qnorm and M-norm as surrogates for its rank. We prove that similar to the… ▽ More In this paper we generalize the 1-bit matrix completion problem to higher order tensors. We prove that when $r=O(1)$ a bounded rank-$r$, order-$d$ tensor $T$ in $\mathbb{R}^{N} \times \mathbb{R}^{N} \times \cdots \times \mathbb{R}^{N}$ can be estimated efficiently by only $m=O(Nd)$ binary measurements by regularizing its max-qnorm and M-norm as surrogates for its rank. We prove that similar to the matrix case, i.e., when $d=2$, the sample complexity of recovering a low-rank tensor from 1-bit measurements of a subset of its entries is the same as recovering it from unquantized measurements. Moreover, we show the advantage of using 1-bit tensor completion over matricization both theoretically and numerically. Specifically, we show how the 1-bit measurement model can be used for context-aware recommender systems. △ Less

Submitted 30 March, 2018; originally announced April 2018.

Comments: 26 pages

MSC Class: 62B10; 94A17; 15A69; 62D05 ACM Class: H.3.3; I.2.6

Near-optimal sample complexity for convex tensor completion

Authors: Navid Ghadermarzy, Yaniv Plan, Özgür Yılmaz

Abstract: We analyze low rank tensor completion (TC) using noisy measurements of a subset of the tensor. Assuming a rank-$r$, order-$d$, $N \times N \times \cdots \times N$ tensor where $r=O(1)$, the best sampling complexity that was achieved is $O(N^{\frac{d}{2}})$, which is obtained by solving a tensor nuclear-norm minimization problem. However, this bound is significantly larger than the number of free v… ▽ More We analyze low rank tensor completion (TC) using noisy measurements of a subset of the tensor. Assuming a rank-$r$, order-$d$, $N \times N \times \cdots \times N$ tensor where $r=O(1)$, the best sampling complexity that was achieved is $O(N^{\frac{d}{2}})$, which is obtained by solving a tensor nuclear-norm minimization problem. However, this bound is significantly larger than the number of free variables in a low rank tensor which is $O(dN)$. In this paper, we show that by using an atomic-norm whose atoms are rank-$1$ sign tensors, one can obtain a sample complexity of $O(dN)$. Moreover, we generalize the matrix max-norm definition to tensors, which results in a max-quasi-norm (max-qnorm) whose unit ball has small Rademacher complexity. We prove that solving a constrained least squares estimation using either the convex atomic-norm or the nonconvex max-qnorm results in optimal sample complexity for the problem of low-rank tensor completion. Furthermore, we show that these bounds are nearly minimax rate-optimal. We also provide promising numerical results for max-qnorm constrained tensor completion, showing improved recovery results compared to matricization and alternating least squares. △ Less

Submitted 14 November, 2017; originally announced November 2017.

MSC Class: 62H12; 94A15; 15A69

Multi-View Product Image Search Using Deep ConvNets Representations

Authors: Muhammet Bastan, Ozgur Yilmaz

Abstract: Multi-view product image queries can improve retrieval performance over single view queries significantly. In this paper, we investigated the performance of deep convolutional neural networks (ConvNets) on multi-view product image search. First, we trained a VGG-like network to learn deep ConvNets representations of product images. Then, we computed the deep ConvNets representations of database an… ▽ More Multi-view product image queries can improve retrieval performance over single view queries significantly. In this paper, we investigated the performance of deep convolutional neural networks (ConvNets) on multi-view product image search. First, we trained a VGG-like network to learn deep ConvNets representations of product images. Then, we computed the deep ConvNets representations of database and query images and performed single view queries, and multi-view queries using several early and late fusion approaches. We performed extensive experiments on the publicly available Multi-View Object Image Dataset (MVOD 5K) with both clean background queries from the Internet and cluttered background queries from a mobile phone. We compared the performance of ConvNets to the classical bag-of-visual-words (BoWs). We concluded that (1) multi-view queries with deep ConvNets representations perform significantly better than single view queries, (2) ConvNets perform much better than BoWs and have room for further improvement, (3) pre-training of ConvNets on a different image dataset with background clutter is needed to obtain good performance on cluttered product image queries obtained with a mobile phone. △ Less

Submitted 1 May, 2017; v1 submitted 11 August, 2016; originally announced August 2016.

Comments: 13 pages, 16 figures

Extended OOBE Comparisons for OFDM, GFDM and WCP-COQAM at Equal Spectral Efficiency

Authors: Ali Bulut Üçüncü, Ali Özgür Yılmaz

Abstract: Generalized frequency division multiplexing (GFDM), windowed cyclic prefix circular offset quadrature amplitude modulation (WCP-COQAM) and orthogonal frequency division multiplexing (OFDM) are among the candidate 5G modulation formats. In this study, we present additional results for the OOBE comparisons between OFDM, GFDM and WCP-COQAM under equal or unequal spectral efficiency conditions for var… ▽ More Generalized frequency division multiplexing (GFDM), windowed cyclic prefix circular offset quadrature amplitude modulation (WCP-COQAM) and orthogonal frequency division multiplexing (OFDM) are among the candidate 5G modulation formats. In this study, we present additional results for the OOBE comparisons between OFDM, GFDM and WCP-COQAM under equal or unequal spectral efficiency conditions for various simulation scenarios. △ Less

Submitted 29 June, 2016; originally announced June 2016.

U-CATCH: Using Color ATtribute of image patCHes in binary descriptors

Authors: Alisher Abdulkhaev, Ozgur Yilmaz

Abstract: In this study, we propose a simple yet very effective method for extracting color information through binary feature description framework. Our method expands the dimension of binary comparisons into RGB and YCbCr spaces, showing more than 100% matching improve ment compared to non-color binary descriptors for a wide range of hard-to-match cases. The proposed method is general and can be applied t… ▽ More In this study, we propose a simple yet very effective method for extracting color information through binary feature description framework. Our method expands the dimension of binary comparisons into RGB and YCbCr spaces, showing more than 100% matching improve ment compared to non-color binary descriptors for a wide range of hard-to-match cases. The proposed method is general and can be applied to any binary descriptor to make it color sensitive. It is faster than classical binary descriptors for RGB sampling due to the abandonment of grayscale conversion and has almost identical complexity (insignificant compared to smoothing operation) for YCbCr sampling. △ Less

Submitted 22 August, 2019; v1 submitted 14 March, 2016; originally announced March 2016.

Reducing MIMO Detection Complexity via Hierarchical Modulation

Authors: Yigit Ugur, Ali Ozgur Yilmaz

Abstract: This work considers multiple-input multiple-output (MIMO) communication systems using hierarchical modulation. A disadvantage of the maximum-likelihood (ML) MIMO detector is that computational complexity increases exponentially with the number of transmit antennas. To reduce complexity, we propose a hierarchical modulation scheme to be used in MIMO trans- mission where base and enhancement layers… ▽ More This work considers multiple-input multiple-output (MIMO) communication systems using hierarchical modulation. A disadvantage of the maximum-likelihood (ML) MIMO detector is that computational complexity increases exponentially with the number of transmit antennas. To reduce complexity, we propose a hierarchical modulation scheme to be used in MIMO trans- mission where base and enhancement layers are incorporated. In the proposed receiver, the base layer is detected first with a minimum mean square error (MMSE) detector which is followed by ML detection of the enhancement layer. Our results indicate that the proposed low complexity scheme does not compromise performance when design parameters such as code rates and constellation ratio are chosen carefully. △ Less

Submitted 23 February, 2016; originally announced February 2016.

Comments: 4 pages, 5 figures, submitted to IEEE Communications Letters

Out-of-Band Radiation Comparison of GFDM, WCP-COQAM and OFDM at Equal Spectral Efficiency

Authors: Ali Bulut Üçüncü, Ali Özgür Yılmaz

Abstract: GFDM and WCP-COQAM are amongst the candidate physical layer modulation formats to be used in 5G, whose claimed lower out-of-band (OOB) emissions are important with respect to cognitive radio based dynamic spectrum access solutions. In this study, we compare OFDM, GFDM and WCP-COQAM in terms of OOB emissions in a fair manner such that their spectral efficiencies are the same and OOB emission reduct… ▽ More GFDM and WCP-COQAM are amongst the candidate physical layer modulation formats to be used in 5G, whose claimed lower out-of-band (OOB) emissions are important with respect to cognitive radio based dynamic spectrum access solutions. In this study, we compare OFDM, GFDM and WCP-COQAM in terms of OOB emissions in a fair manner such that their spectral efficiencies are the same and OOB emission reduction techniques are applied to all of the modulation types. Analytical PSD expressions are also correlated with the simulation based OOB emission results. Maintaining the same spectral efficiency, carrier frequency offset immunities will also be compared. △ Less

Submitted 5 October, 2015; originally announced October 2015.

Comments: submitted to IEEE Signal Processing Letters

Pulse Shaping Methods for OQAM/OFDM and WCP-COQAM

Authors: Ali Bulut Üçüncü, Ali Özgür Yılmaz

Abstract: GFDM is a new modulation format whose advantages compared to OFDM reportedly make it a preferable modulation format for 5G. However, the non-orthogonal nature of GFDM with matched filtering (MF) receiver for pulses with good time-frequency localization is one of its disadvantages, leading to the proposal of WCP-COQAM, employing offset quadrature amplitude modulation (OQAM). In this paper, we prove… ▽ More GFDM is a new modulation format whose advantages compared to OFDM reportedly make it a preferable modulation format for 5G. However, the non-orthogonal nature of GFDM with matched filtering (MF) receiver for pulses with good time-frequency localization is one of its disadvantages, leading to the proposal of WCP-COQAM, employing offset quadrature amplitude modulation (OQAM). In this paper, we prove that a pulse satisfying orthogonality conditions for OQAM-OFDM will also satisfy orthogonality with WCP-COQAM, thus the pulse design methods developed for OQAM-OFDM can also be used with WCP-COQAM. This statement is also verified by the simulation based results. △ Less

Submitted 3 September, 2015; originally announced September 2015.

Comments: 5 pages, 1 figure, submitted to IEEE signal processing letters

Classification of Occluded Objects using Fast Recurrent Processing

Authors: Ozgur Yilmaz

Abstract: Recurrent neural networks are powerful tools for handling incomplete data problems in computer vision, thanks to their significant generative capabilities. However, the computational demand for these algorithms is too high to work in real time, without specialized hardware or software solutions. In this paper, we propose a framework for augmenting recurrent processing capabilities into a feedforwa… ▽ More Recurrent neural networks are powerful tools for handling incomplete data problems in computer vision, thanks to their significant generative capabilities. However, the computational demand for these algorithms is too high to work in real time, without specialized hardware or software solutions. In this paper, we propose a framework for augmenting recurrent processing capabilities into a feedforward network without sacrificing much from computational efficiency. We assume a mixture model and generate samples of the last hidden layer according to the class decisions of the output layer, modify the hidden layer activity using the samples, and propagate to lower layers. For visual occlusion problem, the iterative procedure emulates feedforward-feedback loop, filling-in the missing hidden layer activity with meaningful representations. The proposed algorithm is tested on a widely used dataset, and shown to achieve 2$\times$ improvement in classification accuracy for occluded objects. When compared to Restricted Boltzmann Machines, our algorithm shows superior performance for occluded object classification. △ Less

Submitted 6 May, 2015; originally announced May 2015.

Comments: arXiv admin note: text overlap with arXiv:1409.8576 by other authors

Sparse regression with highly correlated predictors

Authors: Behrooz Ghorbani, Ozgur Yilmaz

Abstract: We consider a linear regression $y=Xβ+u$ where $X\in\mathbb{\mathbb{R}}^{n\times p}$, $p\gg n,$ and $β$ is $s$-sparse. Motivated by examples in financial and economic data, we consider the situation where $X$ has highly correlated and clustered columns. To perform sparse recovery in this setting, we introduce the \emph{clustering removal algorithm} (CRA), that seeks to decrease the correlation in… ▽ More We consider a linear regression $y=Xβ+u$ where $X\in\mathbb{\mathbb{R}}^{n\times p}$, $p\gg n,$ and $β$ is $s$-sparse. Motivated by examples in financial and economic data, we consider the situation where $X$ has highly correlated and clustered columns. To perform sparse recovery in this setting, we introduce the \emph{clustering removal algorithm} (CRA), that seeks to decrease the correlation in $X$ by removing the cluster structure without changing the parameter vector $β$. We show that as long as certain assumptions hold about $X$, the decorrelated matrix will satisfy the restricted isometry property (RIP) with high probability. We also provide examples of the empirical performance of CRA and compare it with other sparse recovery techniques. △ Less

Submitted 4 April, 2015; originally announced April 2015.

Quantization of compressive samples with stable and robust recovery

Authors: Rayan Saab, Rongrong Wang, Ozgur Yilmaz

Abstract: In this paper we study the quantization stage that is implicit in any compressed sensing signal acquisition paradigm. We propose using Sigma-Delta quantization and a subsequent reconstruction scheme based on convex optimization. We prove that the reconstruction error due to quantization decays polynomially in the number of measurements. Our results apply to arbitrary signals, including compressibl… ▽ More In this paper we study the quantization stage that is implicit in any compressed sensing signal acquisition paradigm. We propose using Sigma-Delta quantization and a subsequent reconstruction scheme based on convex optimization. We prove that the reconstruction error due to quantization decays polynomially in the number of measurements. Our results apply to arbitrary signals, including compressible ones, and account for measurement noise. Additionally, they hold for sub-Gaussian (including Gaussian and Bernoulli) random compressed sensing measurements, as well as for both high bit-depth and coarse quantizers, and they extend to 1-bit quantization. In the noise-free case, when the signal is strictly sparse we prove that by optimizing the order of the quantization scheme one can obtain root-exponential decay in the reconstruction error due to quantization. △ Less

Submitted 31 March, 2015; originally announced April 2015.

Connectionist-Symbolic Machine Intelligence using Cellular Automata based Reservoir-Hyperdimensional Computing

Authors: Ozgur Yilmaz

Abstract: We introduce a novel framework of reservoir computing, that is capable of both connectionist machine intelligence and symbolic computation. Cellular automaton is used as the reservoir of dynamical systems. Input is randomly projected onto the initial conditions of automaton cells and nonlinear computation is performed on the input via application of a rule in the automaton for a period of time. Th… ▽ More We introduce a novel framework of reservoir computing, that is capable of both connectionist machine intelligence and symbolic computation. Cellular automaton is used as the reservoir of dynamical systems. Input is randomly projected onto the initial conditions of automaton cells and nonlinear computation is performed on the input via application of a rule in the automaton for a period of time. The evolution of the automaton creates a space-time volume of the automaton state space, and it is used as the reservoir. The proposed framework is capable of long short-term memory and it requires orders of magnitude less computation compared to Echo State Networks. We prove that cellular automaton reservoir holds a distributed representation of attribute statistics, which provides a more effective computation than local representation. It is possible to estimate the kernel for linear cellular automata via metric learning, that enables a much more efficient distance computation in support vector machine framework. Also, binary reservoir feature vectors can be combined using Boolean operations as in hyperdimensional computing, paving a direct way for concept building and symbolic processing. △ Less

Submitted 24 April, 2015; v1 submitted 3 March, 2015; originally announced March 2015.

Comments: Corrected Typos. Responded some comments on section 8. Added appendix for details. Recurrent architecture emphasized

Noise-shaping Quantization Methods for Frame-based and Compressive Sampling Systems

Authors: Evan Chou, C. Sinan Güntürk, Felix Krahmer, Rayan Saab, Özgür Yılmaz

Abstract: Noise shaping refers to an analog-to-digital conversion methodology in which quantization error is arranged to lie mostly outside the signal spectrum by means of oversampling and feedback. Recently it has been successfully applied to more general redundant linear sampling and reconstruction systems associated with frames as well as non-linear systems associated with compressive sampling. This chap… ▽ More Noise shaping refers to an analog-to-digital conversion methodology in which quantization error is arranged to lie mostly outside the signal spectrum by means of oversampling and feedback. Recently it has been successfully applied to more general redundant linear sampling and reconstruction systems associated with frames as well as non-linear systems associated with compressive sampling. This chapter reviews some of the recent progress in this subject. △ Less

Submitted 20 February, 2015; originally announced February 2015.

Comments: 18 pages, 2 figures. chapter in the SAMPTA 2013 book

Reservoir Computing using Cellular Automata

Authors: Ozgur Yilmaz

Abstract: We introduce a novel framework of reservoir computing. Cellular automaton is used as the reservoir of dynamical systems. Input is randomly projected onto the initial conditions of automaton cells and nonlinear computation is performed on the input via application of a rule in the automaton for a period of time. The evolution of the automaton creates a space-time volume of the automaton state space… ▽ More We introduce a novel framework of reservoir computing. Cellular automaton is used as the reservoir of dynamical systems. Input is randomly projected onto the initial conditions of automaton cells and nonlinear computation is performed on the input via application of a rule in the automaton for a period of time. The evolution of the automaton creates a space-time volume of the automaton state space, and it is used as the reservoir. The proposed framework is capable of long short-term memory and it requires orders of magnitude less computation compared to Echo State Networks. Also, for additive cellular automaton rules, reservoir features can be combined using Boolean operations, which provides a direct way for concept building and symbolic processing, and it is much more efficient compared to state-of-the-art approaches. △ Less

Submitted 1 October, 2014; originally announced October 2014.

Comments: 9 pages, 4 figures

A Low-Complexity Graph-Based LMMSE Receiver for MIMO ISI Channels with M-QAM Modulation

Authors: Pinar Sen, Ali Ozgur Yilmaz

Abstract: In this paper, we propose a low complexity graph-based linear minimum mean square error (LMMSE) equalizer in order to remove inter-symbol and inter-stream interference in multiple input multiple output (MIMO) communication. The proposed state space representation inflicted on the graph provides linearly increasing computational complexity with block length. Also, owing to the Gaussian assumption u… ▽ More In this paper, we propose a low complexity graph-based linear minimum mean square error (LMMSE) equalizer in order to remove inter-symbol and inter-stream interference in multiple input multiple output (MIMO) communication. The proposed state space representation inflicted on the graph provides linearly increasing computational complexity with block length. Also, owing to the Gaussian assumption used in the presented cycle-free factor graph, the complexity of the suggested equalizer structure is not affected by the size of the signalling space. In addition, we introduce an efficient way of computing extrinsic bit log-likelihood ratio (LLR) values for LMMSE estimation compatible with higher order alphabets which is shown to perform better than the other methods in the literature. Overall, we provide an efficient receiver structure reaching high data rates in frequency selective MIMO systems whose performance is shown to be very close to a genie-aided matched filter bound through extensive simulations. △ Less

Submitted 2 January, 2017; v1 submitted 13 May, 2014; originally announced May 2014.

Comments: 28 pages, 6 figures, 2 tables, submitted to IEEE Transactions on Wireless Communications

Journal ref: IEEE Transactions on Wireless Communications , vol.PP, no.99, pp.1-1, Dec. 2016

Factor Graph Based LMMSE Filtering for Colored Gaussian Processes

Authors: Pinar Sen, Ali Ozgur Yilmaz

Abstract: We propose a low complexity, graph based linear minimum mean square error (LMMSE) filter in which the non-white characteristics of a random process are taken into account. Our method corresponds to block LMMSE filtering, and has the advantage of complexity linearly increasing with the block length and the ease of incorporating the a priori information of the input signals whenever possible. The pr… ▽ More We propose a low complexity, graph based linear minimum mean square error (LMMSE) filter in which the non-white characteristics of a random process are taken into account. Our method corresponds to block LMMSE filtering, and has the advantage of complexity linearly increasing with the block length and the ease of incorporating the a priori information of the input signals whenever possible. The proposed method can be used with any random process with a known autocorrelation function with the help of an approximation to an autoregressive (AR) process. We show through extensive simulations that our method performs very close to the optimal block LMMSE filtering for Gaussian input signals. △ Less

Submitted 13 May, 2014; v1 submitted 6 January, 2014; originally announced January 2014.

Comments: 5 pages, 4 figures

Performance Analysis of Network Coded Systems Under Quasi-static Rayleigh Fading Channels

Authors: Tugcan Aktas, A. Ozgur Yilmaz, Emre Aktas

Abstract: In the area of basic and network coded cooperative communication, the expected end-to-end bit error rate (BER) values are frequently required to compare the proposed coding, relaying, and decoding techniques. Instead of obtaining these values via time consuming Monte Carlo simulations, deriving closed form expressions using approximations is crucial. In this work, the ultimate goal is to derive an… ▽ More In the area of basic and network coded cooperative communication, the expected end-to-end bit error rate (BER) values are frequently required to compare the proposed coding, relaying, and decoding techniques. Instead of obtaining these values via time consuming Monte Carlo simulations, deriving closed form expressions using approximations is crucial. In this work, the ultimate goal is to derive an approximate average BER expression for a network coded system. While reaching this goal, we firstly consider the cooperative systems' instantaneous BER values that are commonly composed of Q-functions of more than one variables. For these Q-functions, we investigate the convergence characteristics of the sampling property and generalize this property to arbitrary functions of multiple variables. Second, we adapt the equivalent channel approach to the network coded scenario for the ease of analysis and propose a network decoder with reduced complexity. Finally, by combining these techniques, we show that the obtained closed form expressions well agree with simulation results in a wide SNR range. △ Less

Submitted 5 December, 2013; originally announced December 2013.

Comments: 22 pages, 7 figures, Submitted to IEEE Transactions on Communications. arXiv admin note: text overlap with arXiv:1301.6471

Non-Convex Compressed Sensing Using Partial Support Information

Authors: Navid Ghadermarzy, Hassan Mansour, Ozgur Yilmaz

Abstract: In this paper we address the recovery conditions of weighted $\ell_p$ minimization for signal reconstruction from compressed sensing measurements when partial support information is available. We show that weighted $\ell_p$ minimization with $0<p<1$ is stable and robust under weaker sufficient conditions compared to weighted $\ell_1$ minimization. Moreover, the sufficient recovery conditions of we… ▽ More In this paper we address the recovery conditions of weighted $\ell_p$ minimization for signal reconstruction from compressed sensing measurements when partial support information is available. We show that weighted $\ell_p$ minimization with $0<p<1$ is stable and robust under weaker sufficient conditions compared to weighted $\ell_1$ minimization. Moreover, the sufficient recovery conditions of weighted $\ell_p$ are weaker than those of regular $\ell_p$ minimization if at least $50%$ of the support estimate is accurate. We also review some algorithms which exist to solve the non-convex $\ell_p$ problem and illustrate our results with numerical experiments. △ Less

Submitted 15 November, 2013; originally announced November 2013.

Comments: 22 pages, 10 figures

MSC Class: 94A12; 94A20; 94A08

A Low-Complexity Graph-Based LMMSE Receiver Designed for Colored Noise Induced by FTN-Signaling

Authors: Pinar Sen, Tugcan Aktas, A. Ozgur Yilmaz

Abstract: We propose a low complexity graph-based linear minimum mean square error (LMMSE) equalizer which considers both the intersymbol interference (ISI) and the effect of non-white noise inherent in Faster-than-Nyquist (FTN) signaling. In order to incorporate the statistics of noise signal into the factor graph over which the LMMSE algorithm is implemented, we suggest a method that models it as an autor… ▽ More We propose a low complexity graph-based linear minimum mean square error (LMMSE) equalizer which considers both the intersymbol interference (ISI) and the effect of non-white noise inherent in Faster-than-Nyquist (FTN) signaling. In order to incorporate the statistics of noise signal into the factor graph over which the LMMSE algorithm is implemented, we suggest a method that models it as an autoregressive (AR) process. Furthermore, we develop a new mechanism for exchange of information between the proposed equalizer and the channel decoder through turbo iterations. Based on these improvements, we show that the proposed low complexity receiver structure performs close to the optimal decoder operating in ISI-free ideal scenario without FTN signaling through simulations. △ Less

Submitted 13 May, 2014; v1 submitted 12 October, 2013; originally announced October 2013.

Comments: 6 pages, 6 figures, IEEE Wireless Communications and Networking Conference 2014, Istanbul, Turkey

Effects of Individual Success on Globally Distributed Team Performance

Authors: Onur Yılmaz

Abstract: Necessity of different competencies with high level of knowledge makes it inevitable that software development is a team work. With the today's technology, teams can communicate both synchronously and asynchronously using different online collaboration tools throughout the world. Researches indicate that there are many factors that affect the team success and in this paper, effect of individual su… ▽ More Necessity of different competencies with high level of knowledge makes it inevitable that software development is a team work. With the today's technology, teams can communicate both synchronously and asynchronously using different online collaboration tools throughout the world. Researches indicate that there are many factors that affect the team success and in this paper, effect of individual success on globally distributed team performance will be analyzed. Student team projects undertaken by other researchers will be used to analyze collected data and conclusions will be drawn for further analysis. △ Less

Submitted 4 August, 2013; originally announced August 2013.

Comments: 5 pages, 8 figures, research paper

Sigma-Delta quantization of sub-Gaussian frame expansions and its application to compressed sensing

Authors: Felix Krahmer, Rayan Saab, Özgür Yılmaz

Abstract: Suppose that the collection $\{e_i\}_{i=1}^m$ forms a frame for $\R^k$, where each entry of the vector $e_i$ is a sub-Gaussian random variable. We consider expansions in such a frame, which are then quantized using a Sigma-Delta scheme. We show that an arbitrary signal in $\R^k$ can be recovered from its quantized frame coefficients up to an error which decays root-exponentially in the oversamplin… ▽ More Suppose that the collection $\{e_i\}_{i=1}^m$ forms a frame for $\R^k$, where each entry of the vector $e_i$ is a sub-Gaussian random variable. We consider expansions in such a frame, which are then quantized using a Sigma-Delta scheme. We show that an arbitrary signal in $\R^k$ can be recovered from its quantized frame coefficients up to an error which decays root-exponentially in the oversampling rate $m/k$. Here the quantization scheme is assumed to be chosen appropriately depending on the oversampling rate and the quantization alphabet can be coarse. The result holds with high probability on the draw of the frame uniformly for all signals. The crux of the argument is a bound on the extreme singular values of the product of a deterministic matrix and a sub-Gaussian frame. For fine quantization alphabets, we leverage this bound to show polynomial error decay in the context of compressed sensing. Our results extend previous results for structured deterministic frame expansions and Gaussian compressed sensing measurements. △ Less

Submitted 19 June, 2013; originally announced June 2013.

Comments: 22 pages

MSC Class: 94A12; 94A20; 41A25; 15B52

A fast randomized Kaczmarz algorithm for sparse solutions of consistent linear systems

Authors: Hassan Mansour, Ozgur Yilmaz

Abstract: The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear equations with sparse solutions. The speedup is achieved by projecting every iterate onto a weighted row of the linear system while maintaining the random row… ▽ More The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear equations with sparse solutions. The speedup is achieved by projecting every iterate onto a weighted row of the linear system while maintaining the random row selection criteria of Strohmer and Vershynin. The weights are chosen to attenuate the contribution of row elements that lie outside of the estimated support of the sparse solution. While the Kaczmarz algorithm and its variants can only find solutions to overdetermined linear systems, our algorithm surprisingly succeeds in finding sparse solutions to underdetermined linear systems as well. We present empirical studies which demonstrate the acceleration in convergence to the sparse solution using this modified approach in the overdetermined case. We also demonstrate the sparse recovery capabilities of our approach in the underdetermined case and compare the performance with that of $\ell_1$ minimization. △ Less

Submitted 16 May, 2013; originally announced May 2013.

Tag-based Semantic Website Recommendation for Turkish Language

Authors: Onur Yılmaz

Abstract: With the dramatic increase in the number of websites on the internet, tagging has become popular for finding related, personal and important documents. When the potentially increasing internet markets are analyzed, Turkey, in which most of the people use Turkish language on the internet, found to be exponentially increasing. In this paper, a tag-based website recommendation method is presented, wh… ▽ More With the dramatic increase in the number of websites on the internet, tagging has become popular for finding related, personal and important documents. When the potentially increasing internet markets are analyzed, Turkey, in which most of the people use Turkish language on the internet, found to be exponentially increasing. In this paper, a tag-based website recommendation method is presented, where similarity measures are combined with semantic relationships of tags. In order to evaluate the system, an experiment with 25 people from Turkey is undertaken and participants are firstly asked to provide websites and tags in Turkish and then they are asked to evaluate recommended websites. △ Less

Submitted 6 August, 2013; v1 submitted 6 February, 2013; originally announced February 2013.

Comments: 7 pages, research and experiment about recommendation system for Turkish

Generalizing the Sampling Property of the Q-function for Error Rate Analysis of Cooperative Communication in Fading Channels

Authors: Tugcan Aktas, Ali Ozgur Yilmaz, Emre Aktas

Abstract: This paper extends some approximation methods that are used to identify closed form Bit Error Rate (BER) expressions which are frequently utilized in investigation and comparison of performance for wireless communication systems in the literature. By using this group of approximation methods, some expectation integrals, which are complicated to analyze and have high computational complexity to eva… ▽ More This paper extends some approximation methods that are used to identify closed form Bit Error Rate (BER) expressions which are frequently utilized in investigation and comparison of performance for wireless communication systems in the literature. By using this group of approximation methods, some expectation integrals, which are complicated to analyze and have high computational complexity to evaluate through Monte Carlo simulations, are computed. For these integrals, by using the sampling property of the integrand functions of one or more arguments, reliable BER expressions revealing the diversity and coding gains are derived. Although the methods we present are valid for a larger class of integration problems, in this work we show the step by step derivation of the BER expressions for a canonical cooperative communication scenario in addition to a network coded system starting from basic building blocks. The derived expressions agree with the simulation results for a very wide range of signal-to-noise ratio (SNR) values. △ Less

Submitted 28 January, 2013; originally announced January 2013.

Comments: 5 pages, 5 figures, Submitted to IEEE International Symposium on Information Theory, ISIT 2013, Istanbul, Turkey

Error Rate Analysis of GF(q) Network Coded Detect-and-Forward Wireless Relay Networks Using Equivalent Relay Channel Models

Authors: Ilgın Şafak, Emre Aktaş, Ali Özgür Yılmaz

Abstract: This paper investigates simple means of analyzing the error rate performance of a general q-ary Galois Field network coded detect-and-forward cooperative relay network with known relay error statistics at the destination. Equivalent relay channels are used in obtaining an approximate error rate of the relay network, from which the diversity order is found. Error rate analyses using equivalent rela… ▽ More This paper investigates simple means of analyzing the error rate performance of a general q-ary Galois Field network coded detect-and-forward cooperative relay network with known relay error statistics at the destination. Equivalent relay channels are used in obtaining an approximate error rate of the relay network, from which the diversity order is found. Error rate analyses using equivalent relay channel models are shown to be closely matched with simulation results. Using the equivalent relay channels, low complexity receivers are developed whose performances are close to that of the optimal maximum likelihood receiver. △ Less

Submitted 5 February, 2013; v1 submitted 10 September, 2012; originally announced September 2012.

Comments: 28 pages, 10 figures. This work has been submitted to the IEEE for possible publication

Support driven reweighted $\ell_1$ minimization

Authors: Hassan Mansour, Ozgur Yilmaz

Abstract: In this paper, we propose a support driven reweighted $\ell_1$ minimization algorithm (SDRL1) that solves a sequence of weighted $\ell_1$ problems and relies on the support estimate accuracy. Our SDRL1 algorithm is related to the IRL1 algorithm proposed by Cand{è}s, Wakin, and Boyd. We demonstrate that it is sufficient to find support estimates with \emph{good} accuracy and apply constant weights… ▽ More In this paper, we propose a support driven reweighted $\ell_1$ minimization algorithm (SDRL1) that solves a sequence of weighted $\ell_1$ problems and relies on the support estimate accuracy. Our SDRL1 algorithm is related to the IRL1 algorithm proposed by Cand{è}s, Wakin, and Boyd. We demonstrate that it is sufficient to find support estimates with \emph{good} accuracy and apply constant weights instead of using the inverse coefficient magnitudes to achieve gains similar to those of IRL1. We then prove that given a support estimate with sufficient accuracy, if the signal decays according to a specific rate, the solution to the weighted $\ell_1$ minimization problem results in a support estimate with higher accuracy than the initial estimate. We also show that under certain conditions, it is possible to achieve higher estimate accuracy when the intersection of support estimates is considered. We demonstrate the performance of SDRL1 through numerical simulations and compare it with that of IRL1 and standard $\ell_1$ minimization. △ Less

Submitted 30 May, 2012; originally announced May 2012.

Comments: Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), March, 2012

Weighted-{$\ell_1$} minimization with multiple weighting sets

Authors: Hassan Mansour, Ozgur Yilmaz

Abstract: In this paper, we study the support recovery conditions of weighted $\ell_1$ minimization for signal reconstruction from compressed sensing measurements when multiple support estimate sets with different accuracy are available. We identify a class of signals for which the recovered vector from $\ell_1$ minimization provides an accurate support estimate. We then derive stability and robustness guar… ▽ More In this paper, we study the support recovery conditions of weighted $\ell_1$ minimization for signal reconstruction from compressed sensing measurements when multiple support estimate sets with different accuracy are available. We identify a class of signals for which the recovered vector from $\ell_1$ minimization provides an accurate support estimate. We then derive stability and robustness guarantees for the weighted $\ell_1$ minimization problem with more than one support estimate. We show that applying a smaller weight to support estimate that enjoy higher accuracy improves the recovery conditions compared with the case of a single support estimate and the case with standard, i.e., non-weighted, $\ell_1$ minimization. Our theoretical results are supported by numerical simulations on synthetic signals and real audio signals. △ Less

Submitted 30 May, 2012; originally announced May 2012.

Comments: Proceedings of the SPIE, Wavelets and Sparsity XIV, San Diego, August 2011

Practical Methods for Wireless Network Coding with Multiple Unicast Transmissions

Authors: Tugcan Aktas, A. Ozgur Yilmaz, Emre Aktas

Abstract: We propose a simple yet effective wireless network coding and decoding technique for a multiple unicast network. It utilizes spatial diversity through cooperation between nodes which carry out distributed encoding operations dictated by generator matrices of linear block codes. In order to exemplify the technique, we make use of greedy codes over the binary field and show that the arbitrary divers… ▽ More We propose a simple yet effective wireless network coding and decoding technique for a multiple unicast network. It utilizes spatial diversity through cooperation between nodes which carry out distributed encoding operations dictated by generator matrices of linear block codes. In order to exemplify the technique, we make use of greedy codes over the binary field and show that the arbitrary diversity orders can be flexibly assigned to nodes. Furthermore, we present the optimal detection rule for the given model that accounts for intermediate node errors and suggest a low-complexity network decoder using the sum-product (SP) algorithm. The proposed SP detector exhibits near optimal performance. We also show asymptotic superiority of network coding over a method that utilizes the wireless channel in a repetitive manner without network coding (NC) and give related rate-diversity trade-off curves. Finally, we extend the given encoding method through selective encoding in order to obtain extra coding gains. △ Less

Submitted 5 September, 2012; v1 submitted 14 December, 2011; originally announced December 2011.

Comments: 29 pages, 9 figures, Submitted to the IEEE Transactions on Communications on 14.12.2011, revised on 18.05.2012 and on 04.09.2012. arXiv admin note: text overlap with arXiv:1110.0594

Practical Wireless Network Coding and Decoding Methods for Multiple Unicast Transmissions

Authors: Tugcan Aktas, Ali Ozgur Yilmaz, Emre Aktas

Abstract: We propose a simple yet effective wireless network coding and decoding technique. It utilizes spatial diversity through cooperation between nodes which carry out distributed encoding operations dictated by generator matrices of linear block codes. For this purpose, we make use of greedy codes over the binary field and show that desired diversity orders can be flexibly assigned to nodes in a multip… ▽ More We propose a simple yet effective wireless network coding and decoding technique. It utilizes spatial diversity through cooperation between nodes which carry out distributed encoding operations dictated by generator matrices of linear block codes. For this purpose, we make use of greedy codes over the binary field and show that desired diversity orders can be flexibly assigned to nodes in a multiple unicast network, contrary to the previous findings in the literature. Furthermore, we present the optimal detection rule for the given model that accounts for intermediate node errors and suggest a network decoder using the sum-product algorithm. The proposed sum-product detector exhibits near optimal performance. △ Less

Submitted 4 October, 2011; originally announced October 2011.

Comments: 6 pages, 5 figures, Submitted to WCNC 2012, IEEE Wireless Communication and Networking Conference