-
Parabolic Relaxation for Quadratically-constrained Quadratic Programming -- Part II: Theoretical & Computational Results
Authors:
Ramtin Madani,
Mersedeh Ashraphijuo,
Mohsen Kheirandishfard,
Alper Atamturk
Abstract:
In the first part of this work [32], we introduce a convex parabolic relaxation for quadratically-constrained quadratic programs, along with a sequential penalized parabolic relaxation algorithm to recover near-optimal feasible solutions. In this second part, we show that starting from a feasible solution or a near-feasible solution satisfying certain regularity conditions, the sequential penalize…
▽ More
In the first part of this work [32], we introduce a convex parabolic relaxation for quadratically-constrained quadratic programs, along with a sequential penalized parabolic relaxation algorithm to recover near-optimal feasible solutions. In this second part, we show that starting from a feasible solution or a near-feasible solution satisfying certain regularity conditions, the sequential penalized parabolic relaxation algorithm convergences to a point which satisfies Karush-Kuhn-Tucker optimality conditions. Next, we present numerical experiments on benchmark non-convex QCQP problems as well as large-scale instances of system identification problem demonstrating the efficiency of the proposed approach.
△ Less
Submitted 6 August, 2022;
originally announced August 2022.
-
Parabolic Relaxation for Quadratically-constrained Quadratic Programming -- Part I: Definitions & Basic Properties
Authors:
Ramtin Madani,
Mersedeh Ashraphijuo,
Mohsen Kheirandishfard,
Alper Atamturk
Abstract:
For general quadratically-constrained quadratic programming (QCQP), we propose a parabolic relaxation described with convex quadratic constraints. An interesting property of the parabolic relaxation is that the original non-convex feasible set is contained on the boundary of the parabolic relaxation. Under certain assumptions, this property enables one to recover near-optimal feasible points via o…
▽ More
For general quadratically-constrained quadratic programming (QCQP), we propose a parabolic relaxation described with convex quadratic constraints. An interesting property of the parabolic relaxation is that the original non-convex feasible set is contained on the boundary of the parabolic relaxation. Under certain assumptions, this property enables one to recover near-optimal feasible points via objective penalization. Moreover, through an appropriate change of coordinates that requires a one-time computation of an optimal basis, the easier-to-solve parabolic relaxation can be made as strong as a semidefinite programming (SDP) relaxation, which can be effective in accelerating algorithms that require solving a sequence of convex surrogates. The majority of theoretical and computational results are given in the next part of this work [57].
△ Less
Submitted 6 August, 2022;
originally announced August 2022.
-
On Deterministic Sampling Patterns for Robust Low-Rank Matrix Completion
Authors:
Morteza Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
In this letter, we study the deterministic sampling patterns for the completion of low rank matrix, when corrupted with a sparse noise, also known as robust matrix completion. We extend the recent results on the deterministic sampling patterns in the absence of noise based on the geometric analysis on the Grassmannian manifold. A special case where each column has a certain number of noisy entries…
▽ More
In this letter, we study the deterministic sampling patterns for the completion of low rank matrix, when corrupted with a sparse noise, also known as robust matrix completion. We extend the recent results on the deterministic sampling patterns in the absence of noise based on the geometric analysis on the Grassmannian manifold. A special case where each column has a certain number of noisy entries is considered, where our probabilistic analysis performs very efficiently. Furthermore, assuming that the rank of the original matrix is not given, we provide an analysis to determine if the rank of a valid completion is indeed the actual rank of the data corrupted with sparse noise by verifying some conditions.
△ Less
Submitted 5 December, 2017;
originally announced December 2017.
-
Rank Determination for Low-Rank Data Completion
Authors:
Morteza Ashraphijuo,
Xiaodong Wang,
Vaneet Aggarwal
Abstract:
Recently, fundamental conditions on the sampling patterns have been obtained for finite completability of low-rank matrices or tensors given the corresponding ranks. In this paper, we consider the scenario where the rank is not given and we aim to approximate the unknown rank based on the location of sampled entries and some given completion. We consider a number of data models, including single-v…
▽ More
Recently, fundamental conditions on the sampling patterns have been obtained for finite completability of low-rank matrices or tensors given the corresponding ranks. In this paper, we consider the scenario where the rank is not given and we aim to approximate the unknown rank based on the location of sampled entries and some given completion. We consider a number of data models, including single-view matrix, multi-view matrix, CP tensor, tensor-train tensor and Tucker tensor. For each of these data models, we provide an upper bound on the rank when an arbitrary low-rank completion is given. We characterize these bounds both deterministically, i.e., with probability one given that the sampling pattern satisfies certain combinatorial properties, and probabilistically, i.e., with high probability given that the sampling probability is above some threshold. Moreover, for both single-view matrix and CP tensor, we are able to show that the obtained upper bound is exactly equal to the unknown rank if the lowest-rank completion is given. Furthermore, we provide numerical experiments for the case of single-view matrix, where we use nuclear norm minimization to find a low-rank completion of the sampled data and we observe that in most of the cases the proposed upper bound on the rank is equal to the true rank.
△ Less
Submitted 3 July, 2017;
originally announced July 2017.
-
Fundamental Conditions for Low-CP-Rank Tensor Completion
Authors:
Morteza Ashraphijuo,
Xiaodong Wang
Abstract:
We consider the problem of low canonical polyadic (CP) rank tensor completion. A completion is a tensor whose entries agree with the observed entries and its rank matches the given CP rank. We analyze the manifold structure corresponding to the tensors with the given rank and define a set of polynomials based on the sampling pattern and CP decomposition. Then, we show that finite completability of…
▽ More
We consider the problem of low canonical polyadic (CP) rank tensor completion. A completion is a tensor whose entries agree with the observed entries and its rank matches the given CP rank. We analyze the manifold structure corresponding to the tensors with the given rank and define a set of polynomials based on the sampling pattern and CP decomposition. Then, we show that finite completability of the sampled tensor is equivalent to having a certain number of algebraically independent polynomials among the defined polynomials. Our proposed approach results in characterizing the maximum number of algebraically independent polynomials in terms of a simple geometric structure of the sampling pattern, and therefore we obtain the deterministic necessary and sufficient condition on the sampling pattern for finite completability of the sampled tensor. Moreover, assuming that the entries of the tensor are sampled independently with probability $p$ and using the mentioned deterministic analysis, we propose a combinatorial method to derive a lower bound on the sampling probability $p$, or equivalently, the number of sampled entries that guarantees finite completability with high probability. We also show that the existing result for the matrix completion problem can be used to obtain a loose lower bound on the sampling probability $p$. In addition, we obtain deterministic and probabilistic conditions for unique completability. It is seen that the number of samples required for finite or unique completability obtained by the proposed analysis on the CP manifold is orders-of-magnitude lower than that is obtained by the existing analysis on the Grassmannian manifold.
△ Less
Submitted 30 March, 2017;
originally announced March 2017.
-
Characterization of Deterministic and Probabilistic Sampling Patterns for Finite Completability of Low Tensor-Train Rank Tensor
Authors:
Morteza Ashraphijuo,
Xiaodong Wang
Abstract:
In this paper, we analyze the fundamental conditions for low-rank tensor completion given the separation or tensor-train (TT) rank, i.e., ranks of unfoldings. We exploit the algebraic structure of the TT decomposition to obtain the deterministic necessary and sufficient conditions on the locations of the samples to ensure finite completability. Specifically, we propose an algebraic geometric analy…
▽ More
In this paper, we analyze the fundamental conditions for low-rank tensor completion given the separation or tensor-train (TT) rank, i.e., ranks of unfoldings. We exploit the algebraic structure of the TT decomposition to obtain the deterministic necessary and sufficient conditions on the locations of the samples to ensure finite completability. Specifically, we propose an algebraic geometric analysis on the TT manifold that can incorporate the whole rank vector simultaneously in contrast to the existing approach based on the Grassmannian manifold that can only incorporate one rank component. Our proposed technique characterizes the algebraic independence of a set of polynomials defined based on the sampling pattern and the TT decomposition, which is instrumental to obtaining the deterministic condition on the sampling pattern for finite completability. In addition, based on the proposed analysis, assuming that the entries of the tensor are sampled independently with probability $p$, we derive a lower bound on the sampling probability $p$, or equivalently, the number of sampled entries that ensures finite completability with high probability. Moreover, we also provide the deterministic and probabilistic conditions for unique completability.
△ Less
Submitted 22 March, 2017;
originally announced March 2017.
-
Deterministic and Probabilistic Conditions for Finite Completability of Low-rank Multi-View Data
Authors:
Morteza Ashraphijuo,
Xiaodong Wang,
Vaneet Aggarwal
Abstract:
We consider the multi-view data completion problem, i.e., to complete a matrix $\mathbf{U}=[\mathbf{U}_1|\mathbf{U}_2]$ where the ranks of $\mathbf{U},\mathbf{U}_1$, and $\mathbf{U}_2$ are given. In particular, we investigate the fundamental conditions on the sampling pattern, i.e., locations of the sampled entries for finite completability of such a multi-view data given the corresponding rank co…
▽ More
We consider the multi-view data completion problem, i.e., to complete a matrix $\mathbf{U}=[\mathbf{U}_1|\mathbf{U}_2]$ where the ranks of $\mathbf{U},\mathbf{U}_1$, and $\mathbf{U}_2$ are given. In particular, we investigate the fundamental conditions on the sampling pattern, i.e., locations of the sampled entries for finite completability of such a multi-view data given the corresponding rank constraints. In contrast with the existing analysis on Grassmannian manifold for a single-view matrix, i.e., conventional matrix completion, we propose a geometric analysis on the manifold structure for multi-view data to incorporate more than one rank constraint. We provide a deterministic necessary and sufficient condition on the sampling pattern for finite completability. We also give a probabilistic condition in terms of the number of samples per column that guarantees finite completability with high probability. Finally, using the developed tools, we derive the deterministic and probabilistic guarantees for unique completability.
△ Less
Submitted 25 April, 2017; v1 submitted 3 January, 2017;
originally announced January 2017.
-
Deterministic and Probabilistic Conditions for Finite Completability of Low-Tucker-Rank Tensor
Authors:
Morteza Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
We investigate the fundamental conditions on the sampling pattern, i.e., locations of the sampled entries, for finite completability of a low-rank tensor given some components of its Tucker rank. In order to find the deterministic necessary and sufficient conditions, we propose an algebraic geometric analysis on the Tucker manifold, which allows us to incorporate multiple rank components in the pr…
▽ More
We investigate the fundamental conditions on the sampling pattern, i.e., locations of the sampled entries, for finite completability of a low-rank tensor given some components of its Tucker rank. In order to find the deterministic necessary and sufficient conditions, we propose an algebraic geometric analysis on the Tucker manifold, which allows us to incorporate multiple rank components in the proposed analysis in contrast with the conventional geometric approaches on the Grassmannian manifold. This analysis characterizes the algebraic independence of a set of polynomials defined based on the sampling pattern, which is closely related to finite completion. Probabilistic conditions are then studied and a lower bound on the sampling probability is given, which guarantees that the proposed deterministic conditions on the sampling patterns for finite completability hold with high probability. Furthermore, using the proposed geometric approach for finite completability, we propose a sufficient condition on the sampling pattern that ensures there exists exactly one completion for the sampled tensor.
△ Less
Submitted 9 May, 2019; v1 submitted 5 December, 2016;
originally announced December 2016.
-
On the DoF of Two-way $2\times2\times2$ Relay Networks with or without Relay Caching
Authors:
Mehdi Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
Two-way relay is potentially an effective approach to spectrum sharing and aggregation by allowing simultaneous bidirectional transmissions between source-destinations pairs. This paper studies the two-way $2\times2\times2$ relay network, a class of four-unicast networks, where there are four source/destination nodes and two relay nodes, with each source sending a message to its destination. We sh…
▽ More
Two-way relay is potentially an effective approach to spectrum sharing and aggregation by allowing simultaneous bidirectional transmissions between source-destinations pairs. This paper studies the two-way $2\times2\times2$ relay network, a class of four-unicast networks, where there are four source/destination nodes and two relay nodes, with each source sending a message to its destination. We show that without relay caching the total degrees of freedom (DoF) is bounded from above by $8/3$, indicating that bidirectional links do not double the DoF (It is known that the total DoF of one-way $2\times2\times2$ relay network is $2$.). Further, we show that the DoF of $8/3$ is achievable for the two-way $2\times2\times2$ relay network with relay caching. Finally, even though the DoF of this network is no more than $8/3$ for generic channel gains, DoF of $4$ can be achieved for a symmetric configuration of channel gains.
△ Less
Submitted 26 November, 2016;
originally announced November 2016.
-
The DoF of Two-way Butterfly Networks
Authors:
Mehdi Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
This paper studies the two-way butterfly network, a class of two-way four-unicast networks. We first show that bidirectional links do not increase the degrees of freedom for this network thus giving the first example for networks, to the best of our knowledge, where bidirectional links do not increase the degrees of freedom. Further, we see that sufficient caching at the relays or increasing the n…
▽ More
This paper studies the two-way butterfly network, a class of two-way four-unicast networks. We first show that bidirectional links do not increase the degrees of freedom for this network thus giving the first example for networks, to the best of our knowledge, where bidirectional links do not increase the degrees of freedom. Further, we see that sufficient caching at the relays or increasing the number of antennas in the relays can double the two-way degrees of freedom for butterfly network.
△ Less
Submitted 20 July, 2016;
originally announced July 2016.
-
On the Capacity Regions of Two-Way Diamond Channels
Authors:
Mehdi Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
In this paper, we study the capacity regions of two-way diamond channels. We show that for a linear deterministic model the capacity of the diamond channel in each direction can be simultaneously achieved for all values of channel parameters, where the forward and backward channel parameters are not necessarily the same. We divide the achievability scheme into three cases, depending on the forward…
▽ More
In this paper, we study the capacity regions of two-way diamond channels. We show that for a linear deterministic model the capacity of the diamond channel in each direction can be simultaneously achieved for all values of channel parameters, where the forward and backward channel parameters are not necessarily the same. We divide the achievability scheme into three cases, depending on the forward and backward channel parameters. For the first case, we use a reverse amplify-and-forward strategy in the relays. For the second case, we use four relay strategies based on the reverse amplify-and-forward with some modifications in terms of replacement and repetition of some stream levels. For the third case, we use two relay strategies based on performing two rounds of repetitions in a relay. The proposed schemes for deterministic channels are used to find the capacity regions within constant gaps for two special cases of the Gaussian two-way diamond channel. First, for the general Gaussian two-way relay channel with a simple coding scheme the smallest gap is achieved compared to the prior works. Then, a special symmetric Gaussian two-way diamond model is considered and the capacity region is achieved within four bits.
△ Less
Submitted 19 October, 2014;
originally announced October 2014.
-
On the Symmetric $K$-user Interference Channels with Limited Feedback
Authors:
Mehdi Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
In this paper, we develop achievability schemes for symmetric $K$-user interference channels with a rate-limited feedback from each receiver to the corresponding transmitter. We study this problem under two different channel models: the linear deterministic model, and the Gaussian model. For the deterministic model, the proposed scheme achieves a symmetric rate that is the minimum of the symmetric…
▽ More
In this paper, we develop achievability schemes for symmetric $K$-user interference channels with a rate-limited feedback from each receiver to the corresponding transmitter. We study this problem under two different channel models: the linear deterministic model, and the Gaussian model. For the deterministic model, the proposed scheme achieves a symmetric rate that is the minimum of the symmetric capacity with infinite feedback, and the sum of the symmetric capacity without feedback and the symmetric amount of feedback. For the Gaussian interference channel, we use lattice codes to propose a transmission strategy that incorporates the techniques of Han-Kobayashi message splitting, interference decoding, and decode and forward. This strategy achieves a symmetric rate which is within a constant number of bits to the minimum of the symmetric capacity with infinite feedback, and the sum of the symmetric capacity without feedback and the amount of symmetric feedback. This constant is obtained as a function of the number of users, $K$. The symmetric achievable rate is used to characterize the achievable generalized degrees of freedom which exhibits a gradual increase from no feedback to perfect feedback in the presence of feedback links with limited capacity.
△ Less
Submitted 26 July, 2016; v1 submitted 4 March, 2014;
originally announced March 2014.
-
On the Capacity and Degrees of Freedom Regions of MIMO Interference Channels with Limited Receiver Cooperation
Authors:
Mehdi Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
This paper gives the approximate capacity region of a two-user MIMO interference channel with limited receiver cooperation, where the gap between the inner and outer bounds is in terms of the total number of receive antennas at the two receivers and is independent of the actual channel values. The approximate capacity region is then used to find the degrees of freedom region. For the special case…
▽ More
This paper gives the approximate capacity region of a two-user MIMO interference channel with limited receiver cooperation, where the gap between the inner and outer bounds is in terms of the total number of receive antennas at the two receivers and is independent of the actual channel values. The approximate capacity region is then used to find the degrees of freedom region. For the special case of symmetric interference channels, we also find the amount of receiver cooperation in terms of the backhaul capacity beyond which the degrees of freedom do not improve. Further, the generalized degrees of freedom are found for MIMO interference channels with equal number of antennas at all nodes. It is shown that the generalized degrees of freedom improve gradually from a "W" curve to a "V" curve with increase in cooperation in terms of the backhaul capacity.
△ Less
Submitted 15 August, 2013;
originally announced August 2013.
-
On the Capacity Region and the Generalized Degrees of Freedom Region for the MIMO Interference Channel with Feedback
Authors:
Mehdi Ashraphijuo,
Vaneet Aggarwal,
Xiaodong Wang
Abstract:
In this paper, we study the effect of feedback on two-user MIMO interference channels. The capacity region of MIMO interference channels with feedback is characterized within a constant number of bits, where this constant is independent of the channel matrices. Further, it is shown that the capacity region of a MIMO interference channel with feedback and its reciprocal interference channel are wit…
▽ More
In this paper, we study the effect of feedback on two-user MIMO interference channels. The capacity region of MIMO interference channels with feedback is characterized within a constant number of bits, where this constant is independent of the channel matrices. Further, it is shown that the capacity region of a MIMO interference channel with feedback and its reciprocal interference channel are within a constant number of bits. Finally, the generalized degrees of freedom region for the MIMO interference channel with feedback is characterized.
△ Less
Submitted 14 September, 2013; v1 submitted 19 December, 2012;
originally announced December 2012.
