-
A New Active Set Scheme for Quadratic Programing
Authors:
Negin Bagherpour,
Nima Minayi,
AmirHossein Shanaghi
Abstract:
We are faced with convex quadratic programing in many contexts related to control theory, economy and robotics. In this paper, we introduce a new active set algorithm for solving such problems and analyze its possible advantages. The novelty of the proposed scheme is in the way of solving the KKT system based on matrix properties. More precisely, we combine the two KKT equations to reduce the orde…
▽ More
We are faced with convex quadratic programing in many contexts related to control theory, economy and robotics. In this paper, we introduce a new active set algorithm for solving such problems and analyze its possible advantages. The novelty of the proposed scheme is in the way of solving the KKT system based on matrix properties. More precisely, we combine the two KKT equations to reduce the order and substitute it with a null space computation. The null space is in hand by use of the singular values decomposition. In problems with high number of independent constraints, we proposed another scheme. This also aims to solve the KKT system based on matrix properties. We implement both algorithms and test them over both randomly generated problems and standard problems mentioned in CUTEst. In general, more than 2000 tests with great variety are generated and computing times and accuracies are reported. The proposed schemes for solving convex quadratic problems are members of active set family. Because of using matrix properties, it reduces computing time and as larger as the problem is, the improvement shows to be more remarkable. The first strategy performs the original active set when the number of constraints is low while the second outperforms the original algorithm when there exists a lot of independent constraints.
△ Less
Submitted 25 August, 2024;
originally announced August 2024.
-
On Solving General and Special Structure Medium-Scale MINLP Problems
Authors:
Negin Bagherpour,
Mahdi Sharifzadeh
Abstract:
Mixed integer nonlinear programming (MINLP) problems are encountered in modeling a physical/industrial process consisting both nonlinearity and discrete selective parameters. There are variety of algorithms for solving MINLP problems most of which solve large-scale MINLP problems very slowly. In this research two parallelization scheme are suggested for solving general and special structure large-…
▽ More
Mixed integer nonlinear programming (MINLP) problems are encountered in modeling a physical/industrial process consisting both nonlinearity and discrete selective parameters. There are variety of algorithms for solving MINLP problems most of which solve large-scale MINLP problems very slowly. In this research two parallelization scheme are suggested for solving general and special structure large-scale MINLP problems satisfyingly fast. Special structure refers to problems in which a group of variables are appeared in the objective function and constraints and others are appeared in some constraints separately. Moreover, it is proved that both algorithms have at least R-linear convergence. To show the efficiency of algorithms, numerical test results are presented and compared to available GAMS solvers. According to the numerical results, in almost 80 percent of tests both algorithms compute the solution faster than the best solver in GAMS.
△ Less
Submitted 15 May, 2024; v1 submitted 17 December, 2023;
originally announced December 2023.
-
Some Ideas for Improving Stock Price Prediction Based on Machine Learning
Authors:
Negin Bagherpour
Abstract:
Stock price prediction is a complicated and interesting task. Noisy trends make stock pricing sensitive and complicated while the economical motivation behind, keeps it interesting for researchers and investors. In this paper we are to outline two novel ideas for stock pricing. We also test each of our suggested algorithms for predicting the price of 6 stocks from different sectors. To show the ef…
▽ More
Stock price prediction is a complicated and interesting task. Noisy trends make stock pricing sensitive and complicated while the economical motivation behind, keeps it interesting for researchers and investors. In this paper we are to outline two novel ideas for stock pricing. We also test each of our suggested algorithms for predicting the price of 6 stocks from different sectors. To show the efficiency of our proposed algorithm, we compare the predicted prices with real values and also perform a backtest to verify that the annual returns based on real data and predicted price are almost the same.
△ Less
Submitted 17 December, 2023;
originally announced December 2023.
-
On the Frobenius Coin Problem in Three Variables
Authors:
Negin Bagherpour,
Amir Jafari,
Amin Najafi Amin
Abstract:
The Frobenius coin problem in three variables, for three positive relatively prime integers $a_1< a_2< a_3$ asks to find the largest number not representable as $a_1x_1+a_2x_2+a_3x_3$ with non-negative integer coefficients $x_1$, $x_2$ and $x_3$. In this article, we present a new algorithm to solve this problem that is faster and in our belief simpler than all existing algorithms and runs in…
▽ More
The Frobenius coin problem in three variables, for three positive relatively prime integers $a_1< a_2< a_3$ asks to find the largest number not representable as $a_1x_1+a_2x_2+a_3x_3$ with non-negative integer coefficients $x_1$, $x_2$ and $x_3$. In this article, we present a new algorithm to solve this problem that is faster and in our belief simpler than all existing algorithms and runs in $\mbox{O}(\log a_1)$ steps.
△ Less
Submitted 22 March, 2022;
originally announced March 2022.
-
Computing Symmetric Positive Definite Solutions of Three Types of Nonlinear Matrix Equations
Authors:
Negin Bagherpour,
Nezam Mahdavi-Amiri
Abstract:
Nonlinear matrix equations arise in many practical contexts related to control theory, dynamical programming and finite element methods for solving some partial differential equations. In most of these applications, it is needed to compute a symmetric and positive definite solution. Here, we propose new iterative algorithms for solving three different types of nonlinear matrix equations. We have r…
▽ More
Nonlinear matrix equations arise in many practical contexts related to control theory, dynamical programming and finite element methods for solving some partial differential equations. In most of these applications, it is needed to compute a symmetric and positive definite solution. Here, we propose new iterative algorithms for solving three different types of nonlinear matrix equations. We have recently proposed a new algorithm for solving positive definite total least squares problems. Making use of an iterative process for inverse of a matrix, we convert the nonlinear matrix equation to an iterative linear one, and, in every iteration, we apply our algorithm for solving a positive definite total least squares problem to solve the linear subproblem and update the newly defined variables and the matrix inverse terms using appropriate formulas. Our proposed algorithms have a number of useful features. One is that the computed unknown matrix remains symmetric and positive definite in all iterations. As the second useful feature, numerical test results show that in most cases our proposed approach turns to compute solutions with smaller errors within lower computing times. Finally, we provide some test results showing that our proposed algorithm converges to a symmetric and positive definite solution in Matlab software environment on a PC, while other methods fail to do so.
△ Less
Submitted 21 October, 2014;
originally announced October 2014.
-
Efficient Algorithms for Positive Semi-Definite Total Least Squares Problems, Minimum Rank Problem and Correlation Matrix Computation
Authors:
Negin Bagherpour,
Nezam Mahdavi-Amiri
Abstract:
We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side matrices are respectively named data and target matrices. A more complicated problem is encountered when the unknown matrix is to be positive semi-definite. The pro…
▽ More
We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side matrices are respectively named data and target matrices. A more complicated problem is encountered when the unknown matrix is to be positive semi-definite. The problem arises in estimating the compliance matrix to model deformable structures and approximating correlation and covariance matrices in financial modeling. Several methods have been proposed for solving such problems assuming that the data matrix is unrealistically error free. Here, considering error in measured data and target matrices, we propose a new approach to solve a positive semi-definite constrained total least squares problem. We first consider solving the problem when the rank of the unknown matrix is known, by defining a new error formulation for the positive semi-definite total least squares problem and use of optimization methods on Stiefel manifolds. We prove quadratic convergence of our proposed approach. We then describe how to generalize our proposed method to solve the general positive semi-definite total least squares problem. We further apply the proposed approach to solve the minimum rank problem and the problem of computing correlation matrix. Comparative numerical results show the efficiency of our proposed algorithms. Finally, the Dolan-More performance profiles are shown to summarize our comparative study.
△ Less
Submitted 18 September, 2014; v1 submitted 15 July, 2014;
originally announced July 2014.
-
A New Error in Variables Model for Solving Positive Definite Linear System Using Orthogonal Matrix Decompositions
Authors:
Negin Bagherpour,
Nezam Mahdavi Amiri
Abstract:
The need to estimate a positive definite solution to an overdetermined linear system of equations with multiple right hand side vectors arises in several process control contexts. The coefficient and the right hand side matrices are respectively named data and target matrices. A number of optimization methods were proposed for solving such problems, in which the data matrix is unrealistically assu…
▽ More
The need to estimate a positive definite solution to an overdetermined linear system of equations with multiple right hand side vectors arises in several process control contexts. The coefficient and the right hand side matrices are respectively named data and target matrices. A number of optimization methods were proposed for solving such problems, in which the data matrix is unrealistically assumed to be error free. Here, considering error in measured data and target matrices, we present an approach to solve a positive definite constrained linear system of equations based on the use of a newly defined error function. To minimize the defined error function, we derive necessary and sufficient optimality conditions and outline a direct algorithm to compute the solution. We provide a comparison of our proposed approach and two existing methods, the interior point method and a method based on quadratic programming. Two important characteristics of our proposed method as compared to the existing methods are computing the solution directly and considering error both in data and target matrices. Moreover, numerical test results show that the new approach leads to smaller standard deviations of error entries and smaller effective rank as desired by control problems. Furthermore, in a comparative study, using the Dolan-Moré performance profiles, we show the approach to be more efficient.
△ Less
Submitted 15 June, 2015; v1 submitted 5 July, 2014;
originally announced July 2014.
