Showing 1–14 of 14 results for author: Haddou, M

Approximation of an optimal control problem on a network with a perturbed problem in the whole space

Authors: Mohamed Camar-Eddine, Mériadec Chuberre, Mounir Haddou, Olivier Ley

Abstract: A classical optimal control problem posed in the whole space R^2 is perturbed by a singular term of magnitude $ε$^{-1} aimed at driving the trajectories to a prescribed network $Γ$. We are interested in the link between the limit problem, as $ε$ $\rightarrow$ 0, and some optimal control problems on networks studied in the literature. We prove that the sequence of trajectories admits a subsequentia… ▽ More A classical optimal control problem posed in the whole space R^2 is perturbed by a singular term of magnitude $ε$^{-1} aimed at driving the trajectories to a prescribed network $Γ$. We are interested in the link between the limit problem, as $ε$ $\rightarrow$ 0, and some optimal control problems on networks studied in the literature. We prove that the sequence of trajectories admits a subsequential limit evolving on $Γ$. Moreover, in the case of the Eikonal equation, we show that the sequence of value functions associated with the perturbed optimal control problems converges to a limit which, in particular, coincides with the value function of the expected optimal control problem set on the network $Γ$. △ Less

Submitted 28 April, 2025; originally announced April 2025.

Classification of left invariant Riemannian metrics on nonunimodular 4-dimensional Lie groups

Authors: Malika Ait Ben Haddou, Youssef Ayad

Abstract: We classify, up to automorphism, left invariant Riemannian metrics on 4-dimensional simply connected nonunimodular Lie groups. This is equivalent to classifying, up to automorphism, inner products on 4-dimensional nonunimodular Lie algebras. We classify, up to automorphism, left invariant Riemannian metrics on 4-dimensional simply connected nonunimodular Lie groups. This is equivalent to classifying, up to automorphism, inner products on 4-dimensional nonunimodular Lie algebras. △ Less

Submitted 20 May, 2025; v1 submitted 2 January, 2025; originally announced January 2025.

MSC Class: 53C30; 53C20

Solving Nonlinear Absolute Value Equations

Authors: Aris Daniilidis, Mounir Haddou, Tri Minh Le, Olivier Ley

Abstract: In this work we show that several problems naturally modeled as Nonlinear Absolute Value Equations (NAVE), can be restated as Nonlinear Complementarity Problems (NCP) and solved efficiently using smoothing regularizing techniques under mild assumptions. Applications include ridge optimization and resolution of nonlinear ordinary differential equations. In this work we show that several problems naturally modeled as Nonlinear Absolute Value Equations (NAVE), can be restated as Nonlinear Complementarity Problems (NCP) and solved efficiently using smoothing regularizing techniques under mild assumptions. Applications include ridge optimization and resolution of nonlinear ordinary differential equations. △ Less

Submitted 2 October, 2024; v1 submitted 26 February, 2024; originally announced February 2024.

Analysis and Comparison of Two-Level KFAC Methods for Training Deep Neural Networks

Authors: Abdoulaye Koroko, Ani Anciaux-Sedrakian, Ibtihel Ben Gharbia, Valérie Garès, Mounir Haddou, Quang Huy Tran

Abstract: As a second-order method, the Natural Gradient Descent (NGD) has the ability to accelerate training of neural networks. However, due to the prohibitive computational and memory costs of computing and inverting the Fisher Information Matrix (FIM), efficient approximations are necessary to make NGD scalable to Deep Neural Networks (DNNs). Many such approximations have been attempted. The most sophis… ▽ More As a second-order method, the Natural Gradient Descent (NGD) has the ability to accelerate training of neural networks. However, due to the prohibitive computational and memory costs of computing and inverting the Fisher Information Matrix (FIM), efficient approximations are necessary to make NGD scalable to Deep Neural Networks (DNNs). Many such approximations have been attempted. The most sophisticated of these is KFAC, which approximates the FIM as a block-diagonal matrix, where each block corresponds to a layer of the neural network. By doing so, KFAC ignores the interactions between different layers. In this work, we investigate the interest of restoring some low-frequency interactions between the layers by means of two-level methods. Inspired from domain decomposition, several two-level corrections to KFAC using different coarse spaces are proposed and assessed. The obtained results show that incorporating the layer interactions in this fashion does not really improve the performance of KFAC. This suggests that it is safe to discard the off-diagonal blocks of the FIM, since the block-diagonal approach is sufficiently robust, accurate and economical in computation time. △ Less

Submitted 3 April, 2023; v1 submitted 31 March, 2023; originally announced March 2023.

Comments: Under Review

A new smoothing method for nonlinear complementarity problems involving P0 function

Authors: El Hassene Osmani, Mounir Haddou, Lina Abdallah, Naceurdine Bensalem

Abstract: In this paper, we propose a smoothing method to solve nonlinear complementarity problems involving P 0-functions. We propose a nonparametric algorithm to solve the nonlinear corresponding system of equations and prove some global and local convergence results. We also present several numerical experiments and applications that show the efficiency of our approach. Our main contribution relies in th… ▽ More In this paper, we propose a smoothing method to solve nonlinear complementarity problems involving P 0-functions. We propose a nonparametric algorithm to solve the nonlinear corresponding system of equations and prove some global and local convergence results. We also present several numerical experiments and applications that show the efficiency of our approach. Our main contribution relies in the fact that the regularization parameter r is considered as a variable and we do not need any complicated strategy to update it. △ Less

Submitted 21 February, 2022; originally announced February 2022.

Efficient Approximations of the Fisher Matrix in Neural Networks using Kronecker Product Singular Value Decomposition

Authors: Abdoulaye Koroko, Ani Anciaux-Sedrakian, Ibtihel Ben Gharbia, Valérie Garès, Mounir Haddou, Quang Huy Tran

Abstract: Several studies have shown the ability of natural gradient descent to minimize the objective function more efficiently than ordinary gradient descent based methods. However, the bottleneck of this approach for training deep neural networks lies in the prohibitive cost of solving a large dense linear system corresponding to the Fisher Information Matrix (FIM) at each iteration. This has motivated v… ▽ More Several studies have shown the ability of natural gradient descent to minimize the objective function more efficiently than ordinary gradient descent based methods. However, the bottleneck of this approach for training deep neural networks lies in the prohibitive cost of solving a large dense linear system corresponding to the Fisher Information Matrix (FIM) at each iteration. This has motivated various approximations of either the exact FIM or the empirical one. The most sophisticated of these is KFAC, which involves a Kronecker-factored block diagonal approximation of the FIM. With only a slight additional cost, a few improvements of KFAC from the standpoint of accuracy are proposed. The common feature of the four novel methods is that they rely on a direct minimization problem, the solution of which can be computed via the Kronecker product singular value decomposition technique. Experimental results on the three standard deep auto-encoder benchmarks showed that they provide more accurate approximations to the FIM. Furthermore, they outperform KFAC and state-of-the-art first-order methods in terms of optimization speed. △ Less

Submitted 14 October, 2022; v1 submitted 25 January, 2022; originally announced January 2022.

A New Approach for Solving the Linear Complementarity Problem using Smoothing Functions

Authors: El Hassene Osmani, Mounir Haddou, Lina Abdallah, Naceurdine Bensalem

Abstract: Based on smoothing techniques, we propose two new methods to solve linear complementarity problems (LCP) called TLCP and Soft-Max. The idea of these two new methods takes inspiration from interior-point methods in optimization. The technique that we propose avoids any parameter management while ensuring good theoretical convergence results. In our approach we do not need any complicated strategy t… ▽ More Based on smoothing techniques, we propose two new methods to solve linear complementarity problems (LCP) called TLCP and Soft-Max. The idea of these two new methods takes inspiration from interior-point methods in optimization. The technique that we propose avoids any parameter management while ensuring good theoretical convergence results. In our approach we do not need any complicated strategy to update the smoothing parameter r since we will consider it as a new variable. Our methods are validated by extensive numerical tests, in which we compare our methods to several other classical methods. △ Less

Submitted 27 April, 2021; originally announced April 2021.

A convex function satisfying the Lojasiewicz inequality but failing the gradient conjecture both at zero and infinity

Authors: Aris Daniilidis, Mounir Haddou, Olivier Ley

Abstract: We construct an example of a smooth convex function on the plane with a strict minimum at zero, which is real analytic except at zero, for which Thom's gradient conjecture fails both at zero and infinity. More precisely, the gradient orbits of the function spiral around zero and at infinity. Besides, the function satisfies the Lojasiewicz gradient inequality at zero. We construct an example of a smooth convex function on the plane with a strict minimum at zero, which is real analytic except at zero, for which Thom's gradient conjecture fails both at zero and infinity. More precisely, the gradient orbits of the function spiral around zero and at infinity. Besides, the function satisfies the Lojasiewicz gradient inequality at zero. △ Less

Submitted 1 September, 2021; v1 submitted 10 February, 2021; originally announced February 2021.

A new Relaxation Method for Optimal Control of Semilinear Elliptic Variational Inequalities Obstacle Problems

Authors: El Hassene Osmani, Mounir Haddou, Naceurdine Bensalem

Abstract: In this paper, we investigate optimal control problems governed by semilinear elliptic variational inequalities involving constraints on the state, and more precisely the obstacle problem. Since we adopt a numerical point of view, we first relax the feasible domain of the problem, then using both mathematical programming methods and penalization methods we get optimality conditions with smooth Lag… ▽ More In this paper, we investigate optimal control problems governed by semilinear elliptic variational inequalities involving constraints on the state, and more precisely the obstacle problem. Since we adopt a numerical point of view, we first relax the feasible domain of the problem, then using both mathematical programming methods and penalization methods we get optimality conditions with smooth Lagrange multipliers. Some numerical experiments using IPOPT algorithm are presented to verify the efficiency of our approach. △ Less

Submitted 9 July, 2020; originally announced July 2020.

Explicit formulas for $C^{1,1}$ Glaeser-Whitney extensions of 1-fields in Hilbert spaces

Authors: Aris Daniilidis, Mounir Haddou, Erwan Le Gruyer, Olivier Ley

Abstract: We give a simple alternative proof for the $C^{1,1}$--convex extension problem which has been introduced and studied by D. Azagra and C. Mudarra [2]. As an application, we obtain an easy constructive proof for the Glaeser-Whitney problem of $C^{1,1}$ extensions on a Hilbert space. In both cases we provide explicit formulae for the extensions. For the Gleaser-Whitney problem the obtained extension… ▽ More We give a simple alternative proof for the $C^{1,1}$--convex extension problem which has been introduced and studied by D. Azagra and C. Mudarra [2]. As an application, we obtain an easy constructive proof for the Glaeser-Whitney problem of $C^{1,1}$ extensions on a Hilbert space. In both cases we provide explicit formulae for the extensions. For the Gleaser-Whitney problem the obtained extension is almost minimal, that is, minimal up to a factor $\frac{1+\sqrt{3}}{2}$ in the sense of Le Gruyer [15]. △ Less

Submitted 19 February, 2018; v1 submitted 6 June, 2017; originally announced June 2017.

Smoothing Methods for Nonlinear Complementarity Problems

Authors: Mounir Haddou, Patrick Maheux

Abstract: In this paper, we present a new smoothing approach to solve general nonlinear complementarity problems. Under the $P_0$ condition on the original problems, we prove some existence and convergence results . We also present an error estimate under a new and general monotonicity condition. The numerical tests confirm the efficiency of our proposed methods. In this paper, we present a new smoothing approach to solve general nonlinear complementarity problems. Under the $P_0$ condition on the original problems, we prove some existence and convergence results . We also present an error estimate under a new and general monotonicity condition. The numerical tests confirm the efficiency of our proposed methods. △ Less

Submitted 10 June, 2010; originally announced June 2010.

Comments: 16 pages, 1 figures

MSC Class: 90C33

Optimization of operational aircraft parameters Reducing Noise Emission

Authors: Lina Abdallah, Mounir Haddou, Salah Khardi

Abstract: The objective of this paper is to develop a model and a minimization method to provide flight path optimums reducing aircraft noise in the vicinity of airports. Optimization algorithm has solved a complex optimal control problem, and generates flight paths minimizing aircraft noise levels. Operational and safety constraints have been considered and their limits satisfied. Results are here presen… ▽ More The objective of this paper is to develop a model and a minimization method to provide flight path optimums reducing aircraft noise in the vicinity of airports. Optimization algorithm has solved a complex optimal control problem, and generates flight paths minimizing aircraft noise levels. Operational and safety constraints have been considered and their limits satisfied. Results are here presented and discussed. △ Less

Submitted 3 June, 2008; v1 submitted 25 April, 2008; originally announced April 2008.

A new class of smoothing methods for mathematical programs with equilibrium constraints

Authors: Mounir Haddou

Abstract: A class of smoothing methods is proposed for solving mathematical programs with equimibrium constraints. We introduce new and very simple regularizations of the complementarity constraints. Some estimate distance to optimal solution and expansions of the optimal value function are presented. Limited numerical experiments using SNOPT algorithm are presented to verify the efficiency of our approac… ▽ More A class of smoothing methods is proposed for solving mathematical programs with equimibrium constraints. We introduce new and very simple regularizations of the complementarity constraints. Some estimate distance to optimal solution and expansions of the optimal value function are presented. Limited numerical experiments using SNOPT algorithm are presented to verify the efficiency of our approach. △ Less

Submitted 13 March, 2007; originally announced March 2007.

Journal ref: Pacific Journal of Optimization 5, 1 (2009) 86

A regularization method for ill-posed bilevel optimization problems

Authors: Maïtine Bergounioux, Mounir Haddou

Abstract: We present a regularization method to approach a solution of the pessimistic formulation of ill -posed bilevel problems . This allows to overcome the difficulty arising from the non uniqueness of the lower level problems solutions and responses. We prove existence of approximated solutions, give convergence result using Hoffman-like assumptions. We end with objective value error estimates. We present a regularization method to approach a solution of the pessimistic formulation of ill -posed bilevel problems . This allows to overcome the difficulty arising from the non uniqueness of the lower level problems solutions and responses. We prove existence of approximated solutions, give convergence result using Hoffman-like assumptions. We end with objective value error estimates. △ Less

Submitted 31 March, 2006; originally announced March 2006.

Comments: 19 pages

Journal ref: RAIRO Operations Research 40 (2006) n?1, p. 19-35