-
Federated Deep Learning in Electricity Forecasting: An MCDM Approach
Authors:
Marco Repetto,
Davide La Torre,
Muhammad Tariq
Abstract:
Large-scale data analysis is growing at an exponential rate as data proliferates in our societies. This abundance of data has the advantage of allowing the decision-maker to implement complex models in scenarios that were prohibitive before. At the same time, such an amount of data requires a distributed thinking approach. In fact, Deep Learning models require plenty of resources, and distributed…
▽ More
Large-scale data analysis is growing at an exponential rate as data proliferates in our societies. This abundance of data has the advantage of allowing the decision-maker to implement complex models in scenarios that were prohibitive before. At the same time, such an amount of data requires a distributed thinking approach. In fact, Deep Learning models require plenty of resources, and distributed training is needed. This paper presents a Multicriteria approach for distributed learning. Our approach uses the Weighted Goal Programming approach in its Chebyshev formulation to build an ensemble of decision rules that optimize aprioristically defined performance metrics. Such a formulation is beneficial because it is both model and metric agnostic and provides an interpretable output for the decision-maker. We test our approach by showing a practical application in electricity demand forecasting. Our results suggest that when we allow for dataset split overlapping, the performances of our methodology are consistently above the baseline model trained on the whole dataset.
△ Less
Submitted 9 January, 2022; v1 submitted 27 November, 2021;
originally announced November 2021.
-
Optimization of Structural Similarity in Mathematical Imaging
Authors:
D. Otero,
D. La Torre,
O. Michailovich,
E. R. Vrscay
Abstract:
It is now generally accepted that Euclidean-based metrics may not always adequately represent the subjective judgement of a human observer. As a result, many image processing methodologies have been recently extended to take advantage of alternative visual quality measures, the most prominent of which is the Structural Similarity Index Measure (SSIM). The superiority of the latter over Euclidean-b…
▽ More
It is now generally accepted that Euclidean-based metrics may not always adequately represent the subjective judgement of a human observer. As a result, many image processing methodologies have been recently extended to take advantage of alternative visual quality measures, the most prominent of which is the Structural Similarity Index Measure (SSIM). The superiority of the latter over Euclidean-based metrics have been demonstrated in several studies. However, being focused on specific applications, the findings of such studies often lack generality which, if otherwise acknowledged, could have provided a useful guidance for further development of SSIM-based image processing algorithms. Accordingly, instead of focusing on a particular image processing task, in this paper, we introduce a general framework that encompasses a wide range of imaging applications in which the SSIM can be employed as a fidelity measure. Subsequently, we show how the framework can be used to cast some standard as well as original imaging tasks into optimization problems, followed by a discussion of a number of novel numerical strategies for their solution.
△ Less
Submitted 7 February, 2020;
originally announced February 2020.
-
A Multicriteria Macroeconomic Model with Intertemporal Equity and Spatial Spillovers
Authors:
Herb Kunze,
Davide La Torre,
Simone Marsiglio
Abstract:
We analyze a macroeconomic model with intergenerational equity considerations and spatial spillovers, which gives rise to a multicriteria optimization problem. Intergenerational equity requires to add in the definition of social welfare a long run sustainability criterion to the traditional discounted utilitarian criterion. The spatial structure allows for the possibility of heterogeneiity and spa…
▽ More
We analyze a macroeconomic model with intergenerational equity considerations and spatial spillovers, which gives rise to a multicriteria optimization problem. Intergenerational equity requires to add in the definition of social welfare a long run sustainability criterion to the traditional discounted utilitarian criterion. The spatial structure allows for the possibility of heterogeneiity and spatial diffusion implies that all locations within the spatial domain are interconnected via spatial spillovers. We rely on different techniques (scalarization, $ε$-constraint method and goal programming) to analyze such a spatial multicriteria problem, relying on numerical approaches to illustrate the nature of the trade-off between the discounted utilitarian and the sustainability criteria.
△ Less
Submitted 19 November, 2019;
originally announced November 2019.
-
Solving Inverse Problems for Steady-State Equations using A Multiple Criteria Model with Collage Distance, Entropy, and Sparsity
Authors:
Herb Kunze,
Davide La Torre
Abstract:
In this paper, we extend the previous method for solving inverse problems for steady-state equations using the Generalized Collage Theorem by searching for an approximation that not only minimizes the collage error but also maximizes the entropy and minimize the sparsity. In this extended formulation, the parameter estimation minimization problem can be understood as a multiple criteria problem, w…
▽ More
In this paper, we extend the previous method for solving inverse problems for steady-state equations using the Generalized Collage Theorem by searching for an approximation that not only minimizes the collage error but also maximizes the entropy and minimize the sparsity. In this extended formulation, the parameter estimation minimization problem can be understood as a multiple criteria problem, with three different and conflicting criteria: The generalized collage error, the entropy associated with the unknown parameters, and the sparsity of the set of unknown parameters. We implement a scalarization technique to reduce the multiple criteria program to a single criterion one, by combining all objective functions with different trade-off weights. Numerical examples confirm that the collage method produces good, but sub-optimal, results. A relatively low-weighted entropy term allows for better approximations while the sparsity term decreases the complexity of the solution in terms of the number of elements in the basis.
△ Less
Submitted 7 November, 2019;
originally announced November 2019.
-
Using the Generalized Collage Theorem for Estimating Unknown Parameters in Perturbed Mixed Variational Equations
Authors:
A. I. Garralda-Guillem,
H. Kunze,
D. La Torre,
M. Ruiz Galan
Abstract:
In this paper, we study a mixed variational problem subject to perturbations, where the noise term is modelled by means of a bilinear form that has to be understood to be "small" in some sense. Indeed, we consider a family of such problems and provide a result that guarantees existence and uniqueness of the solution. Moreover, a stability condition for the solutions yields a Generalized Collage Th…
▽ More
In this paper, we study a mixed variational problem subject to perturbations, where the noise term is modelled by means of a bilinear form that has to be understood to be "small" in some sense. Indeed, we consider a family of such problems and provide a result that guarantees existence and uniqueness of the solution. Moreover, a stability condition for the solutions yields a Generalized Collage Theorem, which extends previous results by the same authors. We introduce the corresponding Galerkin method and study its convergence. We also analyze the associated inverse problem and we show how to solve it by means of the mentioned Generalized Collage Theorem and the use of adequate Schauder bases. Numerical examples show how the method works in a practical context.
△ Less
Submitted 6 November, 2019; v1 submitted 29 September, 2019;
originally announced September 2019.
-
A Goal Programming Model with Satisfaction Function for Risk Management and Optimal Portfolio Diversification
Authors:
Davide La Torre,
Marco Maggis
Abstract:
We extend the classical risk minimization model with scalar risk measures to the general case of set-valued risk measures. The problem we obtain is a set-valued optimization model and we propose a goal programming-based approach with satisfaction function to obtain a solution which represents the best compromise between goals and the achievement levels. Numerical examples are provided to illustrat…
▽ More
We extend the classical risk minimization model with scalar risk measures to the general case of set-valued risk measures. The problem we obtain is a set-valued optimization model and we propose a goal programming-based approach with satisfaction function to obtain a solution which represents the best compromise between goals and the achievement levels. Numerical examples are provided to illustrate how the method works in practical situations.
△ Less
Submitted 19 September, 2012; v1 submitted 9 January, 2012;
originally announced January 2012.
-
IFSM representation of Brownian motion with applications to simulation
Authors:
S. M. Iacus,
D. La Torre
Abstract:
Several methods are currently available to simulate paths of the Brownian motion. In particular, paths of the BM can be simulated using the properties of the increments of the process like in the Euler scheme, or as the limit of a random walk or via L2 decomposition like the Kac-Siegert/Karnounen-Loeve series.
In this paper we first propose a IFSM (Iterated Function Systems with Maps) operator…
▽ More
Several methods are currently available to simulate paths of the Brownian motion. In particular, paths of the BM can be simulated using the properties of the increments of the process like in the Euler scheme, or as the limit of a random walk or via L2 decomposition like the Kac-Siegert/Karnounen-Loeve series.
In this paper we first propose a IFSM (Iterated Function Systems with Maps) operator whose fixed point is the trajectory of the BM. We then use this representation of the process to simulate its trajectories. The resulting simulated trajectories are self-affine, continuous and fractal by construction. This fact produces more realistic trajectories than other schemes in the sense that their geometry is closer to the one of the true BM's trajectories. The IFSM trajectory of the BM can then be used to generate more realistic solutions of stochastic differential equations.
△ Less
Submitted 16 January, 2006;
originally announced January 2006.
-
Nonparametric estimation of distribution and density functions in presence of missing data: an IFS approach
Authors:
Stefano M. Iacus,
Davide La Torre
Abstract:
In this paper we consider a class of nonparametric estimators of a distribution function F, with compact support, based on the theory of IFSs. The estimator of F is tought as the fixed point of a contractive operator T defined in terms of a vector of parameters p and a family of affine maps W which can be both depend of the sample (X_1, X_2, ...., X_n). Given W, the problem consists in finding a…
▽ More
In this paper we consider a class of nonparametric estimators of a distribution function F, with compact support, based on the theory of IFSs. The estimator of F is tought as the fixed point of a contractive operator T defined in terms of a vector of parameters p and a family of affine maps W which can be both depend of the sample (X_1, X_2, ...., X_n). Given W, the problem consists in finding a vector p such that the fixed point of T is ``sufficiently near'' to F. It turns out that this is a quadratic constrained optimization problem that we propose to solve by penalization techniques. If F has a density f, we can also provide an estimator of f based on Fourier techniques. IFS estimators for F are asymptotically equivalent to the empirical distribution function (e.d.f.) estimator. We will study relative efficiency of the IFS estimators with respect to the e.d.f. for small samples via Monte Carlo approach.
For well behaved distribution functions F and for a particular family of so-called wavelet maps the IFS estimators can be dramatically better than the e.d.f. (or the kernel estimator for density estimation) in presence of missing data, i.e. when it is only possibile to observe data on subsets of the whole support of F.
This research has also produced a free package for the R statistical environment which is ready to be used in applications.
△ Less
Submitted 2 February, 2003;
originally announced February 2003.
-
Approximating distribution functions by iterated function systems
Authors:
Stefano M. Iacus,
Davide La Torre
Abstract:
In this paper an iterated function system on the space of distribution functions is built. The inverse problem is introduced and studied by convex optimization problems. Some applications of this method to approximation of distribution functions and to estimation theory are given.
In this paper an iterated function system on the space of distribution functions is built. The inverse problem is introduced and studied by convex optimization problems. Some applications of this method to approximation of distribution functions and to estimation theory are given.
△ Less
Submitted 13 November, 2001;
originally announced November 2001.
