Showing 1–6 of 6 results for author: Silvestri, M

Community Membership Hiding via Gradient-based Optimization

Authors: Matteo Silvestri, Edoardo Gabrielli, Fabrizio Silvestri, Gabriele Tolomei

Abstract: We tackle the problem of \emph{community membership hiding}, which involves strategically altering a network's structure to obscure a target node's membership in a specific community identified by a detection algorithm. We reformulate the original discrete counterfactual graph objective as a differentiable constrained optimization task. To solve this, we propose \method{}, a gradient-based method… ▽ More We tackle the problem of \emph{community membership hiding}, which involves strategically altering a network's structure to obscure a target node's membership in a specific community identified by a detection algorithm. We reformulate the original discrete counterfactual graph objective as a differentiable constrained optimization task. To solve this, we propose \method{}, a gradient-based method that modifies the network's structure within the feasible bounds for an individual target node, effectively concealing its membership. Experimental results across multiple datasets and community detection algorithms show that our approach surpasses existing baselines, offering a better balance between accuracy and computational efficiency. △ Less

Submitted 1 February, 2025; originally announced February 2025.

Analysis of Hopfield Model as Associative Memory

Authors: Matteo Silvestri

Abstract: This article delves into the Hopfield neural network model, drawing inspiration from biological neural systems. The exploration begins with an overview of the model's foundations, incorporating insights from mechanical statistics to deepen our understanding. Focusing on audio retrieval, the study demonstrates the Hopfield model's associative memory capabilities. Through practical implementation, t… ▽ More This article delves into the Hopfield neural network model, drawing inspiration from biological neural systems. The exploration begins with an overview of the model's foundations, incorporating insights from mechanical statistics to deepen our understanding. Focusing on audio retrieval, the study demonstrates the Hopfield model's associative memory capabilities. Through practical implementation, the network is trained to retrieve different patterns. △ Less

Submitted 24 January, 2024; originally announced February 2024.

Comments: 35 pages, 23 figures, 3 codes

Score Function Gradient Estimation to Widen the Applicability of Decision-Focused Learning

Authors: Mattia Silvestri, Senne Berden, Jayanta Mandi, Ali İrfan Mahmutoğulları, Brandon Amos, Tias Guns, Michele Lombardi

Abstract: Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is to estimate said parameters via machine learning (ML) models trained to minimize the prediction error, which however is not necessarily aligned with the downstr… ▽ More Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is to estimate said parameters via machine learning (ML) models trained to minimize the prediction error, which however is not necessarily aligned with the downstream task-level error. The decision-focused learning (DFL) paradigm overcomes this limitation by training to directly minimize a task loss, e.g. regret. Since the latter has non-informative gradients for combinatorial problems, state-of-the-art DFL methods introduce surrogates and approximations that enable training. But these methods exploit specific assumptions about the problem structures (e.g., convex or linear problems, unknown parameters only in the objective function). We propose an alternative method that makes no such assumptions, it combines stochastic smoothing with score function gradient estimation which works on any task loss. This opens up the use of DFL methods to nonlinear objectives, uncertain parameters in the problem constraints, and even two-stage stochastic optimization. Experiments show that it typically requires more epochs, but that it is on par with specialized methods and performs especially well for the difficult case of problems with uncertainty in the constraints, in terms of solution quality, scalability, or both. △ Less

Submitted 16 June, 2024; v1 submitted 11 July, 2023; originally announced July 2023.

An analysis of Universal Differential Equations for data-driven discovery of Ordinary Differential Equations

Authors: Mattia Silvestri, Federico Baldo, Eleonora Misino, Michele Lombardi

Abstract: In the last decade, the scientific community has devolved its attention to the deployment of data-driven approaches in scientific research to provide accurate and reliable analysis of a plethora of phenomena. Most notably, Physics-informed Neural Networks and, more recently, Universal Differential Equations (UDEs) proved to be effective both in system integration and identification. However, there… ▽ More In the last decade, the scientific community has devolved its attention to the deployment of data-driven approaches in scientific research to provide accurate and reliable analysis of a plethora of phenomena. Most notably, Physics-informed Neural Networks and, more recently, Universal Differential Equations (UDEs) proved to be effective both in system integration and identification. However, there is a lack of an in-depth analysis of the proposed techniques. In this work, we make a contribution by testing the UDE framework in the context of Ordinary Differential Equations (ODEs) discovery. In our analysis, performed on two case studies, we highlight some of the issues arising when combining data-driven approaches and numerical solvers, and we investigate the importance of the data collection process. We believe that our analysis represents a significant contribution in investigating the capabilities and limitations of Physics-informed Machine Learning frameworks. △ Less

Submitted 17 June, 2023; originally announced June 2023.

UNIFY: a Unified Policy Designing Framework for Solving Constrained Optimization Problems with Machine Learning

Authors: Mattia Silvestri, Allegra De Filippo, Michele Lombardi, Michela Milano

Abstract: The interplay between Machine Learning (ML) and Constrained Optimization (CO) has recently been the subject of increasing interest, leading to a new and prolific research area covering (e.g.) Decision Focused Learning and Constrained Reinforcement Learning. Such approaches strive to tackle complex decision problems under uncertainty over multiple stages, involving both explicit (cost function, con… ▽ More The interplay between Machine Learning (ML) and Constrained Optimization (CO) has recently been the subject of increasing interest, leading to a new and prolific research area covering (e.g.) Decision Focused Learning and Constrained Reinforcement Learning. Such approaches strive to tackle complex decision problems under uncertainty over multiple stages, involving both explicit (cost function, constraints) and implicit knowledge (from data), and possibly subject to execution time restrictions. While a good degree of success has been achieved, the existing methods still have limitations in terms of both applicability and effectiveness. For problems in this class, we propose UNIFY, a unified framework to design a solution policy for complex decision-making problems. Our approach relies on a clever decomposition of the policy in two stages, namely an unconstrained ML model and a CO problem, to take advantage of the strength of each approach while compensating for its weaknesses. With a little design effort, UNIFY can generalize several existing approaches, thus extending their applicability. We demonstrate the method effectiveness on two practical problems, namely an Energy Management System and the Set Multi-cover with stochastic coverage requirements. Finally, we highlight some current challenges of our method and future research directions that can benefit from the cross-fertilization of the two fields. △ Less

Submitted 25 October, 2022; originally announced October 2022.

Injecting Domain Knowledge in Neural Networks: a Controlled Experiment on a Constrained Problem

Authors: Mattia Silvestri, Michele Lombardi, Michela Milano

Abstract: Given enough data, Deep Neural Networks (DNNs) are capable of learning complex input-output relations with high accuracy. In several domains, however, data is scarce or expensive to retrieve, while a substantial amount of expert knowledge is available. It seems reasonable that if we can inject this additional information in the DNN, we could ease the learning process. One such case is that of Cons… ▽ More Given enough data, Deep Neural Networks (DNNs) are capable of learning complex input-output relations with high accuracy. In several domains, however, data is scarce or expensive to retrieve, while a substantial amount of expert knowledge is available. It seems reasonable that if we can inject this additional information in the DNN, we could ease the learning process. One such case is that of Constraint Problems, for which declarative approaches exists and pure ML solutions have obtained mixed success. Using a classical constrained problem as a case study, we perform controlled experiments to probe the impact of progressively adding domain and empirical knowledge in the DNN. Our results are very encouraging, showing that (at least in our setup) embedding domain knowledge at training time can have a considerable effect and that a small amount of empirical knowledge is sufficient to obtain practically useful results. △ Less

Submitted 25 February, 2020; originally announced February 2020.