-
CoCoAFusE: Beyond Mixtures of Experts via Model Fusion
Authors:
Aurelio Raffa Ugolini,
Mara Tanelli,
Valentina Breschi
Abstract:
Many learning problems involve multiple patterns and varying degrees of uncertainty dependent on the covariates. Advances in Deep Learning (DL) have addressed these issues by learning highly nonlinear input-output dependencies. However, model interpretability and Uncertainty Quantification (UQ) have often straggled behind. In this context, we introduce the Competitive/Collaborative Fusion of Exper…
▽ More
Many learning problems involve multiple patterns and varying degrees of uncertainty dependent on the covariates. Advances in Deep Learning (DL) have addressed these issues by learning highly nonlinear input-output dependencies. However, model interpretability and Uncertainty Quantification (UQ) have often straggled behind. In this context, we introduce the Competitive/Collaborative Fusion of Experts (CoCoAFusE), a novel, Bayesian Covariates-Dependent Modeling technique. CoCoAFusE builds on the very philosophy behind Mixtures of Experts (MoEs), blending predictions from several simple sub-models (or "experts") to achieve high levels of expressiveness while retaining a substantial degree of local interpretability. Our formulation extends that of a classical Mixture of Experts by contemplating the fusion of the experts' distributions in addition to their more usual mixing (i.e., superimposition). Through this additional feature, CoCoAFusE better accommodates different scenarios for the intermediate behavior between generating mechanisms, resulting in tighter credible bounds on the response variable. Indeed, only resorting to mixing, as in classical MoEs, may lead to multimodality artifacts, especially over smooth transitions. Instead, CoCoAFusE can avoid these artifacts even under the same structure and priors for the experts, leading to greater expressiveness and flexibility in modeling. This new approach is showcased extensively on a suite of motivating numerical examples and a collection of real-data ones, demonstrating its efficacy in tackling complex regression problems where uncertainty is a key quantity of interest.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
The epistemic dimension of algorithmic fairness: assessing its impact in innovation diffusion and fair policy making
Authors:
Eugenia Villa,
Camilla Quaresmini,
Valentina Breschi,
Viola Schiaffonati,
Mara Tanelli
Abstract:
Algorithmic fairness is an expanding field that addresses a range of discrimination issues associated with algorithmic processes. However, most works in the literature focus on analyzing it only from an ethical perspective, focusing on moral principles and values that should be considered in the design and evaluation of algorithms, while disregarding the epistemic dimension related to knowledge tr…
▽ More
Algorithmic fairness is an expanding field that addresses a range of discrimination issues associated with algorithmic processes. However, most works in the literature focus on analyzing it only from an ethical perspective, focusing on moral principles and values that should be considered in the design and evaluation of algorithms, while disregarding the epistemic dimension related to knowledge transmission and validation. However, this aspect of algorithmic fairness should also be included in the debate, as it is crucial to introduce a specific type of harm: an individual may be systematically excluded from the dissemination of knowledge due to the attribution of a credibility deficit/excess. In this work, we specifically focus on characterizing and analyzing the impact of this credibility deficit or excess on the diffusion of innovations on a societal scale, a phenomenon driven by individual attitudes and social interactions, and also by the strength of mutual connections. Indeed, discrimination might shape the latter, ultimately modifying how innovations spread within the network. In this light, to incorporate, also from a formal point of view, the epistemic dimension in innovation diffusion models becomes paramount, especially if these models are intended to support fair policy design. For these reasons, we formalize the epistemic properties of a social environment, by extending the well-established Linear Threshold Model (LTM) in an epistemic direction to show the impact of epistemic biases in innovation diffusion. Focusing on the impact of epistemic bias in both open-loop and closed-loop scenarios featuring optimal fostering policies, our results shed light on the pivotal role the epistemic dimension might have in the debate of algorithmic fairness in decision-making.
△ Less
Submitted 28 March, 2025;
originally announced April 2025.
-
Optimal Policy Design for Repeated Decision-Making under Social Influence
Authors:
Chiara Ravazzi,
Valentina Breschi,
Paolo Frasca,
Fabrizio Dabbene,
Mara Tanelli
Abstract:
In this paper, we present a novel model to characterize individual tendencies in repeated decision-making scenarios, with the goal of designing model-based control strategies that promote virtuous choices amidst social and external influences. Our approach builds on the classical Friedkin and Johnsen model of social influence, extending it to include random factors (e.g., inherent variability in i…
▽ More
In this paper, we present a novel model to characterize individual tendencies in repeated decision-making scenarios, with the goal of designing model-based control strategies that promote virtuous choices amidst social and external influences. Our approach builds on the classical Friedkin and Johnsen model of social influence, extending it to include random factors (e.g., inherent variability in individual needs) and controllable external inputs. We explicitly account for the temporal separation between two processes that shape opinion dynamics: individual decision-making and social imitation. While individual decisions occur at regular, frequent intervals, the influence of social imitation unfolds over longer periods. The inclusion of random factors naturally leads to dynamics that do not converge in the classical sense. However, under specific conditions, we prove that opinions exhibit ergodic behavior. Building on this result, we propose a constrained asymptotic optimal control problem designed to foster, on average, social acceptance of a target action within a network. To address the transient dynamics of opinions, we reformulate this problem within a Model Predictive Control (MPC) framework. Simulations highlight the significance of accounting for these transient effects in steering individuals toward virtuous choices while managing policy costs.
△ Less
Submitted 5 March, 2025;
originally announced March 2025.
-
SINDy vs Hard Nonlinearities and Hidden Dynamics: a Benchmarking Study
Authors:
Aurelio Raffa Ugolini,
Valentina Breschi,
Andrea Manzoni,
Mara Tanelli
Abstract:
In this work we analyze the effectiveness of the Sparse Identification of Nonlinear Dynamics (SINDy) technique on three benchmark datasets for nonlinear identification, to provide a better understanding of its suitability when tackling real dynamical systems. While SINDy can be an appealing strategy for pursuing physics-based learning, our analysis highlights difficulties in dealing with unobserve…
▽ More
In this work we analyze the effectiveness of the Sparse Identification of Nonlinear Dynamics (SINDy) technique on three benchmark datasets for nonlinear identification, to provide a better understanding of its suitability when tackling real dynamical systems. While SINDy can be an appealing strategy for pursuing physics-based learning, our analysis highlights difficulties in dealing with unobserved states and non-smooth dynamics. Due to the ubiquity of these features in real systems in general, and control applications in particular, we complement our analysis with hands-on approaches to tackle these issues in order to exploit SINDy also in these challenging contexts.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
-
Explainable data-driven modeling via mixture of experts: towards effective blending of grey and black-box models
Authors:
Jessica Leoni,
Valentina Breschi,
Simone Formentin,
Mara Tanelli
Abstract:
Traditional models grounded in first principles often struggle with accuracy as the system's complexity increases. Conversely, machine learning approaches, while powerful, face challenges in interpretability and in handling physical constraints. Efforts to combine these models often often stumble upon difficulties in finding a balance between accuracy and complexity. To address these issues, we pr…
▽ More
Traditional models grounded in first principles often struggle with accuracy as the system's complexity increases. Conversely, machine learning approaches, while powerful, face challenges in interpretability and in handling physical constraints. Efforts to combine these models often often stumble upon difficulties in finding a balance between accuracy and complexity. To address these issues, we propose a comprehensive framework based on a "mixture of experts" rationale. This approach enables the data-based fusion of diverse local models, leveraging the full potential of first-principle-based priors. Our solution allows independent training of experts, drawing on techniques from both machine learning and system identification, and it supports both collaborative and competitive learning paradigms. To enhance interpretability, we penalize abrupt variations in the expert's combination. Experimental results validate the effectiveness of our approach in producing an interpretable combination of models closely resembling the target phenomena.
△ Less
Submitted 30 January, 2024;
originally announced January 2024.
-
Social network analysis of electric vehicles adoption: a data-based approach
Authors:
V. Breschi,
M. Tanelli,
C. Ravazzi,
S. Strada,
F. Dabbene
Abstract:
Mobility is undergoing dramatic transformations. Especially in the context of urban areas, several significant changes are underway, driven by both new mobility needs and environmental concerns. The most mature one, which still is struggling to affirm itself is the process of the adoption of Electric Vehicles (EVs), thus switching from fuel-based to battery-powered propulsion technologies. Many so…
▽ More
Mobility is undergoing dramatic transformations. Especially in the context of urban areas, several significant changes are underway, driven by both new mobility needs and environmental concerns. The most mature one, which still is struggling to affirm itself is the process of the adoption of Electric Vehicles (EVs), thus switching from fuel-based to battery-powered propulsion technologies. Many social and economic barriers have proved to play a crucial role in this process, ranging from level of education, environmental awareness, age and census. This work aims at contributing to the study of this adoption process through a data-based lens, using real mobility patterns to setup a social-network analysis to model the spread of consensus among neighbouring people that can enable the switch to EVs. In particular, we build the network topology using proximity measures that emerge from the analysis of real trips, and the initial disposition of the single agents towards the EV technology is inferred from their real mobility patterns. Based on this network, a cascade adoption model is simulated to investigate the dynamics of the adoption process, and an incentive scheme is designed to show how different policies can contribute to the opinion diffusion over time on the network.
△ Less
Submitted 27 January, 2020;
originally announced January 2020.
-
Analysis and development of a novel algorithm for the in-vehicle hand-usage of a smartphone
Authors:
Simone Gelmini,
Silvia Strada,
Mara Tanelli,
Sergio Savaresi,
Vincenzo Biase
Abstract:
Smartphone usage while driving is unanimously considered to be a really dangerous habit due to strong correlation with road accidents. In this paper, the problem of detecting whether the driver is using the phone during a trip is addressed. To do this, high-frequency data from the triaxial inertial measurement unit (IMU) integrated in almost all modern phone is processed without relying on externa…
▽ More
Smartphone usage while driving is unanimously considered to be a really dangerous habit due to strong correlation with road accidents. In this paper, the problem of detecting whether the driver is using the phone during a trip is addressed. To do this, high-frequency data from the triaxial inertial measurement unit (IMU) integrated in almost all modern phone is processed without relying on external inputs so as to provide a self-contained approach. By resorting to a frequency-domain analysis, it is possible to extract from the raw signals the useful information needed to detect when the driver is using the phone, without being affected by the effects that vehicle motion has on the same signals. The selected features are used to train a Support Vector Machine (SVM) algorithm. The performance of the proposed approach are analyzed and tested on experimental data collected during mixed naturalistic driving scenarios, proving the effectiveness of the proposed approach.
△ Less
Submitted 30 August, 2018; v1 submitted 6 April, 2018;
originally announced April 2018.